60:I[510592,["/_next/static/chunks/41aagivimsyys.js","/_next/static/chunks/1w6b9x4ox-2ab.js","/_next/static/chunks/2du4f4hdcx8vy.js","/_next/static/chunks/3lydxrl6slrf2.js","/_next/static/chunks/1la1pzs9j8idc.js","/_next/static/chunks/2hrea-dwwjjr_.js","/_next/static/chunks/28ougzph2g_t9.js","/_next/static/chunks/3r5yd4k4rms8-.js","/_next/static/chunks/125flzb3dd6q2.js","/_next/static/chunks/0wbn6hf2c6k2t.js","/_next/static/chunks/3pjc6r7w9qxan.js","/_next/static/chunks/39vtz3iby1cf_.js","/_next/static/chunks/2v5t_o330ua3s.js","/_next/static/chunks/3trxs7mom31q3.js","/_next/static/chunks/3nk0wrm9knx3m.js","/_next/static/chunks/1kxuebyfge68i.js","/_next/static/chunks/22e07luyn9bfp.js","/_next/static/chunks/1_lyn-lih218f.js","/_next/static/chunks/1dwajbnfjnvzx.js","/_next/static/chunks/0bvim9_g0hu68.js","/_next/static/chunks/3c7e5ojau5akn.js","/_next/static/chunks/0gf5i4fmb2vxz.js","/_next/static/chunks/3a57oltrmz5kh.js","/_next/static/chunks/3j9dwf14_qrhp.js","/_next/static/chunks/21k90yd6lrzsc.js","/_next/static/chunks/3-5mrnq0kjby0.js","/_next/static/chunks/1r40kzfox4d83.js","/_next/static/chunks/24_gg9g_4g22i.js","/_next/static/chunks/0l0c166aeafbb.js","/_next/static/chunks/0czpc-f8wjri8.js","/_next/static/chunks/3xaq4o65p_dw0.js","/_next/static/chunks/2dyt8rg18m736.js","/_next/static/chunks/43b9k5vjei3d1.js","/_next/static/chunks/3eatuedmz1636.js","/_next/static/chunks/2pqhypz2vo8mu.js","/_next/static/chunks/1nz6e-lpv7lb-.js","/_next/static/chunks/2l525havh4_yi.js","/_next/static/chunks/0fpx6rmsgi4um.js"],"PlaygroundContextProvider"] 61:T15d4,# Step 3.7 Flash ## Description Step-3.7-Flash is a StepFun vision-language model built on Step 3.5 Flash with additional vision capability for native multimodal, agentic, and coding-related use cases. The model is intended to process text and image inputs and produce text outputs, with emphasis on image understanding, fast throughput, and tool-use workflows. *This model is ready for commercial/non-commercial use.* ## Third-Party Community Consideration: This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party's requirements for this application and use case; see link to Non-NVIDIA [Step-3.7-Flash Model Card](https://huggingface.co/stepfun-ai). ## License and Terms of Use: **GOVERNING TERMS:** The trial service is governed by the [NVIDIA API Trial Terms of Service](https://assets.ngc.nvidia.com/products/api-catalog/legal/NVIDIA%20API%20Trial%20Terms%20of%20Service.pdf); and use of this model is governed by the [NVIDIA Open Model Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/). **Additional Information:** [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0). ## Deployment Geography: Global ## Use Case: **Use Case:** Step-3.7-Flash is intended for multimodal understanding, agentic workflow support, coding and frontend-generation workflows, tool calling, and GUI-oriented tasks that use text, screenshots, or images as input. **Key Features:** - **Sparse MoE Efficiency:** 196B parameters with only ~11B active per token, combining elite intelligence with 11B-class inference speed - **MTP-3 Acceleration:** 3-way Multi-Token Prediction enables 100-300 tok/s throughput, peaking at 350 tok/s for coding - **Efficient Long Context:** 256K context window using 3:1 Sliding Window Attention ratio for cost-efficient processing - **Agentic Mastery:** 74.4% on SWE-bench Verified, 51.0% on Terminal-Bench 2.0, 88.2 on τ²-Bench ## Release Date: **Build.NVIDIA.com:** 05/28/2026 via [link](https://build.nvidia.com/stepfun-ai/step-3.7-flash)
**Huggingface:** 05/28/2026 via [link](https://huggingface.co/stepfun-ai/Step-3.7-Flash) ## Reference(s): - [Step-3.7-Flash Model Card](https://huggingface.co/stepfun-ai) ## Model Architecture: **Architecture Type:** Transformer **Network Architecture:** Mixture-of-Experts **Total Parameters:** 198B **Active Parameters:** Approximately 11B per token **Text backbone based on Step 3.5 Flash** ### Input: **Input Types:** Text, Image **Input Formats:** String, Red, Green, Blue (RGB) **Input Parameters:** One-Dimensional (1D), Two-Dimensional (2D) **Other Input Properties:** The vision module uses an image size of 728x728 pixels. **Input Context Length (ISL):** 256k ### Output: **Output Types:** Text **Output Format:** String **Output Parameters:** One-Dimensional (1D) **Other Output Properties:** None __Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA's hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions.__ ## Software Integration: **Runtime Engines:** - **vLLM** - **SGLang** **Supported Hardware:** - **NVIDIA Blackwell:** B200, B100, GB200 - **NVIDIA Hopper:** H100, H200 **Preferred Operating Systems:** Linux __The integration of foundation and fine-tuned models into AI systems requires additional testing using use-case-specific data to ensure safe and effective deployment. Following the V-model methodology, iterative testing and validation at both unit and system levels are essential to mitigate risks, meet technical and functional requirements, and ensure compliance with safety and ethical standards before deployment.__ ## Model Version(s) Step-3.7-Flash v1.0 ## Training, Testing, and Evaluation Datasets: ### Training Dataset **Data Modality:** Text, Image **Image Training Data Size:** Undisclosed **Text Training Data Size:** Undisclosed **Training Data Collection:** Undisclosed **Training Labeling:** Undisclosed **Training Properties:** Undisclosed ### Testing Dataset **Testing Data Collection:** Undisclosed **Testing Labeling:** Undisclosed **Testing Properties:** Undisclosed ### Evaluation Dataset **Evaluation Benchmark Score:** Undisclosed **Evaluation Data Collection:** Undisclosed **Evaluation Labeling:** Undisclosed **Evaluation Properties:** Undisclosed ## Inference **Acceleration Engine:** vLLM **Test Hardware:** NVIDIA 4xH100 ## Ethical Considerations NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. Developers should work with their internal developer team to ensure these software components meet requirements for the relevant industry and use case and address unforeseen product misuse. Please make sure you have proper rights and permissions for all input image content; if image includes people, personal health information, or intellectual property, the image generated will not blur or maintain proportions of image subjects included. Users are responsible for model inputs and outputs. Users are responsible for ensuring safe integration of this model, including implementing guardrails as well as other safety mechanisms, prior to deployment. Please report model quality, risk, security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).62:T1d81,<% // Catalog ejs locals replace JSON with {stringify} only (spread skips non-enumerable parse). const deepClone = (value) => { if (Array.isArray(value)) return value.map(deepClone); if (value && typeof value === "object") { const out = {}; for (const key of Object.keys(value)) out[key] = deepClone(value[key]); return out; } return value; }; const mediaConfig = {"image": {"mimeTypes": {".png": "image/png", ".jpg": "image/jpeg", ".jpeg": "image/jpeg", ".webp": "image/webp"}}, "video": {"mimeTypes": {}}, "audio": {"mimeTypes": {}, "defaultFormat": "wav"}}; const stripNulls = (value) => { if (Array.isArray(value)) return value.map(stripNulls); if (value && typeof value === "object") { const out = {}; for (const [key, item] of Object.entries(value)) { if (item === null || item === undefined) continue; out[key] = stripNulls(item); } return out; } return value; }; const payloadForSnippet = stripNulls(deepClone(request || {})); const hasStream = payloadForSnippet.stream !== undefined && payloadForSnippet.stream !== null; const pyStream = payloadForSnippet.stream ? "True" : "False"; if (hasStream) payloadForSnippet.stream = "__STREAM__"; const hasMediaKind = (kind) => Object.keys(mediaConfig[kind].mimeTypes || {}).length > 0; const isInlineDataUrl = (url, kind) => ( typeof url === "string" && new RegExp(`^data:${kind}/[^;]+;base64,`, "i").test(url) ); const mediaUrl = (part, key) => { const slot = part?.[key]; return typeof slot === "string" ? slot : slot?.url; }; const setMediaUrl = (part, key, url) => { if (typeof part[key] === "string") part[key] = url; else { if (!part[key] || typeof part[key] !== "object") part[key] = {}; part[key].url = url; } }; let imageCount = 0; let videoCount = 0; let audioCount = 0; (payloadForSnippet.messages || []).forEach((message) => { if (!Array.isArray(message?.content)) return; message.content.forEach((part) => { const imageUrl = mediaUrl(part, "image_url"); const videoUrl = mediaUrl(part, "video_url"); const audioUrl = mediaUrl(part, "audio_url"); // File helpers only for inline base64; http(s) URLs stay as-is in the payload. if (hasMediaKind("image") && part?.type === "image_url" && isInlineDataUrl(imageUrl, "image")) { setMediaUrl(part, "image_url", `__IMAGE_DATA_URL_${imageCount}__`); imageCount += 1; } else if (hasMediaKind("video") && part?.type === "video_url" && isInlineDataUrl(videoUrl, "video")) { setMediaUrl(part, "video_url", `__VIDEO_DATA_URL_${videoCount}__`); videoCount += 1; } else if (hasMediaKind("audio") && part?.type === "audio_url" && isInlineDataUrl(audioUrl, "audio")) { setMediaUrl(part, "audio_url", `__AUDIO_DATA_URL_${audioCount}__`); audioCount += 1; } else if (hasMediaKind("audio") && part?.type === "input_audio" && part.input_audio?.data) { part.input_audio.data = `__AUDIO_B64_${audioCount}__`; part.input_audio.format = part.input_audio.format || mediaConfig.audio.defaultFormat; audioCount += 1; } }); }); const pyRepr = (value, level = 0) => { if (value === null) return "None"; if (typeof value === "boolean") return value ? "True" : "False"; if (typeof value === "number") return String(value); if (typeof value === "string") return JSON.stringify(value); const pad = " ".repeat(level); const innerPad = " ".repeat(level + 2); if (Array.isArray(value)) { if (value.length === 0) return "[]"; return "[\n" + value.map((item) => `${innerPad}${pyRepr(item, level + 2)}`).join(",\n") + "\n" + pad + "]"; } if (typeof value === "object") { const entries = Object.entries(value); if (entries.length === 0) return "{}"; return "{\n" + entries.map(([key, item]) => `${innerPad}${JSON.stringify(key)}: ${pyRepr(item, level + 2)}`).join(",\n") + "\n" + pad + "}"; } return "None"; }; const replaceAll = (s, a, b) => s.split(a).join(b); let renderedPayload = pyRepr(payloadForSnippet); if (hasStream) renderedPayload = replaceAll(renderedPayload, '"__STREAM__"', "stream"); for (let i = 0; i < imageCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__IMAGE_DATA_URL_${i}__"`, `image_data_urls[${i}]`); } for (let i = 0; i < videoCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__VIDEO_DATA_URL_${i}__"`, `video_data_urls[${i}]`); } for (let i = 0; i < audioCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__AUDIO_DATA_URL_${i}__"`, `audio_data_urls[${i}]`); renderedPayload = replaceAll(renderedPayload, `"__AUDIO_B64_${i}__"`, `audio_b64s[${i}]`); } // Either file helpers XOR inline base64 - never emit unused helpers. const usesFileHelpers = imageCount + videoCount + audioCount > 0 && [...Array(imageCount).keys()].every((i) => renderedPayload.includes(`image_data_urls[${i}]`)) && [...Array(videoCount).keys()].every((i) => renderedPayload.includes(`video_data_urls[${i}]`)) && [...Array(audioCount).keys()].every( (i) => renderedPayload.includes(`audio_data_urls[${i}]`) || renderedPayload.includes(`audio_b64s[${i}]`) ); if (!usesFileHelpers) { imageCount = 0; videoCount = 0; audioCount = 0; const restored = stripNulls(deepClone(request || {})); const restoredStream = restored.stream !== undefined && restored.stream !== null; if (restoredStream) restored.stream = "__STREAM__"; renderedPayload = pyRepr(restored); if (restoredStream) renderedPayload = replaceAll(renderedPayload, '"__STREAM__"', "stream"); } const hasMedia = usesFileHelpers; const mimePy = (mimes) => "{" + Object.entries(mimes).map(([k, v]) => `${JSON.stringify(k)}: ${JSON.stringify(v)}`).join(", ") + "}"; %> <% if (hasMedia) { %>import base64 from pathlib import Path <% } %>import requests invoke_url = "https://integrate.api.nvidia.com/v1/chat/completions" stream = <%- pyStream %> <% if (hasMedia) { %> def media_data_url(kind, index, mime_types): for suffix, mime in mime_types.items(): path = Path(f"{kind}_{index}{suffix}") if path.exists(): return f"data:{mime};base64,{base64.b64encode(path.read_bytes()).decode()}" raise FileNotFoundError(f"Expected {kind}_{index} with suffix in {list(mime_types)}") <% if (imageCount > 0) { %> image_data_urls = [media_data_url("image", i, <%- mimePy(mediaConfig.image.mimeTypes) %>) for i in <%- imageCount === 1 ? "[1]" : ("range(1, " + (imageCount + 1) + ")") %>] <% } %><% if (videoCount > 0) { %> video_data_urls = [media_data_url("video", i, <%- mimePy(mediaConfig.video.mimeTypes) %>) for i in <%- videoCount === 1 ? "[1]" : ("range(1, " + (videoCount + 1) + ")") %>] <% } %><% if (audioCount > 0) { %> audio_data_urls = [media_data_url("audio", i, <%- mimePy(mediaConfig.audio.mimeTypes) %>) for i in <%- audioCount === 1 ? "[1]" : ("range(1, " + (audioCount + 1) + ")") %>] audio_b64s = [url.split(",", 1)[1] for url in audio_data_urls] <% } %><% } %> headers = { "Authorization": "Bearer $NVIDIA_API_KEY", "Accept": "text/event-stream" if stream else "application/json", } payload = <%- renderedPayload %> response = requests.post(invoke_url, headers=headers, json=payload, stream=stream) if stream: for line in response.iter_lines(): if line: print(line.decode("utf-8")) else: print(response.json()) 63:T169e,<% const deepClone = (value) => { if (Array.isArray(value)) return value.map(deepClone); if (value && typeof value === "object") { const out = {}; for (const key of Object.keys(value)) out[key] = deepClone(value[key]); return out; } return value; }; const mediaConfig = {"image": {"mimeTypes": {".png": "image/png", ".jpg": "image/jpeg", ".jpeg": "image/jpeg", ".webp": "image/webp"}}, "video": {"mimeTypes": {}}, "audio": {"mimeTypes": {}, "defaultFormat": "wav"}}; const payloadForSnippet = deepClone(request || {}); const messagesForSnippet = deepClone(payloadForSnippet.messages || []); const hasMediaKind = (kind) => Object.keys(mediaConfig[kind].mimeTypes || {}).length > 0; const isInlineDataUrl = (url, kind) => ( typeof url === "string" && new RegExp(`^data:${kind}/[^;]+;base64,`, "i").test(url) ); const mediaUrl = (part, key) => { const slot = part?.[key]; return typeof slot === "string" ? slot : slot?.url; }; const setMediaUrl = (part, key, url) => { if (typeof part[key] === "string") part[key] = url; else { if (!part[key] || typeof part[key] !== "object") part[key] = {}; part[key].url = url; } }; let imageCount = 0; let hasUnsupportedMedia = false; messagesForSnippet.forEach((message) => { if (!Array.isArray(message?.content)) return; message.content.forEach((part) => { const imageUrl = mediaUrl(part, "image_url"); if (hasMediaKind("image") && part?.type === "image_url" && isInlineDataUrl(imageUrl, "image")) { setMediaUrl(part, "image_url", `__IMAGE_DATA_URL_${imageCount}__`); imageCount += 1; } else if (part?.type === "video_url" && isInlineDataUrl(mediaUrl(part, "video_url"), "video")) { // LangChain cannot ship local file helpers for video; reject inline only. hasUnsupportedMedia = true; setMediaUrl(part, "video_url", "__UNSUPPORTED_MEDIA_DATA__"); } else if (part?.type === "audio_url" && isInlineDataUrl(mediaUrl(part, "audio_url"), "audio")) { hasUnsupportedMedia = true; setMediaUrl(part, "audio_url", "__UNSUPPORTED_MEDIA_DATA__"); } else if (part?.type === "input_audio" && part.input_audio?.data) { hasUnsupportedMedia = true; part.input_audio.data = "__UNSUPPORTED_MEDIA_DATA__"; } }); }); const pyRepr = (value, level = 0) => { if (value === null) return "None"; if (typeof value === "boolean") return value ? "True" : "False"; if (typeof value === "number") return String(value); if (typeof value === "string") return JSON.stringify(value); const pad = " ".repeat(level); const innerPad = " ".repeat(level + 2); if (Array.isArray(value)) { if (value.length === 0) return "[]"; return "[\n" + value.map((item) => `${innerPad}${pyRepr(item, level + 2)},`).join("\n") + "\n" + pad + "]"; } if (typeof value === "object") { const entries = Object.entries(value); if (entries.length === 0) return "{}"; return "{\n" + entries.map(([key, item]) => `${innerPad}${JSON.stringify(key)}: ${pyRepr(item, level + 2)},`).join("\n") + "\n" + pad + "}"; } return "None"; }; const replaceAll = (s, a, b) => s.split(a).join(b); let renderedMessages = pyRepr(messagesForSnippet); for (let i = 0; i < imageCount; i++) { renderedMessages = replaceAll(renderedMessages, `"__IMAGE_DATA_URL_${i}__"`, `image_data_urls[${i}]`); } // Either file helpers XOR inline base64 - never emit unused helpers. const usesFileHelpers = imageCount > 0 && [...Array(imageCount).keys()].every((i) => renderedMessages.includes(`image_data_urls[${i}]`)); if (!usesFileHelpers) { imageCount = 0; renderedMessages = pyRepr(deepClone((request || {}).messages || [])); } %> from langchain_nvidia_ai_endpoints import ChatNVIDIA <% if (imageCount > 0) { %>from pathlib import Path import base64 <% } %> client = ChatNVIDIA( model="<%- request.model %>", api_key="$NVIDIA_API_KEY", temperature=<%- request.temperature %>, top_p=<%- request.top_p %>, max_completion_tokens=<%- request.max_tokens %>, ) <% if (imageCount > 0) { %> def find_image_path(index): image_mime_types = <%- pyRepr(mediaConfig.image.mimeTypes) %> for suffix in image_mime_types: path = Path(f"image_{index}{suffix}") if path.exists(): return path expected = "/".join(f".{suffix.lstrip('.')}" for suffix in image_mime_types) raise FileNotFoundError(f"Expected image_{index}{expected}") def read_image_data_url(path): image_mime_types = <%- pyRepr(mediaConfig.image.mimeTypes) %> with open(path, "rb") as f: image_b64 = base64.b64encode(f.read()).decode() return f"data:{image_mime_types[path.suffix.lower()]};base64,{image_b64}" image_data_urls = [read_image_data_url(find_image_path(i)) for i in range(1, <%- imageCount + 1 %>)] <% } %><% if (hasUnsupportedMedia) { %> raise ValueError("LangChain snippet currently supports text and image input. Use Python, Node.js, or Shell for video or audio input.") <% } %> lc_messages = <%- renderedMessages %> <% if (request.stream) { %> for chunk in client.stream(lc_messages<%= request.chat_template_kwargs ? ', chat_template_kwargs=' + pyRepr(request.chat_template_kwargs) : '' %>): if chunk.additional_kwargs and "reasoning_content" in chunk.additional_kwargs: print(chunk.additional_kwargs["reasoning_content"], end="") print(chunk.content, end="") <% } else { %> response = client.invoke(lc_messages<%= request.chat_template_kwargs ? ', chat_template_kwargs=' + pyRepr(request.chat_template_kwargs) : '' %>) if response.additional_kwargs and "reasoning_content" in response.additional_kwargs: print(response.additional_kwargs["reasoning_content"]) print(response.content) <% } %> 64:T1add,<% const deepClone = (value) => { if (Array.isArray(value)) return value.map(deepClone); if (value && typeof value === "object") { const out = {}; for (const key of Object.keys(value)) out[key] = deepClone(value[key]); return out; } return value; }; const mediaConfig = {"image": {"mimeTypes": {".png": "image/png", ".jpg": "image/jpeg", ".jpeg": "image/jpeg", ".webp": "image/webp"}}, "video": {"mimeTypes": {}}, "audio": {"mimeTypes": {}, "defaultFormat": "wav"}}; const payloadForSnippet = deepClone(request || {}); const hasStream = payloadForSnippet.stream !== undefined && payloadForSnippet.stream !== null; if (hasStream) payloadForSnippet.stream = "__STREAM__"; const hasMediaKind = (kind) => Object.keys(mediaConfig[kind].mimeTypes || {}).length > 0; const isInlineDataUrl = (url, kind) => ( typeof url === "string" && new RegExp(`^data:${kind}/[^;]+;base64,`, "i").test(url) ); let imageCount = 0; let videoCount = 0; let audioCount = 0; (payloadForSnippet.messages || []).forEach((message) => { if (!Array.isArray(message?.content)) return; message.content.forEach((part) => { if (hasMediaKind("image") && part?.type === "image_url" && isInlineDataUrl(part.image_url?.url, "image")) { part.image_url.url = `__IMAGE_DATA_URL_${imageCount}__`; imageCount += 1; } else if (hasMediaKind("video") && part?.type === "video_url" && isInlineDataUrl(part.video_url?.url, "video")) { part.video_url.url = `__VIDEO_DATA_URL_${videoCount}__`; videoCount += 1; } else if (hasMediaKind("audio") && part?.type === "audio_url" && isInlineDataUrl(part.audio_url?.url, "audio")) { part.audio_url.url = `__AUDIO_DATA_URL_${audioCount}__`; audioCount += 1; } else if (hasMediaKind("audio") && part?.type === "input_audio" && part.input_audio?.data) { part.input_audio.data = `__AUDIO_B64_${audioCount}__`; part.input_audio.format = part.input_audio.format || mediaConfig.audio.defaultFormat; audioCount += 1; } }); }); const replaceAll = (s, a, b) => s.split(a).join(b); let renderedPayload = JSON.stringify(payloadForSnippet, null, 2); if (hasStream) renderedPayload = replaceAll(renderedPayload, '"__STREAM__"', "stream"); for (let i = 0; i < imageCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__IMAGE_DATA_URL_${i}__"`, `imageDataUrls[${i}]`); } for (let i = 0; i < videoCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__VIDEO_DATA_URL_${i}__"`, `videoDataUrls[${i}]`); } for (let i = 0; i < audioCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__AUDIO_DATA_URL_${i}__"`, `audioDataUrls[${i}]`); renderedPayload = replaceAll(renderedPayload, `"__AUDIO_B64_${i}__"`, `audioB64s[${i}]`); } // Either file helpers XOR inline base64 - never emit unused helpers. const usesFileHelpers = imageCount + videoCount + audioCount > 0 && [...Array(imageCount).keys()].every((i) => renderedPayload.includes(`imageDataUrls[${i}]`)) && [...Array(videoCount).keys()].every((i) => renderedPayload.includes(`videoDataUrls[${i}]`)) && [...Array(audioCount).keys()].every( (i) => renderedPayload.includes(`audioDataUrls[${i}]`) || renderedPayload.includes(`audioB64s[${i}]`) ); if (!usesFileHelpers) { imageCount = 0; videoCount = 0; audioCount = 0; const restored = deepClone(request || {}); const restoredStream = restored.stream !== undefined && restored.stream !== null; if (restoredStream) restored.stream = "__STREAM__"; renderedPayload = JSON.stringify(restored, null, 2); if (restoredStream) renderedPayload = replaceAll(renderedPayload, '"__STREAM__"', "stream"); } const hasMedia = usesFileHelpers; %> import axios from 'axios'; <% if (hasMedia) { %>import { existsSync } from 'node:fs'; import { readFile } from 'node:fs/promises'; import { extname } from 'node:path'; <% } %> const invokeUrl = "https://integrate.api.nvidia.com/v1/chat/completions"; const stream = <%- request.stream %>; const headers = { "Authorization": "Bearer $NVIDIA_API_KEY", "Accept": stream ? "text/event-stream" : "application/json" }; <% if (hasMedia) { %> function findMediaPath(kind, index, mimeTypes) { for (const suffix of Object.keys(mimeTypes)) { const path = `${kind}_${index}${suffix}`; if (existsSync(path)) { return path; } } const expected = Object.keys(mimeTypes).join("/"); throw new Error(`Expected ${kind}_${index}${expected}`); } async function readMediaB64(path) { return Buffer.from(await readFile(path)).toString('base64'); } function mediaDataUrl(path, mediaB64, mimeTypes) { return `data:${mimeTypes[extname(path).toLowerCase()]};base64,${mediaB64}`; } <% } %> async function main() { <% if (imageCount > 0) { %> const imageMimeTypes = <%- JSON.stringify(mediaConfig.image.mimeTypes, null, 2) %>; const imagePaths = [<% for (let i = 1; i <= imageCount; i++) { %>findMediaPath("image", <%- i %>, imageMimeTypes)<%- i < imageCount ? ", " : "" %><% } %>]; const imageB64s = await Promise.all(imagePaths.map(readMediaB64)); const imageDataUrls = imagePaths.map((path, index) => mediaDataUrl(path, imageB64s[index], imageMimeTypes)); <% } %><% if (videoCount > 0) { %> const videoMimeTypes = <%- JSON.stringify(mediaConfig.video.mimeTypes, null, 2) %>; const videoPaths = [<% for (let i = 1; i <= videoCount; i++) { %>findMediaPath("video", <%- i %>, videoMimeTypes)<%- i < videoCount ? ", " : "" %><% } %>]; const videoB64s = await Promise.all(videoPaths.map(readMediaB64)); const videoDataUrls = videoPaths.map((path, index) => mediaDataUrl(path, videoB64s[index], videoMimeTypes)); <% } %><% if (audioCount > 0) { %> const audioMimeTypes = <%- JSON.stringify(mediaConfig.audio.mimeTypes, null, 2) %>; const audioPaths = [<% for (let i = 1; i <= audioCount; i++) { %>findMediaPath("audio", <%- i %>, audioMimeTypes)<%- i < audioCount ? ", " : "" %><% } %>]; const audioB64s = await Promise.all(audioPaths.map(readMediaB64)); const audioDataUrls = audioPaths.map((path, index) => mediaDataUrl(path, audioB64s[index], audioMimeTypes)); <% } %> const payload = <%- renderedPayload %>; const response = await axios.post(invokeUrl, payload, { headers: headers, responseType: stream ? 'stream' : 'json' }); if (stream) { response.data.on('data', (chunk) => { console.log(chunk.toString()); }); } else { console.log(JSON.stringify(response.data)); } } main().catch(error => { if (error.response) { console.error(`HTTP ${error.response.status}`); if (error.response.data?.on) { error.response.data.on('data', (chunk) => console.error(chunk.toString())); } else { console.error(error.response.data); } } else { console.error(error); } }); 65:T1594,<% const deepClone = (value) => { if (Array.isArray(value)) return value.map(deepClone); if (value && typeof value === "object") { const out = {}; for (const key of Object.keys(value)) out[key] = deepClone(value[key]); return out; } return value; }; const mediaConfig = {"image": {"mimeTypes": {".png": "image/png", ".jpg": "image/jpeg", ".jpeg": "image/jpeg", ".webp": "image/webp"}}, "video": {"mimeTypes": {}}, "audio": {"mimeTypes": {}, "defaultFormat": "wav"}}; const payloadForSnippet = deepClone(request || {}); const hasMediaKind = (kind) => Object.keys(mediaConfig[kind].mimeTypes || {}).length > 0; const isInlineDataUrl = (url, kind) => ( typeof url === "string" && new RegExp(`^data:${kind}/[^;]+;base64,`, "i").test(url) ); let imageCount = 0; let videoCount = 0; let audioCount = 0; (payloadForSnippet.messages || []).forEach((message) => { if (!Array.isArray(message?.content)) return; message.content.forEach((part) => { if (hasMediaKind("image") && part?.type === "image_url" && isInlineDataUrl(part.image_url?.url, "image")) { part.image_url.url = `__IMAGE_DATA_URL_${imageCount}__`; imageCount += 1; } else if (hasMediaKind("video") && part?.type === "video_url" && isInlineDataUrl(part.video_url?.url, "video")) { part.video_url.url = `__VIDEO_DATA_URL_${videoCount}__`; videoCount += 1; } else if (hasMediaKind("audio") && part?.type === "audio_url" && isInlineDataUrl(part.audio_url?.url, "audio")) { part.audio_url.url = `__AUDIO_DATA_URL_${audioCount}__`; audioCount += 1; } else if (hasMediaKind("audio") && part?.type === "input_audio" && part.input_audio?.data) { part.input_audio.data = `__AUDIO_B64_${audioCount}__`; part.input_audio.format = part.input_audio.format || mediaConfig.audio.defaultFormat; audioCount += 1; } }); }); const replaceAll = (s, a, b) => s.split(a).join(b); let renderedPayload = JSON.stringify(payloadForSnippet, null, 2); for (let i = 0; i < imageCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__IMAGE_DATA_URL_${i}__"`, `"${"${"}image_${i + 1}_data_url}"`); } for (let i = 0; i < videoCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__VIDEO_DATA_URL_${i}__"`, `"${"${"}video_${i + 1}_data_url}"`); } for (let i = 0; i < audioCount; i++) { renderedPayload = replaceAll(renderedPayload, `"__AUDIO_DATA_URL_${i}__"`, `"${"${"}audio_${i + 1}_data_url}"`); renderedPayload = replaceAll(renderedPayload, `"__AUDIO_B64_${i}__"`, `"${"${"}audio_${i + 1}_b64}"`); } // Either file helpers XOR inline base64 - never emit unused helpers. const usesFileHelpers = imageCount + videoCount + audioCount > 0 && [...Array(imageCount).keys()].every((i) => renderedPayload.includes(`image_${i + 1}_data_url`)) && [...Array(videoCount).keys()].every((i) => renderedPayload.includes(`video_${i + 1}_data_url`)) && [...Array(audioCount).keys()].every( (i) => renderedPayload.includes(`audio_${i + 1}_data_url`) || renderedPayload.includes(`audio_${i + 1}_b64`) ); if (!usesFileHelpers) { imageCount = 0; videoCount = 0; audioCount = 0; renderedPayload = JSON.stringify(deepClone(request || {}), null, 2); } const hasMedia = usesFileHelpers; %> stream=<%- request.stream %> if [ "$stream" = true ]; then accept_header='Accept: text/event-stream' else accept_header='Accept: application/json' fi <% if (hasMedia) { %> mime_type_for() { case "$1" in <% for (const [suffix, mimeType] of Object.entries({...mediaConfig.image.mimeTypes, ...mediaConfig.video.mimeTypes, ...mediaConfig.audio.mimeTypes})) { %> *<%- suffix %>) echo "<%- mimeType %>" ;; <% } %> *) echo "Unsupported media file: $1" >&2; return 1 ;; esac } find_media_path() { local kind="$1" local index="$2" shift 2 local ext path for ext in "$@"; do path="${kind}_${index}.${ext}" if [ -f "$path" ]; then echo "$path" return 0 fi done echo "Expected ${kind}_${index}.$*" >&2 return 1 } media_b64() { base64 < "$1" | tr -d '\n' } media_data_url() { local path="$1" local mime_type media_base64 mime_type=$(mime_type_for "$path") || return 1 media_base64=$(media_b64 "$path") || return 1 printf 'data:%s;base64,%s' "$mime_type" "$media_base64" } <% for (let i = 1; i <= imageCount; i++) { %> image_<%- i %>_path=$(find_media_path image <%- i %><% for (const suffix of Object.keys(mediaConfig.image.mimeTypes)) { %> <%- suffix.slice(1) %><% } %>) image_<%- i %>_data_url=$(media_data_url "$image_<%- i %>_path") <% } %><% for (let i = 1; i <= videoCount; i++) { %> video_<%- i %>_path=$(find_media_path video <%- i %><% for (const suffix of Object.keys(mediaConfig.video.mimeTypes)) { %> <%- suffix.slice(1) %><% } %>) video_<%- i %>_data_url=$(media_data_url "$video_<%- i %>_path") <% } %><% for (let i = 1; i <= audioCount; i++) { %> audio_<%- i %>_path=$(find_media_path audio <%- i %><% for (const suffix of Object.keys(mediaConfig.audio.mimeTypes)) { %> <%- suffix.slice(1) %><% } %>) audio_<%- i %>_b64=$(media_b64 "$audio_<%- i %>_path") audio_<%- i %>_data_url=$(media_data_url "$audio_<%- i %>_path") <% } %><% } %> cat > payload.json < JSON curl https://integrate.api.nvidia.com/v1/chat/completions \ -H "Authorization: Bearer $NVIDIA_API_KEY" \ -H "Content-Type: application/json" \ -H "$accept_header" \ -d @payload.json57:[["$","$L40",".0",{"state":{"mutations":[],"queries":[{"dehydratedAt":1790049817276,"state":{"data":"$37:props:state:queries:0:state:data","dataUpdateCount":1,"dataUpdatedAt":1790049817217,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:0:queryKey","queryHash":"[\"search\",\"labelsets\",\"ENDPOINT\"]"},{"dehydratedAt":1790049817276,"state":{"data":"$37:props:state:queries:1:state:data","dataUpdateCount":1,"dataUpdatedAt":1790049817218,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:1:queryKey","queryHash":"[\"endpoints\",\"license\",\"step-3.7-flash\"]"},{"dehydratedAt":1790049817276,"state":{"data":null,"dataUpdateCount":1,"dataUpdatedAt":1790049817219,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:2:queryKey","queryHash":"[\"killswitches/riva-magpie-2.enabled\"]"},{"dehydratedAt":1790049817276,"state":{"data":"$37:props:state:queries:3:state:data","dataUpdateCount":1,"dataUpdatedAt":1790049817219,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:3:queryKey","queryHash":"[\"killswitches/media/select-example.models.yaml\"]"},{"dehydratedAt":1790049817276,"state":{"data":"$37:props:state:queries:4:state:data","dataUpdateCount":1,"dataUpdatedAt":1790049817219,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:4:queryKey","queryHash":"[\"content/legal/model-terms-of-service.yaml\"]"},{"dehydratedAt":1790049817276,"state":{"data":"$37:props:state:queries:5:state:data","dataUpdateCount":1,"dataUpdatedAt":1790049817220,"error":null,"errorUpdateCount":0,"errorUpdatedAt":0,"fetchFailureCount":0,"fetchFailureReason":null,"fetchMeta":null,"isInvalidated":false,"status":"success","fetchStatus":"idle"},"queryKey":"$37:props:state:queries:5:queryKey","queryHash":"[\"content/legal/playground-disclaimers.yaml\"]"}]},"children":["$","$L60",null,{"initialState":{"artifact":{"artifactType":"ENDPOINT","name":"step-3.7-flash","displayName":"step-3.7-flash","publisher":"stepfun-ai","shortDescription":"A sparse MoE multimodal reasoning model good for enterprise, agentic and coding tasks.","logo":"https://assets.ngc.nvidia.com/products/api-catalog/images/step-3_7-flash.jpg","labels":["Agents","Coding","Vision","cloudPartnerType:endpoint:cloud_partner_type_gmicloud","cloudPartnerType:endpoint:cloud_partner_type_openrouter","nimType:endpoint:nim_type_preview","nimType:endpoint:nim_type_run_anywhere","nimType:endpoint:nim_type_upgrade_available","playgroundType:endpoint:playgroundtype_chat"],"attributes":[{"key":"AVAILABLE","value":"true"},{"key":"DEPRECATION","value":"08/27/2026"},{"key":"PREVIEW","value":"true"}],"updatedDate":"2026-05-29T00:03:32.505Z","canGuestDownload":true,"createdDate":"2026-05-29T00:03:32.505Z","description":"$61","isPublic":true,"isReadOnly":true,"orgName":"qc69jvmznzxy"},"specAttributes":"$58:props:spec:attributes","modelPath":"/stepfun-ai/step-3.7-flash","openApiSpec":{"openapi":"3.1.0","info":{"title":"NVIDIA NIM API for stepfun-ai/step-3.7-flash","description":"The NVIDIA NIM REST API. Please see https://docs.api.nvidia.com/nim/reference/stepfun-ai-step-3-7-flash for more details.","version":"1.0.0","termsOfService":"https://www.nvidia.com/en-us/data-center/products/nvidia-ai-enterprise/eula/","contact":{"name":"NVIDIA Enterprise Support","url":"https://www.nvidia.com/en-us/support/enterprise/"},"license":{"name":"Apache 2.0 License","url":"https://huggingface.co/stepfun-ai/Step-3.7-Flash/blob/main/LICENSE"}},"servers":[{"url":"https://integrate.api.nvidia.com/v1/"}],"paths":{"/chat/completions":{"post":{"operationId":"create_chat_completion_v1_chat_completions_post","tags":["Chat"],"summary":"Creates a model response for the given chat conversation.","description":"Given a list of messages comprising a conversation, the model will return a response. Compatible with OpenAI. See https://platform.openai.com/docs/api-reference/chat/create","requestBody":{"content":{"application/json":{"schema":{"additionalProperties":false,"properties":{"model":{"type":"string","title":"Model","default":"stepfun-ai/step-3.7-flash"},"messages":{"description":"A list of messages comprising the conversation so far. The roles of the messages must be alternating between `user` and `assistant`. The last input message should have role `user`. A message with the the `system` role is optional, and must be the very first message if it is present; `context` is also optional, but must come before a user question.","examples":[[{"content":"I am going to Paris, what should I see?","role":"user"}]],"items":{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"},"title":"Messages","type":"array"},"temperature":{"default":1,"description":"The sampling temperature to use for text generation. The higher the temperature value is, the less deterministic the output text will be. It is not recommended to modify both temperature and top_p in the same call.","maximum":1,"minimum":0,"title":"Temperature","type":"number"},"top_p":{"default":0.95,"description":"The top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not recommended to modify both temperature and top_p in the same call.","maximum":1,"exclusiveMinimum":0,"title":"Top P","type":"number"},"tools":{"anyOf":[{"items":{"properties":{"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"type":"string","title":"Name"},"description":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Description"},"parameters":{"anyOf":[{"type":"object"},{"type":"null"}],"title":"Parameters"}},"additionalProperties":false,"type":"object","required":["name"],"title":"FunctionDefinition"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ChatCompletionToolsParam"},"type":"array"},{"type":"null"}],"title":"Tools"},"max_tokens":{"default":16384,"description":"The maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified.","maximum":262144,"minimum":1,"title":"Max Tokens","type":"integer"},"seed":{"anyOf":[{"maximum":18446744073709552000,"minimum":0,"type":"integer"},{"type":"null"}],"default":null,"description":"If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.","examples":[42],"title":"Seed"},"stream":{"default":false,"description":"If set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by `data: `), with the stream terminated by a `data: [DONE]` message.","title":"Stream","type":"boolean"}},"required":["messages"],"title":"ChatRequest","type":"object"}}},"required":true},"responses":{"200":{"description":"Invocation is fulfilled","content":{"application/json":{"schema":{"properties":{"id":{"description":"A unique identifier for the completion.","format":"uuid","title":"Id","type":"string"},"choices":{"description":"The list of completion choices the model generated for the input prompt.","items":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"message":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion message generated by the model.","examples":[{"content":"Ah, Paris, the City of Light! There are so many amazing things to see and do in this beautiful city ...","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached.","examples":["stop"],"title":"Finish Reason"}},"required":["index","message"],"title":"Choice","type":"object"},"title":"Choices","type":"array"},"usage":{"allOf":[{"properties":{"completion_tokens":{"description":"Number of tokens in the generated completion.","examples":[25],"title":"Completion Tokens","type":"integer"},"prompt_tokens":{"description":"Number of tokens in the prompt.","examples":[9],"title":"Prompt Tokens","type":"integer"},"total_tokens":{"description":"Total number of tokens used in the request (prompt + completion).","examples":[34],"title":"Total Tokens","type":"integer"}},"required":["completion_tokens","prompt_tokens","total_tokens"],"title":"Usage","type":"object"}],"description":"Usage statistics for the completion request."}},"required":["id","choices","usage"],"title":"ChatCompletion","type":"object"}},"text/event-stream":{"schema":{"properties":{"id":{"description":"A unique identifier for the completion.","format":"uuid","title":"Id","type":"string"},"choices":{"description":"The list of completion choices the model generated for the input prompt.","items":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"delta":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion delta generated by streamed model responses.","examples":[{"content":"Ah,","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached. Will be `null` if the model has not finished generating.","title":"Finish Reason"}},"required":["index","delta"],"title":"ChoiceChunk","type":"object"},"title":"Choices","type":"array"}},"required":["id","choices"],"title":"ChatCompletionChunk","type":"object"}}}},"202":{"description":"Result is pending. Client should poll using the requestId.\n","content":{"application/json":{"example":{},"schema":{}}},"headers":{"NVCF-REQID":{"description":"requestId required for pooling","schema":{"type":"string","format":"uuid"}},"NVCF-STATUS":{"description":"Invocation status","schema":{"type":"string"}}}},"422":{"description":"Validation failed, provided entity could not be processed.","content":{"application/json":{"schema":{"properties":{"type":{"type":"string","description":"Error type"},"title":{"type":"string","description":"Error title"},"status":{"type":"integer","description":"Error status code"},"detail":{"type":"string","description":"Detailed information about the error"},"instance":{"type":"string","description":"Function instance used to invoke the request"},"requestId":{"type":"string","format":"uuid","description":"UUID of the request"}},"type":"object","required":["type","title","status","detail","instance","requestId"],"title":"InvokeError"},"example":{"type":"urn:nvcf-worker-service:problem-details:unprocessable-entity","title":"Unprocessable Entity","status":422,"detail":"string","instance":"/v2/nvcf/pexec/functions/4a58c6cb-a9b4-4014-99de-3e704d4ae687","requestId":"3fa85f64-5717-4562-b3fc-2c963f66afa6"}}}},"500":{"description":"The invocation ended with an error.","content":{"application/json":{"schema":{"properties":{"type":{"type":"string","description":"Error type"},"title":{"type":"string","description":"Error title"},"status":{"type":"integer","description":"Error status code"},"detail":{"type":"string","description":"Detailed information about the error"},"instance":{"type":"string","description":"Function instance used to invoke the request"},"requestId":{"type":"string","format":"uuid","description":"UUID of the request"}},"type":"object","required":["type","title","status","detail","instance","requestId"],"title":"InvokeError"},"example":{"type":"urn:nvcf-worker-service:problem-details:internal-server-error","title":"Internal Server Error","status":500,"detail":"string","instance":"/v2/nvcf/pexec/functions/4a58c6cb-a9b4-4014-99de-3e704d4ae687","requestId":"3fa85f64-5717-4562-b3fc-2c963f66afa6"}}}}},"x-nvai-meta":{"name":"Create chat completion","returns":"Returns a [chat completion](/docs/api-reference/chat/object) object, or a streamed sequence of [chat completion chunk](/docs/api-reference/chat/streaming) objects if the request is streamed.\n","path":"create","examples":[{"name":"image","input":{"text":"What is in this image?","images":["https://assets.ngc.nvidia.com/products/api-catalog/phi-3-5-vision/example1b.jpg"]},"output":{"text":"The image shows a wooden boardwalk cutting through tall grass under a blue sky."},"requestJson":"{\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"messages\": [\n {\n \"role\": \"user\",\n \"content\": [\n { \"type\": \"text\", \"text\": \"What is in this image?\" },\n { \"type\": \"image_url\", \"image_url\": { \"url\": \"https://assets.ngc.nvidia.com/products/api-catalog/phi-3-5-vision/example1b.jpg\" } }\n ]\n }\n ],\n \"top_p\": 0.95,\n \"temperature\": 1.0,\n \"max_tokens\": 16384,\n \"seed\": 21,\n \"stream\": true\n}\n","responseJson":"{\n \"id\": \"id-123\",\n \"object\": \"chat.completion\",\n \"created\": 1677652288,\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"system_fingerprint\": \"fp_44709d6fcb\",\n \"choices\": [{\n \"index\": 0,\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"The image shows a wooden boardwalk through tall grass under a blue sky.\"\n },\n \"finish_reason\": \"stop\"\n }],\n \"usage\": {\n \"prompt_tokens\": 256,\n \"completion_tokens\": 24,\n \"total_tokens\": 280\n }\n}\n"},{"name":"Which number is larger, 9.11 or 9.8?","requestJson":"{\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"messages\": [\n {\n \"role\": \"user\",\n \"content\": \"Which number is larger, 9.11 or 9.8?\"\n }\n ],\n \"top_p\": 0.9,\n \"temperature\": 1.0,\n \"max_tokens\": 16384,\n \"seed\": 21,\n \"stream\": true\n}\n","responseJson":"{\n \"id\": \"id-123\",\n \"object\": \"chat.completion\",\n \"created\": 1677652288,\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"system_fingerprint\": \"fp_44709d6fcb\",\n \"choices\": [{\n \"index\": 0,\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"The number 9.8 is larger than 9.11...\"\n },\n \"finish_reason\": \"stop\"\n }],\n \"usage\": {\n \"prompt_tokens\": 9,\n \"completion_tokens\": 12,\n \"total_tokens\": 21\n }\n}\n"},{"name":"image_thinking_on","input":{"text":"Describe the image.","images":["https://assets.ngc.nvidia.com/products/api-catalog/phi-3-5-vision/example2b.jpg"]},"output":{"text":"The image shows a wooden boardwalk cutting through tall grass under a blue sky."},"requestJson":"{\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"messages\": [\n {\n \"role\": \"user\",\n \"content\": [\n { \"type\": \"text\", \"text\": \"Describe the image.\" },\n { \"type\": \"image_url\", \"image_url\": { \"url\": \"https://assets.ngc.nvidia.com/products/api-catalog/phi-3-5-vision/example2b.jpg\" } }\n ]\n }\n ],\n \"top_p\": 0.95,\n \"temperature\": 1.0,\n \"max_tokens\": 16384,\n \"seed\": 21,\n \"stream\": true\n}\n","responseJson":"{\n \"id\": \"id-123\",\n \"object\": \"chat.completion\",\n \"created\": 1677652288,\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"system_fingerprint\": \"fp_44709d6fcb\",\n \"choices\": [{\n \"index\": 0,\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"The image shows a grassy field with a boardwalk under a blue sky.\"\n },\n \"finish_reason\": \"stop\"\n }],\n \"usage\": {\n \"prompt_tokens\": 512,\n \"completion_tokens\": 48,\n \"total_tokens\": 560\n }\n}\n"},{"name":"Write a limerick about the wonders of GPU computing.","requestJson":"{\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"messages\": [\n {\n \"role\": \"user\",\n \"content\": \"Write a limerick about the wonders of GPU computing.\"\n }\n ],\n \"top_p\": 0.9,\n \"temperature\": 1.0,\n \"max_tokens\": 16384,\n \"seed\": 21,\n \"stream\": true\n}\n","responseJson":"{\n \"id\": \"id-123\",\n \"object\": \"chat.completion\",\n \"created\": 1677652288,\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"system_fingerprint\": \"fp_44709d6fcb\",\n \"choices\": [{\n \"index\": 0,\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"There once was a GPU ...\"\n },\n \"finish_reason\": \"stop\"\n }],\n \"usage\": {\n \"prompt_tokens\": 9,\n \"completion_tokens\": 12,\n \"total_tokens\": 21\n }\n}\n"}],"templates":[{"title":"Default","response":"{\n \"choices\": [{\n \"index\": 0,\n \"model\": \"stepfun-ai/step-3.7-flash\",\n \"message\": {\n \"role\": \"assistant\",\n \"content\": \"...\"\n },\n \"finish_reason\": \"stop\"\n }],\n \"usage\": {\n \"prompt_tokens\": 9,\n \"completion_tokens\": 12,\n \"total_tokens\": 21\n }\n}\n","requestEjs":{"python":"$62","langChain":"$63","node.js":"$64","curl":"$65"}}]}}}},"security":[{"Token":[]}],"components":{"securitySchemes":{"Token":{"type":"http","scheme":"bearer"}},"schemas":{"Errors":{"properties":{"type":{"type":"string","description":"Error type"},"title":{"type":"string","description":"Error title"},"status":{"type":"integer","description":"Error status code"},"detail":{"type":"string","description":"Detailed information about the error"},"instance":{"type":"string","description":"Function instance used to invoke the request"},"requestId":{"type":"string","format":"uuid","description":"UUID of the request"}},"type":"object","required":["type","title","status","detail","instance","requestId"],"title":"InvokeError"},"ChatCompletion":{"properties":{"id":{"description":"A unique identifier for the completion.","format":"uuid","title":"Id","type":"string"},"choices":{"description":"The list of completion choices the model generated for the input prompt.","items":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"message":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion message generated by the model.","examples":[{"content":"Ah, Paris, the City of Light! There are so many amazing things to see and do in this beautiful city ...","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached.","examples":["stop"],"title":"Finish Reason"}},"required":["index","message"],"title":"Choice","type":"object"},"title":"Choices","type":"array"},"usage":{"allOf":[{"properties":{"completion_tokens":{"description":"Number of tokens in the generated completion.","examples":[25],"title":"Completion Tokens","type":"integer"},"prompt_tokens":{"description":"Number of tokens in the prompt.","examples":[9],"title":"Prompt Tokens","type":"integer"},"total_tokens":{"description":"Total number of tokens used in the request (prompt + completion).","examples":[34],"title":"Total Tokens","type":"integer"}},"required":["completion_tokens","prompt_tokens","total_tokens"],"title":"Usage","type":"object"}],"description":"Usage statistics for the completion request."}},"required":["id","choices","usage"],"title":"ChatCompletion","type":"object"},"ChatCompletionChunk":{"properties":{"id":{"description":"A unique identifier for the completion.","format":"uuid","title":"Id","type":"string"},"choices":{"description":"The list of completion choices the model generated for the input prompt.","items":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"delta":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion delta generated by streamed model responses.","examples":[{"content":"Ah,","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached. Will be `null` if the model has not finished generating.","title":"Finish Reason"}},"required":["index","delta"],"title":"ChoiceChunk","type":"object"},"title":"Choices","type":"array"}},"required":["id","choices"],"title":"ChatCompletionChunk","type":"object"},"ChatRequest":{"additionalProperties":false,"properties":{"model":{"type":"string","title":"Model","default":"stepfun-ai/step-3.7-flash"},"messages":{"description":"A list of messages comprising the conversation so far. The roles of the messages must be alternating between `user` and `assistant`. The last input message should have role `user`. A message with the the `system` role is optional, and must be the very first message if it is present; `context` is also optional, but must come before a user question.","examples":[[{"content":"I am going to Paris, what should I see?","role":"user"}]],"items":{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"},"title":"Messages","type":"array"},"temperature":{"default":1,"description":"The sampling temperature to use for text generation. The higher the temperature value is, the less deterministic the output text will be. It is not recommended to modify both temperature and top_p in the same call.","maximum":1,"minimum":0,"title":"Temperature","type":"number"},"top_p":{"default":0.95,"description":"The top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not recommended to modify both temperature and top_p in the same call.","maximum":1,"exclusiveMinimum":0,"title":"Top P","type":"number"},"tools":{"anyOf":[{"items":{"properties":{"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"type":"string","title":"Name"},"description":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Description"},"parameters":{"anyOf":[{"type":"object"},{"type":"null"}],"title":"Parameters"}},"additionalProperties":false,"type":"object","required":["name"],"title":"FunctionDefinition"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ChatCompletionToolsParam"},"type":"array"},{"type":"null"}],"title":"Tools"},"max_tokens":{"default":16384,"description":"The maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified.","maximum":262144,"minimum":1,"title":"Max Tokens","type":"integer"},"seed":{"anyOf":[{"maximum":18446744073709552000,"minimum":0,"type":"integer"},{"type":"null"}],"default":null,"description":"If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.","examples":[42],"title":"Seed"},"stream":{"default":false,"description":"If set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by `data: `), with the stream terminated by a `data: [DONE]` message.","title":"Stream","type":"boolean"}},"required":["messages"],"title":"ChatRequest","type":"object"},"Choice":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"message":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion message generated by the model.","examples":[{"content":"Ah, Paris, the City of Light! There are so many amazing things to see and do in this beautiful city ...","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached.","examples":["stop"],"title":"Finish Reason"}},"required":["index","message"],"title":"Choice","type":"object"},"ChoiceChunk":{"properties":{"index":{"description":"The index of the choice in the list of choices (always 0).","title":"Index","type":"integer"},"delta":{"allOf":[{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"}],"description":"A chat completion delta generated by streamed model responses.","examples":[{"content":"Ah,","role":"assistant"}]},"finish_reason":{"anyOf":[{"enum":["stop","length","tool_calls"],"type":"string"},{"type":"null"}],"default":null,"description":"The reason the model stopped generating tokens. This will be `stop` if the model hit a natural stop point or a provided stop sequence, or `length` if the maximum number of tokens specified in the request was reached. Will be `null` if the model has not finished generating.","title":"Finish Reason"}},"required":["index","delta"],"title":"ChoiceChunk","type":"object"},"Message":{"additionalProperties":false,"properties":{"role":{"description":"The role of the message author.","enum":["system","context","user","assistant","tool"],"title":"Role","type":"string"},"content":{"description":"The contents of the message.\n
To pass media (only with role=`user`):\n
- Use content parts. Text is passed with `type`=`text`.\n
- Images are passed with `type`=`image_url`; set `image_url.url` to an image URL or a base64 data URI like `data:image/{format};base64,{base64encodedimage}`.\n
For `system` and `assistant` roles, the object list format is not supported.\n","title":"Content","anyOf":[{"type":"string"},{"items":{"anyOf":[{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"}]},"type":"array"},{"type":"null"}]},"tool_call_id":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Tool Call Id","description":"The id of the tool call."},"tool_calls":{"anyOf":[{"items":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"type":"array"},{"type":"null"}],"title":"Tool Calls","description":"The tool(s) called by the model."}},"required":["role","content"],"title":"Message","type":"object"},"ContentPartImage":{"properties":{"image_url":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"type":{"type":"string","enum":["image_url"],"const":"image_url","title":"Type"}},"type":"object","required":["image_url","type"],"title":"ContentPartImage"},"ContentPartText":{"properties":{"text":{"type":"string","title":"Text"},"type":{"type":"string","enum":["text"],"const":"text","title":"Type"}},"type":"object","required":["text","type"],"title":"ContentPartText"},"ImageURL":{"properties":{"url":{"type":"string","title":"Url"}},"type":"object","required":["url"],"title":"ImageURL"},"ToolCall":{"properties":{"id":{"type":"string","title":"Id"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ToolCall"},"FunctionCall":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"},"arguments":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Arguments"}},"additionalProperties":false,"type":"object","required":["name","arguments"],"title":"FunctionCall"},"ChatCompletionToolsParam":{"properties":{"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"},"function":{"properties":{"name":{"type":"string","title":"Name"},"description":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Description"},"parameters":{"anyOf":[{"type":"object"},{"type":"null"}],"title":"Parameters"}},"additionalProperties":false,"type":"object","required":["name"],"title":"FunctionDefinition"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ChatCompletionToolsParam"},"ChatCompletionNamedFunction":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"}},"additionalProperties":false,"type":"object","required":["name"],"title":"ChatCompletionNamedFunction"},"ChatCompletionNamedToolChoiceParam":{"properties":{"function":{"properties":{"name":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Name"}},"additionalProperties":false,"type":"object","required":["name"],"title":"ChatCompletionNamedFunction"},"type":{"type":"string","enum":["function"],"const":"function","title":"Type","default":"function"}},"additionalProperties":false,"type":"object","required":["function"],"title":"ChatCompletionNamedToolChoiceParam"},"FunctionDefinition":{"properties":{"name":{"type":"string","title":"Name"},"description":{"anyOf":[{"type":"string"},{"type":"null"}],"title":"Description"},"parameters":{"anyOf":[{"type":"object"},{"type":"null"}],"title":"Parameters"}},"additionalProperties":false,"type":"object","required":["name"],"title":"FunctionDefinition"},"Usage":{"properties":{"completion_tokens":{"description":"Number of tokens in the generated completion.","examples":[25],"title":"Completion Tokens","type":"integer"},"prompt_tokens":{"description":"Number of tokens in the prompt.","examples":[9],"title":"Prompt Tokens","type":"integer"},"total_tokens":{"description":"Total number of tokens used in the request (prompt + completion).","examples":[34],"title":"Total Tokens","type":"integer"}},"required":["completion_tokens","prompt_tokens","total_tokens"],"title":"Usage","type":"object"}}}},"pageLayout":"v3"},"children":["$L66","$L67","$L68"]}]}]]