Endpoint Details
Review how to make this request and handle its possible responses.
https://integrate.api.nvidia.com/v1/chat/completionsGiven a list of messages comprising a conversation, the model will return a response. Compatible with OpenAI. See https://platform.openai.com/docs/api-reference/chat/create
Request Body
Edit the request fields below.
Request details
Parameters9 Parameters
modeloptionalnvidia/nemotron-3-ultra-550b-a55bmessagesrequiredA list of messages comprising the conversation so far. The roles of the messages must be alternating between `user` and `assistant`. The last input message should have role `user`. A message with the the `system` role is optional, and must be the very first message if it is present; `context` is also optional, but must come before a user question.
[{"content":"I am going to Paris, what should I see?","role":"user"}]messages[].rolerequiredThe role of the message author.
system · context · user · assistantmessages[].contentrequiredThe contents of the message.
temperatureoptionalThe sampling temperature to use for text generation. The higher the temperature value is, the less deterministic the output text will be. It is not recommended to modify both temperature and top_p in the same call.
1Maximum: 1Exclusive minimum: 0top_poptionalThe top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not recommended to modify both temperature and top_p in the same call.
0.95Maximum: 1Exclusive minimum: 0max_tokensoptionalThe maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified.
16384Minimum: 1Maximum: 32768reasoning_effortoptionalControls Ultra's reasoning mode. `none` disables reasoning tokens, `medium` enables efficient reasoning, and `high` enables full reasoning. Snippets translate this field into the model's `chat_template_kwargs`.
highValid values: none · medium · highseedoptionalIf specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.
42Example: 42streamoptionalIf set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by `data: `), with the stream terminated by a `data: [DONE]` message.
truestopoptionalA string or a list of strings where the API will stop generating further tokens. The returned text will not contain the stop sequence.
Headers3 Headers
AuthorizationrequiredFormat: Bearer $NVIDIA_API_KEY
Content-TyperequiredAcceptoptional