Endpoint Details
Review how to make this request and handle its possible responses.
https://integrate.api.nvidia.com/v1/chat/completionsGiven a list of messages comprising a conversation, the model will return a response. Compatible with OpenAI. See https://platform.openai.com/docs/api-reference/chat/create
Request Body
Edit the request fields below.
Request details
Parameters6 Parameters
modeloptionalpoolside/laguna-xs-2.1messagesrequiredA list of messages comprising the conversation so far. The roles of the messages must be alternating between `user` and `assistant`. The last input message should have role `user`. A message with the the `system` role is optional, and must be the very first message if it is present; `context` is also optional, but must come before a user question.
[{"content":"I am going to Paris, what should I see?","role":"user"}]messages[].rolerequiredThe role of the message author.
user · assistantmessages[].contentrequiredThe contents of the message.
temperatureoptionalThe sampling temperature to use for text generation. The higher the temperature value is, the less deterministic the output text will be. It is not recommended to modify both temperature and top_p in the same call.
1Minimum: 0Maximum: 1top_poptionalThe top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not recommended to modify both temperature and top_p in the same call.
0.95Maximum: 1Exclusive minimum: 0max_tokensoptionalThe maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified.
8192Minimum: 1Maximum: 16384streamoptionalIf set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by `data: `), with the stream terminated by a `data: [DONE]` message.
falseHeaders3 Headers
AuthorizationrequiredFormat: Bearer $NVIDIA_API_KEY
Content-TyperequiredAcceptoptional