Model Overview

Description:

Mistral-7B-Instruct-v0.3 is a language model that can follow instructions, complete requests, and generate creative text formats. It is an instruct version of the Mistral-7B-v0.3 generative text model fine-tuned using a variety of publicly available conversation datasets.

This model is ready for non-commercial use.

Third-Party Community Consideration:

This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see Mistral's 7B Instruct Hugging Face Model Card.

Terms of use

By using this software or model, you are agreeing to the terms and conditions of the license, acceptable use policy and Mistral's privacy policy. Mistral-7B is released under the Apache 2.0 license

References(s):

Mistral 7B Instruct v0.3 Model Card on Hugging Face
Mistral 7B Paper
Mistral 7B Blogpost

Model Architecture:

Architecture Type: Transformer
Network Architecture: Mistral-7B
Model Version: 0.3

Input

• Input Type: Text
• Input Format: String
• Input Parameters: max_tokens, temperature, top_p, stop, frequency_penalty, presence_penalty, seed

Output

• Output Type: Text
• Output Format: String

Software Integration:

• Supported Hardware Platform(s): NVIDIA Hopper
• Preferred Operating System(s): Linux
  

Inference

Engine: TensorRT-LLM
Test Hardware: H100