Nemotron-3.5-Embed-8B-BF16

Description:

Nemotron-3.5-Embed-8B-BF16 is a world-class, versatile embedding model trained by NVIDIA and optimized for multimodal and multilingual question-answering retrieval. The model can embed document pages in the form of image, text, or combined image–text inputs. Documents can be retrieved given a user query in text form. The model supports page images containing text, tables, charts, and infographics. For text retrieval, the model was evaluated across 34 languages: English, Arabic, Assamese, Bengali, Bulgarian, Chinese, Danish, Dutch, Finnish, French, German, Hindi, Hinglish, Indonesian, Italian, Japanese, Korean, Malay, Marathi, Nepali, Norwegian, Persian, Portuguese, Romanian, Russian, Spanish, Swahili, Swedish, Tamil, Telugu, Thai, Ukrainian, Urdu, and Vietnamese. For image retrieval, it was evaluated across 18 languages: Arabic, Bengali, Chinese, English, Persian, Finnish, French, German, Hindi, Indonesian, Japanese, Korean, Russian, Spanish, Swahili, Telugu, Thai, and Yoruba. The model may support additional languages beyond these evaluation sets.

This model is ready for commercial or non-commercial use.

This Model Card describes the NVIDIA API Catalog Preview API for Nemotron-3.5-Embed-8B-BF16.

License and Terms of Use:

Governing Hosted-Service Terms: Use of this trial service is governed by the NVIDIA API Trial Terms of Service. Use of the model is governed by the OpenMDW License Agreement, version 1.1.
Governing Download Terms: Use of the model is governed by the OpenMDW License Agreement, version 1.1.
Additional Information: Apache License, Version 2.0 for Ministral-3-8B-Instruct-2512-BF16.

Deployment Geography:

Global

Use Case:

The Nemotron-3.5-Embed-8B-BF16 is suitable for users who want to build a multimodal question-and-answer application over a large corpus, leveraging the latest dense retrieval technology. The input of the model is a text or document image and the output is a fixed-size embedding vector. The embedding model is a bi-encoder that supports context in textual format (e.g. the query or the OCR text of a page or a section of a document) or the image of a document page. Typically, the embedding model is used first to embed (vectorize) the whole corpus (document images or text chunks), and embeddings are stored in a vector database associated to its raw content (image or text). Then at inference time, the embedding model is used to embed the query. The model generates dense vector embeddings from text or image inputs, enabling multimodal retrieval, semantic search, and (agentic) RAG workflows.

Release Date:

Build.NVIDIA.com: 10/19/2026 via Nemotron 3.5 Embed 8B Preview API
Hugging Face: 10/20/2026 via model card

Model Architecture:

Architecture Type: Transformer
Network Architecture: Nemotron-3.5-Embed-8B-BF16 architecture with the Vision Encoder initialized from mistralai/Ministral-3-8B-Instruct-2512-BF16 and the LLM component initialized from nvidia/Nemotron-3-Embed-8B-BF16.
Total Parameters: 8.38B

The language-model component of Nemotron-3.5-Embed-8B-BF16 is initialized from Nemotron-3-Embed-8B-BF16 and kept frozen, preserving that model's text retrieval accuracy while adding image retrieval capabilities. The two models therefore share the same embedding space and produce identical text embeddings. During fine-tuning, only the vision encoder and multimodal projector were trained, on image and combined image-text datasets.

Input:

Input Type(s): Text, Image
Input Format(s): Text: String; Image: Red, Green, Blue (RGB)
Input Parameters: Text: One-Dimensional (1D), Image: Two-Dimensional (2D)
Other Properties Related to Input: The model supports image and/or text inputs. For queries, the model accepts text input only. For documents, it accepts an image, text, or a combination of image + text. The default image longest_edge is 1,120 pixels, and it can be increased up to 1,540 pixels. The model’s max context length is 32,768 tokens.

Output:

Output Type(s): Embeddings
Output Format: Vector
Output Parameters: One-Dimensional (1D) per input
Other Properties Related to Output: Token-level hidden states are mean-pooled and then L2-normalized to produce one 4096-dimensional embedding vector for each input. The model also supports dynamic embedding sizes by truncating the vector from the end (e.g., retaining the first 1024 or 512 dimensions). The truncated embeddings remain effective for retrieval, provided they are L2-normalized after truncation.

Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA's hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions.

Software Integration:

Runtime Engine(s): Native CUDA backend: Photon Engine

Supported Hardware Microarchitecture Compatibility:

• NVIDIA Ampere
• NVIDIA Blackwell
• NVIDIA Hopper
• NVIDIA Lovelace

Supported Operating System(s): Linux

The integration of foundation and fine-tuned models into AI systems requires additional testing using use-case-specific data to ensure safe and effective deployment. Following the V-model methodology, iterative testing and validation at both unit and system levels are essential to mitigate risks, meet technical and functional requirements, and ensure compliance with safety and ethical standards before deployment.

Model Version(s):

Nemotron-3.5-Embed-8B-BF16

Training, Testing, and Evaluation Datasets:

Training Dataset:

Data Modality:

• Image
• Text

Image Training Data Size: 2.3M samples containing images, with or without accompanying text
Text Training Data Size: 50M+ text-only data samples
Data Collection Method by dataset: Automated, Manually-Labeled, Synthetic
Labeling Method by dataset: Automated, Manually-Labeled, Synthetic
Properties: Training was conducted using publicly available, commercially permissible datasets and synthetically generated datasets.

Public Datasets:

The language model in Nemotron-3.5-Embed-8B-BF16 was trained on more than 50 million text-only samples from the datasets listed in the Nemotron-3-Embed-8B-BF16 Model Card. In addition, the following publicly available datasets were used to train the vision encoder and multimodal projector on image-only or combined image-text inputs.

Synthetic datasets were created either by generating queries from seed documents or by generating complete question–answer pairs through LLM-based prompting using the models listed below.

Testing Dataset:

Data Collection Method by dataset: Not Applicable
Labeling Method by dataset: Not Applicable
Properties: Not Applicable. Model quality was assessed using the evaluation benchmark datasets described in the Evaluation Dataset subsection.

Evaluation Dataset:

Benchmark:

• ViDoRe V3
• MIRACL-VISION
  

Benchmark Score: NDCG@10

The Nemotron-3.5-Embed-8B-BF16 and Nemotron-3.5-Embed-1B-BF16 were evaluated with the models' default image longest_edge of 1,120 pixels. Qwen3-VL-Embedding-8B and Qwen3-VL-Embedding-2B were evaluated with max_pixels set to 1,843,200.

Model training and evaluations used transformers==5.12.1.

The 8B BF16 model achieves NDCG@10 scores of 60.39 (image), 60.65 (text), and 61.47 (image + text) on ViDoRe V3, and 70.15 (image) on MIRACL-VISION.

Detailed Benchmark Comparison Table

Model	ViDoRe V3			MIRACL-VISION
	image	text	image + text	image
Qwen3-VL-Embedding-2B	52.89	48.31	51.97	56.19
Nemotron-3.5-Embed-1B-BF16	58.02	57.80	58.82	66.56
Qwen3-VL-Embedding-8B	58.29	53.69	57.03	65.87
Nemotron-3.5-Embed-8B-BF16	60.39	60.65	61.47	70.15

Data Collection Method by dataset: Automated, Manually-Labeled, Synthetic
Labeling Method by dataset: Automated, Manually-Labeled, Synthetic
Properties: ViDoRe V3 is a visual document retrieval benchmark covering 8 public and 2 private datasets across professional domains. MIRACL-VISION is a multilingual visual retrieval dataset for 18 different languages. It is an extension of MIRACL, a popular text-only multilingual retrieval dataset.

Inference:

Acceleration Engine: Native CUDA backend: Photon Engine
Test Hardware:

• NVIDIA Ampere (A100)
• NVIDIA Ampere (A10G)
• NVIDIA Blackwell (GB200)
• NVIDIA Blackwell (GB10)
• NVIDIA Blackwell (RTX PRO 6000 Blackwell Server Edition)
• NVIDIA Hopper (H100)
• NVIDIA Hopper (H100 NVL)
• NVIDIA Lovelace (L40S)

Ethical Considerations:

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. Developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
Please make sure you have proper rights and permissions for all input image and video content; if image or video includes people, personal health information, or intellectual property, the image or video generated will not blur or maintain proportions of image subjects included.
For more detailed information on ethical considerations for this model, see the Model Card++ Bias, Explainability, Privacy, and Safety & Security subcards.
Please report model quality, risk, security vulnerabilities or NVIDIA AI Concerns here.