Model Overview

Description:

The Google PaLIGemma-3B-mix model is a one-shot visual language understanding solution for image-to-text generation. This model is ready for commercial use.

Third-Party Community Consideration

This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see link to Google's (PaliGemma Model Card.

License, Acceptable Use, and Research Privacy Policy

By using this model, you are agreeing to the terms and conditions of the License, Acceptable Use Policy and Google Research Privacy Policy.

References(s):

• SigLIP paper
• Gemma paper
• PaLIGemma on HuggingFace

Model Architecture:

Architecture Type: Transformer
Network Architecture: SigLIP + Gemma

Input:

Input Format: Image + Text
Input Parameters: Image: Red, Green, and Blue (RGB); Text: String
Other Properties Related to Input: Prompt to caption the image or a question.

Output:

Output Format: Text
Output Parameters: temperature, top_p, max_tokens
Other Properties Related to Output: Stream

Supported Operating System(s):

• Linux

Inference:

Engine: Triton
Test Hardware: Other