nvclip

Prerequisites

• NVIDIA GeForce RTX 4080 or above (see supported GPUs)
• Install the latest NVIDIA GPU Driver on Windows (Version 570+)
• Ensure virtualization is enabled in the system BIOS. In Windows, open Task Manager, select the Performance tab, and find Virtualization. If Disabled, see here to enable.

Open the Windows Subsystem for Linux 2 - WSL2 - Distro

Install the WSL2 Distro.

Once installed, open the NVIDIA-Workbench WSL2 distro using the following command in the Windows terminal.

Copy Code
wsl -d NVIDIA-Workbench

Run the Container

Copy Code
$ podman login nvcr.io
Username: $oauthtoken
Password: <PASTE_API_KEY_HERE>

Pull and run the NVIDIA NIM with the command below.

Copy Code
export NGC_API_KEY=<PASTE_API_KEY_HERE>
export LOCAL_NIM_CACHE=~/.cache/nim
mkdir -p "$LOCAL_NIM_CACHE"
chmod o+w "$LOCAL_NIM_CACHE"
podman run -it --rm \
    --device nvidia.com/gpu=all \
    -e NGC_API_KEY=$NGC_API_KEY \
    -v "$LOCAL_NIM_CACHE:/opt/nim/.cache" \
    -p 8000:8000 \
    nvcr.io/nim/nvidia/nvclip:2.0.0

Test the NIM

You can now make a local API call by opening another Distro instance and using this curl command:

Copy Code
curl -X POST  'http://0.0.0.0:8000/v1/embeddings' \
      -H "Content-Type: application/json" \
      -d '{
        "input": ["The quick brown fox jumped over the lazy dog",
                  "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAIAAACQd1PeAAAAEElEQVR4nGK6HcwNCAAA//8DTgE8HuxwEQAAAABJRU5ErkJggg=="
                ],
        "model": "nvidia/nvclip-vit-h-14",
        "encoding_format": "float"
      }'

For more details on getting started with this NIM, visit the NVIDIA NIM Docs.