nvclip

Requirements

• NVIDIA GeForce RTX 40xx or above (see supported GPUs)
• Install the latest NVIDIA GPU Driver on Windows (Version 570+)

Ensure virtualization is enabled in the system BIOS

In Windows, open the Task Manager. Select the Performance tab and click on CPU. Check if Virtualization is enabled. If it is disabled, see here to enable.

Open the Windows Subsystem for Linux 2 - WSL2 - Distro

Install WSL2. For additional instructions refer to the documentation.

Once installed, open the NVIDIA-Workbench WSL2 distro using the following command in the Windows terminal.

wsl -d NVIDIA-Workbench -u root

Export API Key

Export your personal credentials as environment variables:

export NGC_API_KEY=<PASTE_API_KEY_HERE>

Login to NVIDIA NGC

Login to NVIDIA NGC so that you can pull the NIM container:

echo "$NGC_API_KEY" | podman login nvcr.io --username '$oauthtoken' --password-stdin

Pull and Run NVIDIA NIM

Pull and run the NVIDIA NIM with the command below.

export LOCAL_NIM_CACHE=~/.cache/nim
mkdir -p "$LOCAL_NIM_CACHE"
chmod o+w "$LOCAL_NIM_CACHE"
podman run -it --rm \
    --device nvidia.com/gpu=all \
    -e NGC_API_KEY=$NGC_API_KEY \
    -v "$LOCAL_NIM_CACHE:/opt/nim/.cache" \
    -p 8000:8000 \
    nvcr.io/nim/nvidia/nvclip:latest

Test the NIM

You can now make a local API call by opening another Distro instance and using this curl command:

curl -X POST  'http://0.0.0.0:8000/v1/embeddings' \
      -H "Content-Type: application/json" \
      -d '{
        "input": ["The quick brown fox jumped over the lazy dog",
                  "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAIAAACQd1PeAAAAEElEQVR4nGK6HcwNCAAA//8DTgE8HuxwEQAAAABJRU5ErkJggg=="
                ],
        "model": "nvidia/nvclip-vit-h-14",
        "encoding_format": "float"
      }'

For more details on getting started with this NIM, visit the NVIDIA NIM Docs.