Search results

• 1 HR

  TRT LLM for Inference

  Install and use TensorRT-LLM on DGX Spark

  Playbook
• jetson-llm-benchmark

  Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.

  Skill
• jetson-llm-serve

  Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

  Skill
• Intermediate30 MIN

  Deploy NVIDIA NIM for LLM Inference

  Prebuilt, GPU-optimized model containers with a ready-to-use HTTP endpoint

  Playbook
• Intermediate30 MIN

  Run Hermes Agent with a Local LLM

  Chat from the terminal against local vLLM with the self-improving Nous Research agent (Telegram optional)

  Playbook
• Intermediate30 MIN

  Run NemoClaw with a Local LLM

  Build a local AI assistant in an OpenShell sandbox with vLLM inference and optional Telegram

  Playbook
• Intermediate30 MIN

  Run OpenClaw with a Local LLM

  Install a local-first AI agent and connect it to a private OpenAI-compatible model endpoint

  Playbook
• Intermediate30 MIN

  Serve LLMs with vLLM on One Device

  A locally accessible model API from one DGX Spark or Station

  Playbook
• Intermediate30 MIN

  Serve LLMs with LM Studio

  Local models reachable from your own machine's tools over an encrypted link

  Playbook
• Intermediate30 MIN

  Serve LLMs with vLLM Across DGX Sparks

  Guided and configurable model serving across DGX Spark clusters

  Playbook
• Beginner6 MIN

  Run Local LLMs

  Chat, agents, coding, and document Q&A with Ollama, LM Studio, and AnythingLLM on your hardware

  Playbook
• Intermediate30 MIN

  Serve LLMs with SGLang

  High-throughput serving with RadixAttention, structured output, and an OpenAI-compatible API

  Playbook
• Advanced60 MIN

  Run LLMs on Your NVIDIA Device

  Choose a model and spin it up locally on your NVIDIA device

  Playbook
• Intermediate60 MIN

  Fine-Tune LLMs with LLaMA Factory

  One interface for supervised, RLHF, and parameter-efficient training

  Playbook
• Intermediate8 MIN

  Fine-Tune Specialized LLMs with Unsloth

  LoRA, full training, and RL paths plus Nemotron open models

  Playbook
• Beginner15 MIN

  Chat with LLMs Using Open WebUI and Ollama

  A self-hosted browser interface with models running locally on your GPU

  Playbook
• NVIDIA

  Downloadable

  nemoguard-jailbreak-detect

  Industry leading jailbreak classification model for protection from adversarial attempts

  Model
• Google

  DownloadableFree Endpoint

  diffusiongemma-26b-a4b-it

  Diffusion-based 26B parameter LLM enabling parallel token generation for real-time text apps

  Model
• Healthcare & Life Sciences

  LaunchableDeveloper Example

  Ambient Healthcare Agents

  Build advanced AI agents for providers and patients using this developer example powered by NeMo Microservices, NVIDIA Nemotron, Riva ASR and TTS, and NVIDIA LLM NIM

  Blueprint
• Intermediate60 MIN

  Quantize Models to NVFP4 with NVIDIA Model Optimizer

  Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpoint

  Playbook
• NVIDIA

  Downloadable

  llama-3.1-nemoguard-8b-content-safety

  Leading content safety model for enhancing the safety and moderation capabilities of LLMs

  Model
• NVIDIA

  Free Endpoint

  llama-3.1-nemotron-safety-guard-8b-v3

  Leading multilingual content safety model for enhancing the safety and moderation capabilities of LLMs

  Model
• NVIDIA

  Downloadable

  llama-3.1-nemoguard-8b-topic-control

  Topic control model to keep conversations focused on approved topics, avoiding inappropriate content.

  Model
• Meta

  Free Endpoint

  llama-guard-4-12b

  Multi-modal model to classify safety for input prompts as well output responses.

  Model