Search results

• Playbooks

  1 HR

  TRT LLM for Inference

  Install and use TensorRT-LLM on DGX Spark

  Playbook
• jetson-llm-benchmark

  Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.

  Skill
• jetson-llm-serve

  Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

  Skill
• Playbooks

  Intermediate30 MIN

  Deploy NVIDIA NIM for LLM Inference

  Prebuilt, GPU-optimized model containers with a ready-to-use HTTP endpoint

  Playbook
• Playbooks

  30 MIN

  Run Hermes Agent with a Local LLM

  Chat from the terminal against local vLLM with the self-improving Nous Research agent (Telegram optional)

  Playbook
• Playbooks

  30 MIN

  Run NemoClaw with a Local LLM

  Build a local AI assistant in an OpenShell sandbox with vLLM inference and optional Telegram

  Playbook
• Playbooks

  30 MIN

  Run OpenClaw with a Local LLM

  Install a local-first AI agent and connect it to a private OpenAI-compatible model endpoint

  Playbook
• Playbooks

  Intermediate30 MIN

  Serve LLMs with vLLM

  High-throughput serving for 30+ models, with continuous batching and an OpenAI-compatible API

  Playbook
• Playbooks

  30 MIN

  Serve LLMs with SGLang

  High-throughput serving with RadixAttention, structured output, and an OpenAI-compatible API

  Playbook
• Playbooks

  Advanced60 MIN

  Fine-Tune LLMs with LLaMA Factory

  One interface for supervised, RLHF, and parameter-efficient training

  Playbook
• Playbooks

  Intermediate8 MIN

  Fine-Tune Specialized LLMs with Unsloth

  LoRA, full training, and RL paths plus Nemotron open models

  Playbook
• Playbooks

  Intermediate15 MIN

  Chat with LLMs Using Open WebUI and Ollama

  A self-hosted browser interface with models running locally on your GPU

  Playbook
• NVIDIA

  Downloadable

  nemoguard-jailbreak-detect

  Industry leading jailbreak classification model for protection from adversarial attempts

  Model
• Google

  DownloadableFree Endpoint

  diffusiongemma-26b-a4b-it

  Diffusion-based 26B parameter LLM enabling parallel token generation for real-time text apps

  Model
• Healthcare & Life Sciences

  LaunchableDeveloper Example

  Ambient Healthcare Agents

  Build advanced AI agents for providers and patients using this developer example powered by NeMo Microservices, NVIDIA Nemotron, Riva ASR and TTS, and NVIDIA LLM NIM

  Blueprint
• Playbooks

  Intermediate60 MIN

  Quantize Models to NVFP4 with NVIDIA Model Optimizer

  Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpoint

  Playbook
• NVIDIA

  Downloadable

  llama-3.1-nemoguard-8b-content-safety

  Leading content safety model for enhancing the safety and moderation capabilities of LLMs

  Model
• NVIDIA

  Free Endpoint

  llama-3.1-nemotron-safety-guard-8b-v3

  Leading multilingual content safety model for enhancing the safety and moderation capabilities of LLMs

  Model
• NVIDIA

  Downloadable

  llama-3.1-nemoguard-8b-topic-control

  Topic control model to keep conversations focused on approved topics, avoiding inappropriate content.

  Model
• Meta

  Free Endpoint

  llama-guard-4-12b

  Multi-modal model to classify safety for input prompts as well output responses.

  Model
• Playbooks

  60 MIN

  cuTile Kernels

  Run cuTile kernel benchmarks, FMHA implementation, and LLM inference on DGX Spark and B300

  Playbook
• Playbooks

  20 MIN

  Live VLM WebUI

  Real-time Vision Language Model interaction with webcam streaming

  Playbook
• Financial Services

  LaunchableDeveloper Example

  AI Model Distillation for Financial Data

  Distill and deploy domain-specific AI models from unstructured financial data to generate market signals efficiently—scaling your workflow with the NVIDIA Data Flywheel Blueprint for high-performance, cost-efficient experimentation.

  Blueprint