Search results

• 1 HR

  TRT LLM for Inference

  Install and use TensorRT-LLM on DGX Spark

  Playbook
• jetson-llm-benchmark

  Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.

  Skill
• jetson-llm-serve

  Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

  Skill
• Intermediate30 MIN

  Deploy NVIDIA NIM for LLM Inference

  Prebuilt, GPU-optimized model containers with a ready-to-use HTTP endpoint

  Playbook
• Intermediate30 MIN

  Run Hermes Agent with a Local LLM

  Chat from the terminal against local vLLM with the self-improving Nous Research agent (Telegram optional)

  Playbook
• Intermediate30 MIN

  Run NemoClaw with a Local LLM

  Build a local AI assistant in an OpenShell sandbox with vLLM inference and optional Telegram

  Playbook
• Intermediate30 MIN

  Run OpenClaw with a Local LLM

  Install a local-first AI agent and connect it to a private OpenAI-compatible model endpoint

  Playbook
• Intermediate30 MIN

  Serve LLMs with vLLM

  High-throughput serving for 30+ models, with continuous batching and an OpenAI-compatible API

  Playbook
• Intermediate30 MIN

  Serve LLMs with LM Studio

  Local models reachable from your own machine's tools over an encrypted link

  Playbook
• Beginner6 MIN

  Run Local LLMs

  Chat, agents, coding, and document Q&A with Ollama, LM Studio, and AnythingLLM on your hardware

  Playbook
• Intermediate30 MIN

  Serve LLMs with SGLang

  High-throughput serving with RadixAttention, structured output, and an OpenAI-compatible API

  Playbook
• Advanced60 MIN

  Run LLMs on Your NVIDIA Device

  Choose a model and spin it up locally on your NVIDIA device

  Playbook
• Intermediate60 MIN

  Fine-Tune LLMs with LLaMA Factory

  One interface for supervised, RLHF, and parameter-efficient training

  Playbook
• Intermediate8 MIN

  Fine-Tune Specialized LLMs with Unsloth

  LoRA, full training, and RL paths plus Nemotron open models

  Playbook
• Beginner15 MIN

  Chat with LLMs Using Open WebUI and Ollama

  A self-hosted browser interface with models running locally on your GPU

  Playbook
• NVIDIA

  Downloadable

  nemoguard-jailbreak-detect

  Industry leading jailbreak classification model for protection from adversarial attempts

  Model
• Google

  DownloadableFree Endpoint

  diffusiongemma-26b-a4b-it

  Diffusion-based 26B parameter LLM enabling parallel token generation for real-time text apps

  Model
• Healthcare & Life Sciences

  LaunchableDeveloper Example

  Ambient Healthcare Agents

  Build advanced AI agents for providers and patients using this developer example powered by NeMo Microservices, NVIDIA Nemotron, Riva ASR and TTS, and NVIDIA LLM NIM

  Blueprint
• 20 MIN

  Live VLM WebUI

  Real-time Vision Language Model interaction with webcam streaming

  Playbook
• Z.ai

  Deprecation in 8dFree Endpoint

  glm-5-3

  753B-parameter text MoE with DeepSeek-style sparse attention, native FP8 weights, reasoning and tool calling.

  Model
• Z.ai

  Free Endpoint

  glm-5-3-flash

  Multimodal 320B-total / 18B-active MoE with hybrid KDA and sparse MLA attention, native FP8 weights, reasoning and tool calling.

  Model
• rtvi-vlm-customize-model

  How to swap the VLM in the VSS Alerts Blueprint — covers RTVI-VLM microservice deployment methods, all three VLM consumers (rtvi-vlm, vlm-as-verifier, vss-agent), and health checks.

  Skill
• nemo-mbridge-mlm-bridge-training

  Run Megatron-LM (MLM) and Megatron Bridge training with mock or real data. Covers correlation testing, available recipes, and multi-GPU examples.

  Skill
• tao-analyze-gaps-vlm-bcq

  Extract false-positive and false-negative gaps from VLM binary-classification-question (BCQ, yes/no) predictions. Use when the user asks to "analyze VLM BCQ gaps", "extract VLM false positives and false negatives", or identify failure cases from a predict

  Skill