Search results
Prebuilt, GPU-optimized model containers with a ready-to-use HTTP endpointIntermediate30 MINDeploy NVIDIA NIM for LLM Inference
Chat from the terminal against local vLLM with the self-improving Nous Research agent (Telegram optional)Intermediate30 MINRun Hermes Agent with a Local LLM
Build a local AI assistant in an OpenShell sandbox with vLLM inference and optional TelegramIntermediate30 MINRun NemoClaw with a Local LLM
Install a local-first AI agent and connect it to a private OpenAI-compatible model endpointIntermediate30 MINRun OpenClaw with a Local LLM
High-throughput serving for 30+ models, with continuous batching and an OpenAI-compatible APIIntermediate30 MINServe LLMs with vLLM
Local models reachable from your own machine's tools over an encrypted linkIntermediate30 MINServe LLMs with LM Studio
Chat, agents, coding, and document Q&A with Ollama, LM Studio, and AnythingLLM on your hardwareBeginner6 MINRun Local LLMs
High-throughput serving with RadixAttention, structured output, and an OpenAI-compatible APIIntermediate30 MINServe LLMs with SGLang
Choose a model and spin it up locally on your NVIDIA deviceAdvanced60 MINRun LLMs on Your NVIDIA Device
One interface for supervised, RLHF, and parameter-efficient trainingIntermediate60 MINFine-Tune LLMs with LLaMA Factory
LoRA, full training, and RL paths plus Nemotron open modelsIntermediate8 MINFine-Tune Specialized LLMs with Unsloth
A self-hosted browser interface with models running locally on your GPUBeginner15 MINChat with LLMs Using Open WebUI and Ollama
Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpointIntermediate60 MINQuantize Models to NVFP4 with NVIDIA Model Optimizer
Run cuTile kernel benchmarks, FMHA implementation, and LLM inference on DGX Spark and B30060 MINcuTile Kernels
Deploy LM Studio and serve LLMs on a Spark device; use LM Link to access models remotely.30 MINLM Studio on DGX Spark
Learn about using LLMs locally on PCs and workstations with Ollama, AnythingLLM, and LM Studio. Fine-tune Vision-Language Models for image and video understanding tasks using Qwen2.5-VL and InternVL3 Image and video understanding adapted to your own specialized tasksIntermediate2 HOURSFine-Tune Vision Language Models
A webcam-based testbed for comparing VLMs across backendsIntermediate30 MINStream Real-Time Video to a Vision Language Model
Extract triples with Ollama or vLLM, store them in a graph database, and explore them in a GPU-accelerated web UIIntermediate30 MINBuild Knowledge Graphs with txt2kg
Isolate OpenClaw with kernel-level policies and route inference to a local model Homogeneous dual-GPU setups for llama.cpp tensor parallel and ComfyUI multi-GPU diffusionIntermediate13 MINBuild a Multi-GPU AI PC
Items per page
of 2 pages