Search results

• Playbooks

  30 MIN

  Serve LLMs with SGLang

  High-throughput serving with RadixAttention, structured output, and an OpenAI-compatible API

  Playbook
• Playbooks

  Intermediate30 MIN

  Serve LLMs with vLLM

  High-throughput serving for 30+ models, with continuous batching and an OpenAI-compatible API

  Playbook
• Playbooks

  Intermediate60 MIN

  Quantize Models to NVFP4 with NVIDIA Model Optimizer

  Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpoint

  Playbook