---
title: "Run Hermes Agent with a Local LLM — Agent-ready Models"
canonical: "https://build.nvidia.com/spark/hermes-agent/agent-ready-models.md"
---

# Agent-ready models for Hermes

Hermes expects an **OpenAI-compatible** local endpoint. This playbook uses **vLLM** and the agent-ready model recipe validated for the supported hardware platform below.

Serve the model with the [Serve LLMs with vLLM](https://build.nvidia.com/spark/vllm) playbook (Agent-ready Models tab), then return here to install and configure Hermes.

## Recommended models by hardware platform

| Hardware platform | Recommended agent-ready model | Serve with |
| :---- | :---- | :---- |
| **DGX Spark** | Agent-ready Qwen3.6-35B-A3B (NVFP4) — `nvidia/Qwen3.6-35B-A3B-NVFP4` | [vLLM playbook — Agent-ready Models](https://build.nvidia.com/playbooks/vllm) |

Only platforms listed in the Supported hardware platforms table (Overview) are listed above.

## After the model is serving

1. Confirm the OpenAI-compatible API on port **8000**:

```shell
curl -sS http://localhost:8000/v1/models
```

You should see a JSON `"data"` array that includes your served model handle.

2. Continue with the **Instructions** tab to install Hermes and point it at `http://localhost:8000/v1`.