Set Up Claude Code with Local Inference

Basic idea

Use Ollama on your hardware platform to run a local coding model and connect a CLI coding agent. This playbook uses Claude Code with Ollama's built-in launch method (ollama launch claude), so you can work without environment variables, provider config files, or external cloud APIs.

CLI agent

This playbook uses Claude Code as the CLI agent, connected to a local Ollama model for inference.

What you'll accomplish

You'll run a local coding model (Qwen3.6 qwen3.6:27b) on your hardware platform with Ollama, launch Claude Code against it with a single command, and complete a small coding task end-to-end.

What to know before starting

Required:

• Comfort with Linux command line basics
• Experience running terminal-based tools and editors
• Familiarity with Python for the short coding task

Optional:

• Experience browsing models on the Ollama library (for example, Qwen3.6)

Supported hardware platforms

Use the matrix below to confirm your hardware platform, recommended default local settings, and whether multi-node applies.

Prerequisites

Hardware requirements

• Supported hardware platform — see Supported hardware platforms matrix above
• Hardware platform powered on, networked, and reachable for local or SSH terminal access
• Sufficient GPU memory for qwen3.6:27b
• Enough free storage for the model download

Software requirements

• A current Ollama release (required for ollama launch and the recommended model): ollama --version
• Internet access to download model weights
• Python 3 with venv support for the coding-task verification

Find model recipes

Browse models you can pull and run with Ollama in the Ollama library. Use the tags and sizes that fit your hardware platform’s memory and storage.

Use the Claude Code tab for the base workflow.

Ancillary files

No local ancillary files are required. All steps use Ollama and Claude Code on your hardware platform.

Time & risk

• Estimated time: 30 MIN (mostly model download time)
• Risk level: Low
  • Large model downloads can fail if network connectivity is unstable
  • Ollama must support ollama launch and the recommended model tag — verify with ollama --version and install from ollama.com/download if needed
• Rollback: Stop Ollama and delete the downloaded model from ~/.ollama/models (see Cleanup in the Claude Code tab). Cleanup is optional and removes downloaded model files.
• Last Updated: 08/03/2026
  • Set up Claude Code against a local Qwen3.6 model with ollama launch on supported hardware platforms