---
title: "inkling"
publisher: "thinkingmachines"
type: "endpoint"
updated: "2026-07-16T02:11:18.448Z"
description: "Inkling is a multimodal (text + image) reasoning model from Thinking Machines — a Mamba-hybrid, 256-expert Mixture-of-Experts architecture with tool use and switchable reasoning."
canonical: "https://build.nvidia.com/thinkingmachines/inkling"
---

# Inkling

## Description
Inkling is a general-purpose multimodal autoregressive transformer model from Thinking Machines Lab Inc. that accepts text, image, and audio inputs and generates text outputs. The model is intended for English and other languages, multiple coding languages, agentic and tool-use systems, coding assistants, chatbots, retrieval-augmented generation systems, general-purpose conversational use, instruction following, and other natural language or multimodal tasks.

*This model is ready for commercial or non-commercial use.*

## Third-Party Community Consideration:
This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party's requirements for this application and use case; see link to Non-NVIDIA [Inkling Model Card](https://huggingface.co/thinkingmachines/Inkling)

## License and Terms of Use:
**GOVERNING TERMS:** The trial service is governed by the [NVIDIA API Trial Terms of Service](https://assets.ngc.nvidia.com/products/api-catalog/legal/NVIDIA%20API%20Trial%20Terms%20of%20Service.pdf). Use of the model is governed by the [NVIDIA Open Model Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-agreement/). ADDITIONAL INFORMATION: [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0).

## Deployment Geography:
Global

## Use Case:
**Use Case:** Inkling is intended for developers building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, retrieval-augmented generation systems, general-purpose conversational AI, instruction-following systems, and multimodal applications.

## Release Date:
**Build.NVIDIA.com:** 07/15/2026 via [link](http://build.nvidia.com/thinkingmachines/inkling)<br>
**Huggingface:** 07/15/2026 via [link](https://huggingface.co/thinkingmachines/Inkling)

## Reference(s):
**References:**
- [Inkling Model Page](https://huggingface.co/thinkingmachines/Inkling)
- [Inkling NVFP4 Model Page](https://huggingface.co/thinkingmachines/Inkling-NVFP4)
- [Thinking Machines Acceptable Use Policy](https://thinkingmachines.ai/model-acceptable-use-policy/)
- [Tinker Cookbook](https://github.com/thinking-machines-lab/tinker-cookbook)
- [Inkling Tinker Documentation](https://tinker-docs.thinkingmachines.ai/cookbook/inkling/)

## Model Architecture:
**Architecture Type:** Transformer<br>
**Network Architecture:** Mixture-of-Experts<br>
**Total Parameters:** 975B<br>
**Active Parameters:** 41B

### Input:
**Input Types:** Text, Image, Audio<br>
**Input Formats:** String, Red, Green, Blue (RGB), Other (Waveform)<br>
**Input Parameters:** One-Dimensional (1D), Two-Dimensional (2D), One-Dimensional (1D)<br>
**Other Input Properties:** Text input uses UTF-8 encoding; image input supports pixel-based formats with each dimension ideally between 40 and 4,096 pixels; audio input uses WAV format sampled at 16 kHz and is ideally under 20 minutes.

### Output:
**Output Types:** Text<br>
**Output Format:** String<br>
**Output Parameters:** One-Dimensional (1D)<br>
**Other Output Properties:** Inkling generates UTF-8 encoded text.

__Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA's hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions.__

## Software Integration:
**Runtime Engines:**
- **SGLang**
- **vLLM**

**Supported Hardware:**
- **NVIDIA Blackwell:** B300
- **NVIDIA Hopper:** H200

**Preferred Operating Systems:** Linux

__The integration of foundation and fine-tuned models into AI systems requires additional testing using use-case-specific data to ensure safe and effective deployment. Following the V-model methodology, iterative testing and validation at both unit and system levels are essential to mitigate risks, meet technical and functional requirements, and ensure compliance with safety and ethical standards before deployment.__

## Model Version(s)
Inkling v1.0

## Training, Testing, and Evaluation Datasets:

### Training Dataset
**Data Modality:** Text, Image, Audio, Video<br>
**Text Training Data Size:** Undisclosed<br>
**Image Training Data Size:** Undisclosed<br>
**Audio Training Data Size:** Undisclosed<br>
**Video Training Data Size:** Undisclosed<br>
**Training Data Collection:** Hybrid: Automated, Manually-Collected, Synthetic<br>
**Training Labeling:** Undisclosed<br>
**Training Properties:** Training data includes a broad variety of content types, including text, images, audio, and video, drawn from publicly available sources, third-party acquired sources, and synthetically generated or augmented data. The training data curation process includes cleaning, processing, modification, deduplication, filtering, and other data-type-specific processing steps to remove low-quality content or advance safety objectives.

### Testing Dataset
**Testing Data Collection:** Undisclosed<br>
**Testing Labeling:** Undisclosed<br>
**Testing Properties:** Undisclosed

### Evaluation Dataset
**Evaluation Benchmark Score:** Inkling reports reasoning, agentic, factuality, chat, vision, audio, and safety benchmark results at effort=0.99. Selected official Hugging Face scores include 46.0% HLE with tools, 97.1% AIME 2026, 77.6% SWEBench Verified, 54.3% SWEBench Pro (Public), 63.8 Terminal Bench 2.1, 88.7% Global-MMLU-Lite, 73.3% MMMU Pro (Standard 10), 91.4% VoiceBench, and 98.6% StrongREJECT.

Detailed benchmark comparison tables are available in the official [Inkling Model Card](https://huggingface.co/thinkingmachines/Inkling).

**Evaluation Data Collection:** Hybrid: Automated, Manually-Collected<br>
**Evaluation Labeling:** Hybrid: Automated, Manually-Labeled<br>
**Evaluation Properties:** The evaluation suite covers reasoning, coding and agentic tasks, factuality, chat and instruction following, multimodal vision and audio tasks, and safety benchmarks, with results reported at effort=0.99 and comparison scores from the r/acc leaderboard generated July 14, 2026.

## Inference
**Acceleration Engine:** SGLang + Dynamo<br>
**Test Hardware:** NVIDIA Blackwell (GB200)

## Additional Details
Inkling may exhibit general limitations common to foundation models, including hallucination, occasional failures to follow instructions precisely, degraded performance in long multi-turn conversations, demographic, cultural, or linguistic bias, and uneven performance across languages, dialects, or subject domains that were less represented during training. Downstream developers and deployers should apply human oversight for high-stakes or safety-critical contexts, conduct use-case-specific evaluation, and implement application-layer safeguards such as content filtering, rate limiting, monitoring, and input/output moderation.

Safety evaluations were conducted ahead of release across everyday human-AI interaction and dangerous-capability testing. Evaluation areas included sycophancy, harmful manipulation, psychological-harm patterns, refusal behavior, CBRN, cyber, loss of control, agentic capability, strategic deception, sabotage potential, internal evaluations, external testing, open-ended external red teaming, and refusal-suppressed variants to estimate latent capability with safeguards removed. For more information on model safety, please view the [Inkling Model Card](https://huggingface.co/thinkingmachines/Inkling).

## Ethical Considerations
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. Developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.

Please make sure you have proper rights and permissions for all input image content; if image includes people, personal health information, or intellectual property, the image generated will not blur or maintain proportions of image subjects included.

Please report model quality, risk, security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).

## Capabilities

- **Function Calling:** Not supported

## Prototype

```python
from openai import OpenAI

client = OpenAI(
base_url = "https://integrate.api.nvidia.com/v1",
api_key = "$NVIDIA_API_KEY"
)

completion = client.chat.completions.create(
model="",
messages=[{"role":"user","content":""}],
temperature=,
top_p=,
max_tokens=,
stream=NaN
)

print(completion.choices[0].message.content)
```

```python
from langchain_nvidia_ai_endpoints import ChatNVIDIA

client = ChatNVIDIA(
model="",
api_key="$NVIDIA_API_KEY", 
temperature=,
top_p=,
max_tokens=,
)

response = client.invoke([{"role":"user","content":""}])
print(response.content)
```

```javascript
import OpenAI from 'openai';

const openai = new OpenAI({
apiKey: '$NVIDIA_API_KEY',
baseURL: 'https://integrate.api.nvidia.com/v1',
})

async function main() {
const completion = await openai.chat.completions.create({
model: "",
messages: [{"role":"user","content":""}],
temperature: ,
top_p: ,
max_tokens: ,
stream: 
})

process.stdout.write(completion.choices[0]?.message?.content);

}

main();
```

```bash
invoke_url='https://integrate.api.nvidia.com/v1/chat/completions'

authorization_header='Authorization: Bearer '
accept_header='Accept: application/json'
content_type_header='Content-Type: application/json'

data=$'{
"messages": [
{
"role": "user",
"content": ""
}
]
}'

response=$(curl --silent -i -w "\n%{http_code}" --request POST \
--url "$invoke_url" \
--header "$authorization_header" \
--header "$accept_header" \
--header "$content_type_header" \
--data "$data"
)

echo "$response"
```