nvidia · Open weights
Nvidia Nemotron 70b
Nvidia's latest Llama fine-tune optimized for instruction following. Early results hints that it might outperform models such as GPT-4o and Claude 3.5 Sonnet.
- Input
- Text
- Output
- Text
- Discovery tier
- Open weights
Pricing
USD per 1M tokens- Input
- $0.36
- Output
- $0.41
Reference prices as published by the model provider. API example
Specifications
- Context window
- 16.4K
- Max output
- 8.2K
Side by side
Nvidia Nemotron 70b compared
Specifications, prices, speed and benchmark scores next to each other. Benchmarks below show every compared model too.
| Nvidia Nemotron 70bnvidiaThis model | Llama 3.1 8B (decentralized)MetaRemove | |
|---|---|---|
| Provider | nvidia | Meta |
| Discovery tier | Open weights | Open weights |
| Added | Apr 15, 2025 | Jan 1, 2024 |
| Limits | ||
| Context window | 16.38K | 128KBest |
| Max output | 8.19K | 16.38KBest |
| Pricing, USD per 1M tokens | ||
| Input | $0.36 | $0.02Best |
| Output | $0.41 | $0.03Best |
| Performance | ||
| Request success (24h) | 22.9% | 100.0%Best |
| Benchmark indexes | ||
| Intelligence Index | 6.9 | 6.9 |
| Coding Index | — | 5.4 |
| Math Index | 11.0Best | 4.3 |
| Capabilities | ||
| Reasoning effort | — | — |
Public evaluations
Benchmarks
Independent evaluation results, with how each score ranks among the models in the Noumen catalog.
- Nvidia Nemotron 70b
- Llama 3.1 8B (decentralized)
Intelligence Index
- Nvidia Nemotron 70b6.9
- Llama 3.1 8B (decentralized)6.9
Nvidia Nemotron 70b: Better than 8% of 326 scored models
Indexes
Coding Index
Composite of the coding evaluations
- Nvidia Nemotron 70b: —
- Llama 3.1 8B (decentralized): 5.4
Math Index
Composite of the math evaluations
- Nvidia Nemotron 70b: 11.0Top
- Llama 3.1 8B (decentralized): 4.3
Document reasoning
AA-LCRv1.1
Reasoning across long documents
- Nvidia Nemotron 70b: 8.3%
- Llama 3.1 8B (decentralized): 18.0%Top
Reasoning and knowledge
Humanity’s Last Exam
Expert-level questions across academic fields
- Nvidia Nemotron 70b: 4.2%
- Llama 3.1 8B (decentralized): 5.3%Top
GPQA Diamond
Graduate-level science questions
- Nvidia Nemotron 70b: 46.5%Top
- Llama 3.1 8B (decentralized): 25.9%
MMLU-Pro
Multi-subject knowledge and reasoning
- Nvidia Nemotron 70b: 69.0%Top
- Llama 3.1 8B (decentralized): 47.6%
IFBench
Following precise output instructions
- Nvidia Nemotron 70b: 30.7%Top
- Llama 3.1 8B (decentralized): 28.6%
Coding
LiveCodeBench
Recent competitive programming problems
- Nvidia Nemotron 70b: 16.9%Top
- Llama 3.1 8B (decentralized): 11.6%
Math
AIME 2025
Competition mathematics, 2025 problems
- Nvidia Nemotron 70b: 11.0%Top
- Llama 3.1 8B (decentralized): 4.3%
AIME
Competition mathematics
- Nvidia Nemotron 70b: 24.7%Top
- Llama 3.1 8B (decentralized): 7.7%
MATH-500
Competition math problems
- Nvidia Nemotron 70b: 73.3%Top
- Llama 3.1 8B (decentralized): 51.9%
Legacy evaluations
Terminal-Bench Hard
Earlier terminal task suite
- Nvidia Nemotron 70b: 4.5%Top
- Llama 3.1 8B (decentralized): 0.8%
τ²-Bench Telecom
Tool use in a customer-support simulation
- Nvidia Nemotron 70b: 23.1%Top
- Llama 3.1 8B (decentralized): 16.4%
AA-LCR (unversioned)
Long-context reasoning, earlier grading
- Nvidia Nemotron 70b: 8.3%
- Llama 3.1 8B (decentralized): 18.0%Top
Scores from Artificial Analysis, updated Oct 26, 2026. Artificial Analysis
Live routing data
Performance and reliability
Recent averages across requests routed for this model. Your own speed depends on prompt length, reasoning effort and load.
- Request success (24h)
- 22.9%
Developers
Use it through the API
Noumen’s API is OpenAI-compatible: any Chat Completions client works with a base URL and a key.
curl https://www.noumen.xyz/api/v1/chat/completions \
-H "Authorization: Bearer $NOUMEN_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
"messages": [{ "role": "user", "content": "Explain this stack trace." }]
}'import os
from openai import OpenAI
client = OpenAI(base_url="https://www.noumen.xyz/api/v1", api_key=os.environ["NOUMEN_API_KEY"])
reply = client.chat.completions.create(
model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
messages=[{"role": "user", "content": "Explain this stack trace."}],
)
print(reply.choices[0].message.content)nvidia
Related models
Other nvidia models, starting with the same family.