anthracite · Open weights

Magnum V2 72B

Added Jan 1, 2024Open weights

Use in the app

Magnum V2 72B

Input: Text
Output: Text
Discovery tier: Open weights

Pricing

USD per 1M tokens

Input: $2.01
Output: $2.99

Reference prices as published by the model provider. API example

Specifications

Context window: 16.4K
Max output: 8.2K
Average output (7 days): 319 tokens; Longer than 34% of 465 models

Side by side

Compare models

Put Magnum V2 72B next to up to three other models. The comparison stays in the link, so you can share it.

TryEVA-LLaMA-3.33-70B-v0.1 Mixtral 8x22B GPT-OSS 120B TEE All 3

Public evaluations

Benchmarks

There are no public benchmark results for Magnum V2 72B yet.

Live routing data

Performance and reliability

Recent averages across requests routed for this model. Your own speed depends on prompt length, reasoning effort and load.

Throughput: 16.2 tok/s; Faster than 7% of 250 models
Time to first token: 8.0 s; Quicker than 16% of 250 models
Prompt cache hits: 0.0%
Request success (24h): 55.0%

Cache hits are the share of input tokens recently served from a prompt cache across all requests. They are not a forecast of your own hit rate.

Developers

Use it through the API

Noumen’s API is OpenAI-compatible: any Chat Completions client works with a base URL and a key.

Read the quickstart

curl https://www.noumen.xyz/api/v1/chat/completions \
  -H "Authorization: Bearer $NOUMEN_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "anthracite-org/magnum-v2-72b",
    "messages": [{ "role": "user", "content": "Explain this stack trace." }]
  }'

import os
from openai import OpenAI

client = OpenAI(base_url="https://www.noumen.xyz/api/v1", api_key=os.environ["NOUMEN_API_KEY"])
reply = client.chat.completions.create(
    model="anthracite-org/magnum-v2-72b",
    messages=[{"role": "user", "content": "Explain this stack trace."}],
)
print(reply.choices[0].message.content)

anthracite

Other anthracite models, starting with the same family.