readable AI benchmarks (simplified)

readable AI benchmarks

Inception

Mercury 2.5

reasoning · closed weights · Sep 8, 2026

Mercury 2.5 does not yet have enough benchmark data for a Quality Score. Per 1M tokens, pricing is $0.200 input, $0.750 output, and $0.020 cached input. It accepts text input, outputs text, and has a 260k token context window.

Quality Scorenot availableQuality unavailable: missing AA Intelligence and AA-Omniscience outcomes
Value Scorenot available
Factual reliabilitynot available
Cache Discount90%

Model specification

Reasoning
reasoning
Input modalities
text
Output modalities
text
Context window
260k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$0.200
Output
$0.750
Cached Input
$0.020
Cache write
not available
Cost per task
not available

Capability

Intelligence
not available
Omniscience (native net)
not available
Correct
not available
Blended price
$0.129

Answer outcomes

Fully graded outcomes (Correct + Incorrect): not available

Omniscience outcome data not available for this model.

Artificial Analysis benchmarks aa-v5

Current Intelligence Index components

AA-Briefcase v1.1
378.5 Elo
AutomationBench-AA
2.4%
private 657-task split from dataset v1.0.6
GDP.pdf
3.6%
Terminal-Bench v4.0
0.0%
AA mini-swe-agent standardized runs · 66 tasks, pass@1 averaged over 3 repeats per task
HLE-Diamond
5.1%

Standalone evaluations

GDPval-AA v2.1
481.8 Elo

Historical evaluations

SciCode v1.0.1
38.5%
AA Long Context Reasoning v1.1
71.7%
Humanity's Last Exam
11.8%
CritPt
0.0%

Similar models

Support me! Patreon