readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

GPT-6.1 Sol (Xhigh)

reasoning · closed weights · release date not listed

GPT-6.1 Sol (Xhigh) has a Quality Score of 61.8, ranking 26th among 283 scored models. Per 1M tokens, pricing is $2.00 input, $10.00 output, $0.100 cached input, and $2.50 cache write. It has a 1M token context window. Its Reliability Score is 71.2, ranking 26th among 288 scored models, above average (total average: 48.2). Its Value Score is 41.3, high compared with the total Value average of 29.3.

Quality Score61.8coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score41.3
Factual reliability71.2
Cache Discount95%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
1M tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$2.00
Output
$10.00
Cached Input
$0.100
Cache write
$2.50
Cost per task
$0.764

Capability

Intelligence
52.5
Omniscience (native net)
42.4
Correct
61.1%
Blended price
$1.47

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 79.8%

Correct 61.1%Incorrect 18.7%Partial / not attempted 20.2%

Artificial Analysis benchmarks aa-v5

Current Intelligence Index components

AA-Briefcase v1.1
1504.4 Elo
AutomationBench-AA
66.6%
private 657-task split from dataset v1.0.6
GDP.pdf
31.8%
FrontierCode v2.0
38.5%
AA Stirrup · 132 tasks, 3 attempts per task
Terminal-Bench v4.0
54.0%
AA mini-swe-agent standardized runs · 66 tasks, pass@1 averaged over 3 repeats per task
AA-Omniscience v1.1
42.4 native net
HLE-Diamond
55.8%
CritPt v2 Hard
69.5%
AA Stirrup · hard subset, 40 of 70 problems
Terminal-Bench-Science v0.1.0
50.5%

Standalone evaluations

GDPval-AA v2.1
1562.6 Elo

Historical evaluations

SciCode v1.0.1
55.7%
AA Long Context Reasoning v1.1
79.7%
Humanity's Last Exam
52.6%
CritPt
31.7%
FrontierCode
46.3%

Similar models

Support me! Patreon