readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

GPT-6.1 Sol (Medium)

reasoning · closed weights · release date not listed

GPT-6.1 Sol (Medium) has a Quality Score of 58.2, ranking 40th among 283 scored models. Per 1M tokens, pricing is $2.00 input, $10.00 output, $0.100 cached input, and $2.50 cache write. It has a 1M token context window. Its Reliability Score is 70.1, ranking 34th among 288 scored models, above average (total average: 48.2). Its Value Score is 38.9, high compared with the total Value average of 29.3.

Quality Score58.2coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score38.9
Factual reliability70.1
Cache Discount95%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
1M tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$2.00
Output
$10.00
Cached Input
$0.100
Cache write
$2.50
Cost per task
$0.359

Capability

Intelligence
46.3
Omniscience (native net)
40.2
Correct
59.6%
Blended price
$1.47

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 79.0%

Correct 59.6%Incorrect 19.4%Partial / not attempted 21.0%

Artificial Analysis benchmarks aa-v5

Current Intelligence Index components

AA-Briefcase v1.1
1360.6 Elo
AutomationBench-AA
62.6%
private 657-task split from dataset v1.0.6
GDP.pdf
30.0%
FrontierCode v2.0
33.4%
AA Stirrup · 132 tasks, 3 attempts per task
Terminal-Bench v4.0
48.0%
AA mini-swe-agent standardized runs · 66 tasks, pass@1 averaged over 3 repeats per task
AA-Omniscience v1.1
40.2 native net
HLE-Diamond
46.0%
CritPt v2 Hard
67.0%
AA Stirrup · hard subset, 40 of 70 problems
Terminal-Bench-Science v0.1.0
37.1%

Standalone evaluations

GDPval-AA v2.1
1463.1 Elo

Historical evaluations

SciCode v1.0.1
53.2%
AA Long Context Reasoning v1.1
83.3%
Humanity's Last Exam
49.9%
CritPt
27.7%
FrontierCode
43.3%

Similar models

Support me! Patreon