readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

o3

reasoning · closed weights · Apr 16, 2025

o3 has a Quality Score of 36.7, ranking 218th among 571 scored models. Per 1M tokens, pricing is $2.00 input, $8.00 output, and $0.500 cached input. It accepts text, image, and pdf input, outputs text, and has a 200k token context window. Its Reliability Score is 42.2, ranking 216th among 573 scored models, above average (total average: 36.5). Its Value Score is 24.3, low compared with the total Value average of 31.4.

Quality Score36.7coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score24.3
Factual reliability42.2
Cache Discount75%

Model specification

Reasoning
reasoning
Input modalities
text, image, pdf
Output modalities
text
Context window
200k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$2.00
Output
$8.00
Cached Input
$0.500
Cache write
not available
Cost per task
not available

Capability

Intelligence
20.2
Coding
not available
Agentic
not available
Omniscience
-15.6
Correct
38.6%
Blended price
$1.55

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 92.7%

Correct 38.6%Incorrect 54.1%Partial / not attempted 7.3%

Artificial Analysis benchmarks

Humanity’s Last Exam
20%
GPQA Diamond
83%
CritPt
1%
AA-Omniscience
42%
AA-LCR
75%

Similar models

Support me! Patreon