readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

o3-mini (high)

reasoning · closed weights · Jan 31, 2025

o3-mini (high) has a Quality Score of 22.8, ranking 330th among 551 scored models. Per 1M tokens, pricing is $1.10 input, $4.40 output, and $0.550 cached input. It has a 200k token context window. Its Reliability Score is 28.7, ranking 322nd among 553 scored models, below average (total average: 35.6). Its Value Score is 15.9, low compared with the total Value average of 30.7.

Quality Score22.8coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score15.9
Factual reliability28.7
Cache Discount50%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
200k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$1.10
Output
$4.40
Cached Input
$0.550
Cache write
not available
Cost per task
not available

Capability

Intelligence
11.0
Coding
not available
Agentic
not available
Omniscience
-42.6
Correct
21.3%
Blended price
$1.05

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 85.1%

Correct 21.3%Incorrect 63.8%Partial / not attempted 14.9%

Artificial Analysis benchmarks

GDPval-AA v2
0%
τ³-Banking
5%
SciCode
43%
Humanity’s Last Exam
12%
GPQA Diamond
77%
CritPt
0%
AA-Omniscience
29%
AA-LCR
43%

Similar models

Support me! Patreon