readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

GPT-4o (Nov '24)

non-reasoning · closed weights · Nov 20, 2024

GPT-4o (Nov '24) has a Quality Score of 28.9, ranking 259th among 551 scored models. Per 1M tokens, pricing is $2.50 input, $10.00 output, and $1.50 cached input. It accepts text, image, and pdf input, outputs text, and has a 128k token context window. Its Reliability Score is 44.7, ranking 170th among 553 scored models, above average (total average: 35.6). Its Value Score is 18.1, low compared with the total Value average of 30.7.

Quality Score28.9coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score18.1
Factual reliability44.7
Cache Discount40%

Model specification

Reasoning
non-reasoning
Input modalities
text, image, pdf
Output modalities
text
Context window
128k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$2.50
Output
$10.00
Cached Input
$1.50
Cache write
not available
Cost per task
not available

Capability

Intelligence
8.4
Coding
not available
Agentic
not available
Omniscience
-10.5
Correct
19.9%
Blended price
$2.55

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 50.2%

Correct 19.9%Incorrect 30.4%Partial / not attempted 49.8%

Artificial Analysis benchmarks

Humanity’s Last Exam
2%
GPQA Diamond
54%
CritPt
0%
AA-Omniscience
45%
AA-LCR
49%

Similar models

Support me! Patreon