readable AI benchmarks (simplified)

readable AI benchmarks

Anthropic

Claude 3.7 Sonnet (Non-reasoning)

non-reasoning · closed weights · Feb 24, 2025

Claude 3.7 Sonnet (Non-reasoning) has a Quality Score of 34.3, ranking 218th among 553 scored models. Per 1M tokens, pricing is $3.00 input, $15.00 output, $0.300 cached input, and $3.75 cache write. It has a 200k token context window. Its Reliability Score is 45.1, ranking 165th among 555 scored models, above average (total average: 35.7). Its Value Score is 21.7, low compared with the total Value average of 30.7.

Quality Score34.3coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score21.7
Factual reliability45.1
Cache Discount90%

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
200k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$3.00
Output
$15.00
Cached Input
$0.300
Cache write
$3.75
Cost per task
not available

Capability

Intelligence
15.3
Coding
not available
Agentic
not available
Omniscience
-9.7
Correct
28.2%
Blended price
$2.31

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 66.1%

Correct 28.2%Incorrect 37.9%Partial / not attempted 33.9%

Artificial Analysis benchmarks

Humanity’s Last Exam
4%
GPQA Diamond
66%
CritPt
0%
AA-Omniscience
45%
AA-LCR
52%

Similar models

Support me! Patreon