readable AI benchmarks (simplified)
Anthropic
Claude 3.7 Sonnet (Reasoning)
Claude 3.7 Sonnet (Reasoning) has a Quality Score of 33.7, ranking 133rd among 239 scored models. It has a 200k token context window. Its Reliability Score is 49.6, ranking 111th among 246 scored models, above average (total average: 46.4).
Quality Score33.7coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability49.6
Cache Discountnot available
Model specification
- Reasoning
- reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 200k tokens
- Weights
- closed weights
Token prices USD per 1M tokens
- Input
- not available
- Output
- not available
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 17.7
- Omniscience (native net)
- -0.7
- Correct
- 28.0%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 56.8%
Correct 28.0%Incorrect 28.8%Partial / not attempted 43.2%
Artificial Analysis benchmarks legacy records
- Humanity’s Last Exam
- 10%
- GPQA Diamond
- 77%
- CritPt
- 1%
Similar models
- Claude 4 Sonnet (Reasoning)AnthropicQuality Score 34.5Value Score not available
- Claude Haiku 5.5 (Low)AnthropicQuality Score 34.9Value Score 31.9
- Claude 4.5 Haiku (Reasoning)AnthropicQuality Score 32.3Value Score 23.4
- Claude 4.5 Sonnet (Reasoning)AnthropicQuality Score 35.3Value Score 22.3
- Claude Sonnet 5 (Low)AnthropicQuality Score 35.1Value Score 23.3
- Claude Haiku 5.5 (Medium)AnthropicQuality Score 38.3Value Score 35.1