readable AI benchmarks (simplified)
Anthropic
Claude 3.5 Haiku
Claude 3.5 Haiku has a Quality Score of 26.2, ranking 294th among 551 scored models. It has a 200k token context window. Its Reliability Score is 38.7, ranking 231st among 553 scored models, above average (total average: 35.6).
Quality Score26.2coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability38.7
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 200k tokens
- Weights
- closed weights
Token prices USD per 1M tokens
- Input
- not available
- Output
- not available
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 8.9
- Coding
- not available
- Agentic
- not available
- Omniscience
- -22.5
- Correct
- 13.2%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 48.9%
Correct 13.2%Incorrect 35.7%Partial / not attempted 51.1%
Artificial Analysis benchmarks
- GDPval-AA v2
- 0%
- Humanity’s Last Exam
- 4%
- GPQA Diamond
- 41%
- CritPt
- 0%
- AA-Omniscience
- 39%
- AA-LCR
- 27%
Similar models
- Claude 3 HaikuAnthropicQuality Score 17.1Value Score not available
- Claude 3.7 Sonnet (Non-reasoning)AnthropicQuality Score 34.3Value Score 21.7
- Claude 4.5 Haiku (Non-reasoning)AnthropicQuality Score 35.0Value Score 25.2
- Claude 4 Sonnet (Non-reasoning)AnthropicQuality Score 35.5Value Score not available
- Claude 4.5 Sonnet (Non-reasoning)AnthropicQuality Score 37.5Value Score 23.8
- Claude Sonnet 4.6 (Non-reasoning, Low Effort)AnthropicQuality Score 42.4Value Score 26.8