readable AI benchmarks (simplified)
Allen Institute for AI
Olmo 3.1 32B Think
Olmo 3.1 32B Think has a Quality Score of 19.6, ranking 412th among 572 scored models. Per 1M tokens, pricing is $0.0000 input and $0.0000 output. It has a 65,500 token context window. Its Reliability Score is 28.3, ranking 347th among 574 scored models, below average (total average: 36.5).
Quality Score19.6coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability28.3
Cache Discountnot available
Model specification
- Reasoning
- reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 65,500 tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- $0.0000
- Output
- $0.0000
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 7.1
- Coding
- not available
- Agentic
- not available
- Omniscience
- -43.4
- Correct
- 13.8%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 70.9%
Correct 13.8%Incorrect 57.1%Partial / not attempted 29.1%
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 6%
- GPQA Diamond
- 59%
- CritPt
- 0%
- AA-Omniscience
- 28%
- AA-LCR
- 0%
Similar models
- Olmo 3 32B ThinkAllen Institute for AIQuality Score 15.5Value Score not available
- Olmo 3 7B ThinkAllen Institute for AIQuality Score 11.4Value Score not available
- Olmo 3.1 32B InstructAllen Institute for AIQuality Score 16.9Value Score not available
- Molmo2-8BAllen Institute for AIQuality Score 11.5Value Score not available
- Olmo 3 7B InstructAllen Institute for AIQuality Score 9.8Value Score not available
- Llama 3.1 Tulu3 405BAllen Institute for AIQuality Score not availableValue Score not available