readable AI benchmarks (simplified)
Allen Institute for AI
Olmo 3 7B Instruct
Olmo 3 7B Instruct has a Quality Score of 9.8, ranking 547th among 571 scored models. Per 1M tokens, pricing is $0.100 input and $0.200 output. It has a 65,536 token context window. Its Reliability Score is 11.5, ranking 552nd among 573 scored models, below average (total average: 36.5).
Quality Score9.8coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability11.5
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 65,536 tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- $0.100
- Output
- $0.200
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 5.2
- Coding
- not available
- Agentic
- not available
- Omniscience
- -77.1
- Correct
- 7.4%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 91.9%
Correct 7.4%Incorrect 84.5%Partial / not attempted 8.1%
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 6%
- GPQA Diamond
- 40%
- CritPt
- 0%
- AA-Omniscience
- 11%
- AA-LCR
- 0%
Similar models
- Molmo2-8BAllen Institute for AIQuality Score 11.5Value Score not available
- Olmo 3.1 32B InstructAllen Institute for AIQuality Score 16.9Value Score not available
- Olmo 3 7B ThinkAllen Institute for AIQuality Score 11.4Value Score not available
- Olmo 3 32B ThinkAllen Institute for AIQuality Score 15.5Value Score not available
- Olmo 3.1 32B ThinkAllen Institute for AIQuality Score 19.6Value Score not available
- Molmo 7B-DAllen Institute for AIQuality Score not availableValue Score not available