readable AI benchmarks

Allen Institute for AI

Olmo 3 7B Think

reasoning · open weights · Nov 20, 2025

Quality Score5.3
Value Scorenot available
Reliability14.1
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
text
Output modalities
text
Context window
65,536 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
not available
Output
not available
Cached Input
not available
Cached Output
not available
Cost per task
not available

Capability

Intelligence
3.6
Coding
not available
Agentic
not available
Omniscience
-71.8
Correct
11.1%
Blended price
not available

Answer outcomes

Correct 11.1%Incorrect 82.9%Abstained 6.0%

Artificial Analysis benchmarks

SciCode
21%
Humanity’s Last Exam
6%
GPQA Diamond
52%
CritPt
0%
AA-Omniscience
14%
AA-LCR
0%

Similar models