readable AI benchmarks

Allen Institute for AI

Olmo 3 7B Instruct

non-reasoning · open weights · Nov 20, 2025

Quality Score3.4
Value Score3.8
Reliability11.5
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
text
Output modalities
text
Context window
65,536 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.100
Output
$0.200
Cached Input
not available
Cached Output
not available
Cost per task
not available

Capability

Intelligence
2.4
Coding
not available
Agentic
not available
Omniscience
-77.1
Correct
7.4%
Blended price
$0.110

Answer outcomes

Correct 7.4%Incorrect 84.5%Abstained 8.1%

Artificial Analysis benchmarks

SciCode
10%
Humanity’s Last Exam
6%
GPQA Diamond
40%
CritPt
0%
AA-Omniscience
11%
AA-LCR
0%

Similar models