readable AI benchmarks (simplified)

readable AI benchmarks

Mistral

Devstral Small 2

non-reasoning · open weights · Dec 9, 2025

Devstral Small 2 has a Quality Score of 16.4, ranking 473rd among 571 scored models. It accepts text and image input, outputs text, and has a 256k token context window. Its Reliability Score is 21.1, ranking 459th among 573 scored models, below average (total average: 36.5).

Quality Score16.4coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability21.1
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
text, image
Output modalities
text
Context window
256k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
not available
Output
not available
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
7.5
Coding
not available
Agentic
not available
Omniscience
-57.7
Correct
15.8%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 89.3%

Correct 15.8%Incorrect 73.5%Partial / not attempted 10.7%

Artificial Analysis benchmarks

GDPval-AA v2
2%
τ³-Banking
11%
SciCode
32%
Humanity’s Last Exam
3%
GPQA Diamond
53%
CritPt
0%
AA-Omniscience
21%
AA-LCR
28%

Similar models

Support me! Patreon