readable AI benchmarks (simplified)

readable AI benchmarks

StepFun

Step 3.5 Flash

reasoning · open weights · Feb 2, 2026

Step 3.5 Flash has a Quality Score of 27.3, ranking 283rd among 551 scored models. Per 1M tokens, pricing is $0.100 input, $0.300 output, and $0.020 cached input. It accepts text input, outputs text, and has a 256k token context window. Its Reliability Score is 29.1, ranking 314th among 553 scored models, below average (total average: 35.6). Its Value Score is 25.3, low compared with the total Value average of 30.7.

Quality Score27.3coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score25.3
Factual reliability29.1
Cache Discount80%

Model specification

Reasoning
reasoning
Input modalities
text
Output modalities
text
Context window
256k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.100
Output
$0.300
Cached Input
$0.020
Cache write
not available
Cost per task
not available

Capability

Intelligence
16.6
Coding
not available
Agentic
not available
Omniscience
-41.8
Correct
23.6%
Blended price
$0.064

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 89.0%

Correct 23.6%Incorrect 65.4%Partial / not attempted 11.0%

Artificial Analysis benchmarks

Humanity’s Last Exam
21%
GPQA Diamond
83%
CritPt
2%
AA-Omniscience
29%
AA-LCR
50%

Similar models

Support me! Patreon