readable AI benchmarks (simplified)

readable AI benchmarks

Alibaba

Qwen3 8B (Reasoning)

reasoning · open weights · Apr 28, 2025

Qwen3 8B (Reasoning) has a Quality Score of 14.4, ranking 491st among 551 scored models. Per 1M tokens, pricing is $0.180 input and $2.10 output. It has a 131,072 token context window. Its Reliability Score is 17.6, ranking 492nd among 553 scored models, below average (total average: 35.6).

Quality Score14.4coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability17.6
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
131,072 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.180
Output
$2.10
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
7.3
Coding
not available
Agentic
not available
Omniscience
-64.7
Correct
13.6%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 92.0%

Correct 13.6%Incorrect 78.4%Partial / not attempted 8.0%

Artificial Analysis benchmarks

GDPval-AA v2
0%
τ³-Banking
5%
SciCode
28%
Humanity’s Last Exam
4%
GPQA Diamond
59%
CritPt
0%
AA-Omniscience
18%
AA-LCR
0%

Similar models

Support me! Patreon