readable AI benchmarks (simplified)

readable AI benchmarks

Alibaba

Qwen3 235B A22B 2507 (Reasoning)

reasoning · open weights · Jul 25, 2025

Qwen3 235B A22B 2507 (Reasoning) has a Quality Score of 23.1, ranking 328th among 551 scored models. Per 1M tokens, pricing is $0.230 input and $2.30 output. It has a 256k token context window. Its Reliability Score is 26.7, ranking 348th among 553 scored models, below average (total average: 35.6).

Quality Score23.1coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability26.7
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
256k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.230
Output
$2.30
Cached Input
not available
Cache write
not available
Cost per task
$0.081

Capability

Intelligence
12.7
Coding
not available
Agentic
not available
Omniscience
-46.5
Correct
22.8%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 92.2%

Correct 22.8%Incorrect 69.3%Partial / not attempted 7.9%

Artificial Analysis benchmarks

GDPval-AA v2
0%
τ³-Banking
8%
SciCode
41%
Humanity’s Last Exam
16%
GPQA Diamond
79%
CritPt
0%
AA-Omniscience
27%
AA-LCR
72%

Similar models

Support me! Patreon