readable AI benchmarks (simplified)

readable AI benchmarks

Alibaba

Qwen3.8 Max (0902)

reasoning · closed weights · Aug 3, 2026

Qwen3.8 Max (0902) has a Quality Score of 62.9, ranking 48th among 572 scored models. Per 1M tokens, pricing is $2.00 input, $6.00 output, and $0.250 cached input. It accepts text, image, video, and pdf input, outputs text, and has a 983,616 token context window. Its Reliability Score is 56.0, ranking 88th among 574 scored models, above average (total average: 36.5). Its Value Score is 43.2, high compared with the total Value average of 31.5.

Quality Score62.9coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score43.2
Factual reliability56.0
Cache Discount88%

Model specification

Reasoning
reasoning
Input modalities
text, image, video, pdf
Output modalities
text
Context window
983,616 tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$2.00
Output
$6.00
Cached Input
$0.250
Cache write
not available
Cost per task
$5.41

Capability

Intelligence
45.4
Coding
not available
Agentic
not available
Omniscience
12.0
Correct
31.7%
Blended price
$1.18

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 51.4%

Correct 31.7%Incorrect 19.7%Partial / not attempted 48.6%

Artificial Analysis benchmarks

GDPval-AA v2
59%
τ³-Banking
48%
SciCode
52%
Humanity’s Last Exam
43%
GPQA Diamond
93%
CritPt
18%
AA-Omniscience
56%
AA-LCR
80%

DeepSWE operational cross-check

Pass@1
57.5%
Avg steps/scored attempt
111.34
Mean cost/scored attempt (USD)
$3.73
Mean output tokens/scored attempt
95,075.183
Mean duration/scored attempt (s)
2567 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Support me! Patreon