readable AI benchmarks (simplified)

readable AI benchmarks

DeepSeek

DeepSeek V4 Flash 0731 (Max)

reasoning · open weights · Jul 31, 2026

DeepSeek V4 Flash 0731 (Max) has a Quality Score of 47.8, ranking 121st among 571 scored models. Per 1M tokens, pricing is $0.440 input, $1.32 output, and $0.014 cached input. It accepts text input, outputs text, and has a 1M token context window. Its Reliability Score is 42.9, ranking 210th among 573 scored models, above average (total average: 36.5). Its Value Score is 39.7, high compared with the total Value average of 31.4.

Quality Score47.8coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score39.7
Factual reliability42.9
Cache Discount97%

Model specification

Reasoning
reasoning
Input modalities
text
Output modalities
text
Context window
1M tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.440
Output
$1.32
Cached Input
$0.014
Cache write
not available
Cost per task
$0.220

Capability

Intelligence
34.3
Coding
not available
Agentic
not available
Omniscience
-14.3
Correct
40.4%
Blended price
$0.230

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 95.0%

Correct 40.4%Incorrect 54.7%Partial / not attempted 5.0%

Artificial Analysis benchmarks

GDPval-AA v2
47%
τ³-Banking
39%
SciCode
50%
Humanity’s Last Exam
39%
GPQA Diamond
91%
CritPt
17%
AA-Omniscience
43%
AA-LCR
80%

DeepSWE operational cross-check

Pass@1
53.3%
Avg steps/scored attempt
152.88
Mean cost/scored attempt (USD)
$0.100
Mean output tokens/scored attempt
107,687.022
Mean duration/scored attempt (s)
1439 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Support me! Patreon