readable AI benchmarks (simplified)

readable AI benchmarks

Google

Gemini 3.7 Flash (High)

reasoning · closed weights · Aug 13, 2026

Gemini 3.7 Flash (High) has a Quality Score of 61.7, ranking 56th among 572 scored models. Per 1M tokens, pricing is $0.750 input, $3.75 output, $0.075 cached input, and $0.750 cache write. It accepts text, image, video, audio, and pdf input, outputs text, and has a 1M token context window. Its Reliability Score is 63.2, ranking 47th among 574 scored models, above average (total average: 36.5). Its Value Score is 46.1, high compared with the total Value average of 31.5.

Quality Score61.7coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score46.1
Factual reliability63.2
Cache Discount90%

Model specification

Reasoning
reasoning
Input modalities
text, image, video, audio, pdf
Output modalities
text
Context window
1M tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$0.750
Output
$3.75
Cached Input
$0.075
Cache write
$0.750
Cost per task
$0.925

Capability

Intelligence
39.1
Coding
not available
Agentic
not available
Omniscience
26.5
Correct
55.3%
Blended price
$0.578

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 84.2%

Correct 55.3%Incorrect 28.8%Partial / not attempted 15.8%

Artificial Analysis benchmarks

GDPval-AA v2
45%
τ³-Banking
33%
SciCode
57%
Humanity’s Last Exam
48%
GPQA Diamond
95%
CritPt
14%
AA-Omniscience
63%
AA-LCR
82%

DeepSWE operational cross-check

Pass@1
65.3%
Avg steps/scored attempt
124.52
Mean cost/scored attempt (USD)
$2.18
Mean output tokens/scored attempt
107,248.303
Mean duration/scored attempt (s)
1245 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Support me! Patreon