readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

GPT-5.6 Sol (Medium)

reasoning · closed weights · release date not listed

GPT-5.6 Sol (Medium) has a Quality Score of 60.0, ranking 61st among 577 scored models. Per 1M tokens, pricing is $4.00 input, $20.00 output, $0.400 cached input, and $5.00 cache write. It has a 1M token context window. Its Reliability Score is 59.7, ranking 68th among 579 scored models, above average (total average: 36.6). Its Value Score is 36.7, high compared with the total Value average of 31.8.

Quality Score60.0coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score36.7
Factual reliability59.7
Cache Discount90%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
1M tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$4.00
Output
$20.00
Cached Input
$0.400
Cache write
$5.00
Cost per task
$0.505

Capability

Intelligence
39.2
Coding
not available
Agentic
not available
Omniscience
19.4
Correct
57.8%
Blended price
$3.08

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 96.1%

Correct 57.8%Incorrect 38.4%Partial / not attempted 3.9%

Artificial Analysis benchmarks

GDPval-AA v2
46%
τ³-Banking
36%
SciCode
57%
Humanity’s Last Exam
42%
GPQA Diamond
93%
CritPt
23%
AA-Omniscience
60%
AA-LCR
80%

DeepSWE operational cross-check

Pass@1
61.1%
Avg steps/scored attempt
30.91
Mean cost/scored attempt (USD)
$1.86
Mean output tokens/scored attempt
18,425.217
Mean duration/scored attempt (s)
423 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Support me! Patreon