readable AI benchmarks (simplified)

readable AI benchmarks

GPT-6 Astra (Low) has a Quality Score of 70.4, ranking 24th among 398 scored models. Per 1M tokens, pricing is $10.00 input, $50.00 output, $1.00 cached input, and $12.50 cache write. It has a 1M token context window. Its Reliability Score is 70.3, ranking 15th among 399 scored models, above average (total average: 38.0). Its Value Score is 38.9, high compared with the total Value average of 33.2.

Quality Score70.4coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available

Value Score38.9

Factual reliability70.3

Cache Discount90%

Model specification

Reasoning: reasoning
Input modalities: none
Output modalities: none
Context window: 1M tokens
Weights: closed weights

Token prices USD per 1M tokens

Input: $10.00
Output: $50.00
Cached Input: $1.00
Cache write: $12.50
Cost per task: $0.818

Capability

Intelligence: 45.8
Coding: not available
Agentic: not available
Omniscience: 40.5
Correct: 59.5%
Blended price: $7.70

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 78.5%

Correct 59.5%Incorrect 19.0%Partial / not attempted 21.5%

Artificial Analysis benchmarks

GDPval-AA v2: 44%
τ³-Banking: 32%
SciCode: 54%
Humanity’s Last Exam: 49%
GPQA Diamond: 93%
CritPt: 26%
AA-Omniscience: 70%
AA-LCR: 80%

DeepSWE operational cross-check

Pass@1: 67.0%
Avg steps/scored attempt: 19.54
Mean cost/scored attempt (USD): $1.60
Mean output tokens/scored attempt: 10,579.54
Mean duration/scored attempt (s): 613 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Graph Open on Artificial Analysis