readable AI benchmarks (simplified)

readable AI benchmarks

Google

Gemma 4 12B (Non-reasoning)

non-reasoning · open weights · release date not listed

Gemma 4 12B (Non-reasoning) has a Quality Score of 19.0, ranking 432nd among 577 scored models. Per 1M tokens, pricing is $0.100 input and $0.300 output. It has a 262,144 token context window. Its Reliability Score is 23.6, ranking 429th among 579 scored models, below average (total average: 36.6).

Quality Score19.0coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability23.6
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
262,144 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.100
Output
$0.300
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
9.4
Coding
not available
Agentic
not available
Omniscience
-52.8
Correct
11.9%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 76.6%

Correct 11.9%Incorrect 64.7%Partial / not attempted 23.4%

Artificial Analysis benchmarks

Humanity’s Last Exam
6%
GPQA Diamond
66%
CritPt
0%
AA-Omniscience
24%
AA-LCR
35%

Similar models

Support me! Patreon