readable AI benchmarks (simplified)

readable AI benchmarks

Google

Gemma 3 27B Instruct

non-reasoning · open weights · release date not listed

Gemma 3 27B Instruct has a Quality Score of 10.6, ranking 230th among 238 scored models. Per 1M tokens, pricing is $0.0000 input and $0.0000 output. It has a 128k token context window. Its Reliability Score is 16.4, ranking 235th among 245 scored models, below average (total average: 46.4).

Quality Score10.6coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability16.4
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.0000
Output
$0.0000
Cached Input
not available
Cache write
not available
Cost per task
$0.0000

Capability

Intelligence
4.9
Omniscience (native net)
-67.2
Correct
13.0%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 93.1%

Correct 13.0%Incorrect 80.2%Partial / not attempted 6.9%

Artificial Analysis benchmarks legacy records

Legacy GDPval-AA (normalized)
0%
τ³-Banking
1%
SciCode
23%
Humanity’s Last Exam
4%
GPQA Diamond
43%
CritPt
0%
AA-LCR
7%

Similar models

Support me! Patreon