readable AI benchmarks (simplified)

readable AI benchmarks

Google

Gemma 3 27B Instruct

non-reasoning · open weights · Mar 12, 2025

Gemma 3 27B Instruct has a Quality Score of 11.9, ranking 513th among 551 scored models. Per 1M tokens, pricing is $0.0000 input and $0.0000 output. It has a 128k token context window. Its Reliability Score is 16.4, ranking 503rd among 553 scored models, below average (total average: 35.6).

Quality Score11.9coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability16.4
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.0000
Output
$0.0000
Cached Input
not available
Cache write
not available
Cost per task
$0.0000

Capability

Intelligence
4.9
Coding
not available
Agentic
not available
Omniscience
-67.2
Correct
13.0%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 93.1%

Correct 13.0%Incorrect 80.2%Partial / not attempted 6.9%

Artificial Analysis benchmarks

GDPval-AA v2
0%
τ³-Banking
1%
SciCode
23%
Humanity’s Last Exam
4%
GPQA Diamond
43%
CritPt
0%
AA-Omniscience
16%
AA-LCR
7%

Similar models

Support me! Patreon