readable AI benchmarks (simplified)

readable AI benchmarks

Meta

Llama 3.2 Instruct 1B

non-reasoning · open weights · Sep 25, 2024

Llama 3.2 Instruct 1B has a Quality Score of 15.0, ranking 482nd among 551 scored models. It has a 128k token context window. Its Reliability Score is 22.6, ranking 422nd among 553 scored models, below average (total average: 35.6).

Quality Score15.0coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability22.6
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
not available
Output
not available
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
4.8
Coding
not available
Agentic
not available
Omniscience
-54.7
Correct
7.0%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 68.7%

Correct 7.0%Incorrect 61.7%Partial / not attempted 31.3%

Artificial Analysis benchmarks

Humanity’s Last Exam
5%
GPQA Diamond
20%
CritPt
0%
AA-Omniscience
23%
AA-LCR
7%

Similar models

Support me! Patreon