readable AI benchmarks (simplified)

readable AI benchmarks

Meta

Llama 3.2 Instruct 11B (Vision)

non-reasoning · open weights · Sep 25, 2024

Llama 3.2 Instruct 11B (Vision) has a Quality Score of 13.5, ranking 521st among 572 scored models. Per 1M tokens, pricing is $0.345 input and $0.345 output. It has a 128k token context window. Its Reliability Score is 18.7, ranking 497th among 574 scored models, below average (total average: 36.5).

Quality Score13.5coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability18.7
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.345
Output
$0.345
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
5.4
Coding
not available
Agentic
not available
Omniscience
-62.6
Correct
10.6%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 83.8%

Correct 10.6%Incorrect 73.2%Partial / not attempted 16.2%

Artificial Analysis benchmarks

Humanity’s Last Exam
6%
GPQA Diamond
22%
CritPt
0%
AA-Omniscience
19%
AA-LCR
13%

Similar models

Support me! Patreon