readable AI benchmarks

Meta

Llama 3.2 Instruct 11B (Vision)

non-reasoning · open weights · Sep 25, 2024

Quality Score5.6
Value Score4.7
Reliability18.7
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
text, image
Output modalities
text
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.345
Output
$0.345
Cached Input
not available
Cached Output
not available
Cost per task
not available

Capability

Intelligence
3.0
Coding
not available
Agentic
not available
Omniscience
-62.6
Correct
10.6%
Blended price
$0.345

Answer outcomes

Correct 10.6%Incorrect 73.2%Abstained 16.2%

Artificial Analysis benchmarks

SciCode
11%
Humanity’s Last Exam
6%
GPQA Diamond
22%
CritPt
0%
AA-Omniscience
19%
AA-LCR
16%

Similar models