readable AI benchmarks (simplified)

readable AI benchmarks

Meta

Llama 3 Instruct 8B

non-reasoning · open weights · Apr 18, 2024

Llama 3 Instruct 8B has a Quality Score of 11.2, ranking 518th among 551 scored models. Per 1M tokens, pricing is $0.045 input and $0.145 output. It has a 8,192 token context window. Its Reliability Score is 14.9, ranking 513th among 553 scored models, below average (total average: 35.6).

Quality Score11.2coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability14.9
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
8,192 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.045
Output
$0.145
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
4.8
Coding
not available
Agentic
not available
Omniscience
-70.1
Correct
10.4%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 90.8%

Correct 10.4%Incorrect 80.5%Partial / not attempted 9.2%

Artificial Analysis benchmarks

Humanity’s Last Exam
5%
GPQA Diamond
30%
CritPt
0%
AA-Omniscience
15%
AA-LCR
0%

Similar models

Support me! Patreon