readable AI benchmarks (simplified)

readable AI benchmarks

Meta

Llama 3.1 Instruct 70B

non-reasoning · open weights · Jul 23, 2024

Llama 3.1 Instruct 70B has a Quality Score of 19.3, ranking 403rd among 551 scored models. Per 1M tokens, pricing is $0.560 input and $0.560 output. It has a 128k token context window. Its Reliability Score is 28.4, ranking 326th among 553 scored models, below average (total average: 35.6).

Quality Score19.3coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability28.4
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.560
Output
$0.560
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
6.6
Coding
not available
Agentic
not available
Omniscience
-43.1
Correct
19.7%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 82.5%

Correct 19.7%Incorrect 62.8%Partial / not attempted 17.5%

Artificial Analysis benchmarks

Humanity’s Last Exam
4%
GPQA Diamond
41%
CritPt
0%
AA-Omniscience
28%

Similar models

Support me! Patreon