readable AI benchmarks

Meta

Llama 3.1 Instruct 405B

non-reasoning · open weights · Jul 23, 2024

Quality Score21.4
Value Scorenot available
Reliability41.5
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
text
Output modalities
text
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
not available
Output
not available
Cached Input
not available
Cached Output
not available
Cost per task
not available

Capability

Intelligence
8.3
Coding
not available
Agentic
not available
Omniscience
-17.1
Correct
23.2%
Blended price
not available

Answer outcomes

Correct 23.2%Incorrect 40.3%Abstained 36.5%

Artificial Analysis benchmarks

SciCode
30%
Humanity’s Last Exam
4%
GPQA Diamond
52%
CritPt
0%
AA-Omniscience
41%
AA-LCR
25%

Similar models