readable AI benchmarks (simplified)
Meta
Llama 3.1 Instruct 405B
Llama 3.1 Instruct 405B has a Quality Score of 26.3, ranking 312th among 572 scored models. It has a 128k token context window. Its Reliability Score is 41.5, ranking 224th among 574 scored models, above average (total average: 36.5).
Quality Score26.3coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability41.5
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 128k tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- not available
- Output
- not available
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 7.3
- Coding
- not available
- Agentic
- not available
- Omniscience
- -17.1
- Correct
- 23.2%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 63.5%
Correct 23.2%Incorrect 40.3%Partial / not attempted 36.5%
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 4%
- GPQA Diamond
- 52%
- CritPt
- 0%
- AA-Omniscience
- 41%
- AA-LCR
- 25%
Similar models
- Llama 3.1 Instruct 8BMetaQuality Score 22.6Value Score not available
- Llama 4 MaverickMetaQuality Score 22.2Value Score 17.8
- Llama 3.1 Instruct 70BMetaQuality Score 19.3Value Score not available
- Llama 4 ScoutMetaQuality Score 18.2Value Score not available
- Llama 3.3 Instruct 70BMetaQuality Score 17.4Value Score 12.7
- Llama 3 Instruct 70BMetaQuality Score 15.6Value Score not available