readable AI benchmarks (simplified)
Allen Institute for AI
Llama 3.1 Tulu3 405B
Llama 3.1 Tulu3 405B does not yet have enough benchmark data for a Quality Score. It has a 128k token context window.
Quality Scorenot availableQuality unavailable: missing AA-Omniscience outcomes
Value Scorenot available
Factual reliabilitynot available
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 128k tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- not available
- Output
- not available
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 7.2
- Coding
- not available
- Agentic
- not available
- Omniscience
- not available
- Correct
- not available
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): not available
Omniscience outcome data not available for this model.
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 3%
- GPQA Diamond
- 52%
Similar models
- Olmo 3.1 32B InstructAllen Institute for AIQuality Score 16.9Value Score not available
- OLMo 2 32BAllen Institute for AIQuality Score not availableValue Score not available
- OLMo 2 7BAllen Institute for AIQuality Score not availableValue Score not available
- Molmo 7B-DAllen Institute for AIQuality Score not availableValue Score not available
- Olmo 3 7B InstructAllen Institute for AIQuality Score 9.8Value Score not available
- Molmo2-8BAllen Institute for AIQuality Score 11.5Value Score not available