readable AI benchmarks (simplified)
NVIDIA
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) has a Quality Score of 18.0, ranking 427th among 551 scored models. It has a 128k token context window. Its Reliability Score is 24.9, ranking 376th among 553 scored models, below average (total average: 35.6).
Quality Score18.0coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability24.9
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 128k tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- not available
- Output
- not available
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 7.3
- Coding
- not available
- Agentic
- not available
- Omniscience
- -50.3
- Correct
- 13.5%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 77.2%
Correct 13.5%Incorrect 63.8%Partial / not attempted 22.8%
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 4%
- GPQA Diamond
- 52%
- CritPt
- 0%
- AA-Omniscience
- 25%
- AA-LCR
- 12%
Similar models
- Llama Nemotron Super 49B v1.5 (Non-reasoning)NVIDIAQuality Score 19.1Value Score not available
- Llama 3.1 Nemotron Instruct 70BNVIDIAQuality Score 20.1Value Score not available
- NVIDIA Nemotron Nano 9B V2 (Non-reasoning)NVIDIAQuality Score 16.0Value Score not available
- NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)NVIDIAQuality Score 12.9Value Score 12.0
- NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)NVIDIAQuality Score 11.4Value Score not available
- Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)NVIDIAQuality Score 19.6Value Score not available