readable AI benchmarks (simplified)

readable AI benchmarks

NVIDIA

Llama 3.3 Nemotron Super 49B v1 (Reasoning)

reasoning · open weights · release date not listed

Llama 3.3 Nemotron Super 49B v1 (Reasoning) has a Quality Score of 14.9, ranking 218th among 238 scored models. It has a 128k token context window. Its Reliability Score is 20.9, ranking 229th among 245 scored models, below average (total average: 46.4).

Quality Score14.9coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability20.9
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
not available
Output
not available
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
8.9
Omniscience (native net)
-58.3
Correct
17.1%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 92.5%

Correct 17.1%Incorrect 75.4%Partial / not attempted 7.5%

Artificial Analysis benchmarks legacy records

Humanity’s Last Exam
6%
GPQA Diamond
64%
CritPt
0%
AA-LCR
18%

Similar models

Support me! Patreon