readable AI benchmarks (simplified)

readable AI benchmarks

Nous Research

Hermes 4 - Llama-3.1 405B (Reasoning)

reasoning · open weights · release date not listed

Hermes 4 - Llama-3.1 405B (Reasoning) has a Quality Score of 21.8, ranking 367th among 571 scored models. Per 1M tokens, pricing is $1.00 input and $3.00 output. It has a 128k token context window. Its Reliability Score is 32.0, ranking 305th among 573 scored models, below average (total average: 36.5).

Quality Score21.8coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability32.0
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$1.00
Output
$3.00
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
7.5
Coding
not available
Agentic
not available
Omniscience
-36.0
Correct
30.1%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 96.2%

Correct 30.1%Incorrect 66.1%Partial / not attempted 3.8%

Artificial Analysis benchmarks

Humanity’s Last Exam
11%
GPQA Diamond
73%
CritPt
0%
AA-Omniscience
32%
AA-LCR
22%

Similar models

Support me! Patreon