readable AI benchmarks (simplified)
Nous Research
Hermes 4 - Llama-3.1 405B (Non-reasoning)
Hermes 4 - Llama-3.1 405B (Non-reasoning) has a Quality Score of 22.4, ranking 360th among 577 scored models. Per 1M tokens, pricing is $1.00 input and $3.00 output. It has a 128k token context window. Its Reliability Score is 33.4, ranking 300th among 579 scored models, below average (total average: 36.6).
Quality Score22.4coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability33.4
Cache Discountnot available
Model specification
- Reasoning
- non-reasoning
- Input modalities
- none
- Output modalities
- none
- Context window
- 128k tokens
- Weights
- open weights
Token prices USD per 1M tokens
- Input
- $1.00
- Output
- $3.00
- Cached Input
- not available
- Cache write
- not available
- Cost per task
- not available
Capability
- Intelligence
- 7.4
- Coding
- not available
- Agentic
- not available
- Omniscience
- -33.3
- Correct
- 26.1%
- Blended price
- not available
Answer outcomes
Fully graded outcomes (Correct + Incorrect): 85.4%
Correct 26.1%Incorrect 59.3%Partial / not attempted 14.6%
Artificial Analysis benchmarks
- Humanity’s Last Exam
- 4%
- GPQA Diamond
- 54%
- CritPt
- 0%
- AA-Omniscience
- 33%
- AA-LCR
- 22%
Similar models
- Hermes 4 - Llama-3.1 70B (Non-reasoning)Nous ResearchQuality Score 18.0Value Score not available
- Hermes 4 - Llama-3.1 405B (Reasoning)Nous ResearchQuality Score 21.8Value Score not available
- Hermes 4 - Llama-3.1 70B (Reasoning)Nous ResearchQuality Score 18.7Value Score not available
- DeepHermes 3 - Mistral 24B Preview (Non-reasoning)Nous ResearchQuality Score not availableValue Score not available
- Hermes 3 - Llama-3.1 70BNous ResearchQuality Score not availableValue Score not available
- DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)Nous ResearchQuality Score not availableValue Score not available