readable AI benchmarks (simplified)

readable AI benchmarks

DeepSeek

DeepSeek R1 Distill Llama 70B

reasoning · open weights · Jan 20, 2025

DeepSeek R1 Distill Llama 70B has a Quality Score of 19.5, ranking 398th among 551 scored models. Per 1M tokens, pricing is $0.700 input and $1.10 output. It has a 128k token context window. Its Reliability Score is 26.8, ranking 347th among 553 scored models, below average (total average: 35.6).

Quality Score19.5coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability26.8
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.700
Output
$1.10
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
7.9
Coding
not available
Agentic
not available
Omniscience
-46.4
Correct
19.2%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 84.7%

Correct 19.2%Incorrect 65.5%Partial / not attempted 15.3%

Artificial Analysis benchmarks

Humanity’s Last Exam
5%
GPQA Diamond
40%
CritPt
0%
AA-Omniscience
27%
AA-LCR
10%

Similar models

Support me! Patreon