readable AI benchmarks (simplified)

readable AI benchmarks

Mistral

Mistral 7B Instruct

non-reasoning · open weights · Sep 27, 2023

Mistral 7B Instruct has a Quality Score of 12.6, ranking 508th among 551 scored models. Per 1M tokens, pricing is $0.150 input and $0.200 output. It has a 8,192 token context window. Its Reliability Score is 17.5, ranking 493rd among 553 scored models, below average (total average: 35.6).

Quality Score12.6coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability17.5
Cache Discountnot available

Model specification

Reasoning
non-reasoning
Input modalities
none
Output modalities
none
Context window
8,192 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.150
Output
$0.200
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
5.0
Coding
not available
Agentic
not available
Omniscience
-64.9
Correct
9.0%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 83.0%

Correct 9.0%Incorrect 73.9%Partial / not attempted 17.0%

Artificial Analysis benchmarks

Humanity’s Last Exam
5%
GPQA Diamond
18%
CritPt
0%
AA-Omniscience
18%
AA-LCR
0%

Similar models

Support me! Patreon