readable AI benchmarks (simplified)

readable AI benchmarks

Sarvam

Sarvam M (Reasoning, based on Mistral Small 3.1)

reasoning · open weights · May 23, 2025

Sarvam M (Reasoning, based on Mistral Small 3.1) has a Quality Score of 13.7, ranking 497th among 551 scored models. Per 1M tokens, pricing is $0.0000 input and $0.0000 output. It has a 32,768 token context window. Its Reliability Score is 19.2, ranking 468th among 553 scored models, below average (total average: 35.6).

Quality Score13.7coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Scorenot available
Factual reliability19.2
Cache Discountnot available

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
32,768 tokens
Weights
open weights

Token prices USD per 1M tokens

Input
$0.0000
Output
$0.0000
Cached Input
not available
Cache write
not available
Cost per task
not available

Capability

Intelligence
5.3
Coding
not available
Agentic
not available
Omniscience
-61.6
Correct
15.2%
Blended price
not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 92.1%

Correct 15.2%Incorrect 76.8%Partial / not attempted 7.9%

Artificial Analysis benchmarks

Humanity’s Last Exam
3%
GPQA Diamond
42%
CritPt
0%
AA-Omniscience
19%
AA-LCR
0%

Similar models

Support me! Patreon