readable AI benchmarks (simplified)

readable AI benchmarks

Thinking Machines

Inkling 2 Small

reasoning · closed weights · release date not listed

Inkling 2 Small has a Quality Score of 44.3, ranking 69th among 237 scored models. Per 1M tokens, pricing is $0.300 input, $1.00 output, and $0.030 cached input. It has a 1024k token context window. Its Reliability Score is 58.0, ranking 69th among 244 scored models, above average (total average: 46.4). Its Value Score is 37.7, high compared with the total Value average of 28.3.

Quality Score44.3coverage 100.0%: AA Intelligence and AA-Omniscience outcomes available
Value Score37.7
Factual reliability58.0
Cache Discount90%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
1024k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$0.300
Output
$1.00
Cached Input
$0.030
Cache write
not available
Cost per task
$1.18

Capability

Intelligence
30.6
Omniscience (native net)
16.1
Correct
33.8%
Blended price
$0.181

Answer outcomes

Fully graded outcomes (Correct + Incorrect): 51.4%

Correct 33.8%Incorrect 17.7%Partial / not attempted 48.6%

Artificial Analysis benchmarks aa-v5

Current Intelligence Index components

AA-Briefcase v1.1
1526.9 Elo
AutomationBench-AA
45.6%
private 657-task split from dataset v1.0.6
GDP.pdf
25.2%
FrontierCode v2.0
25.4%
AA Stirrup · 132 tasks, 3 attempts per task
Terminal-Bench v4.0
13.1%
AA mini-swe-agent standardized runs · 66 tasks, pass@1 averaged over 3 repeats per task
AA-Omniscience v1.1
16.1 native net
HLE-Diamond
28.7%
CritPt v2 Hard
35.0%
AA Stirrup · hard subset, 40 of 70 problems
Terminal-Bench-Science v0.1.0
5.7%

Standalone evaluations

GDPval-AA v2.1
1630.2 Elo
τ³-Banking
40.4%

Historical evaluations

SciCode v1.0.1
52.3%
AA Long Context Reasoning v1.1
83.3%
Humanity's Last Exam
44.1%
Terminal-Bench v2.1
81.3%

Similar models

Support me! Patreon