readable AI benchmarks (simplified)

readable AI benchmarks

OpenAI

o1-preview

reasoning · closed weights · Sep 12, 2024

o1-preview does not yet have enough benchmark data for a Quality Score. Per 1M tokens, pricing is $16.50 input, $66.00 output, and $8.25 cached input. It has a 128k token context window.

Quality Scorenot availableQuality unavailable: missing AA-Omniscience outcomes
Value Scorenot available
Factual reliabilitynot available
Cache Discount50%

Model specification

Reasoning
reasoning
Input modalities
none
Output modalities
none
Context window
128k tokens
Weights
closed weights

Token prices USD per 1M tokens

Input
$16.50
Output
$66.00
Cached Input
$8.25
Cache write
not available
Cost per task
not available

Capability

Intelligence
11.4
Coding
not available
Agentic
not available
Omniscience
not available
Correct
not available
Blended price
$15.68

Answer outcomes

Fully graded outcomes (Correct + Incorrect): not available

Omniscience outcome data not available for this model.

Artificial Analysis benchmarks

GPQA Diamond
76%

Similar models

Support me! Patreon