readable AI benchmarks (simplified)

readable AI benchmarks

Muse Spark 1.1 does not yet have enough benchmark data for a Quality Score. It accepts text, image, pdf, and video input, outputs text, and has a 1,048,576 token context window.

Quality Scorenot availableQuality unavailable: missing AA Intelligence and AA-Omniscience outcomes

Value Scorenot available

Factual reliabilitynot available

Cache Discountnot available

Model specification

Reasoning: reasoning
Input modalities: text, image, pdf, video
Output modalities: text
Context window: 1,048,576 tokens
Weights: closed weights

Token prices USD per 1M tokens

Input: not available
Output: not available
Cached Input: not available
Cache write: not available
Cost per task: not available

Capability

Intelligence: not available
Coding: not available
Agentic: not available
Omniscience: not available
Correct: not available
Blended price: not available

Answer outcomes

Fully graded outcomes (Correct + Incorrect): not available

Omniscience outcome data not available for this model.

DeepSWE operational cross-check

Pass@1: 53.3%
Avg steps/scored attempt: 95.83
Mean cost/scored attempt (USD): $2.36
Mean output tokens/scored attempt: 74,008.42
Mean duration/scored attempt (s): 898 s

Mean cost/scored attempt is the official feed's mean_cost_usd: mean benchmark cost in USD per scored attempt under the source's cost basis. It is not Artificial Analysis cost per task and not token price (USD per 1M tokens). Mean output tokens/scored attempt is mean_output_tokens, also averaged over every scored attempt including scored failures. Mean duration/scored attempt is mean_duration_seconds; it is informational only, and wall-clock varies with provider and host load. These three fields do not affect Quality Score, Value Score, or Reliability. Epoch General ECI's benchmark basket includes DeepSWE v1.1, so Epoch General ECI and this DeepSWE cross-check are not independent evidence.

official DeepSWE v1.1 source

Similar models

Graph Open on Artificial Analysis