Claude 3 Opus (BM25 retrieval) AI Model Benchmark Evaluation

Intelligence Index

—/ 100

Calibrated multi-domain composite

Throughput Speed

—tok/sec

Output streaming throughput

Time To First Token

—ms

Initial chunk server latency

LiveBench Contam-Free

—%

September 2026 suite score

Sourced Benchmark Evaluations (1)

Verified performance across authoritative benchmarks with provenance tracking.

Benchmark	Status	Score	Trust	Date	Source Type	Provenance
SWE-bench	Deprecated	3.79%	10	2024-03-04	independent	Source ↗

Anthropic Python SDKAPI Ready

import anthropic

client = anthropic.Anthropic()
message = client.messages.create(
    model="claude-3-opus-bm25-retrieval",
    max_tokens=2048,
    temperature=0,
    messages=[{"role": "user", "content": "Execute SWE-bench verified repository fix"}]
)
print(message.content[0].text)

Evaluation & Sourcing Notes

Scores listed for Claude 3 Opus (BM25 retrieval) represent verified evaluations extracted from official research papers, independent evaluation suites (HELM, LMSYS, OpenCompass, LiveBench), and verified audit reports.

All benchmarks marked as saturated or deprecated reflect historical performance where the benchmark no longer provides active discriminative power.