by MistralCoding AgentfreemiumRank #7 on Leaderboard
Mistral Vibe
Coding agent harness from Mistral, measured on the Artificial Analysis Coding Agent Index.
Overall Index
40.6/ 100
Artificial Analysis benchmark compositeSWE-bench Verified
—
Real-world GitHub issue resolutionFrontierCode-AA 2.0
20.5%
Multi-file software engineering tasksTerminal-Bench 4.1
42.4%
Shell execution & command accuracyAvg Cost / Task
$1.34
Inference token expenditure per taskOverview & Analysis
Mistral Vibe was evaluated by Artificial Analysis with Mistral Large 4 (High). We have not written a full profile for it yet.
Pricing Model: See the vendor for current pricing.
Technical Specs & Models
Mistral Large 4 (High)
Key Capabilities & Features
Specialized engineering mechanisms implemented in Mistral Vibe.
Pros & Cons Evaluation
Forensic analysis of developer experience, cost efficiency, and trade-offs.
Strengths & Advantages
Limitations & Trade-Offs
Pricing Plans & Tiers
Subscription plans, credit quotas, and commercial deployment options.
Verified Benchmark Evaluations
Standardized evaluation scores recorded on SWE-bench and synthetic code harnesses.
| Benchmark Harness | Score / Accuracy | Evaluation Metric | Verification Status | Evaluation Notes |
|---|---|---|---|---|
| Coding Agent Index (v2.1) | 40.6% | Composite of three benchmarks | Verified | Source: Artificial Analysis. |
| FrontierCode-AA 2.0 | 20.5% | Software engineering tasks | Verified | Standard benchmark instance run. |
| Terminal-Bench 4.1 | 42.4% | Agentic terminal use | Verified | Standard benchmark instance run. |
| SWE-Atlas-QnA-AA | 58.9% | Technical Q&A | Verified | Standard benchmark instance run. |