Automated page. Written and translated automatically by AI and checked against the sources by software; no human editor. SI-IQ is an index built from public benchmark results, not an IQ test. How it works

How smart is Mistral Large 2 (Nov 2024)?

71 SI-IQ · 90% interval 66–76
Not ranked: too little data

Mistral Large 2 (Nov 2024) is a model from Mistral AI, released on Nov 18, 2024. Its SI-IQ is 71 (90% interval 66–76), estimated from 4 benchmark results by 2 evaluators.

Data as of Oct 18, 2026 · method 1.0.0

A model is ranked when its results come from at least 5 benchmarks (the two GPQA Diamond runs count as one) in at least 3 areas, from at least 2 different evaluators, and its versions are released no more than 60 days apart. This model does not meet that yet, so it is shown with a provisional estimate but not ranked.

Facts

Developer: Mistral AI
Released: Nov 18, 2024
Access: Open weights (non-commercial licence)
Benchmarks used: 4 benchmark results from 2 evaluators

Ability by area (SI-IQ, 90% interval)

Every benchmark result we used

Each score is one value exactly as the source published it: for Epoch AI the best of its run settings, for OpenRouter the median hosting provider (the developer's own hosting when it ran the test). “Implied SI-IQ” is the ability that this single result points to; the overall SI-IQ is their precision-weighted average.

Benchmark	Area	Score	Implied SI-IQ	Evaluated by	As listed by the source	Retrieved	Source
MATH Level 5	Math	50.3%	69	Epoch AI	`mistral-large-2411`	Oct 18, 2026	Epoch AI Benchmarking Hub · data file
OTIS Mock AIME 2024–2025	Math	7.8%	67	Epoch AI	`mistral-large-2411`	Oct 18, 2026	Epoch AI Benchmarking Hub · data file
GPQA Diamond	Knowledge	51.3%	75	Epoch AI	`mistral-large-2411`	Oct 18, 2026	Epoch AI Benchmarking Hub · data file
Berkeley Function Calling Leaderboard	Agents	38.4%	82	UC Berkeley (Gorilla)	`mistral-large-2411 (FC)`	Oct 18, 2026	Berkeley Function Calling Leaderboard · data file

Human preference (Arena)

On the Arena leaderboard, where people vote between two anonymous answers, Mistral Large 2 (Nov 2024) has a rating of 1,306 (1,301–1,310) from 28,073 votes (published Oct 15, 2026). Human preference is a different measure from benchmark ability and is not part of SI-IQ. Arena (Hugging Face)

Computed with SI-IQ method version 1.0.0. Read the full methodology

Data sources: Arena leaderboard dataset on Hugging Face (CC BY 4.0); Berkeley Function Calling Leaderboard, Gorilla project (Apache-2.0); Epoch AI, ‘Capabilities & benchmarking’ (CC BY 4.0) (licences and changes).