GSM8K

Frontier models cleared ~95% by 2023–24 and the reasoning-model era pushed scores to ~97–99%, collapsing headroom. But saturation here is the sharpest 'saturated ≠ solved' case on the wiki: GSM-Symbolic (Apple, 2024) showed that changing only names/numbers, and especially adding one irrelevant clause (GSM-NoOp), drops accuracy heavily across models — so the SCORE is saturated while the CAPABILITY (robust arithmetic reasoning) is not. saturated_date 2024-01 marks the point frontier scores stopped discriminating; the discriminating signal moved to harder math (MATH → AIME → FrontierMath) and to robustness variants.