Google DeepMindAPIGemini 2.0 Flash ThinkingParamsUndisclosed (Thinking)Context1.0MSpeed—ReleaseJan 2025
Google DeepMindAPIGemini 3.6 Flash (LLM Stats snapshot)ParamsUndisclosedContext128kSpeed—ReleaseAug 2024
Google DeepMindAPIGemini-1.5-pro (README Avg. snapshot)ParamsUndisclosedContext128kSpeed—ReleaseAug 2024
Google DeepMindAPIGemma 4 31B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPITerminus 2 + Gemini 3.1 Pro (high; TB 2.1)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini CLI + Gemini 3.1 Pro (high; TB 2.1)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini CLI + Gemini 3 Pro (high; TB 2.1)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPITerminus 2 + Gemini 3 Pro (high; TB 2.1)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3 Pro (mini-SWE-agent 2.0.0)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3 Flash (high reasoning; mini-SWE-agent 2.0.0)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemma 3 27B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 2.5 Pro Preview 06-05 (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3.5 Flash-Lite (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3.1 Flash-Lite (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3.6 Flash (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemma 4 26B-A4B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemma 4 12B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3.1 Pro (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemma 4 E2B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3 Flash (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemma 4 E4B (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3.5 Flash (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIGemini 3 Pro (LLM Stats MRCR v2 8-needle)ParamsUndisclosedContext128kSpeed—ReleaseJun 2024
Google DeepMindAPIPaLM 540B (translate-to-English CoT)ParamsUndisclosedContext128kSpeed—ReleaseDec 2023
Google DeepMindAPIGemini Ultra (10-shot decontaminated)ParamsUndisclosedContext128kSpeed—ReleaseDec 2023
Google DeepMindAPIPaLM 540B (CoT + self-consistency)ParamsUndisclosedContext128kSpeed—ReleaseMar 2022
Google DeepMindAPIAlphaCode 9B (test set, 10@100k, no clustering)ParamsUndisclosedContext128kSpeed—ReleaseFeb 2022
Google DeepMindAPIAlphaCode 41B (test set, 10@100k, no clustering)ParamsUndisclosedContext128kSpeed—ReleaseFeb 2022
Google DeepMindAPIAlphaCode 41B + clustering (test set, 10@100k)ParamsUndisclosedContext128kSpeed—ReleaseFeb 2022