IFBench

A benchmark evaluating precise instruction-following generalization on 58 diverse, verifiable out-of-domain constraints that test models' ability to follow specific output requirements.

Models: 150 current, 451 in total
Median: 43.0%
Range: 12.1%–82.9%

Score distribution

Lowest: 12.1%
Median: 43.0%
Highest: 82.9%

Leaderboard

Include deprecated models

Rank	Model	Score
1	MiniMax-M3 MiniMax	82.9%
2	Nemotron 3 Ultra 550B A55B (Reasoning) NVIDIA	81.4%
3	Nemotron Cascade 2 30B A3B NVIDIA	80.4%
4	Nova 2.0 Pro Preview (Low) Amazon	79.6%
5	Nova 2.0 Pro Preview (Medium) Amazon	79.0%
6	Qwen3.5 397B A17B (Reasoning) Alibaba	78.8%
7	Qwen3.7 Plus Alibaba	78.0%
8	Gemini 3.1 Pro Preview Google	77.1%
9	Qwen3.5 122B A10B (Reasoning) Alibaba	75.7%
10	Gemma 4 31B (Reasoning) Google	75.6%
11	GPT-5.3 Codex (Xhigh) OpenAI	75.4%
12	Command A+ Cohere	73.9%
13	Gemma 4 12B (Reasoning) Google	73.5%
14	Gemma 4 26B A4B (Reasoning) Google	72.4%
15	o3 OpenAI	71.4%
16	NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) NVIDIA	71.1%
17	Nova 2.0 Lite (High) Amazon	70.7%
18	Apriel-v1.6-15B-Thinker ServiceNow	69.1%
19	gpt-oss-120b (High) OpenAI	69.0%
20	Mistral Medium 3.5 Mistral	68.8%
21	Nova 2.0 Lite (Medium) Amazon	68.5%
22	Qwen3.5 9B (Reasoning) Alibaba	66.7%
23	KAT Coder Pro V2 KwaiKAT	66.7%
24	HyperNova 60B 2605 (High, Based on gpt-oss-120b) Multiverse Computing	66.5%
25	Nex-N2-Pro (Based on Qwen3.5-397B-A17B) Nex AGI	66.2%
26	Nova 2.0 Omni (Medium) Amazon	66.2%
27	Olmo 3.1 32B Think Allen Institute for AI	66.0%
28	gpt-oss-20b (High) OpenAI	65.1%
29	Qwen3.6 35B A3B (Reasoning) Alibaba	64.4%
30	Nemotron 3 Nano Omni 30B A3B Reasoning NVIDIA	63.2%
31	Kimi K2.7 Code Kimi	63.1%
32	K2 Think V2 Institute of Foundation Models	62.8%
33	Nova 2.0 Omni (Low) Amazon	61.8%
34	Nova 2.0 Lite (Low) Amazon	61.2%
35	Nemotron 3.5 Bolt E4B 4GB (Reasoning) NVIDIA	61.1%
36	Qwen3 Next 80B A3B (Reasoning) Alibaba	60.7%
37	K2-V2 (High) Institute of Foundation Models	60.1%
38	DiffusionGemma 26B A4B Google	59.5%
39	gpt-oss-120b (Low) OpenAI	58.3%
40	NVIDIA Nemotron 3 Nano 4B NVIDIA	58.2%
41	EXAONE 4.5 33B (Reasoning) LG AI Research	58.0%
42	gpt-oss-20b (Low) OpenAI	57.8%
43	Solar Open 100B (Reasoning) Upstage	57.7%
44	North Mini Code Cohere	57.6%
45	Motif-2-12.7B-Reasoning Motif Technologies	57.0%
46	Trinity Large Thinking Arcee AI	56.3%
47	LFM2.5-8B-A1B Liquid AI	55.6%
48	K2-V2 (Medium) Institute of Foundation Models	55.1%
49	Tri-21B-Think Trillion Labs	54.6%
50	Falcon-H1R-7B TII UAE	54.4%