Terminal-Bench 4.0

A harder 66-task benchmark of complex terminal work across software, machine learning, science, operations, security, hardware, and media, with recalibrated compute and time allowances and improved instructions, environments, and verifiers.

Category: Coding
Intelligence Index weight: 10%
Models: 147 current, 252 in total
Median: 11.1%
Range: 0.0%–67.2%

Score distribution

Lowest: 0.0%
Median: 11.1%
Highest: 67.2%

Leaderboard

Include deprecated models

Rank	Model	Score	Cost / task	Time / task	Output tokens / task
1	Kimi K3.1 Pro Kimi	67.2%	$5.27	59m 27s	116K
2	Gemini 4 Carbon (High) Google	65.2%	$10.05	32m 35s	161K
3	Claude Sonnet 5.5 (Max, Default Fallback) Anthropic	63.6%	$12.65	41m 30s	382K
4	Gemini 4 Carbon (Low) Google	62.6%	$8.57	35m 49s	139K
5	Claude Fable 5.2 (Xhigh, Default Fallback) Anthropic	61.6%	$20.81	41m 57s	260K
6	Gemini 4 Carbon (Medium) Google	60.6%	$8.82	32m 18s	143K
7	Claude Fable 5.2 (Max, Default Fallback) Anthropic	59.6%	$31.59	61m 7s	377K
8	Claude Fable 5.2 (High, Default Fallback) Anthropic	59.6%	$13.47	28m 13s	158K
9	Claude Opus 5.5 (Max, Default Fallback) Anthropic	59.6%	$13.11	36m 4s	253K
10	Claude Opus 5.5 (Xhigh, Default Fallback) Anthropic	59.6%	$8.78	26m 3s	169K
11	GPT-6 Astra (Xhigh) OpenAI	59.6%	$5.86	18m 32s	43.3K
12	GPT-6 Astra (Max) OpenAI	59.1%	$8.50	33m 31s	75.7K
13	Claude Sonnet 5.5 (Xhigh, Default Fallback) Anthropic	57.1%	$6.08	23m 2s	192K
14	Gemini 4 Argon (High) Google	57.1%	$13.56	40m 39s	165K
15	Muse Wonder Full (Max) Meta	57.1%	—	—	153K
16	Claude Opus 5.5 (High, Default Fallback) Anthropic	56.6%	$5.12	15m 56s	100K
17	GPT-6.1 Sol (Max) OpenAI	56.1%	$1.82	32m 5s	108K
18	GPT-6.1 Terra (Max) OpenAI	55.6%	$1.49	23m 2s	101K
19	Claude Fable 5.2 (Medium, Default Fallback) Anthropic	55.1%	$5.25	11m 36s	63.2K
20	Claude Fable 5.2 (Low, Default Fallback) Anthropic	54.5%	$4.34	9m 30s	52.9K
21	GPT-6.1 Sol (Xhigh) OpenAI	54.0%	$1.03	17m 0s	56.9K
22	GPT-6 Astra (High) OpenAI	54.0%	$4.05	12m 54s	30.4K
23	Claude Opus 5.5 (Medium, Default Fallback) Anthropic	52.5%	$4.04	12m 12s	75.7K
24	Muse Wonder (Max) Meta	52.0%	$12.21	22m 52s	167K
25	GPT-6.1 Sol (High) OpenAI	51.5%	$0.83	12m 46s	43.7K
26	GPT-6 Astra (Medium) OpenAI	49.5%	$4.43	11m 35s	29.7K
27	GPT-6.1 Sol (Medium) OpenAI	48.0%	$0.61	9m 2s	32K
28	GPT-6.1 Terra (Xhigh) OpenAI	46.5%	$0.66	11m 1s	47.5K
29	Claude Sonnet 5.5 (High, Default Fallback) Anthropic	43.9%	$2.19	9m 4s	76.7K
30	GLM-5.3 (Max) Z AI	41.9%	$8.06	47m 13s	195K
31	GPT-6.1 Terra (High) OpenAI	41.9%	$0.44	7m 14s	30.4K
32	GPT-6 Astra (Low) OpenAI	41.9%	$2.25	6m 15s	14.9K
33	Muse Ember (Max) Meta	40.9%	$0.27	5m 25s	148K
34	Qwen3.8 Max (0902) Alibaba	38.9%	$18.68	95m 29s	293K
35	Muse Wonder (High) Meta	38.4%	$8.10	15m 55s	116K
36	Tencent Hy4 Tencent	37.4%	$1.64	—	123K
37	Muse Ember (Xhigh) Meta	35.4%	$0.22	4m 48s	132K
38	GLM-5.3 (Low) Z AI	34.8%	$6.40	36m 7s	128K
39	MiMo-V2.6-Pro Xiaomi	34.8%	$0.44	54m 30s	184K
40	DeepSeek V4.1 Flash 1017 (Max) DeepSeek	33.8%	$0.88	26m 20s	218K
41	Ling 3.1 Flash InclusionAI	33.3%	—	—	—
42	Step 5 Preview StepFun	33.3%	$5.18	30m 6s	260K
43	Claude Haiku 5.5 (Max) Anthropic	32.8%	$0.65	22m 44s	347K
44	GLM-5.3-Flash Z AI	32.8%	$0.89	60m 57s	181K
45	Ling 3.1 Flash 1019 InclusionAI	32.8%	$6.59	—	434K
46	GPT-6.1 Terra (Medium) OpenAI	32.3%	$0.28	4m 38s	19.3K
47	Claude Opus 5.5 (Low, Default Fallback) Anthropic	31.3%	$2.08	5m 49s	37.8K
48	GPT-6.1 Sol (Low) OpenAI	30.8%	$0.38	5m 7s	17.4K
49	Claude Sonnet 5.5 (Medium, Default Fallback) Anthropic	29.8%	$1.58	6m 11s	51.6K
50	Nanbeige4.3-33B Nanbeige	29.8%	—	—	313K

Rank 1
Kimi K3.1 Pro
Kimi
Score
67.2%
Cost / task
$5.27
Time / task
59m 27s
Output tokens / task
116K
Rank 2
Gemini 4 Carbon (High)
Google
Score
65.2%
Cost / task
$10.05
Time / task
32m 35s
Output tokens / task
161K
Rank 3
Claude Sonnet 5.5 (Max, Default Fallback)
Anthropic
Score
63.6%
Cost / task
$12.65
Time / task
41m 30s
Output tokens / task
382K
Rank 4
Gemini 4 Carbon (Low)
Google
Score
62.6%
Cost / task
$8.57
Time / task
35m 49s
Output tokens / task
139K
Rank 5
Claude Fable 5.2 (Xhigh, Default Fallback)
Anthropic
Score
61.6%
Cost / task
$20.81
Time / task
41m 57s
Output tokens / task
260K
Rank 6
Gemini 4 Carbon (Medium)
Google
Score
60.6%
Cost / task
$8.82
Time / task
32m 18s
Output tokens / task
143K
Rank 7
Claude Fable 5.2 (Max, Default Fallback)
Anthropic
Score
59.6%
Cost / task
$31.59
Time / task
61m 7s
Output tokens / task
377K
Rank 8
Claude Fable 5.2 (High, Default Fallback)
Anthropic
Score
59.6%
Cost / task
$13.47
Time / task
28m 13s
Output tokens / task
158K
Rank 9
Claude Opus 5.5 (Max, Default Fallback)
Anthropic
Score
59.6%
Cost / task
$13.11
Time / task
36m 4s
Output tokens / task
253K
Rank 10
Claude Opus 5.5 (Xhigh, Default Fallback)
Anthropic
Score
59.6%
Cost / task
$8.78
Time / task
26m 3s
Output tokens / task
169K
Rank 11
GPT-6 Astra (Xhigh)
OpenAI
Score
59.6%
Cost / task
$5.86
Time / task
18m 32s
Output tokens / task
43.3K
Rank 12
GPT-6 Astra (Max)
OpenAI
Score
59.1%
Cost / task
$8.50
Time / task
33m 31s
Output tokens / task
75.7K
Rank 13
Claude Sonnet 5.5 (Xhigh, Default Fallback)
Anthropic
Score
57.1%
Cost / task
$6.08
Time / task
23m 2s
Output tokens / task
192K
Rank 14
Gemini 4 Argon (High)
Google
Score
57.1%
Cost / task
$13.56
Time / task
40m 39s
Output tokens / task
165K
Rank 15
Muse Wonder Full (Max)
Meta
Score
57.1%
Cost / task
—
Time / task
—
Output tokens / task
153K
Rank 16
Claude Opus 5.5 (High, Default Fallback)
Anthropic
Score
56.6%
Cost / task
$5.12
Time / task
15m 56s
Output tokens / task
100K
Rank 17
GPT-6.1 Sol (Max)
OpenAI
Score
56.1%
Cost / task
$1.82
Time / task
32m 5s
Output tokens / task
108K
Rank 18
GPT-6.1 Terra (Max)
OpenAI
Score
55.6%
Cost / task
$1.49
Time / task
23m 2s
Output tokens / task
101K
Rank 19
Claude Fable 5.2 (Medium, Default Fallback)
Anthropic
Score
55.1%
Cost / task
$5.25
Time / task
11m 36s
Output tokens / task
63.2K
Rank 20
Claude Fable 5.2 (Low, Default Fallback)
Anthropic
Score
54.5%
Cost / task
$4.34
Time / task
9m 30s
Output tokens / task
52.9K
Rank 21
GPT-6.1 Sol (Xhigh)
OpenAI
Score
54.0%
Cost / task
$1.03
Time / task
17m 0s
Output tokens / task
56.9K
Rank 22
GPT-6 Astra (High)
OpenAI
Score
54.0%
Cost / task
$4.05
Time / task
12m 54s
Output tokens / task
30.4K
Rank 23
Claude Opus 5.5 (Medium, Default Fallback)
Anthropic
Score
52.5%
Cost / task
$4.04
Time / task
12m 12s
Output tokens / task
75.7K
Rank 24
Muse Wonder (Max)
Meta
Score
52.0%
Cost / task
$12.21
Time / task
22m 52s
Output tokens / task
167K
Rank 25
GPT-6.1 Sol (High)
OpenAI
Score
51.5%
Cost / task
$0.83
Time / task
12m 46s
Output tokens / task
43.7K
Rank 26
GPT-6 Astra (Medium)
OpenAI
Score
49.5%
Cost / task
$4.43
Time / task
11m 35s
Output tokens / task
29.7K
Rank 27
GPT-6.1 Sol (Medium)
OpenAI
Score
48.0%
Cost / task
$0.61
Time / task
9m 2s
Output tokens / task
32K
Rank 28
GPT-6.1 Terra (Xhigh)
OpenAI
Score
46.5%
Cost / task
$0.66
Time / task
11m 1s
Output tokens / task
47.5K
Rank 29
Claude Sonnet 5.5 (High, Default Fallback)
Anthropic
Score
43.9%
Cost / task
$2.19
Time / task
9m 4s
Output tokens / task
76.7K
Rank 30
GLM-5.3 (Max)
Z AI
Score
41.9%
Cost / task
$8.06
Time / task
47m 13s
Output tokens / task
195K
Rank 31
GPT-6.1 Terra (High)
OpenAI
Score
41.9%
Cost / task
$0.44
Time / task
7m 14s
Output tokens / task
30.4K
Rank 32
GPT-6 Astra (Low)
OpenAI
Score
41.9%
Cost / task
$2.25
Time / task
6m 15s
Output tokens / task
14.9K
Rank 33
Muse Ember (Max)
Meta
Score
40.9%
Cost / task
$0.27
Time / task
5m 25s
Output tokens / task
148K
Rank 34
Qwen3.8 Max (0902)
Alibaba
Score
38.9%
Cost / task
$18.68
Time / task
95m 29s
Output tokens / task
293K
Rank 35
Muse Wonder (High)
Meta
Score
38.4%
Cost / task
$8.10
Time / task
15m 55s
Output tokens / task
116K
Rank 36
Tencent Hy4
Tencent
Score
37.4%
Cost / task
$1.64
Time / task
—
Output tokens / task
123K
Rank 37
Muse Ember (Xhigh)
Meta
Score
35.4%
Cost / task
$0.22
Time / task
4m 48s
Output tokens / task
132K
Rank 38
GLM-5.3 (Low)
Z AI
Score
34.8%
Cost / task
$6.40
Time / task
36m 7s
Output tokens / task
128K
Rank 39
MiMo-V2.6-Pro
Xiaomi
Score
34.8%
Cost / task
$0.44
Time / task
54m 30s
Output tokens / task
184K
Rank 40
DeepSeek V4.1 Flash 1017 (Max)
DeepSeek
Score
33.8%
Cost / task
$0.88
Time / task
26m 20s
Output tokens / task
218K
Rank 41
Ling 3.1 Flash
InclusionAI
Score
33.3%
Cost / task
—
Time / task
—
Output tokens / task
—
Rank 42
Step 5 Preview
StepFun
Score
33.3%
Cost / task
$5.18
Time / task
30m 6s
Output tokens / task
260K
Rank 43
Claude Haiku 5.5 (Max)
Anthropic
Score
32.8%
Cost / task
$0.65
Time / task
22m 44s
Output tokens / task
347K
Rank 44
GLM-5.3-Flash
Z AI
Score
32.8%
Cost / task
$0.89
Time / task
60m 57s
Output tokens / task
181K
Rank 45
Ling 3.1 Flash 1019
InclusionAI
Score
32.8%
Cost / task
$6.59
Time / task
—
Output tokens / task
434K
Rank 46
GPT-6.1 Terra (Medium)
OpenAI
Score
32.3%
Cost / task
$0.28
Time / task
4m 38s
Output tokens / task
19.3K
Rank 47
Claude Opus 5.5 (Low, Default Fallback)
Anthropic
Score
31.3%
Cost / task
$2.08
Time / task
5m 49s
Output tokens / task
37.8K
Rank 48
GPT-6.1 Sol (Low)
OpenAI
Score
30.8%
Cost / task
$0.38
Time / task
5m 7s
Output tokens / task
17.4K
Rank 49
Claude Sonnet 5.5 (Medium, Default Fallback)
Anthropic
Score
29.8%
Cost / task
$1.58
Time / task
6m 11s
Output tokens / task
51.6K
Rank 50
Nanbeige4.3-33B
Nanbeige
Score
29.8%
Cost / task
—
Time / task
—
Output tokens / task
313K

Data from Artificial Analysis

Command Palette

Terminal-Bench 4.0

Score distribution

Leaderboard