HyperAI
Command Palette
Search for a command to run...
Agents
Testing LLMs as autonomous agents that plan, use tools, interact with environments, and complete multi-step tasks in simulated worlds.
Leaderboard
100 models total
Benchmarks
ALFWorld
WebShop
WebArena
ScienceWorld
OSWorld
blocksworld
WebVoyager
GAIA
Game of 24
AndroidWorld
TravelPlanner
Android World
WebWalkerQA
SWE-bench Lite
AppWorld
HotPotQA
Jiminy Cricket
MBPP
SWE-Bench Verified
NoisyToolBench
CraigslistBargain
NLP4LP
OptiBench
OptMATH
AGORABENCH
BabyAI
CIMA
CSR-Bench
MATH
StableToolBench
WebArena-Lite
GSM8K
MiniWoB++
AndroidControl
BFCL-v3
BrowseComp
CompileAgentBench
ESConv
Mind2Web
BrowseComp-zh
EB-ALFRED
floortile
MAS-Bench
Mind2Web-Live
Spread
TextCraft
Trip Planning
VisEscape
VISUALWEBARENA
ACRE
Bargaining
BFCL V3
ferry
List Functions
Logistics
Maze
miconic
NaturalGAIA
satellite
SciWorld
spanner
transport
WorkArena
AitW
API-Bank
Bamboogle
BoxLift
BoxNet
DA-Bench
DailyLifeAPIs
Date
Game 24
HuggingFace
HumanEval
Jericho
LiveVQA
MATH_alg
MMSearch
Path Plan
SimpleVQA
sokoban
TabMWP
Verified-50
VirtualHome
WindowsAgentArena
ALFRED
CyBench
DroidTask
DX
FloDial
MedDG
MultiAgentBench
OpenRCA
OSWorld-Verified
AIOpsLab
Benchmark
Date Understanding
FAIL-TALMS
GroundedVQA
GSM-Hard
Letters
Logical Deduction
MATH-Count&Probability
MATH-Geometry
MathDial
MatplotBench
Minecraft
Navigate
Number Multiplying
NYU CTF
PDDL
PDDLGym
RLbench
ScienceAgentBench
SOTOPIA
ToolQA
Web of Lies
AndroidControl-Real
AndroidLab
AutoTools-Eval
CC-Gen
ComplexLP
ComplexOR
CrossTask
IndOR
MediLongChat
Meeting Planning
MiniWob
MS-TOD
Negotiation
NL4Opt
QQ Music
RestBench-TMDB
Robotouille (Sync)
rovers
SPA-Bench
ToolBench
ToolQuery
XBench-DeepSearch
Agent-Dojo
ANDROIDCONTROL-LOW
BBH
Bench2Drive
BigCodeBench-Chat
BIOTOOL
BlackJack
Coding (Graph)
Coding (Tree)
EarthBench
GAIA-text
GUI-Act-Web
GUI-Odyssey
HTB
Intercode Bash
InterCode-CTF
InterCode-SQL
Language Table Benchmark
Match-2 Elimination
MATH-Chat
Maze Navigation
MCP-Universe
Mind2Web cross-task
Mind2Web cross-website
MMOral-OPG
Mobile-Eval-E
Mobile-Eval-RAG
NESTFUL
NumberLine
ProactiveMobile
RandomWorld test set
Research
RestBench
Simpler Env Benchmark
tau-Bench
TMDB
Tool-Query
ToolEmu
unknown
VoTa-Bench
WebAggregatorQA
WebVoyager test set
Werewolf
Werewolf game
WideSearch
Wordcraft
WorkBench
XBench
xbench-DeepResearch
2WMHQA
ALF
ALF-OOD
AM
APIBench
Baby
Baby-OOD
BD
BFCL v4 Multi-Turn
Classifieds
Combined Data
Custom benchmark
DSBench
DynAfford
dynamic evaluation benchmark
Dynamic ScienceWorld
EB-Habitat
Game of X
GitTaskBench
Grassland
Guess My City
LeetCodeHardGym
Minecraft Interaction Benchmark
ML-Bench
MultiWOZ 2.4
MV
Mystery Blocksworld
MZ
N-Puzzle
NQ
Online-Mind2Web
Points24
Popular Applications
Pseudo-Symbolic Logic Maze
Real-World
RelyToolBench
Sci
Semantle
ST
SuperAPP Benchmark
Synth
TC
TL
ToolAlpaca
ToolQuery-Unified
TriviaQA
Twenty Questions
Tyreworld
VoTa-Bench (Seen)
WD
Word Ladder
WS
WT
Zork1
AC-Real
AgentBench
AI2-THOR
AIME 24
AIME 25
AITW-Gen
Android-in-the-Wild
Android-World
AnnoMI
ASDiv
Bank
Barman
BAY
BFCL
BIRD
Box Push
Broadcast Channel
BrowseComp+
CheckManual
Chess Combat
COIN
COL
Compass
CRAD
Database (DB)
DebtBench
Dec-Tiger
DeepSearch
DESRD
Detective
DevAI
Diamond Pickaxe
DS-1000
ExtendaBench
ExTES
FEVER
FRAMES
FVQA-test
Golden Shovel
Gorilla APIBench
GPQA
GPT4Tools
GSM 8K
GSM-H
GUI Odyssey
HLE
Householding (HH)
HR-MMSearch
HumanEvalFix
Humanity's Last Exam
InfoSeek
InterCode
Jiang and Riloff (2021) object corpus
KG-Harmony-Bench
Kincade / Marshall
Kincade Fire
Lateral thinking puzzles (LTP)
M3ToolEval
Market
Mars Rover
Marshall / Kincade
Marshall Fire
MAT-Search
MATH 500
MCP-Mark
MedMCP-Calc
Meet 27
Meet 2x2
Meet 3x3
Mind2Web-Online
MME RealWorld
MobileMiniWob
MobileReach
Multimodal Mind2Web
MultiWOZ 2.2
Navigation
NL Schedule
NY
OctoGibson
OctoGTA
OctoMC
OmniAct
OmniAct-Desktop
OmniAct-Web
OmniBench
Online evaluation
Open-World Minecraft Benchmark
OpenAct
Operating System (OS)
OS-Genesis
Overcooked
P4G
PersuasionForGood
ProofWriter
Rail
Red Dead Redemption 2
Repeated Matrix Game
Retail-3I
RISK-Bench
RuleTaker
SealQA
ShoppingBench
SIREN
Sketchtopia
Spider2-V
SSAD
SSD
SVAMP
SWE-bench
SWE-bench-Verified
Tau2-bench
Telecom
Torch
Undercover
Unseen Websites
WebVLN
Wireless
xbench-DS
τ-Bench
τ²-bench
20Q
2D-FetchQ
2WikihopQA
2WikiMultihopQA
3DMEM-BENCH
Advent
Adversary
AgentDriver
AIME24
AIME25
AITZ
ALFWorld-Afford
Alice&Bob
arithmetic_base
Auto-UI
AutoDW
AvalonBench
AwA2
BabyAI Synth
Balances
BEHAVIORHUB
BioCoder
BioProBench
Black Myth: Wukong
BLOCKSW
CAGUI
CARLA town03
CARLA town04
Chair
Chat
ChEMBL-1000
Chemical
Chess
Combined
Combined / Combined
ComfyBench
Counter
Crafter
CraigslistBargains
DA-Code
DB
DDXPlus
Deephome
dhrd-se
dhrd-sg
dhrd-tpe
Dirt
DOOM
EmbodiedEval
Enchanter
Env-Base
Env-Image
Env-Name
Env-Noise
Env-Position
EZPoints
ff_27
FlashAdventure
FrozenLake
GRF
GridWorld
Gripper
GRIPPERS
GroundUI-1K
GSM-8K
GTA
Gym Cards
GymCards
Habitat-MAS
Human Evaluation
Humanity's Last Exam (HLE)
In-house OOD benchmark
InquireBench
iTHOR
JARVIS-1 benchmark
JMultiWOZ
LaTeX Beamer Writing
LBF
LEGENT
Library
Logs
Ludicorp
M3Tool
MaDS-Benchmark
Magnetic
Map2Seq
MCP
MDDial
MemGUI-Bench
Microsoft Word tasks
MindPower Benchmark
MineDojo
Mineflayer
MineRL
MINT
MIRAGE-World
MMLU
Mobile-R1 benchmark
Mobile3M
Movie
MTU-Bench (OOD)
MTU-Eval
NetHack Learning Environment (NLE)
NIV
nuPlan
Online Study
OpenHA benchmark suite
OS
OS Interaction
Pentari
Popup-box
PP
PrimitiveSkill
QQ Music (desktop)
Real robot tasks
RealTravel
Reddit-Movie
RegAgent
Rest.
retro*-190
River Cross
Robotic manipulation
Robotouille
RoCo-benchmark
ScreenDrag
ScreenSpot
ScreenSpot-Pro
ScreenSpot-v2
SEC-bench
Seeds
ShopSimulator
SMACv2
Stardew Valley
Stone
STORAGE
succ_zero_eq
Sudoku
SWE-Bench-Lite
synth-L
synth-L-cost
synth-S
synth-S-cost
synth-XL
T-Eval
Table
Tabletop-Afford
Tag
Taxi
TDW-Cook
TDW-Game
Tech tree mastery
Temple
TERMES
Tool Usage Benchmark
ToolTalk
TopDial
Tower of Hanoi
TPS-Bench-Hard
Travel
Travel Planner
VirtualHome-Env
Web Browsing
WebArena Easy
WebArena–Shopping
WebShop-1000
Weibo
Weibo (web)
Wikipedia Agent
WindowsBench
Wordle
Ztuu