HyperAIHyperAI

Command Palette

Search for a command to run...

Harvey LAB-AA v1.1

An implementation of Harvey's Legal Agent Benchmark (LAB), testing AI agents on real-world legal work from Harvey's dataset of 120 private tasks spanning 24 legal practice areas. v1.1, built in collaboration with Harvey, checks every deliverable against the task's source documents for hallucinations, so work that passes every rubric criterion but contains a material hallucination receives no credit. A panel of three judges grades each deliverable criterion-by-criterion.

Models
27 current, 33 in total
Median
2.8%
Range
0.0%–13.1%

Score distribution

Lowest
0.0%
Median
2.8%
Highest
13.1%

Leaderboard

Data from Artificial Analysis