Inference
Vals AI

Harvey's Legal Agent Benchmark

Tests an agent's ability to complete legal work using documents, spreadsheets, presentations, and file-system tools

ModelsModels with a result.59
Top resultBest result on this test.25.4%Muse Spark 1.2
Top-3 spreadPoints from first to third.3.3 pts
UpdatedDate the source changed the results.21 Sept 2026

Result and cost

020406080100$0.01$0.03$0.1$0.3$1$3$10$30$100RESULTUS DOLLARS PER TASK · LOG SCALE

Results

59 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01Muse Spark 1.225.4%$2.0924 min
02Muse Spark 1.3 Max23.8%$2.2415 min
03Muse Spark 1.322.1%$2.7317 min
04Muse Spark 1.120.0%$0.812 min
05Grok 4.615.8%$4.0145 min
06Grok 4.512.9%$2.0210 min
07Grok 4.712.1%$11.0142 min
08Claude Fable 511.3%$19.2327 min
08Qwen3.8-27B11.3%$4.0319 min
10Qwen3.8 Max10.4%$2.3749 min
11Gemini 3.8 Flash10.0%$3.6629 min
12Claude Opus 4.89.6%$10.2224 min
13Hy4 preview9.2%$0.98429 min
14Gemini 3.7 Flash8.8%$2.568 min
15GLM-5.38.3%$4.343 min
15DeepSeek V4 Flash 04238.3%$0.24517 min
17GLM-5.27.1%$2.0621 min
18Claude Fable 5.16.7%$46.211.9 h
18Claude Opus 56.7%$23.6756 min
18DeepSeek V4.1 Flash6.7%$0.17310 min
18GLM-5.3-Flash6.7%$0.5752 min
18Claude Opus 4.76.7%$10.8125 min
23DeepSeek V4 Pro 04235.6%$0.82422 min
24GPT-6 Astra5.4%$26.1625 min
25Claude Sonnet 55.0%$13.4339 min
25Claude Sonnet 4.65.0%$3.0419 min
27MiniMax M34.2%$1.4623 min
28GPT-5.53.8%$4.612 min
29Gemini 3.6 Flash3.3%$1.916 min
30GPT-5.6 Sol2.5%$10.3723 min
30Gemini 3.5 Flash2.5%$2.118 min
32MiMo-V2.5-Pro2.1%$0.1079 min
32Inkling2.1%$1.2518 min
34Qwen3.7 Max1.7%$1.5832 min
34Inkling-Small1.7%$0.17531 min
34MiMo-V2.51.7%$0.0367 min
37GPT-5.6 Luna1.3%$0.38411 min
37Qwen3.6 Plus1.3%$3.9415 min
37Ling 3.0 Flash1.3%$0.0463 min
40GPT-5.6 Terra0.8%$3.217 min
40Claude Haiku 4.5 Thinking0.8%$0.4176 min
42Grok 4.30.4%$0.3893 min
42Mistral Medium 3.50.4%$6.0762 min
44GPT-5.40.0%$3.615 min
44Gemini 3.1 Pro Preview0.0%$1.157 min
44Gemini 3 Flash Preview0.0%$0.2643 min
44Qwen3.7 Plus0.0%$0.2349 min
44GLM-5.10.0%$0.5568 min
44Grok 4.20 (Reasoning)0.0%$0.9878 min
44GPT-5.4 mini0.0%$111 min
44Gemini 3.5 Flash-Lite0.0%$0.3324 min
44Kimi K2.5 Thinking0.0%$0.35125 min
44MiniMax M2.70.0%$0.5857 min
44GPT-5.4 nano0.0%$0.1846 min
44Gemini 3.1 Flash Lite Preview0.0%$0.08461 s
44Mercury 2.50.0%$0.1932 min
44Laguna M.10.0%$0.5288 min
44Laguna XS.20.0%$0.28420 min
44Nemotron Lightning 3p5 30B A3B0.0%$0.02829 min