Inference
Vals AI

Finance Agent (v2)

Evaluating agents on core financial analyst tasks using the FAB v2 harness

ModelsModels with a result.58
Top resultBest result on this test.61.4%Gemini 3.8 Flash
Top-3 spreadPoints from first to third.1.5 pts
UpdatedDate the source changed the results.21 Sept 2026

Result and cost

020406080100$0.01$0.03$0.1$0.3$1$3$10RESULTUS DOLLARS PER TASK · LOG SCALE

Results

58 results
#ModelResultThe score from the source.CostUS dollars to run one task.TimeTime to run one task.
01Gemini 3.8 Flash61.4%$23 min
02Muse Spark 1.260.6%$0.775 min
03Muse Spark 1.3 Max60.0%$0.7573 min
04Gemini 3.7 Flash59.0%$1.483 min
05Muse Spark 1.358.9%$0.7416 min
06Claude Fable 5.158.9%$8.3518 min
07Claude Opus 558.6%$5.1210 min
08Gemini 3.5 Flash57.9%$2.515 min
09GLM-5.3-Flash57.9%$0.04815 min
10Muse Spark 1.157.2%$0.7237 min
11Claude Fable 556.3%$8.0610 min
12Gemini 3.6 Flash56.3%$1.44 min
13GLM-5.355.8%$1.0716 min
14Hy4 preview55.1%$0.5924 min
15GPT-5.6 Luna55.0%$0.26213 min
16GPT-5.6 Terra54.4%$3.3624 min
17Claude Opus 4.853.9%$4.229 min
18Claude Sonnet 553.9%$1.1313 min
19GPT-5.6 Sol53.8%$1.2519 min
20Grok 4.653.7%$1.6617 min
21GPT-6 Astra53.5%$6.8212 min
22DeepSeek V4.1 Flash53.5%$0.2076 min
23Grok 4.752.3%$5.0116 min
24GPT-5.551.8%$4.1511 min
25Claude Opus 4.751.5%$4.036 min
26Claude Sonnet 4.651.0%$2.4112 min
27Qwen3.8 Max50.6%$1.2420 min
28GLM-5.249.7%$0.7148 min
29DeepSeek V4 Flash 042349.5%$0.2768 min
30Qwen3.8-27B48.6%$0.74910 min
31Grok 4.548.3%$1.165 min
32MiniMax M348.3%$0.3238 min
33Qwen3.7 Max47.8%$0.55311 min
34Gemini 3.5 Flash-Lite47.4%$0.392 min
35DeepSeek V4 Pro 042347.2%$0.8816 min
36Inkling46.6%$0.99618 min
37GPT-5.4 mini45.4%$1.236 min
38GLM-5.144.8%$0.61815 min
39Gemini 3.1 Pro Preview43.0%$1.593 min
40Gemini 3 Flash Preview42.6%$0.5714 min
41MiMo-V2.5-Pro41.5%$0.2068 min
42Inkling-Small41.3%$0.2317 min
43Qwen3.6 Plus40.8%$0.81410 min
44Qwen3.7 Plus38.2%$0.3589 min
45GPT-5.4 nano38.2%$0.1596 min
46Grok 4.337.7%$0.84810 min
47MiMo-V2.536.7%$0.0876 min
48Kimi K2.5 Thinking35.8%$0.29413 min
49Mistral Medium 3.532.1%$1.9113 min
50Claude Haiku 4.5 Thinking31.0%$0.6023 min
51Ling 3.0 Flash30.3%$0.053 min
52Gemini 3.1 Flash Lite Preview30.0%$0.14255 s
53Grok 4.20 (Reasoning)28.5%$0.7926 min
54MiniMax M2.727.9%$0.18313 min
55Laguna M.125.0%$0.81820 min
56Mercury 2.518.6%$0.1062 min
57Nemotron Lightning 3p5 30B A3B18.5%$0.0299 min
58Laguna XS.215.6%$0.1929 min