WallStreetDebug>_ Wall Street, debugged.
Markets
Subscribe
Head-to-head · published results only

Gemini 3.8 Flash vs Muse Spark 1.2 on finance benchmarks

The two runners-up on Finance Agent v2 swap places when grading gets strict: Gemini 3.8 Flash leads on partial credit, Muse Spark 1.2 leads on All-Pass. Muse Spark costs less per test; Gemini is much stronger on Excel modeling.

Same benchmarks, same harness, as published by Vals AI Context: FAB v2: n=450 test questions, 3 runs · Oct 12, 2026 leaderboard · Vals AI · ± SEM Context: EMB: n=51 test tasks · Oct 12, 2026 leaderboard · Vals AI · ± as published, type not stated Context: Tax Agent: n=193 test questions · Oct 12, 2026 leaderboard · Vals AI · ± as published, type not stated
MeasureGemini 3.8 FlashMuse Spark 1.2GapRead
Finance Agent v261.44% ±0.1360.60% ±0.280.84 ptsGemini 3.8 Flash ahead
Excel Modeling Benchmark72.20% ±2.4256.98% ±3.1315.22 ptsGemini 3.8 Flash ahead
Tax Agent Bench32.12% ±3.3732.80% ±2.750.68 ptsWithin published margins
FAB v2 cost / time per task$2.00 / 3m21s$0.77 / 5m04s
API price per 1M tokens (in / out)$1.50 / $7.50$1.25 / $4.25

How to read this

  • "Within published margins" means the gap is smaller than the two published margins added together, so the order is not settled.
  • Both models ran in the same Vals AI harness with the same tools; your own prompts and tools may give different results.
  • These are research and modeling tests graded by AI judges, not trading results.

Limits that apply to each model

Gemini 3.8 Flash

  • Strong on analyst research and Excel modeling, much weaker on corporate tax research (18th of 69 on Tax Agent Bench).
  • Same-family judge caveat as other Google models: Gemini 3.1 Pro sits on the Finance Agent v2 jury.

Muse Spark 1.2

  • Excel modeling is a weak spot: 42nd of 74 on the Excel Modeling Benchmark.
  • Its financial modeling category lead on Finance Agent v2 is 34.5% Context: n: not disclosed per category · Oct 12, 2026 leaderboard · Vals AI · margin: not disclosed, which means most modeling answers still miss.

Primary sources

Last verified: . Prices and scores change; check the primary source before relying on them. We have no affiliate links and receive nothing from the companies listed. Every percentage carries its sample size, period and source (no naked percentages).

Not financial advice. For information and education only. Benchmark scores and vendor descriptions are not trading results and do not predict returns. Nothing here is a recommendation to buy or sell any asset or to subscribe to any product. See our disclaimer.