WallStreetDebug>_ Wall Street, debugged.
Markets
Subscribe
Test report

About 570 AI paper portfolios, three weeks: Claude led each week, but the S&P 500 beat all five AI families in the last

On October 12, 2026 the AI lab Infinite Ascent published weekly results from its live trading ledger, where five model families run paper portfolios under identical rules. The numbers are small and short, and they are also unusually well documented.

+2.66%1Claude's best week, vs the S&P 500 at -0.22%
+1.16%2S&P 500 in the latest week, above all five AI families
76 shares3One NVIDIA order, closed at a 2.92% simulated loss

Infinite Ascent, a company whose team lists researchers from KTH, CERN, Jane Street and Microsoft, published a post on October 12, 2026 describing the trading ledger it uses to test AI agents. Each agent gets an independent simulated brokerage account. A shared system handles execution, accounting and valuation, so hundreds of agents can run under consistent rules. The post closes with three weekly charts, and those charts are what make it worth reading. We opened the post on October 16, 2026 and checked every number below against it.

How the test is set up

Each week began with a new population of agents, with up to 50 portfolios per model family. About 570 portfolios ran across the three weeks shown: 14 to 18 September, 28 September to 2 October, and 5 to 9 October. The week of 21 to 25 September is excluded for system maintenance. The five families are Claude, DeepSeek, GPT, Grok and Kimi, and results are pooled by family and weighted by opening capital4. The post does not say which version of each model ran.

Three weeks of results

Pooled weekly return by model family, against the S&P 500 4
WeekClaudeDeepSeekGPTGrokKimiS&P 500
Sep 14 to 18+2.39%-0.87%-1.81%-2.40%-1.10%-0.09%
Sep 28 to Oct 2+2.66%+0.38%-0.76%-0.51%+0.79%-0.22%
Oct 5 to 9+1.01%-0.27%+0.71%+0.72%-0.35%+1.16%

Claude's portfolios led every week, gaining 2.39%, 2.66% and 1.01%, while the other four families ranged from -2.40% to +0.79% over the first two weeks4. In the first two weeks the S&P 500 was slightly negative, so Claude beat it by more than two percentage points each time. The latest week reversed that. The S&P 500 rose 1.16%, ahead of all five AI families, with Claude closest at 1.01%.

The paths differed as much as the totals. In the latest week, Grok's portfolios were up 1.64% at their peak, fell 1.52% from there to 0.10%, and finished at 0.72%. By maximum drawdown at daily closes, Grok's fall of 1.52% was the largest, ahead of Claude at 0.95%, Kimi at 0.74%, DeepSeek at 0.69% and GPT at 0.48%5.

One trade, from thesis to exit

The post includes a single worked example. On 5 October one agent ordered 76 shares of NVIDIA, describing it as 'the AI earnings engine' and expecting it to outperform the SPY ETF over the week. It recorded one invalidation condition: lagging SPY by at least 1.5 percentage points. Three days later its closing order stated that the condition had been met. The ledger booked the purchase at $237.22 and the sale at $230.29, a 2.92% simulated loss3. The useful part is not the loss. It is that the agent wrote down what would prove it wrong before it traded, and the ledger kept that note.

Why the accounting matters

Paper-trading tests are often too generous, so the rules matter. Infinite Ascent says equity purchases fill at the observed ask and sales at the bid, so the spread counts. Order size is capped using volume from prior completed sessions, so an agent cannot assume unlimited liquidity. Short sales need simulated borrow, with fees accruing at a default 30 basis points a year, and purchases are cash-funded with no margin loans. Dividends and stock splits are not applied in these experiments, and because orders are simulated they do not move the market.

What it does not show

Fifteen trading days is a very small window, and a single week can flip the order, as week three just did. The post gives no confidence intervals, no count of portfolios in each family each week, and no significance tests. Infinite Ascent says so itself: a correct analysis can lose and a flawed one can profit in a favorable market, so one return is a weak basis for judging capability. The company is also building its own financial models, and its blog lists a trading model called Vulcan Mini, so this is a vendor describing its own evaluation setup.

For context, the larger public record is mixed in the same way. A separate benchmark we covered today, TradeRank, found fewer than half of AI model-seasons finished profitable.

What it shows / What it doesn't

It shows

  • How five AI model families' pooled paper portfolios compared with the S&P 500 in three specific weeks, with Claude ahead of the other families each week.4
  • That the order flipped against the index in the latest week: the S&P 500 beat all five families.
  • What a documented agent trade looks like, with a stated thesis, an invalidation rule and a booked exit.

It doesn't show

  • Whether Claude, or any family, has a lasting edge. Fifteen sessions in three weeks cannot settle that.
  • Which model versions ran, or how many portfolios each family had in each week.
  • What the same agents would do with real money, real fills or dividends and splits applied.

Why it matters

The honest reading of an AI trading test is a table with the index beside it. Three weeks of a clear leader and one week where a plain index fund won is a normal result, and a reason to ask for a longer record.

Data notes

Sample size · period · source · margin of error for each figure marked with a number.

  1. n=up to 50 portfolios per family · Sep 28 to Oct 2, 2026 · Infinite Ascent · margin: not disclosed
  2. n=5 model families · Oct 5 to Oct 9, 2026 · Infinite Ascent · margin: not disclosed
  3. n=1 order · Oct 5 to Oct 8, 2026 · Infinite Ascent · margin: not disclosed
  4. n=up to 50 portfolios per model family per week, about 570 in total · Sep 14 to Oct 9, 2026 · Infinite Ascent · margin: not disclosed
  5. n=up to 50 portfolios per family · Oct 5 to Oct 9, 2026 · Infinite Ascent · margin: not disclosed

Primary sources

Your turn: what should we test next?

Questions about this test or study, or an AI tool you want us to put through the same checks? Reply to our post on X @WallStreetDebug or email [email protected]. The best ideas become next week's tests.

Keep reading

In our directories

How we used AI: We read the Infinite Ascent post in full on October 16, 2026 and kept only figures printed in it, including the chart labels. The test is run by the company that publishes it.

Not financial advice. For information and education only. AI model outputs and research results can be wrong and do not predict future returns. Nothing here is a recommendation to buy or sell any asset. See our disclaimer and methodology.

AI trading agentsPaper tradingLLM benchmarksClaude