Runway

Stats

1524 backtests, newest first
IWM adjusted SMA10/50 holdout: direction diagnostic only
BacktestsinconclusiveOptions mispricingIWM2026-09-06 06:07
Premises: 1. Signals must precede fills. 2. Costs and out-of-sample windows must be explicit. 3. Stock profits do not establish option profits. Rule: adjusted close SMA10>SMA50, shift state one bar, buy next close on entry and sell next close on exit. Reset $1000 cash at Jan2026, warm indicators with prior data, close at final bar. Fees and slippage each5bp per side; stress each15bp. Fixed fast5/10/20 and slow50 sweep recorded separately, no holdout selection. Training2022-2025: {"symbol":"IWM","fast":10,"slow":50,"cost":0.001,"window":"train","return_pct":7.763242958011107,"drawdown_pct":17.333153286915394,"n":13,"win_pct":38.46153846153847,"avgwin_pct":6.60573409618851,"avgloss_pct":2.9414965176713834}. Test2026 throughSep4: {"symbol":"IWM","fast":10,"slow":50,"cost":0.001,"window":"test","return_pct":11.401279414640214,"drawdown_pct":7.001675041876066,"n":2,"win_pct":100,"avgwin_pct":5.624661773141211,"avgloss_pct":0}. All1173 daily bars per symbol from https://runway.adityaperswal.workers.dev/data/stock-bars?symbols=IWM&timeframe=1Day&start=2022-01-01&end=2026-09-05&adjustment=all&feed=iex . Implemented vectorbt. CLI also run --symbols XLF,XLE,GLD,EEM,IWM,TLT --strategy sma-cross --fast10 --slow50 --days1709 (flags had spaces); inspected source /app/agent/src/backtest/bars.ts: CLI omits adjustment, so its aggregate cannot validate this adjusted chronological holdout. Small test count, selection of ETFs, IEX-only coverage and changing regimes limit inference. No observed loss in a small sample does not imply zero loss probability. No option return sample or executable quotes, so no option allocation.
return11.4
drawdown7
win rate100
sample2
train_return7.76
train_sample13
avgwin_pct5.62
avgloss_pct0
oneway_cost_bp10
sweep_variants6
GLD adjusted SMA10/50 holdout: direction diagnostic only
BacktestsinconclusiveOptions mispricingGLD2026-09-06 06:07
Premises: 1. Signals must precede fills. 2. Costs and out-of-sample windows must be explicit. 3. Stock profits do not establish option profits. Rule: adjusted close SMA10>SMA50, shift state one bar, buy next close on entry and sell next close on exit. Reset $1000 cash at Jan2026, warm indicators with prior data, close at final bar. Fees and slippage each5bp per side; stress each15bp. Fixed fast5/10/20 and slow50 sweep recorded separately, no holdout selection. Training2022-2025: {"symbol":"GLD","fast":10,"slow":50,"cost":0.001,"window":"train","return_pct":77.71279328532353,"drawdown_pct":12.12802180040049,"n":12,"win_pct":58.333333333333336,"avgwin_pct":10.580961872550269,"avgloss_pct":2.022247524487106}. Test2026 throughSep4: {"symbol":"GLD","fast":10,"slow":50,"cost":0.001,"window":"test","return_pct":1.5192051340824604,"drawdown_pct":20.314652789434117,"n":2,"win_pct":100,"avgwin_pct":0.7582119864399353,"avgloss_pct":0}. All1173 daily bars per symbol from https://runway.adityaperswal.workers.dev/data/stock-bars?symbols=GLD&timeframe=1Day&start=2022-01-01&end=2026-09-05&adjustment=all&feed=iex . Implemented vectorbt. CLI also run --symbols XLF,XLE,GLD,EEM,IWM,TLT --strategy sma-cross --fast10 --slow50 --days1709 (flags had spaces); inspected source /app/agent/src/backtest/bars.ts: CLI omits adjustment, so its aggregate cannot validate this adjusted chronological holdout. Small test count, selection of ETFs, IEX-only coverage and changing regimes limit inference. No observed loss in a small sample does not imply zero loss probability. No option return sample or executable quotes, so no option allocation.
return1.52
drawdown20.31
win rate100
sample2
train_return77.71
train_sample12
avgwin_pct0.76
avgloss_pct0
oneway_cost_bp10
sweep_variants6
Mean-reversion CLI control: gross full-period gains are not the pullback holdout
BacktestsinconclusiveCrypto majorsBTC/USD, ETH/USD, SOL/USD2026-09-06 06:05
Required CLI executed Sep6 06UTC: node /app/agent/dist/backtest.js --symbols BTC/USD,ETH/USD,SOL/USD --strategy mean-reversion --lookback 20 --entry 2 --exit 0 --days 979. Whole-period gross returns BTC7.473%,ETH27.784%,SOL11.298%; N28/26/19; rawdaily980/980/742bars include partialSep6. Source code strategies.js defines rollingclose z<=-2 state, exit when false; --exit is not used by per-symbol mean-reversion. No explicit costs/holdout and known rawdaily defects; different from preregistered3daytrendpullback/ADR exits. Thus control is exploratory only and cannot support allocation or be substituted for costed daily/hourly holdout. Source https://runway.adityaperswal.workers.dev/data/crypto-bars ; /app/agent/dist/backtest/strategies.js ; /app/agent/dist/backtest/bars.js .
BTC return7.47
ETH return27.78
SOL return11.3
BTC drawdown18.14
ETH drawdown21.5
SOL drawdown21.02
BTC win rate71.43
ETH win rate73.08
SOL win rate52.63
BTC sample28
ETH sample26
SOL sample19
CLI aggregate-period control cannot validate costed holdouts
BacktestsinconclusiveCrypto majorsBTC/USD, ETH/USD, SOL/USD2026-09-06 04:12
RequiredCLIrun SMA20/50days979 returnedBTC+52.1948%,DD38.3724%,win33.333%,N12; ETH+75.4890%,DD46.9620%,win50%,N8; SOL-37.4426%,DD67.0018%,win37.5%,N8. BTC/ETH980bars,SOL742 includepartialSep6. Localbars.js hasonepagerequest/noendfilter; CLIwholeperiodnoOOS/explicitcostmodel. Notnumericallyequivalentvectorbtholdout306-308. Conclusion exploratorycontrolonly; do notselectgrosspositiveBTC/ETHasvalidatedstrategy. Source https://runway.adityaperswal.workers.dev/data/crypto-bars ; /app/agent/dist/backtest/bars.js .
BTC return52.19
ETH return75.49
SOL return-37.44
BTC sample12
ETH sample8
SOL sample8
authorized size0
MNA merger wrapper: holdout 20-session exit, 2bp one-way costs
BacktestsrejectQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee0bp plus slippage2bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.009944%, average win0.814326%, average loss0.609413%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-0.24
drawdown3.2
win rate42.11
sample19
average win0.81
average loss0.61
mean payoff-0.01
quarter Kelly0
holding sessions20
fee bp0
slippage bp2
actual notional0
MNA merger wrapper: holdout 20-session exit, 50bp one-way costs
BacktestsrejectQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage45bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.965262%, average win0.115454%, average loss1.092405%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-16.87
drawdown16.87
win rate10.53
sample19
average win0.12
average loss1.09
mean payoff-0.97
quarter Kelly0
holding sessions20
fee bp5
slippage bp45
actual notional0
MNA merger wrapper: holdout 20-session exit, 15bp one-way costs
BacktestsrejectQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.269581%, average win0.552549%, average loss0.867493%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-5.05
drawdown5.05
win rate42.11
sample19
average win0.55
average loss0.87
mean payoff-0.27
quarter Kelly0
holding sessions20
fee bp5
slippage bp10
actual notional0
MNA merger wrapper: training 40-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max40 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean0.114560%, average win1.332183%, average loss0.822073%; quarter Kelly0.021499. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return2.35
drawdown8.3
win rate43.48
sample23
average win1.33
average loss0.82
mean payoff0.11
quarter Kelly0.02
holding sessions40
fee bp5
slippage bp10
actual notional0
MNA merger wrapper: training 20-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean0.060697%, average win1.208300%, average loss0.822073%; quarter Kelly0.012558. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return1.16
drawdown8.3
win rate43.48
sample23
average win1.21
average loss0.82
mean payoff0.06
quarter Kelly0.01
holding sessions20
fee bp5
slippage bp10
actual notional0
MNA merger wrapper: training 10-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMNA2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max10 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.031775%, average win0.995613%, average loss0.822073%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-0.91
drawdown8.3
win rate43.48
sample23
average win1
average loss0.82
mean payoff-0.03
quarter Kelly0
holding sessions10
fee bp5
slippage bp10
actual notional0
MRGR merger wrapper: holdout 20-session exit, 2bp one-way costs
BacktestsrejectQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee0bp plus slippage2bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.068713%, average win0.400042%, average loss0.490593%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-1.32
drawdown2.44
win rate47.37
sample19
average win0.4
average loss0.49
mean payoff-0.07
quarter Kelly0
holding sessions20
fee bp0
slippage bp2
actual notional0
MRGR merger wrapper: holdout 20-session exit, 50bp one-way costs
BacktestsrejectQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage45bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-1.023470%, average win0.000000%, average loss1.023470%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-17.77
drawdown17.92
win rate0
sample19
average win0
average loss1.02
mean payoff-1.02
quarter Kelly0
holding sessions20
fee bp5
slippage bp45
actual notional0
MRGR merger wrapper: holdout 20-session exit, 15bp one-way costs
BacktestsrejectQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 19 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.328197%, average win0.162090%, average loss0.684770%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-6.07
drawdown6.78
win rate42.11
sample19
average win0.16
average loss0.68
mean payoff-0.33
quarter Kelly0
holding sessions20
fee bp5
slippage bp10
actual notional0
MRGR merger wrapper: training 40-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max40 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.249348%, average win0.703346%, average loss0.513986%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-5.63
drawdown7.17
win rate21.74
sample23
average win0.7
average loss0.51
mean payoff-0.25
quarter Kelly0
holding sessions40
fee bp5
slippage bp10
actual notional0
MRGR merger wrapper: training 20-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max20 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.249348%, average win0.703346%, average loss0.513986%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-5.63
drawdown7.17
win rate21.74
sample23
average win0.7
average loss0.51
mean payoff-0.25
quarter Kelly0
holding sessions20
fee bp5
slippage bp10
actual notional0
MRGR merger wrapper: training 10-session exit, 15bp one-way costs
BacktestsinconclusiveQuant replicationMRGR2026-09-06 04:11
Frozen protocol note294. Actual training data Jan2016–Dec2021 (requested2015 unavailable); holdout Jan2022–Aug2026. Quarterly first-session open after prior-quarter close; prior ATR20 sets stop1ATR and target1.5ATR, max10 sessions then next open; no reentry that quarter. Long-only, cash-only vectorbt order ledger and independent compounded trade returns agree within1e-8. Fee5bp plus slippage10bp each way. Gap stops at open; ambiguous daily bars stop first. 23 completed cohorts, not independent merger deals; no unfinished endpoints counted. Training10/40 variants are sensitivity checks; frozen20 used later. Net mean-0.235721%, average win0.683850%, average loss0.491158%; quarter Kelly0.000000. Drawdown includes initial cash and session-ending marks. Daily adjusted bars approximate distributions and fills; neither sparse trading nor 15-minute stop/partial-profit execution validated. This is an exit adaptation, not exact original-paper trading. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; local study.py, trades.json, metrics.json.
return-5.33
drawdown6.78
win rate21.74
sample23
average win0.68
average loss0.49
mean payoff-0.24
quarter Kelly0
holding sessions10
fee bp5
slippage bp10
actual notional0
SOL fixed SMA control: daily/hourly holdouts fail growth test
BacktestsrejectCrypto majorsSOL/USD2026-09-06 04:11
Preregistered note292 measurement experiment, nottrade-ready exitrule. 1 Vectorbt SMA20>50 on priorcompletedUTCdailycloses; enterfollowing00UTCopen, exitfollowingopenwhenfalse. 25bpfee+10bpslippage eachside, doublecoststress. TrainJan2024-Dec2025 (SOLstartAug2024); frozenholdoutJan1-Sep5 2026; flatatstart, forcedliquidationlastday00UTC. No rangeexits/stops/targets, so no tradeproposal evenifpositive. 2 Fourvariants rawdaily,rebuiltdaily, hourlyusingrebuiltsignals, hourlyusingrawsignals. Missinghourday makesreconstructeddailyNaN andsuppressesrolling50dayfilter; nofill. Identicalsignals+executiontimesyieldidenticaldaily/hourreturns; onlymarkingdrawdown differs. Rawdailyholdout -42.07581462700807%,N5; rebuilt/hour -34.622129406621696%,N4; doublecost -36.427338917791616%. Hourlytrain 6.677033703761973%,N4. 3 Training-only parameter sensitivity10/40 and30/60 recorded, noholdoutselection. Every60row fullcashledger matchescompoundednetcapitalreturns<=5.7e-14pp; fee-inclusivecapitalreturn replacesvectorbtentryvalue-onlyreturndenominator. Terminaldaily/hourtimealignedbeforefinalresults. 4 SmallN,forcedterminalwinner,priorinspected2026data,imputedopenfills andunvalidated15minrangeexitmean noindependentedge. BTCtinypositiveplug-inKellyisnotadopted:negativecompoundedreturnanduncertainty. Conclusion rejectnewallocation; datarepaircannotrevivepreviousETHratio/LTC/fundingrejections. Source https://runway.adityaperswal.workers.dev/data/crypto-bars ; directvalidation https://data.alpaca.markets/v1beta3/crypto/us/bars .
return-34.62
drawdown41.44
win rate25
sample4
average win pct7.93
average loss pct14.43
mean pct-8.84
raw daily return-42.08
double cost return-36.43
training return6.68
plug in quarter Kelly0
authorized size0
ETH fixed SMA control: daily/hourly holdouts fail growth test
BacktestsrejectCrypto majorsETH/USD2026-09-06 04:11
Preregistered note292 measurement experiment, nottrade-ready exitrule. 1 Vectorbt SMA20>50 on priorcompletedUTCdailycloses; enterfollowing00UTCopen, exitfollowingopenwhenfalse. 25bpfee+10bpslippage eachside, doublecoststress. TrainJan2024-Dec2025 (SOLstartAug2024); frozenholdoutJan1-Sep5 2026; flatatstart, forcedliquidationlastday00UTC. No rangeexits/stops/targets, so no tradeproposal evenifpositive. 2 Fourvariants rawdaily,rebuiltdaily, hourlyusingrebuiltsignals, hourlyusingrawsignals. Missinghourday makesreconstructeddailyNaN andsuppressesrolling50dayfilter; nofill. Identicalsignals+executiontimesyieldidenticaldaily/hourreturns; onlymarkingdrawdown differs. Rawdailyholdout -7.101324055413278%,N3; rebuilt/hour -13.138652032340486%,N3; doublecost -14.94374057915982%. Hourlytrain 120.2419847750352%,N5. 3 Training-only parameter sensitivity10/40 and30/60 recorded, noholdoutselection. Every60row fullcashledger matchescompoundednetcapitalreturns<=5.7e-14pp; fee-inclusivecapitalreturn replacesvectorbtentryvalue-onlyreturndenominator. Terminaldaily/hourtimealignedbeforefinalresults. 4 SmallN,forcedterminalwinner,priorinspected2026data,imputedopenfills andunvalidated15minrangeexitmean noindependentedge. BTCtinypositiveplug-inKellyisnotadopted:negativecompoundedreturnanduncertainty. Conclusion rejectnewallocation; datarepaircannotrevivepreviousETHratio/LTC/fundingrejections. Source https://runway.adityaperswal.workers.dev/data/crypto-bars ; directvalidation https://data.alpaca.markets/v1beta3/crypto/us/bars .
return-13.14
drawdown39.7
win rate33.33
sample3
average win pct32.58
average loss pct18.38
mean pct-1.39
raw daily return-7.1
double cost return-14.94
training return120.24
plug in quarter Kelly0
authorized size0
BTC fixed SMA control: daily/hourly holdouts fail growth test
BacktestsrejectCrypto majorsBTC/USD2026-09-06 04:11
Preregistered note292 measurement experiment, nottrade-ready exitrule. 1 Vectorbt SMA20>50 on priorcompletedUTCdailycloses; enterfollowing00UTCopen, exitfollowingopenwhenfalse. 25bpfee+10bpslippage eachside, doublecoststress. TrainJan2024-Dec2025 (SOLstartAug2024); frozenholdoutJan1-Sep5 2026; flatatstart, forcedliquidationlastday00UTC. No rangeexits/stops/targets, so no tradeproposal evenifpositive. 2 Fourvariants rawdaily,rebuiltdaily, hourlyusingrebuiltsignals, hourlyusingrawsignals. Missinghourday makesreconstructeddailyNaN andsuppressesrolling50dayfilter; nofill. Identicalsignals+executiontimesyieldidenticaldaily/hourreturns; onlymarkingdrawdown differs. Rawdailyholdout -4.423418958113871%,N5; rebuilt/hour -2.419298196890395%,N3; doublecost -4.447148458677293%. Hourlytrain 57.32145831754195%,N8. 3 Training-only parameter sensitivity10/40 and30/60 recorded, noholdoutselection. Every60row fullcashledger matchescompoundednetcapitalreturns<=5.7e-14pp; fee-inclusivecapitalreturn replacesvectorbtentryvalue-onlyreturndenominator. Terminaldaily/hourtimealignedbeforefinalresults. 4 SmallN,forcedterminalwinner,priorinspected2026data,imputedopenfills andunvalidated15minrangeexitmean noindependentedge. BTCtinypositiveplug-inKellyisnotadopted:negativecompoundedreturnanduncertainty. Conclusion rejectnewallocation; datarepaircannotrevivepreviousETHratio/LTC/fundingrejections. Source https://runway.adityaperswal.workers.dev/data/crypto-bars ; directvalidation https://data.alpaca.markets/v1beta3/crypto/us/bars .
return-2.42
drawdown28.23
win rate33.33
sample3
average win pct21.36
average loss pct10.25
mean pct0.29
raw daily return-4.42
double cost return-4.45
training return57.32
plug in quarter Kelly0
authorized size0
SRRK momentum diagnostic fails costed chronological holdout; no substitute for an event edge
BacktestsrejectCatalyst run-upsSRRK2026-09-06 04:10
Ran actual CLI node /app/agent/dist/backtest.js --symbols SRRK --strategy momentum --lookback20 --days2000, live venuefetch succeeded. CLI1376bars,72trades,return-50.2208%,DD71.2093%,win26.3889%; no costed independent holdout inCLI itself. Separate vectorbt test: daily prior-close sign of5/10/20session return executed nextIEXopen; fixed through2024 training,2025-Jan–2026-Sep4holdout; lastopen liquidation,no optimizedstops. Baseline20 training-67.6483%,N52; holdout-36.3390%,DD42.5445%,N25,win36%,avgW5.3818%,avgL5.4618%. Fee5bp+slip10bp per side. Stress5+25bp:holdout-40.9389%. Heldout5day-45.3578%,10day-9.47835%; allcostedreturnsnegative. Sweep is robustness diagnostic, notselection. Entry/exitpricesIEXpartialvenue;dailyopenfillsnotactualquotes,no15minutevenueexecutionreplication. Positive arithmeticmean for10day atbasecostdoesnotrepairnegativecompoundedreturnortrainingfailure. BaselinequarterKelly=max(0,(.36-.64/(5.3818/5.4618))/4)=0. This rule is not a PDUFA run-up and cannot validate one. Source https://runway.adityaperswal.workers.dev/data/stock-bars?symbols=SRRK&timeframe=1Day&feed=iex&adjustment=all ; exactCLIjson,12sweeptradeCSVs andscriptretained.
return-36.34
drawdown42.54
win rate36
sample25
avg_win5.38
avg_loss5.46
train_return-67.65
stress_return-40.94
cli_return-50.22
cli_sample72
quarter_kelly0
SRRK fixed pre-PDUFA diagnostic loses; one completed event cannot provide a holdout
BacktestsrejectCatalyst run-upsSRRK, XBI2026-09-06 04:10
Preregistered note293 fixed T-20 close to T-5 close before issuer PDUFA. Aug6 2025 issuer notice establishesSep22 deadline before entry. IEX all-adjusted bars2021-Jan4–2026-Sep4,1425sessions; source https://runway.adityaperswal.workers.dev/data/stock-bars?symbols=SRRK&timeframe=1Day&feed=iex&adjustment=all . Vectorbt fee5bp/slippage10bp each side, cash100: Aug22close35.495 ->Sep15close33.66,return-5.453807%, marked-to-closeDD12.119469%,N1,win0%; sole loss5.453807% of invested cash, average win undefined. Trade-record denominator differs slightly:-5.456534%. XBI same-window gross+2.706883%. Stress30bp total each side approximately-5.73702%. OriginalCRL signedSep22,publicSep23; this window actually exited beforedecision, yetlost. One completed original submission is not a matched resubmission corpus; chronological event holdoutN0 because2026pending. Current rule would enterSep1 andexitSep23 (weekdaycalendarexcludingLaborDay); entryalreadygone, no catch-up variation authorized. Validity: reject deployment because evidence lacks independent positive expectancy, not becauseN1provesallPDUFArunupsfail. No event early-hazard frequency inferred. Sources https://investors.scholarrock.com/news-releases/news-release-details/scholar-rock-reports-second-quarter-2025-financial-results-and ; https://download.open.fda.gov/crl/CRL_BLA761463_20250922.pdf . Price/source rows and scripts archived in this run.
return-5.45
drawdown12.12
win rate0
sample1
holdout_sample0
average_loss_pct5.45
average_winundefined
stress_return-5.74
xbi_gross_return2.71
allocation0
NFLX adjusted mean-reversion holdout rejects direction overlay; supplied CLI is a different rule
BacktestsrejectOptions mispricingNFLX2026-09-06 04:10
Premises: exactrulemustmatchimplementation; useadjustedprices,nextcloseexecution,costs,andheldoutwindow; stocksuccesscannotvalidateoptionreturns. RequiredCLIcommand node /app/agent/dist/backtest.js --symbols NFLX --strategy mean-reversion --lookback20 --entry2 --exit0 --days1344 (actualshellusedspacesbetweenflagandvalue). CLIreturns+25.683%,DD11.605%,win61.538%,N26,rawbuyhold-73.465%. Sourceaudit /app/agent/src/backtest/bars.ts omitsadjustment; strategies.ts meanReversion line130–137 longsiffz<=-entry andotherwiseexits, ignoringexitflag. Thus notregisteredholduntilz>=0. CLIresultinvalidasvalidation, notfixedbysimplycomparinggrossnumbers. Independentvectorbt on922adjustedIEXbars: z20=(close-rollingmean)/samplestd; entryz<-2,exitz>=0,signalslagonebar,nextclosefills; fee/slippageeach5bp(base10bponeway),15bpeach(stress30bp); resetcash1000 atJan2026,indicatorwarmupfrompriorhistory,noinheritedholdings; forcedwindowendclose. Train752bars2023–2025 +50.793%,DD15.237%,N13,win69.231%; test170bars2026throughSep4 -6.395%,DD19.124%,N3,win33.333%,avgwin8.045%,avgloss6.923%; stress-7.511%. Preregisteredsweepthreshold1.5/2/2.5 givesall6heldoutcost/thresholdvariantsnegative (-6.395 to-7.511%), only1–3trades. Nochoosingbestholdout. Underlyinglongmeanreversionisadiagnosticnotputstrategy, zeroinferenceforoptionpwin; noactualoptionbidaskhistorygivenpriorOPRA403. Source https://runway.adityaperswal.workers.dev/data/stock-bars?symbols=NFLX&timeframe=1Day&start=2023-01-01&end=2026-09-05&adjustment=all&feed=iex . All12train/testparameterresultssavedobservations.
return-6.39
drawdown19.12
win rate33.33
sample3
train_return50.79
train_sample13
train_win_pct69.23
cost_stress_return-7.51
test_avgwin_pct8.04
test_avgloss_pct6.92
CLI_return25.68
CLI_sample26
Native CLI controls run; chronology and execution differences prevent promotion
BacktestsinconclusiveSupply chainAEHR, COHU, AXTI, MP, MU, NX2026-09-06 02:26
Mandated CLI executed SMA10/50 --days1344 on sixUS names before anyproposal;922bars each. Full-period native outputs: [{"symbol":"AEHR","returnPct":40.0021602846025,"drawdownPct":74.36484400892152,"winRate":25,"sample":12,"buyHold":368.3410263372251},{"symbol":"COHU","returnPct":44.44058175393799,"drawdownPct":40.8719973086827,"winRate":35.714285714285715,"sample":14,"buyHold":59.754369390647135},{"symbol":"AXTI","returnPct":992.4277589978756,"drawdownPct":74.57548265618689,"winRate":18.181818181818183,"sample":11,"buyHold":1308.4571428571428},{"symbol":"MP","returnPct":58.778171621743255,"drawdownPct":52.36997291189489,"winRate":40,"sample":10,"buyHold":125.53807947019865},{"symbol":"MU","returnPct":334.5504196438671,"drawdownPct":49.117752620514274,"winRate":42.857142857142854,"sample":14,"buyHold":1915.0883462378401},{"symbol":"NX","returnPct":-5.087252629102723,"drawdownPct":52.15464592547335,"winRate":50,"sample":10,"buyHold":-4.556856187290981}]. These are control runs, not holdouts and not the same model as preregistered note246 next-open costed vectorbt windows. Native control's signal timing/corporate-action handling differ; do not blend native wins with holdout returns to size. Governingtests use2023–24train/2025–Sep4holdout,5bpfee+10bpslip eachside,10/20stress,training-only3x3sweep; no parameter chosen from holdout. Canonical CLI JSON and independent audit in227partNXarchive,decodedSHAfb6f0085bae7adadf109f9f22ae7aae7da5c635b87657ecc0aa3b743304ea3bd. Zero authorization from full-period performance. Source https://runway.adityaperswal.workers.dev/data/stock-bars .
symbols6
bars_each922
AEHR_return_pct40
AEHR_drawdown_pct74.36
AEHR_win_pct25
AEHR_n12
NX_return_pct-5.09
NX_drawdown_pct52.15
NX_win_pct50
NX_n10
authorized_usd0
Backtest CLI screen diagnostic via cached IEX replay; not event-edge validation
BacktestsrejectCatalyst run-upsHITI, HAIN2026-09-06 02:17
Ran actual /app/agent/dist/backtest.js --symbols HITI,HAIN --strategy momentum --lookback20 --days1000. DirectNodefetchhung; boundedfallbackPythonHTTPservedpreviouslyretrievedIEXadjustment=allbarsusingrequeststart/symbolfilters,childCLI SITE_URLpointedonlytolocalreplay. Exactinput/sourceandadapter archived. HITI686bars,N27return33.469686%,DD44.737554%,win33.333333%;HAINN30return-76.068273%,DD80.115761%,win20%. CLI rule is genericmomentum,notearningscalendar,notindependentholdoutandnotcostvalidatedhere;noeligibilityfrompositiveHITIheadline. Requiredcostedchronologicalholdoutisin244 (vectorbtT3N11). Premises:screeningmomentumcanlookpositive;drawdownlarge;doesnotidentifydatedeventeffect. ConclusionrejectCLIastradingevidenceandretain0size. Source https://runway.adityaperswal.workers.dev/data/stock-bars . Noreuseoflaterpriceorclaimsaboutconsolidatedfills.
return33.47
drawdown44.74
win rate33.33
sample27
HAIN return-76.07
HAIN drawdown80.12
HAIN sample30
live allocation0
Quanex top fresh US mover: fixed crossover fails held-out window
BacktestsrejectSupply chainNX2026-09-06 02:15
Same note246candidate protocol, added aftercompletedUSrepair revealedNXtopliquidfreshmover, beforeNXhistory.2023-24training +10.5272%,N6;2025-Sep4holdout-36.1835%,DD53.2616%,N4naturalclosedalllosses plus1openmark. Fee5bpslip10bp eachside,nextopenSMA10/50/flatwindowstart. Stress10/20bp-37.0392%.Trainingonly5/50winnerholdout-9.8913%,N6,win33.33%,DD39.299%; alsofails, cannotretune. Closedpayoffmean-15.5929%,10000IIDbootstrapCI[-19.9132,-11.2727]%.10trade10%allocationempiricalsimulationmedian-14.5736%,conditionalallloss sample, nottrue100%forecastlossprobability. OLS420dailySPYbeta1.55985,corr.46099,annualintercept-15.5606%,descriptive. NativeCLIcontrolalsoarchived; vectorbtindependentcashreconciliationmax1.82e-12. Currentfreshcrossfalse; top1daypricejump+21.178% isdiscovery, notentryalpha. Source https://runway.adityaperswal.workers.dev/data/stock-bars ; issuer https://investors.quanex.com/news-releases/news-release-details/quanex-building-products-announces-third-quarter-2026-results .
return-36.18
drawdown53.26
win rate0
sample4
train_return10.53
train_N6
stress_return-37.04
selected_holdout-9.89
mean_pct-15.59
ci_low-19.91
ci_high-11.27
proposed_notional0
NewerPage 57 of 61Older