Quantmodel · Strategy research
Cockroach Portfolio
Cockroach Portfolio receives a research grade of F (composite 47 / 100) on Paper-to-Profit robustness tests run against published monthly ours versus SPY. On these tests the published path does not currently support a constructive allocation case.
Factor grades
Published CAGR 8.66% / Sharpe 1.04 / max DD -15.8% over 293 months. Those headline stats are context only; the grade is the robustness tests above.
Assessment
Statistical edge
The path makes money vs zero (p=0.000) but is not a significant edge versus SPY (p=0.384, excess -0.17% per month). Same failure mode as a strategy that only rides beta.
Bootstrap versus SPY
Block bootstrap of consecutive months (400 paths): P(beat SPY) over 6.0 months is 39%; over 24.0 months is 42%. This is the Paper-to-Profit 'realistic path' test, not a reshuffled iid sample.
Alpha decay
16% of 12-month OLS windows have a significantly positive slope and 37% are significantly negative. Terminal strategy/SPY wealth ratio is 0.73. A steadily rising log-relative-wealth line is the decay test from the tutorial; a late collapse is a warning.
Overfit / stability
70/30 OOS/IS Sharpe ratio is 0.93; second/first-half Sharpe ratio is 0.88. Walk-forward parameter search is not estimable on a frozen catalog snapshot; this split is the overfit proxy. Return-space noise did not halve Sharpe on the tested grid.
Transaction costs
Average daily turnover is 0.008%. Additional one-way costs through 24 bps did not cut Sharpe in half. That is the tutorial's cost-robust case.
Regimes and crises
The path beats SPY in 19% of classified months (3.0/6.0 regimes). In bear/strong-bear/vol-down months it beats SPY 100% of the time. Crisis windows: Dot-com bust: strategy -8.6% vs SPY -25.6%; Global Financial Crisis: strategy -8.9% vs SPY -46.0%; COVID crash: strategy -7.0% vs SPY -19.4%; 2022 inflation shock: strategy -10.5% vs SPY -23.9%.
Limitations
Tests use published monthly ours, already lagged one bar in the engine, versus SPY. t-tests assume roughly comparable monthly means; Wilcoxon is shown as a non-normal check. Bootstrap paths are overlapping consecutive months (not iid reshuffles). Noise is added to monthly returns, not to OHLC, because this producer does not rerun backtests. Walk-forward parameter optimization, SPA, and PBO are not estimable without a trial ledger. Fee drag is extra one-way bps on catalog average daily turnover, on top of the published costed path.
Edge tests
| Test | Statistic | p-value | Significant? |
|---|---|---|---|
| t-test vs zero | 5.11 | 0.0000 | yes |
| t-test vs SPY (paired) | -0.87 | 0.3838 | no |
| Wilcoxon vs zero | 29554.0 | 0.0000 | p<0.05 |
Part 1: a strategy that only beats zero but not SPY has no statistically significant edge versus the market.
Monthly return distributions
Strategy versus SPY on the shared window. Input to the t-tests above.
Block bootstrap — 6 months
400 overlapping consecutive-month paths. P(beat SPY) = 39% . Fan is p10 / p50 / p90 of terminal wealth from $1.
Block bootstrap — 24 months
Same construction at a two-year horizon. P(beat SPY) = 42% .
Bootstrap excess CDF
Sorted 24-month strategy minus SPY terminal wealth. Fraction above zero is P(beat SPY).
Relative wealth versus SPY
Strategy equity divided by SPY equity. A rising line is persistent outperformance; a late roll-over is decay.
Rolling OLS slope of log relative wealth
12-month window on ln(strategy/SPY). Positive significant slopes are the tutorial's "edge is still there" test.
70/30 chronological split
Train through 2019-04. OOS/IS Sharpe ratio 0.93 . Walk-forward parameter search is not estimable here; this is the overfit proxy.
Transaction-cost sensitivity
Extra one-way bps applied to average daily turnover, on top of the published (~10 bps) path. Half-Sharpe at beyond 24 bps.
Return-space noise
Gaussian noise scaled by 12-month rolling vol. Not an OHLC re-backtest. Critical multiplier (Sharpe halves): not reached.
SPY regimes
Seven trend/vol states on a 12-month SPY window. Mean monthly return of strategy versus SPY in each state.
| Regime | Months | Strategy mean | SPY mean | Beats SPY? |
|---|---|---|---|---|
| Strong bull | 114.0 | 0.86% | 1.39% | no |
| Bull | 74.0 | 0.83% | 0.97% | no |
| Sideways | 10.0 | -0.39% | -2.85% | yes |
| Bear | 11.0 | -0.21% | -1.84% | yes |
| Strong bear | 2.0 | — | — | — |
| Volatility up | 48.0 | 1.23% | 2.24% | no |
| Volatility down | 34.0 | 0.24% | -0.32% | yes |
Named crisis windows
| Episode | Status | Strategy | SPY |
|---|---|---|---|
| Dot-com bust | ok | -8.6% | -25.6% |
| Global Financial Crisis | ok | -8.9% | -46.0% |
| COVID crash | ok | -7.0% | -19.4% |
| 2022 inflation shock | ok | -10.5% | -23.9% |
Growth of $1
Published path versus SPY, 60/40 when present, and a leave-one-out catalog mix. Context only — not a scoring factor.
Drawdown
Related tools
- Strategy report — open (ok) Equity, allocations, and replication metrics.
- QuantStats tearsheet — open (ok) Full QuantStats HTML from the same monthly ours path.
- Paper to Profit robustness — open (ok) t-test vs zero and SPY, overlapping-block bootstrap, rolling OLS alpha decay, 70/30 stability, extra-bps cost grid, return-space noise, and seven SPY regimes. Walk-forward parameter search is not estimable on this catalog snapshot.