Stock Analysis Desk

Backtesting Limits

Backtests can help study market ideas, but they can also create false confidence.

Historical tests are useful when their assumptions are visible. They are dangerous when they hide survivorship bias, stale context, execution friction, or overfitting.

A backtest is a research question

A backtest should be treated as a structured question about the past, not as a promise about the future. It can help identify whether a rule would have behaved consistently under certain conditions, but the result depends heavily on the assumptions used to build the test.

Important assumptions include the data source, the timestamp of available information, entry and exit rules, position sizing, fees, spreads, slippage, and whether the tested symbols were selected before or after the outcome was known.

Common ways tests mislead

Overfitting happens when a rule is tuned so closely to past data that it stops being useful in new conditions. Survivorship bias appears when failed, delisted, or ignored symbols are left out. Look-ahead bias appears when the test uses information that would not have been available at the decision time.

Options backtests add more complications because contract selection, implied volatility, open interest, bid and ask spreads, and expiration behavior can all change the practical result.

How to read results more carefully

A better review asks whether the result is robust across time periods, symbols, market regimes, and reasonable parameter changes. It also asks whether the losing cases were understandable or whether the rule failed in ways the user would not tolerate.

Stock Analysis Desk presents backtests as educational context. A strong historical result may justify more review, but it should not replace independent judgment, risk planning, or current source verification.