https://backtestgyan.bulansarkar.com/ The definitive knowledge base on backtesting and quantitative strategy validation — performance metrics, robustness testing, backtesting biases and data quality — for Indian traders, quants and developers, with original diagrams and examples. en-in Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/what-is-backtesting https://backtestgyan.bulansarkar.com/fundamentals/what-is-backtesting Backtesting is the process of simulating a fully specified trading strategy on historical market data to estimate how it would have behaved, so its edge, risk and cost sensitivity can be studied before any real capital is committed. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/why-backtesting-fails https://backtestgyan.bulansarkar.com/fundamentals/why-backtesting-fails Backtesting fails when the reported result reflects fitting to historical noise, information leakage, biased data, ignored frictions or too few trades rather than a genuine, repeatable edge. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/historical-data https://backtestgyan.bulansarkar.com/fundamentals/historical-data Historical data is the recorded market information (prices, volumes, corporate actions and reference data) that a backtest replays, and its accuracy, resolution and point-in-time correctness set the ceiling on how trustworthy any backtest can be. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/trading-rules https://backtestgyan.bulansarkar.com/fundamentals/trading-rules Trading rules are the fully specified, unambiguous logic (entry, exit, position sizing, timing and edge-case handling) that a backtest engine executes deterministically to turn a strategy idea into simulated trades. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/execution-assumptions https://backtestgyan.bulansarkar.com/fundamentals/execution-assumptions Execution assumptions are the modelled details of how orders actually reach the market in a backtest (fill prices, slippage, transaction costs, latency and liquidity limits) and they determine whether a simulated edge could survive real trading. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/data-quality https://backtestgyan.bulansarkar.com/fundamentals/data-quality Data quality is the degree to which backtest data is accurate, complete, consistently adjusted and point-in-time correct, and it sets the hard upper bound on how much any backtest result can be trusted. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/benchmark-comparison https://backtestgyan.bulansarkar.com/fundamentals/benchmark-comparison Benchmark comparison evaluates a strategy's performance relative to an appropriate reference such as a market index or risk-free rate, so that its return is judged against what could have been earned passively at similar risk rather than in isolation. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/validation-process https://backtestgyan.bulansarkar.com/fundamentals/validation-process The validation process is the structured sequence of tests (out-of-sample evaluation, walk-forward analysis, parameter sensitivity, Monte Carlo resampling and forward testing) that establishes whether a backtested edge is robust rather than an artefact of fitting. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/research-workflow https://backtestgyan.bulansarkar.com/fundamentals/research-workflow The research workflow is the disciplined, repeatable pipeline that turns a trading idea into a deployed strategy (hypothesis, data preparation, rule coding, backtest, metric evaluation, robustness validation, forward testing and cautious live deployment), designed above all to prevent self-deception. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/fundamentals/strategy-lifecycle https://backtestgyan.bulansarkar.com/fundamentals/strategy-lifecycle The strategy lifecycle is the full arc a trading strategy travels through (idea, research, validation, deployment, monitoring, decay and eventual retirement) reflecting that every edge is temporary and must be managed across its whole life, not just discovered once. Backtesting Fundamentals Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/cagr https://backtestgyan.bulansarkar.com/metrics/cagr CAGR (compound annual growth rate) is the single constant yearly rate that, compounded over the full test period, would take the starting equity to the ending equity, expressed as (End ÷ Start) raised to the power (1 ÷ Years) minus one. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/absolute-return https://backtestgyan.bulansarkar.com/metrics/absolute-return Absolute return is the total percentage change in equity from the start to the end of a backtest, computed as (End − Start) ÷ Start, with no adjustment for how long the period was or how much risk was taken. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/annualized-return https://backtestgyan.bulansarkar.com/metrics/annualized-return Annualized return is a period return scaled to a full-year rate by geometric compounding, computed for a per-period return r over p periods per year as (1 + r) raised to the power p minus one. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/sharpe-ratio https://backtestgyan.bulansarkar.com/metrics/sharpe-ratio The Sharpe ratio is a risk-adjusted performance measure equal to the portfolio's excess return over the risk-free rate divided by the standard deviation of its returns, expressing how much reward the strategy earned per unit of total volatility. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/sortino-ratio https://backtestgyan.bulansarkar.com/metrics/sortino-ratio The Sortino ratio is a risk-adjusted measure equal to the portfolio's excess return over a target divided by the downside deviation, the standard deviation of only those returns falling below the target, so it penalises harmful volatility while ignoring upside swings. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/calmar-ratio https://backtestgyan.bulansarkar.com/metrics/calmar-ratio The Calmar ratio is a risk-adjusted measure equal to the compound annual growth rate divided by the absolute value of the maximum drawdown, expressing how much annual growth a strategy delivers per unit of its worst peak-to-trough loss. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/information-ratio https://backtestgyan.bulansarkar.com/metrics/information-ratio The information ratio is a risk-adjusted measure equal to the portfolio's active return over a benchmark divided by the tracking error, the standard deviation of that active return, expressing how much and how consistently a strategy outperforms its benchmark per unit of relative risk. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/maximum-drawdown https://backtestgyan.bulansarkar.com/metrics/maximum-drawdown Maximum drawdown is the largest percentage decline from a historical peak to a subsequent trough in an equity curve, taken as the maximum over all points of the peak-minus-equity fall divided by that peak, representing the worst loss a strategy would have inflicted before recovering. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/average-drawdown https://backtestgyan.bulansarkar.com/metrics/average-drawdown Average drawdown is the mean depth of the declines below the high-water mark across an equity curve, describing the typical pain a strategy inflicts rather than the single worst loss captured by maximum drawdown. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/recovery-factor https://backtestgyan.bulansarkar.com/metrics/recovery-factor The recovery factor is a risk metric equal to a strategy's net profit divided by the absolute value of its maximum drawdown, measuring how many times over the strategy earned back the depth of its worst peak-to-trough loss. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/profit-factor https://backtestgyan.bulansarkar.com/metrics/profit-factor The profit factor is a trade-level efficiency metric equal to the gross profit from all winning trades divided by the gross loss from all losing trades, showing how many rupees the strategy earned for every rupee it lost. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/win-rate https://backtestgyan.bulansarkar.com/metrics/win-rate The win rate is the fraction of trades that close profitable, computed as the number of winning trades divided by the total number of trades, describing how often a strategy is right but nothing about how much it wins or loses when it is. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/payoff-ratio https://backtestgyan.bulansarkar.com/metrics/payoff-ratio The payoff ratio is a trade-level metric equal to the average winning trade divided by the average losing trade, describing how large the strategy's wins are relative to its losses and forming, with the win rate, the two halves of profitability. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/expectancy https://backtestgyan.bulansarkar.com/metrics/expectancy Expectancy is the average profit or loss a strategy produces per trade, computed as the win rate times the average win minus the loss rate times the average loss, expressing in a single figure whether and how much of an edge each trade carries. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/metrics/ulcer-index https://backtestgyan.bulansarkar.com/metrics/ulcer-index The ulcer index is a drawdown-based risk measure equal to the square root of the mean of the squared percentage drawdowns at every point in time, capturing both the depth and the duration of declines and penalising deep, prolonged underwater periods most heavily. Performance Metrics Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/walk-forward-analysis https://backtestgyan.bulansarkar.com/robustness/walk-forward-analysis Walk-forward analysis is a validation procedure that repeatedly optimises a strategy on an in-sample window, tests the chosen parameters on the immediately following untouched out-of-sample window, then rolls both windows forward, so that the concatenated out-of-sample results form a track record no single parameter set was ever fitted to. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/monte-carlo-simulation https://backtestgyan.bulansarkar.com/robustness/monte-carlo-simulation Monte Carlo simulation is a robustness technique that repeatedly resamples or reorders a backtest's trade or return series to generate thousands of alternative equity paths, producing a distribution of outcomes, such as maximum drawdown and final equity, rather than the single path history happened to deliver. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/parameter-sensitivity https://backtestgyan.bulansarkar.com/robustness/parameter-sensitivity Parameter sensitivity analysis systematically varies a strategy's parameters across a range and maps how performance responds, to distinguish a robust edge that survives on a broad plateau of settings from a fragile result that depends on one precisely tuned, and probably curve-fit, combination. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/stability-testing https://backtestgyan.bulansarkar.com/robustness/stability-testing Stability testing evaluates whether a strategy's edge is consistent across different sub-periods, instruments, market regimes and small perturbations, rather than concentrated in one favourable window, so that persistence, not a single lucky stretch, is what supports the result. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/cross-validation https://backtestgyan.bulansarkar.com/robustness/cross-validation Cross-validation is a resampling scheme that partitions data into folds so each fold serves in turn as a test set while the rest train the model, but on time-ordered financial data the naive form leaks future information, so it must be adapted with purging, embargoing or forward-only splits. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/scenario-analysis https://backtestgyan.bulansarkar.com/robustness/scenario-analysis Scenario analysis evaluates how a strategy behaves under a set of defined conditions, historical episodes or hypothetical what-if states of the market, so that its response to specific, often adverse, circumstances is understood in advance rather than discovered in live trading. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/out-of-sample-testing https://backtestgyan.bulansarkar.com/robustness/out-of-sample-testing Out-of-sample testing evaluates a strategy on data that was deliberately withheld during its design and tuning, so that performance on this untouched data provides an honest estimate of behaviour, free of the flattery that comes from being fitted to the data you already saw. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/forward-testing https://backtestgyan.bulansarkar.com/robustness/forward-testing Forward testing runs a completely finalised strategy on new market data as it arrives in real time, without any further changes, so that its performance on genuinely unseen data, uncontaminated by design choices, becomes the most honest available evidence before committing real capital. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/paper-trading https://backtestgyan.bulansarkar.com/robustness/paper-trading Paper trading is the simulated execution of a strategy on live, real-time market data using virtual money, so that its behaviour, order handling and operational realities can be observed as if trading, without any capital at risk. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/robustness/stress-testing https://backtestgyan.bulansarkar.com/robustness/stress-testing Stress testing deliberately subjects a strategy to extreme adverse conditions, historical crises, hypothetical shocks and worsened assumptions, to discover where it breaks, how large its losses can become, and whether it can survive events far worse than its average experience. Robustness Testing Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/look-ahead-bias https://backtestgyan.bulansarkar.com/biases/look-ahead-bias Look-ahead bias is the error of letting a backtest use information that would not actually have been known at the moment a decision was made, which makes the strategy appear to know the future and inflates its measured performance. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/survivorship-bias https://backtestgyan.bulansarkar.com/biases/survivorship-bias Survivorship bias is the distortion that arises when a backtest uses only the assets that survived to the present, silently excluding those that were delisted, merged or went bankrupt, which flatters results because the worst outcomes have been removed from the sample. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/selection-bias https://backtestgyan.bulansarkar.com/biases/selection-bias Selection bias is the distortion that arises when the assets, periods or trades used in a backtest are chosen in a way that is not representative of what the strategy will actually face, so the sample itself, rather than the strategy, drives the result. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/data-snooping https://backtestgyan.bulansarkar.com/biases/data-snooping Data snooping, also called data dredging, is the practice of trying many strategies, parameters or variants on the same data and reporting the best one, which manufactures apparently significant results by chance because the more combinations you test, the more likely one looks good purely at random. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/curve-fitting https://backtestgyan.bulansarkar.com/biases/curve-fitting Curve fitting is the practice of tuning a strategy's rules and parameters so closely to a specific historical dataset that it captures the noise of that data rather than a durable signal, producing an excellent backtest that fails on data it has not seen. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/overfitting https://backtestgyan.bulansarkar.com/biases/overfitting Overfitting is the condition in which a strategy or model captures the noise of its training data instead of the underlying signal, so it performs superbly in-sample yet poorly on new, unseen data because the features it learned do not generalise. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/underfitting https://backtestgyan.bulansarkar.com/biases/underfitting Underfitting is the condition in which a strategy or model is too simple or too constrained to capture the genuine structure in the data, so it performs poorly both in-sample and out-of-sample because it has failed to learn the real signal that is present. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/sample-bias https://backtestgyan.bulansarkar.com/biases/sample-bias Sample bias is the distortion that arises when the historical data used to build and test a strategy is not representative of the conditions the strategy will actually face, whether because the sample is too small, too short, or drawn from an unrepresentative period or population. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT https://backtestgyan.bulansarkar.com/biases/confirmation-bias https://backtestgyan.bulansarkar.com/biases/confirmation-bias Confirmation bias is the human tendency to seek, favour and remember evidence that supports a belief you already hold, which in backtesting leads researchers to design, interpret and report tests in ways that confirm a strategy they are already attached to. Backtesting Biases Sat, 11 Jul 2026 18:18:09 GMT