The Secret Art of Backtesting

If you have not back tested your trading system, you might as well trade with your eyes close.

In fact, whatever technical analysis criterion you use to trade with, be it moving averages, candle sticks, volatility breakouts, fibonacci retracements or any other trading system you have devised you're going to need to back test your trading system thoroughly and objectively in order to remove any possible doubt about it's capability.

To remove any self-doubt you need to thoroughly back test or simulate your trading system in such away that it matches the conditions under which it will be traded. Once you have established that you have a reliable and robust trading system only then will you be confident in trading your system.

When trading what is the question in most traders’ mind?

To answer this question I shall quote the introduction from Chapter 8 Back Testing of Mark Jurik’s book Computerized Trading:

Will my trading strategy be profitable? After having gone through the arduous process of crafting a trading strategy, these are the questions you must ask yourself. The ability to answer these questions are the great promises that back testing holds out for all traders. A successful back testing procedure will greatly reduce the probability that you will begin trading with either an unprofitable strategy or one that does not meet your expectations. By adopting a sound and rigorous back testing approach, you will:

  • Pinpoint which approaches to the market that are likely to be successful and which ones are not.
  • Generate good estimates of future performance for each trading strategy you test.
  • Create a record of your trading strategy's historical trading performance.
  • Produce data necessary for other components of your trading approach such as your asset allocation strategy.

    • Important Trading System Criteria

    Profitability is not the only criteria by which a trading system should be evaluated. Drawdown and stress should equally be considered as well... for example, before you open a trading account:

  • Are you satisfied that your system is reliably profitable?
  • Will drawdowns wipe out your account?
  • Is your system trading in a way you can tolerate?
  • Can you tolerate long periods of no trading or too much trading?
  • Can you tolerate a large string of losses?

    • The only way to answer these questions is to subject your trading system to extensive back testing.

    Lack of Confidence

    Lack of confidence usually forces traders to question their own trading systems. They give into the temptation to modify their trading plan with devastating consequences. This temptation spawns on by a string of losing trades or an opportunity to replace their trading system with a whiz-bang indicator that is usually talked about in traders chat forums.

    Anything that sounds to good to be true will attract the attention of a trader who is not satisfied with their own trading system simply because they have not properly tested their system in the first place. In addition, they have not built up the necessary confidence needed to successfully trade the system developed.

    In the end these negative subconscious thoughts will only hinder and destroy your ability to trade successfully. To improve your confidence in your trading system you need to thoroughly and objectively back test it - simple as that! Only then will you be confident enough to commit time and money to it!

    The Traders Dilemma

    How can you test how a trading system will perform over a period of time when trading an arbitrary group of securities?

    --- To truly evaluate the past performance of a trading system you need a trading simulator, which mimics the day-to-day trading activities of a typical trader. Until now this kind of software has been out of the reach of most traders. In fact, there has been some great headway in back testing software. Personally, I use TradeSim with MetaStock.

    TradeSim is the first realistic true trading simulator/analyzer for Metastock that can quickly back-test and evaluate a trading system across a portfolio of securities. With its powerful data processing capabilities, TradeSim can evaluate the historic performance of a given trading system within a matter of minutes and do it with a realistic representation of a real-life trading scenario. Whether a single security or a multiple security portfolio, TradeSim answers the simple question:

    "What would of happened if this system had of been traded in the past using an arbitrary portfolio of securities?"

    Sounds simple - but is extremely complex if not impossible to do with Metastock as it stands alone. However, with TradeSim it is just a simple matter of running a Metastock exploration on a portfolio of securities using your own set of indicators. When the exploration has finished you just simply run TradeSim and analyse the resulting trade data.

    Your system may look good with an expert overlayed on a single chart.

    "But what about it’s real world trading performance?"

    Typically, your system will consist of entry and exit triggers, prices as well as an initial stop loss. These five parameters basically define a framework for a trading system. The trouble with trying to back test a trading system is that the system tester built into Metastock is only extremely limited. As a result, this can give a very distorted view of your potential trading system performance. TradeSim addresses all of these issues whilst exploring new ground in technical analysis and uncovering new issues that have not been addressed by current software technologies.

    Remember, no matter what back tester you go for, anything that sounds too good to be true will attract the attention of a trader who is not satisfied with their own trading system. This due to the fact that they have not properly tested their system in the first place and have not built up the necessary confidence needed to successfully trade it.

    In the end, these negative subconscious thoughts will only hinder and destroy your ability to trade successfully. To improve your confidence in your trading system you need to thoroughly and objectively back test it - simple as that! Only then will you be confident enough to commit time and money to it! By testing your system, you have just put yourself into the top 1% of traders.

    -=-=-==-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-
    David Jenyns is recognized as the leading expert when it
    comes to MetaStock & designing profitable trading systems.

    His MetaStock website offers a huge free collection of trading
    related tips and tricks. Gain free access now.
    Click Here ==> http://www.meta-formula.com/subscribe
    -=-=-==-=- =-=-==-=-=-=-=-=-=-=-=-=-=-=-

    In The News:

    pen paper and inkwell


    cat break through


    Jack and Jill

    Jack and Jill went up the hill to fetch a... Read More

    How Much Money Can I Make With Trading? What Account Size Do I Need To Start?

    What account size do I need?How much money can I... Read More

    Pamplona, the Wild Investment Bulls

    You remember (they show it on TV every year) the... Read More

    The 1% Solution

    You probably know the story of Sherlock Holmes and the... Read More

    Two for the Money

    Look back over the years and try to remember how... Read More

    Choosing An Investment Stock Broker

    If you want one.And I don't recommend any broker with... Read More

    My Stock - Right or Wrong

    We all know the expression, "My country, right or wrong",... Read More

    Dividends

    When is a dividend not a dividend?The latest thing "conservative"... Read More

    A Stock Market Investment Strategy

    I feel that an investment strategy in the stock market... Read More

    Investment Attorneys and Garbage Stocks

    How is it possible that trash Companies are posting less... Read More

    Gurgle Gurgle

    Caught in a whirlpool and being sucked under. No life... Read More

    Trading Baskets II: The Crapolio, A Roll of the Dice in the Stock Market

    In a previously written article, we expanded the use of... Read More

    Understanding the Bulls and the Bears

    If you've ever flipped on the television to CNN Financial... Read More

    Expense Ratios

    Mutual funds and brokers are always preaching not to buy... Read More

    How To Buy And Hold

    One of the most believed bits of conventional wisdom from... Read More

    Mutual Fund Honor Roll ? Buy High, Sell Low by Chasing Performance

    Buy high and sell low -- It's not a typo.Millions... Read More

    Rebalance And Diversify

    The stock market has not been very kind to your... Read More

    Humpty Dumpty the Stock Market Falls Down

    Humpty Dumpty had a great fall and all the King's... Read More

    Stock Chart Reading

    As an investor you will want to check out any... Read More

    You Wont Like This

    Why? Because I am going to shatter your conventional wisdom... Read More

    The Stock Market is a Roller Coaster: Prepare for the Ups and Downs

    IT'S REMINISCENT OF THE OLD children's tale about an old... Read More

    Stock Market Education; Day Trading for Beginnners; How to Pick Stocks

    The trading method you employ to approach the stock market... Read More

    Some Good News for A Change

    Before we get into all the good news out there,... Read More

    Price Targets

    Every day in any financial publication you will find the... Read More

    Protect Your 401K

    Checked your 401K lately? Going back to about a year... Read More

    Social Insecurity

    Just about everything you have been told about Social Security... Read More

    Getting Even

    I know there are a lot of you out there... Read More

    Investing in the Stock Market - When To!

    Is really not as important as to how you invest... Read More

    The Bottom?

    Every day I hear someone on CNBC proclaim that "this... Read More

    Stock Trading Diversification

    This is the continuing story of our two imaginary traders,... Read More

    Planning Your Dive and Diving Your Plan ? Trading!

    A colleague of mine just returned from a scuba diving... Read More

    Municipal Bonds

    Because there are so many stocks that are NOT paying... Read More

    Stock Valuation using the SMP Model

    Disclaimer: Please note that I do not necessarily purchase, own,... Read More