Beware the Backtest

Backtesting is a popular tool amongst traders and marketers. Traders use it to experiment and uncover new strategies. When one looks promising, the marketers go to work! Creating fancy charts and graphs to sell you on hypothetical performance. But are strong backtests indicative of strong future results?

The world of "Smart-Beta" is filled with promising backtests. Unlike plain-vanilla ETFs that simply track an index, Smart-Beta aims to outperform by adjusting their holdings - sometimes greatly deviating from their index.

A recent study called the Smart Beta Mirage analyzed the performance of these "smarter" funds from 2000 - 2018. Sadly, it found that outperformance only lived in the data.

Smart-beta in backtests showed an above-market returns of 2.77%, but when put into action, they underperformed by 0.44%.

There are several reasons for the disappointing results. The most obvious one, no one can predict the future. The oldest adage in investing is "Past performance is no guarantee of future results". Things change, what worked in the past might not work in the future.

Another reason is backtesting is flawed. It's susceptible to bias and data mining. ETF providers are incentivized to attract as many investors as possible. A great way to do this is to show great performance would've been, even if it sacrifices the integrity of testing.

While backtests are interesting and a great tool if used correctly, like star ratings and analyst targets, they do little in predicting the future. Don't count on them.

Comments

The Art of Giving Feedback

Constructive feedback is an awkward affair. You don't want hurt feelings, but recognize the importance of honesty. You've tried the classic "hoping things will get better on its own" and unfortunately it hasn't played out. When giving feedback, here are a few things that I try to keep it mind. Start with empathy. Step into their shoes and understand their story. If you don't know, ask. Be genuinely curious. Feedback is a dynamic affair. Shared communication with a shared goal towards progress. Take the emotion out of it. Focus on the situation, not the person. Focusing on the person adds unnecessary weight to an already emotionally-bloated event. Be specific. Give clear examples. Vague feedback equals dismissed feedback. Doing above won't de-awkward things fully, but it will dampen it and increase the chance of better outcomes.

ELI5: The Stock Market

Today we get back to basics and answer some of the most common questions about the stock market.

Step One is Knowing

In school, we listen to our teachers. At home, our parents. Throughout our childhood, following instructions is praised and rewarded. When we're young, there's value in this. We don't understand how the world works quite yet, so guidance can be lifesaving. The bias to just accept obviously has drawbacks. Insert old jumping off a bridge adage . This conditioning is especially strong for kids from lower income households. Their parents are more likely in working class jobs involving strict order-taking. Parents of middle-class households tend to be knowledge workers where influence is essential. Studies have shown kids from middle-income households are more willing to negotiable with their teachers. They learn from their parents that things are not set in stone. This leads to better grades and learning outcomes when compared to their lower income counterparts who don't negotiable. In business, if we simply accept things as they are, we would never innovate. In work, w

Herman Ye

Search