Are fund ratings biased against index funds?

I just read a very important study by Vanguard called Mutual Fund Ratings and Future Performance. The title would seems to suggest that this study is going to look at whether mutual fund ratings such as Morningstar’s star ratings are a reasonable prediction of future performance.  The study does tackle this issue, but it also addresses an issue that is, I believe, even more important and that most investors are totally unaware of:

empirical evidence has supported the notion that a low-cost index fund is difficult to beat consistently over time. Yet, despite both the theory and the evidence, most mutual fund performance ratings have given index funds an “average” rating.


I have noted this phenomenon in my work, so I was very interested that Vanguard has done such a detailed study.  The reason that index funds will tend to get only an average rating is quite simple:

we conclude that investors should expect an average rating for index funds when relative quantitative metrics are used. This is because the natural distribution of the actively managed fund universe around a benchmark dictates that an appropriately constructed and managed index fund should fall somewhere near the center of that distribution.

The study confirms this reasoning using Morningstar’s star ratings over the period from 1992-2009.
So, we are left with the tendency for ratings that just look at trailing performance (such as Morningstar’s star ratings) to assign an average (aka mediocre) rating to index funds, despite all of the evidence to suggest that indexing is likely to out-perform the vast majority of actively managed funds.
Morningstar has noted that expense ratios are the best  key predictor of long-term performance, and got a lot of attention for this conclusion, but this does not fully compensate for the inherent bias of ratings such as Morningstar’s star ratings against index funds via the mechanism described by Vanguard.

This entry was posted in Mutual Funds and tagged , , , on by .

About Geoff Considine

After earning his Ph.D. in Atmospheric Science, Geoff worked for NASA for 3 years, leaving to become a quantitative analyst developing trading and portfolio management solutions for an energy trading firm. In 2000, Geoff became a consultant focusing on quantitative methods in portfolio management. Geoff founded Quantext in March 2002. Geoff has published commentary and analysis in a range of publications. Quantext is a strategic adviser to FOLIOfn,Inc. (www.foliofn.com (http://www.foliofn.com)). Neither Quantext nor Geoff Considine is an investment advisor.

One thought on “Are fund ratings biased against index funds?

  1. Roger Wohlner

    I would hope that investors do not use the Morningstar star rankings to determine which funds to invest in. Much has been written about how these star rankings are not a good basis for selecting mutual funds, even Morningstar admits this. As a longtime user of Morningstar data I can honestly say that I never look at a fund’s star ranking.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s