False proxies are annoying

sethgodin.typepad.com/seths_blog/2012/11/avoiding-the-false-proxy-trap.html
False proxies are results that are easy to measure and appear on the surface to be related to actual success of a person, program, or organization. The idea is that the higher these measurements seem, the greater the success at accomplishing some real mission.

The problem is that there are often ways to show growth in one of these false proxies, without actually having much success towards having a real increased impact.

Here are a few false proxies that have particularly frustrated me:

1. Volunteer hours are a false proxy for community impact.

2. Standardized test scores are a false proxy for student learning (let alone for student ability to think for herself, have innovative ideas, be ready for a career, etc.).  For that matter, in many cases, grades may also be a false proxy for all of those things.

3. Number of school events planned and dollar value of supplies collected through in-kind donations are false proxies for the likelihood of students dropping out of school. (Particularly if the opportunity cost of increasing these proxies is really a decreased focus on other things that may actually have more of an impact on dropout rates.)

In all of these situations, increasing the false proxy is not necessarily a bad thing (in fact, if done carefully, most of those things can actually have a very positive impact). However, for all of these false proxies, just making every effort to increase the proxy doesn’t automatically imply that real progress is actually being made towards achieving the real objectives. It is often possible to increase the proxy measurement without increasing real success.

What frustrates me is that people and organizations focus on increasing the proxies while sometimes forgetting about the real goals which are supposedly being measured by the proxies.

Advertisements
This entry was posted in CIty Year, Personal Experiences and tagged , , , , , . Bookmark the permalink.

What do you think? Anything to add? Anything you disagree with? Please add your comments below....

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s