Hacker News new | past | comments | ask | show | jobs | submit login

Goodhart's law is an adage often stated as, "When a measure becomes a target, it ceases to be a good measure".





I prefer Campbell’s Law — the more a metric is used in social decision-making, the more likely it is to be manipulated.

You’ve stated the widely-accepted formulation of Goodhart’s, but it can be interesting to note Charles Goodhart’s original statement was that “any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.” (The implication is people doubly go wrong presuming the regularity’s existence and placing pressure on it!)


I'm being humorous here.

I kinda disagree with tour takeaway. I have expanded on this idea elsewhere in this thread, however, the main point is that a measure is a byproduct of an existing process. Making the measure a target, i.e. process output, changes (possibly inadvertently) the process itself.

It does not matter if the regularity truly existed or was wrongly presumed to exist, as putting pressure on it invalidates the causal relationship it had before.


I’m not sure I’ve heard it summarized that way before: that good process causes good metrics, but good metrics don’t cause good process.

People are indeed prone to affirming the consequent.

https://en.wikipedia.org/wiki/Affirming_the_consequent




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: