When the Metric Becomes the Product
Measuring the thing is not the same as improving it
Companies love metrics because metrics create the feeling of clarity. Conversion rate rises. Retention falls. Time on site increases.
Numbers make organizations feel objective.
But a metric can quietly become the thing people optimize for, even when it was originally meant only to indicate progress.
The moment a measurement becomes a target, people start changing the system to improve the measurement.
The classic trap
Imagine a support team measured entirely on tickets closed.
The team will become very good at closing tickets.
But perhaps customers actually need problems solved thoroughly, not quickly categorized as resolved.
The metric has become the goal.
Proxy versus outcome
A metric is often a proxy for something harder to measure.
For example:
Goal: happier customers
Proxy: average session length
Longer sessions might mean people are engaged. They might also mean they cannot find what they need.
Context matters.
Build metrics in pairs
One practical approach is to pair a growth metric with a quality metric.
Examples:
- Activation + retention.
- Speed + accuracy.
- Revenue + refund rate.
- Support volume + resolution quality.
The pair makes it harder to optimize one dimension while quietly damaging another.
Metrics should create questions
A healthy dashboard does not eliminate curiosity. It creates it.
If conversion drops, the next question is why.
If engagement rises, the next question is whether the engagement is useful.
The number is evidence, not a verdict.
Organizations become dangerous when dashboards are treated as truth machines.
The best metric is not the number that makes the company look good. It is the number that helps the company ask a better question.
Robert Hayes
AuthorRobert is a technology and business editor who studies platforms, markets, and the incentives shaping digital products.
View full profile & stories
Discussion (0)
Have a question or insight to share on this story?
Sign in to leave a comment