When Metrics Look Good but Results Feel Wrong

Data gets treated as the closest thing marketing has to truth. It is not, at least not on its own. A dashboard can glow green for a quarter while the only number that pays the bills sits flat, and most teams do not catch it until the pipeline runs dry.

Metrics are very good at telling you what happened and almost useless at telling you why. You can post strong surface numbers and still feel the results coming up short. That gap between the report and reality is where bad decisions get made, because the report says everything is fine and the bank account quietly disagrees.

Clicks, impressions, and engagement get the spotlight for a simple reason. They are easy to measure and they move fast, so they make a campaign feel alive. None of them prove real intent. A campaign can pull a flood of clicks and convert almost none of them, and when that happens the metric was never measuring demand. It was measuring curiosity. We have inherited accounts from previous agencies that looked healthy on every chart and were not producing a single qualified lead, because the whole system had been tuned to make the dashboard look good rather than make the phone ring.

Open rate deserves a special warning here. Since Apple introduced Mail Privacy Protection in 2021, Apple Mail pre-loads images and fires the tracking pixel whether or not a human ever opened the email, which means a large share of reported opens are now machines, not people. Plenty of brands still optimize subject lines against that number. They are tuning a campaign to please a bot. Any decision built on open rate alone is built on sand.

The deeper trap is optimizing a single metric in isolation. The economist Charles Goodhart gave us the warning decades ago, and it has never been more true in marketing: when a measure becomes a target, it stops being a good measure. Push click rate with a louder hook and you will get more clicks, except the hook pulls in people who were never going to buy, so conversion drops and the campaign gets worse while the metric you chose gets better. The number went up. The business went down. We see this constantly when a team has been told to hit one KPI and has quietly wrecked the rest of the funnel to get there.

The fix is not more dashboards. It is reading data with context next to it. When we audit a client account, we never look at a metric alone. We put it beside the number that actually matters, usually revenue or qualified pipeline, and we watch how they move together. Clicks climbing while sales sit still is not a win waiting to be optimized. It is a signal that the traffic is wrong, the offer is off, or the page is breaking the promise the ad made. The metric is a question, not an answer.

This is also why we report to clients differently than most agencies. We lead with the outcomes that change the business, the qualified leads, the cost to acquire a customer, the revenue and the repeat rate, and we treat clicks and impressions as diagnostics that help explain those outcomes rather than as the headline. A founder does not need to feel good about impressions. They need to know whether the money came back, and bigger.

Data is still one of the most powerful tools we have. The mistake is handing it the steering wheel. Used well, it points you toward the right question and lets you keep your judgment. Taken at face value, it talks you into being confident about the wrong thing. Before you trust a number, ask what it is quietly leaving out, because the metric that looks the best is often the one hiding the problem.

← Back to The Vantage