Sometimes the Best Optimisation Is to Stop

Posted by Sean on September 20, 2016

A few weeks ago we turned our programmatic display off. Not tweaked it, not re-targeted it, not shuffled the budget around inside it. Switched it off entirely and left it off, on purpose.

This is harder than it sounds, because everything about how marketing works pushes against it. Programmatic is easy to keep running; it fills your reports with impressions and a steady trickle of last-click conversions, and while those conversions are there, turning it off feels reckless. There’s always another optimisation to try, another audience to test, another reason to keep the thing alive and busy.

The trouble is that a busy channel and a working channel look identical in the reports. A lot of what programmatic records, retargeting especially, is people who were already going to buy. You show a display ad to someone who’s just been on your product page, they come back and purchase, and the channel claims the sale. You can optimise that setup until the end of time and never answer the only question that matters, which is whether it’s bringing in sales you wouldn’t have had anyway.

The way to find out is to stop and watch. Turn it off, hold everything else steady, and see what the overall numbers do. If sales hold up without it, it wasn’t doing what the dashboard said. If they drop, you’ve learned its real worth, which is worth knowing too.

What made this hard wasn’t the analysis, it was the feeling. Turning a channel off looks like giving up, and marketers are rewarded for activity, for launching and testing and reporting motion. Sitting on your hands and deliberately doing less runs against all of that, even though it was the right thing to do here.

I won’t pretend the pause handed us a tidy answer, but it gave us a clearer one than months of fiddling had, and it broke an argument we’d been having in circles. So it’s on the list of proper options now: sometimes the right move is to switch a channel off for a month and read what happens to everything else.