As marketers, finding ways to successfully drive business metrics and organizational goals through marketing is our mission, and continued optimization of our marketing strategy and tactics is our daily work. In the last few years Incrementality and Lift as buzzwords in marketing have started to overshadow other marketing topics, especially given the increasing focus on “growth” marketing. Because these buzzwords put a premium on incremental growth, the notion of incrementality, and the tools to efficiently and effectively measure it, have become a critical focus for marketers.
The notion of incrementality has been around for a long time though. Most marketers have likely heard the 18th century quote from John Wanamaker:
Half the money I spend on advertising is wasted; the trouble is I don't
know which half. - John Wanamaker
Wanamaker’s conundrum gets at the heart of incrementality in the digital age and leads us to ask the following questions:
Incrementality in marketing refers to the incremental benefit generated per unit of action taken. Incrementality is the lift in desired outcome (web visits, conversion, revenue, etc.) provided by marketing activity (ads run, campaigns launched, etc.). Incrementality isn’t solely about assigning credit or value to a conversion (that’s attribution), it’s about identifying the specific interaction that moves a user from passive to active and as such drives real business results.
It can be used to address the following types of questions:
Incrementality strives to identify the causal event of a conversion, allowing businesses to properly allocate budget, reduce wasted ad spend and optimize the marketing mix.
In today’s world it’s a must that marketers require some level of attribution for their paid marketing efforts (last touch, multi-touch attribution, etc.) and also likely provide some form of evaluation of effectiveness (ROI, ROAS, etc.). Measuring and determining the value of marketing has become a common and critical component of marketing organizations these days.
Unfortunately, Incrementality generally isn’t factored into existing marketing attribution or ROI calculations. We are so focused on the mechanics of HOW to measure we lose sight of the WHAT to measure. As a result marketeers often get derailed if asked about the incrementality of their efforts. You measured correctly and assigned credit logically, but how do you know your efforts fundamentally moved the needle? Are our retargeting efforts incremental? Are paid branded terms in search just cannibalizing SEO? Has the TV campaign shown a business lift? Knowing that a lead cost $10 is not as valuable as knowing that same lead generated an additional $100 in revenue. Incrementality testing helps address these questions.
Remarketing has become increasingly popular led by cart abandonment campaigns, recommendations based on site visit behavior, etc. Evaluating based on classic attribution metrics looks great, largely driven by the high intent of the audience (we know they are interested), but incrementality is a bit more nuanced. In our own lead generation programs remarketing new home listings to potential buyers in a given geography we initially saw mixed results, I’ll provide a brief case study.
The ads were extremely compelling and relevant given our ability to leverage consumer intent info from past site visits and integrate into dynamic product ads across a number of ad platforms. The standard measure of success looked great with cost per lead and ROAS much better than our traditional new audience campaigns. So much so that we began shifting even more budget into the remarketing campaigns.
In measuring the incrementality of the campaigns however, it was a little bit shocking to see that we were in low double digits for truly incremental conversions. More importantly, the marginal costs of the leads generated were not consistently ROI positive despite some fairly significant revenue calculation on the true value of the leads. We kept experimenting with tweaking creative, segmenting and isolating audiences (prior channel, recency, similar audiences, geography, etc.), and of course measuring incrementality. We learned a few things along the way:
Based on these insights and numerous others we were able to adjust our marketing spend to optimize for marginal cost of each lead by specific audience segments defined by geography, recency, and site behavior. The process provided valuable insights into not only our marketing efforts, but user behavior, our product experience, and our business model.
There are three common ways to measure incrementality.
Marketing Mix Modeling (MMM) is an important practice in which historical regression can be used to derive incrementality, but this assumes the future will behave much like the past, so things like seasonality, a rapidly changing market, intense competition, etc. can impact reliability.
Multi-Touch Attribution (MTA) is a great framework for attribution, but is often challenged in today's ad environment dominated by “walled garden” networks, current pixel tech (complicated by increasing privacy concerns), and multiple users' presences across numerous devices. Attribution alone also often does not account for ‘immeasurable’ contributions like brand equity, offline marketing, and existing organic behavior.
The most common and generally recommended approach for measuring incrementality is a Design of Experiments (DoE) test.
In a typical Incrementality test, the target audience is segmented into a test group (exposed to the ads) and a control group (suppressed from seeing the ads or shown a “placebo”/Public Service Ad) and the conversion lift on the test group is compared to the conversion lift on the control.
For example: Your test group saw 2% conversion whereas your control group saw a 1.5% conversion. So (2% - 1.5%) / 2% = 25% incrementality in conversions. Then of course you’ll then have to determine whether the 25% incremental conversions were worth the cost of the particular marketing effort.
This methodology accounts for the immeasurable or organic behavior and any other marketing activities, since both the control and treatment groups are being equally affected by those.
Incrementality is an even bigger problem in retargeting where there is potentially strong existing organic behavior from users. A common example of this approach are geographic audience holdouts often used for non-digital executions or the creation of separate and distinct audience cells in digital media.
Like many things, success is often in the planning. It’s important that you spend a bit of time thinking about the DoE incrementality test and what you specifically want to learn. The big challenge here is making sure you are asking the right questions before executing successfully so that your end results are not only accurate, but actionable.
Incrementality is neither good nor bad explicitly, it simply provides insights that have to be aligned with other marketing opportunities. Results are rarely perfect. Incrementality projects are very much It’s about the journey. Along this journey you learn to ask the right questions, analyse the results, and make yourself smarter about your marketing and what actions you take to scale your programs for success.
Once you’ve successfully implemented an incrementality test, what’s next? Any time when you run a lift test or incrementality test you are largely going to be evaluating two interrelated things: Marginal Cost and/or Cannibalization.
Marginal Cost: Most marketing reports look at a blended average for the campaign (or ad platform), which can conceal actual results. When you’re running an incrementality test, you want to see your “real” marginal cost. If too costly, it might not make sense for your business to scale up that channel.
Cannibalization: Cannibalization is related and can be a driver of increased marginal cost, but it can also be independent. Cannibalization occurs when an incrementality test shows that a user would have ultimately successfully converted and credit given to another channel/campaign (often un-measured organic), but the channel/campaign being measured “stole” the conversion as a result of existing business rules or attribution practices.
An app retargeting campaign was added to our existing app acquisition efforts across a mobile display network where the primary KPI was the value of leads generated. Not surprisingly, the cost per lead was much lower with retargeting, and the blended average KPIs of the entire campaign improved. Success!
Looking at the incrementality of the campaign however revealed that less than 20% of the retargeting campaign's impact was incremental. That fact alone meant the marginal (incremental) cost of those additional leads were actually 5X more expensive than originally assumed (pushing negative ROI), and we were simply taking credit for actions which would have eventually occurred through other channels (cannibalization). Failure?
Based on these insights however, we were able to further segment audience data and better understand timing of communication, specifically the interplay between app messaging, email, and the display campaigns. For a certain population (e.g. lapsed users, opt-outs, etc.) the display campaign showed significant incrementality, and augmented existing “organic” re-marketing efforts with acceptable marginal cost. Success!
In hindsight (and simplified for discussion) the outcome seems elementary, but in reality it becomes more complicated and requires a marketer embrace the complex dynamics of their campaigns.
Another classic question involves the incrementality of paid search, with plenty of well documented arguments on both sides. The short answer for search is usually neither a yes or a no, but a Maybe. For example, It’s highly likely paid search is not 100% incremental if you have even a minimal SEO presence. At the same time, attribution models often overlook the “brand” benefits of search beyond the simple click behavior.
Running incrementality tests on thousands (if not more…) keywords is likely unproductive, so focus on keyword segments like branded terms, category terms, product inventory, locations, etc. across your search portfolio and devise certain business rules for SEM efforts and use incrementality testing on those efforts. SEM is often evergreen and audience is not pre-determined (it’s driven by intent), making it difficult to suspend or segment for a test. For this reason geographic segmentations (hold outs) are often used in addition to other segmentation.
Even though your focus is likely SEM (paid search efforts), start with SEO (organic search efforts) What’s your Share of voice? How often are you showing up in the top spot for a given keyword? Understanding this is often challenging and inaccurate, the general goal is to have better insights into which keywords and under which conditions you have a strong position.
Short answer is that if you are not ranking well in SEO the SEM ad is likely incremental. Likewise if you are ranking well in SEO, then you may choose to only show SEM ads to “new visitors” (i.e. not individuals who have previously visited and use search as a shortcut to URL) or make bid decision based on location, time, and of course keywords specifically to shift to greater incrementality. It’s not an all or nothing proposition and the effort will never be perfect. The goal is simply that continued learning and optimization to ensure your search efforts are working as hard as possible to drive business growth.
Focusing on incrementality in your marketing efforts can have a profound impact on your overall marketing strategy and marketing mix. It can help you scale your marketing efforts and provide the justification for needed resources and budget. It also provides a powerful foundation to engage and align the rest of the organization on the focus of incremental growth.
Incrementality can become a common benchmark that applies equally across the organization, providing a true value to the impact of initiatives. What CEO and CMO wouldn’t like a data driven marketing discussion on the marginal cost of acquiring a new user and the potential opportunity given additional marketing budget!
Think of incrementality as the North Star of marketing. By measuring for it, you can begin to understand the positive, negative, or neutral impact a marketing initiative has on your business. Implementing a focus on Incrementality testing can help:
It’s hard to argue against the benefits of incrementality testing. Not only is it the most accurate way to deduce the actual cost of acquired users, but it can also prevent you from cannibalizing your organic traffic. There’s a reason CMOs consider incrementality the “gold standard” of performance metrics. It’s the only way to accurately answer the question: “Did my advertising actually impact the business?” By that measure, it’s critical for marketing teams to get started with incrementality or risk leaving real revenue on the table.
This is how the different elements of your Rich Text Block (RTB) input work, the styles will only be applied to elements inside the RTB. Many of the styles will match other styles throughout the site, this is a way for you to decide what style to apply as you see fit.
The following are all paragraph styles, they can only be applied to the entire paragraph. You can apply the style by selecting any single word within the paragraph, you do not need to select the entire paragraph, highlighting a single word and selecting the required style will automatically apply to the entire paragraph.
This is a paragraph, use this for all the standard body text on the site… This is a paragraph, use this for all the standard body text on the site… This is a paragraph, use this for all the standard body text on the site…
This is a quote, use this for emphasis text that is inset and highlighted, such as a quote.
This is a bullet list item, the text uses the same body style as the paragraph style, but is set as a list item with a bullet.
This is a numbered list item, the text uses the same body style as the paragraph style, but is set as a list item
The following are all character styles, they can be applied to single words or groups of words. You can apply the style by selecting any single word or words within the paragraph, the style does not apply to the entire paragraph. There are 3 character styles, Bold, Italic, Link. The link style also allows you to apply a hyperlink to an external site.