Tuesday 5 March 2013

How Privacy Affects Media Mix Optimization and What You Can Do About It


One of the core features of TagMan's product is to provide advertisers with the ability to get the full picture of their marketing effectiveness across all digital channels at every step of the consumer’s journey towards purchase. Advertisers then use these journeys to make decisions that drive more revenue and better marketing through more effective channel allocation. The jargon for this is 'media mix optimisation , and it means deciding which combination of marketing activity best supports the advertiser’s goals. To provide this functionality, we need to track the marketing campaign activity (clicks and views) that drive customers to our clients' websites through the use of cookies.

Tracking of consumer behaviour across different websites has recently become a hot topic among privacy advocates, regulators, and consumers, especially with the rise of sophisticated targeted advertising. The emerging industry principle is that consumers should have visibility of, and control the extent to which they are tracked and by whom when they are online. Web browser configuration options and add-ons are the typical methods used to increase consumer visibility and control. Two features of web browser security settings are commonly used for this purpose - control over 3rd party cookies and the "do not track" header.

Third Party Cookie User Controls and Defaults

A cookie is a snippet of information that is saved in the browser, and can only be set or read by a single domain (usually a single website). The industry further differentiates between 1st party and 3rd party cookies.1st party cookies are set by a base web page itself, while 3rd party cookies can be set by other assets on the page that come from a different domain, such as script or image tags from an adserver or web analytics tool. Browsers have always offered users control over whether they set and accept either type of cookie, as well as the ability to remove any cookies that have already been set. Two of the top level settings for user control are whether to accept cookies at all, and whether to accept 3rd party cookies.

3rd party cookies can be used to identify a user on any site where the asset, or tag, is placed. Many marketing technologies used by advertisers use 3rd party cookies to measure how effective advertisements have been, because they can see whether somebody who comes to the advertiser’s site has seen an advert or not beforehand on a different site. Generally, the tags that set and read these cookies are provided by vendors who are 3rd party with respect both by the publisher site (where they are used to track clicks and views) and the advertiser site (where they are used to track visits and conversions, and sometimes attribute revenue to the vendor for delivering customers).

Although this is greatly beneficial to advertisers, tracking users across different websites and targeting them with personalized adverts has caused privacy concerns. It is because of this that most browsers have allowed users separate control over the use of third party cookies. However, most people continue to accept 1st party cookies because they are so fundamental to the way many websites work, such as remembering passwords when logging in. As a result, the default setting for most web browsers is to have first party cookie tracking “on,” so if you do nothing, they will be accepted. This is also true in most browsers for 3rd party cookies. Until recently (see below) Safari has been the exception, as it defaults to accepting 1st party, but not 3rd party cookies. As Safari is the default browser for IOS devices (iPhones and iPads) this represents an increasingly large share of consumer traffic. Currently, 17.5% of all traffic that we see at TagMan comes from Safari users, and therefore probably does not accept 3rd party cookies by default.

Recently Firefox also recently announced the intention to change their default for third party cookies. In upcoming release 22, they will have a similar, but slightly more relaxed version of the Safari policy (the difference being that the existence of pre-existing 3rd party cookies will be interpreted as consent). If this proposal is undertaken, it will dramatically increase the extent of this issue (Firefox currently has around 20% market share).

Do-Not-Track Header User Controls and Defaults

Do not track (DNT) is a more recent addition to privacy control tools. This is a setting in the browser that allows the browser to send a signal (as part of the HTTP request), whether it’s to the website domain or a third party domain, that that user does not want to be tracked. Unlike cookie control, which is implemented by the browser, and be overridden by the website or a third party tag on the page, the effect of this directive is voluntary for websites; however, most digital marketing vendors do adhere to it.

Most browsers leave this header to “not set” by default, signaling that the user has not explicitly rejected third party cookies and will accept them by default. The latest version of Microsoft’s browser Internet Explorer (IE10) has reversed this, and defaults to “on,” signaling that users do not want to be tracked. There is considerable debate around this (see the WSJ article on this), especially as the original specification of the standard implies that DNT “on” indicates a conscious choice not to be tracked. Some server-side technology vendors have even taken the step to ignore the DNT setting for IE10 users (see apache's position on this, or or this article on support for DNT by sitecom). TagMan at present respects DNT for all browsers.

TagMan Privacy Support

TagMan has always been very proactive in supporting user choice and control when it comes to online privacy and tracking practices. We offer users a number of ways to control privacy preferences:

  • We have always supported explicit "opt out" functionality, which enables our advertisers to give their customers the ability to permanently opt out of our tracking altogether.
  • We were one of the first in our space to fully support the DNT header opt-out methodology.
  • In addition to opting users out of our own campaign tracking, our opt out / DNT support can be used to control the tracking tags that we serve for our clients through our tag management solution, so that advertisers can specify whether they would like tracking tags from any vendor to fire if a user has opted out.
  • Finally, TagMan protects the consumer by providing vendor level opt-outs and privacy information through an integration with Evidon, the global leader in consumer privacy consent.

Opt-outs and Campaign Tracking Data

So how do all of these privacy controls affect your media mix optimisation  Well, if a customer is not tracked by TagMan as a result of one of these privacy choices, then we won’t be able to tell you what advertisements they saw or clicked on when they convert. This is an increasingly big challenge for marketers, due to the reasons described above - increased awareness and support for privacy choice, changes in the default settings for DNT by Internet Explorer, and growing traffic on mobile and tablet devices that don’t allow third party cookies by default. Fortunately, there are a number of things we can do to mitigate the effect.

Ensuring Accurate Data and Measuring the Problem

The first thing that we can do is accurately quantify and track the extent to which these factors contribute to any loss of tracking data – so we know how big the problem is and which users were affected. TagMan can do this because we record all conversions (usually a sale or registration) on the advertiser’s site, whether the user was tracked or not. We also explicitly record the users that have either opted out, or have DNT set, as well as the likely number of 3rd party cookies that have been disabled through a default setting by recording which browser the customer was using. By tracking all these things, we can identify the proportion of the total users that have not been tracked due to a privacy setting (as opposed to those who simply were not exposed to any marketing activity before converting).

Looking at the figures for non-tracked consumers across our entire install base, we can see that:

  1. The number of users who have opted out through DNT (whether by default or not) is increasing. It is TagMan’s intention to continue to support customer privacy choice in this area, however we will continue identifying and quantifying this factor to determine its impact on tracking.
  2. Users that have opted out through a 3rd party cookie privacy preference are already a significant and growing factor. To reduce this, we recommend that our advertisers consider using TagMan under a 1st party cookie domain, as described below.

First Party Tracking as a Solution

The use of 1st party domains on behalf of advertisers is a very common solution to tracking issues, and is supported by many analytics vendors. Besides better tracking of users that have opted out of third party cookies, other benefits of this approach are that it implicitly reinforces the fact that we are collecting data on behalf of the advertiser (and not on our own behalf as TagMan), and it also further separates each of our advertiser’s data from one another. TagMan already keeps each advertiser’s data separate, even on 3rd party domains, but this further reinforces the separation.

There is little downside to advertisers that wish to adopt this approach, as it is very straightforward to configure. Although there is some administration work involved in setting up the domain, it can be implemented without any code changes on their site, so long as they are already on the most recent version of TagMan. The final change would be to replace existing click redirect links and impression tracking pixels if the advertiser has already implemented them on their campaigns.


In conclusion, our view is that TagMan and our advertisers need to support their customers in their privacy choices, both to conform to changing regulatory conditions and also to build consumer trust for online advertising. TagMan is striving to allow both flexibility in how this is achieved, and also full transparency, especially to advertisers. We will continue to work with advertisers to ensure that the data that we collect is accurate, and they can clearly see the impact of these privacy choices when performing media mix optimisation. We will also continue to innovate on solutions to tracking issues as standards and technologies evolve to find the right balance between consumer choice and marketing measurement for all of our clients and partners.

Thursday 22 March 2012

Meetup Roundup: London Scrum Usergroup (#LSUG) March 2012

The London Scrum Usergroup (LSUG) has had a bit of resurgence relatively recently. Most people who undergo some kind of Scrum Alliance training in London usually get encouraged top become part of the community, and often LSUG and the Scrum Alliance Google group are rolled out as options. I recently went along to the latest meetup.

Thursday 15 March 2012

Trying a different relative estimation approach

At TagMan, we use frameworks that facilitate the Agile mindset as much as possible. Some teams are currently using Scrum, while others are taking a more Kanban-like pull/flow approach. We are still learning both, and constantly look at how we can understand the outcomes of the frameworks, so that we can make them effective in the context of our particular environment.

One of the teams planning their next sprint with their Product Owner
Estimation in general is a double-edged sword. When you have a system that starts to flow well, it actually can become a form of waste. However, while we are still learning it's a useful means to allow us to understand our throughput each development sprint, and to better understand differences in complexity. From a scheduling point of view the main benefit of estimation is really just to allow you to plan releases effectively when you are using an iterative approach.

We have recently adapted our estimation approach to see if it makes the planning process more effective and enjoyable, and wanted to share our experiences with you!

Tuesday 21 February 2012

Welcome to the Techblog

TagMan is the global leader for tag management, allowing customers around the world to manage their digital marketing assets more easily, efficiently and powerfully than ever before. This doesn't happen by magic: since TagMan was founded in 2007 we have been driven by the knowledge that true innovation in software is a creative discipline. Ultimately this comes down to great people with great ideas and great execution.

To introduce this new blog I first need to start with a small story: As we grow, we attract attention from some very innovative and well-respected people. I had the pleasure of talking to one of these people who works for one of the most well-known technology brands in the world. As we were discussing various topics he made the very interesting comment that if someone asked him to name the top company in the UK leading the way in cool product and technical innovation, he wouldn't be able to do so.

This intrigued and concerned me: Is the UK that far behind in applying its amazing software talent pool that no one company has been able to utilise that amazing source of creativity to become a name to rival Google, Apple, Facebook, etc.? Or is it the case that UK companies are simply far too modest in their skills, talent and achievements? I think the latter is more likely.

That's what this blog is all about. At TagMan we want to share our technical adventures with you. What works for us, and what doesn't. How we have tackled unique challenges and created interesting solutions. We want to share all of this with others in the software and marketing communities.

Most of all, our continued success relies on the people we have, will have, and want to have. It's about expanding our culture where we constantly push ourselves to improve and where work is about creativity, fun and overcoming challenges. Welcome to our world.

Paul Cook, Founder and CEO, TagMan