Monthly Archives: February 2009

Measurement: everyone’s talking about it

In the past few weeks there have been numerous items in the on and off-line press about measurement. It seems that when the going gets tough the tough really do start measuring and for so called “New Media” it has never been tougher in its life time. Expect therefore to see a lot more on the subject in coming months as the recession worsens and ahead of that I thought it might be useful to look at one area that commentators are finding most interesting.

Social Media measurement has received some significant attention and in particular recently because of the elevation of Twitter as the new application of the hour. Before Twitter became mainstream organisations were already looking at how social media could be measured and just this week Matthew Yeomans of Custom Communications was interviewed by Econsultancy on the topic.

On measurement, Yeomans identifies three areas that combine to provide ROI data about social media effectiveness in a campaign context. These are: Reach, captured from how many people are talking about a brand post campaign; Sentiment, from people during the campaign; and Competitor Analysis to identify how the brand compared to peers. It would seem that sentiment presents the most measurement issues when talking with clients.

That measuring sentiment creates the most debate is not a huge surprise.  Methods range from software solutions that track words such as ‘like’ and ‘hate’, alongside mentions of brands, to detailed manual evaluation of comments made by identified influencers. The differences between qualitative versus quantitative methods and hybrid solutions leave marketeers no clearer about what is the right approach. Even within the social media industry there is widespread concern that when talking about social media measurment, too many people are talking different languages and that no concrete answers exist – yet.

Adding to the conversation and to the education is some research carried out late last year by Marketing Sherpa. The US study looked at social media measurement, what worked and where problems existed. It concluded that too many Marketers were hung up on quantitative measures when in fact qualitative measures added the most value. The survey found that the easiest things to measure (advertising for example) were the least effective and the hardest things to measure (user reviews & ratings and relationships with bloggers) were the most effective.

Working in a research organisation such as Foviance, it is easy to understand why qualitative measurement is so important. 60% of the work we do is qualitative but a great deal of that  qualitative work is supported by quantitative findings from parallel research in complimentary areas (i.e. using web analytic traffic data to enrich findings from lab observation studies). In our view both are needed to provide a complete picture but there are cost benefit arguments with every research project.

One thing is certain; that there is a lot more to learn and marketeers are going to have to work through the noise to develop a clear understanding of how measurement should work for them. Establishing a measurement framework and strategy is work that can and should be done before even getting involved with evaluating solutions and should start far higher than at just the social media level. Providing your organisation with a measurement strategy is the gift that keeps on giving as it makes sure any decision making is firmly grounded in the business.

Returning toTwitter offers a good example of where a strategy should be established as measuring the effectiveness of Twitter is extremely challenging. Trawling through pages of “Tweets” to establish which referred to your campaign or website is not only time consuming but also very difficult to get right. Twitter’s use of Tiny URL means that you cannot quickly see your campaign url and have to actually clicking through to see which one works. Knowing what to look for first can only help.

Today, organisations are trying Twitter out and the investment can be written off as innovation. Fairly soon someone senior is going to ask about ROI and when they do expect a range of measurement solutions to hit that market very soon afterwards. By which time of course, Twitter will have been superceded by the next big thing. Do try and keep up!

Google Latitude

There are quite a few blog posts popping up on Google’s Latitude service ( and so I thought I would comment on the user experience aspects.

First thing to say is it isn’t exactly new. There is precious little difference with existing services such as Brightkite or Loopt. It is only that Google is the enemy of the hour which has made everyone go crazy about it. As a result it, like the others, doesn’t work unless your browser is open. For many people that is not very often at all and so this is not an application that is going to change the world overnight. It’s time may come, but not until mobile devices use the browser to access more services as a matter of course.

The blog hype has all been about big brother and stalking, which is a little wide of the mark. Google is so paranoid about its public image they have even supplied a video to show how the privacy settings work. In essence you chose who can see your location on a person by person basis and when a contact requests your location information you can accept or deny each individual request.

The main advantage Google has over its rivals is the integration of other Google services like Gmail that allow you not only to see where contacts are but also communicate with them. A concern is the impact this will have on battery life.

Of all I have read my favourite comment about Latitude was from a momoLondon member. He was concerned about how he was going to explain to his girlfriend that he didn’t want her to know where he was. Not a problem that can be solved with technology but as it happened he then revealed that he didn’t actually have a girlfriend anyway. I wonder why!