Social Media MonitoringFinding RelationshipsA Pilot StudyJuly 4, 2011
Your brand is social.From toilet paperto luxury vehicles,social plays a partin the customerexperience of yourbrand.
People have alwaystalked about brandsand experiences
Only now these viewsand experiences arebeing shared online
And subsequently...Agencies and brands arestarting to take social mediaseriously.
With just abouteveryone offeringsome form ofmonitoring andanalysis.
We are starting to askbetter questions.Should we be only watching for brandand product mentions?What issues matter to our ...
But we are ignoring akey question.               ?
But we are ignoring akey question.Why are wethrowing awayall of the data?
Report 1Typically, a baseline social media audit iscreated based on an analysis of brandnames, competitors, and relevant i...
Report 1            Report 2The next report, for a different time period, iscreated from new data. If comparisons to thefirs...
Report 1          Report 2           Report 3With each subsequent social media report,the process remains the same.
We have lots ofpretty chartsand surface-levelanalysis.
Pretty charts.“More people spoke positivelyabout kittens this week.”     1500     1000                                    ...
…and “analysis”.“Here are our top kitteninfluencers this month.”          Twitter name     Kitten Tweets   Klout Score     ...
But are all these kitten loversnet new people everymonth?Is this just a one time spikebecause of something in thenews?Are ...
A Real-World ExampleWe decided to use Nikon (geo-filtered to Canada) as a pilotcase.We explored using both Radian6and Sysom...
Some ChartsMost of the tools can give usaccess to data and clues that leadto insights, but the built-in chartsaren’t that ...
Influence in SysomosSysomos gives us a list of the top Twitterinfluencers based on an algorithmic authorityscore of 7/10 or ...
It falls apart… With this chart, if we dive deeper and look at these users, we discover nearly all are spam or of little v...
Influence in Radian6Some tools, like Radian6,integrate Klout or other similartheoretical metrics of absoluteinfluence.But ou...
We need deeper insights.With web analytics and emailmarketing, we track unique andrepeat visitors.And traditional CRM prog...
Deeper insights in social.Why not track the same thingson social media?Who are our true brandadvocates and what can we lea...
What about Social CRM?                 Some are looking at Social CRM                 to solve this problem.              ...
A new approach.What if we started to wonderabout the people who areconsistently talking about ourbrand or issue?What could...
A new approach.We believe these are people whoare passionate about your brand.We call them the consistentlyengaged.They ar...
Looking across periods. Report 1           Report 2          Report 3 Simply put, we find the individuals who are consisten...
Our hypothesisThe consistently engaged wholove your brand are:•  Findable•  Of value to the brand   (promotions, research,...
Looking across quarters.We extracted all tweets over atwo-quarter period for Nikon andlooked at two lists:  1.  Top Twitte...
Finding the consistently engaged users                                      Volume           ConsistentThe list on the lef...
Finding the consistently engaged users                                     Volume           ConsistentThe green boxes show...
Rethinking InfluenceThe list of influencers most socialmedia tools give us aren’t verymeaningful as they tend to usethe stan...
The Consistently Engaged                                         ConsistentFinding these people was just the     @dorisday...
Understanding these peopleAll social media monitoring toolsstart with a filter – a way tocross-section massive amountsof da...
It’s akin to doing an ethnographystudy where we ignore all thethings the individual does or saysthat don’t directly involv...
So we remove the filter.The “from:username” operator inSysomos MAP allows us to pull alluser tweets over any period oftime ...
Not in the SM tool, sadlyThe text analytics tools in Sysomos MAP quickly fallapart when the filter is removed and we are lo...
So we need to export allthe activity and analyzeit using a qualitativetagging methodology
Qualitative vs. Quantitative ResearchQuantitative content analysis isabout counting content. Itprovides numbers that repre...
Qualitative vs. Quantitative ResearchRather than reporting how manytimes a brand has beenmentioned [quantitative], we canl...
Conducting a                          Conducting aqualitative analysis                       qualitative analysis    of is...
Qualitative Analysis Approach1.       Identify your area of interest.2.       Identify goals: e.g., understanding what com...
What did we find?For this pilot, we analyzed the top20 consistently engaged which wereresponsible for over 20,000 socialmed...
What did we find?Nearly all of our consistently engagedusers sample self-identify as amateur orprofessional photographers.M...
Their relationship with Nikon                                              Wants to buy a Canon    Recently bought a      ...
Their other interestsUsers are more likely to talk about                 iPhone vs. BlackberryiPhones vs. BlackBerry devic...
Their other interestsThe consistently engaged Nikon users              Coffee Mentionsover the time period analyzed weremor...
Quick Recap1.  The consistently engaged are    a better way to find the    relationships you are building    (or not buildi...
The “Secret” Sauce
Our MethodologyA)  Finding consistent users across two quarters1.  Extract two time periods of data from Sysomos MAP.    E...
Our MethodologyB)  Determining tweet volume for consistent users1.  Merge Tweet content from both quarters into a single  ...
Our MethodologyC)  Removing the filter and exporting all user tweets for    “casually engaged” list1.  Using the “from:user...
Our MethodologyD)  Running qualitative analysis to find insights about    users1.  Identify an area of interest and goals. ...
ColophonSean Howard is a freelancer and      Eric Portelance is a Strategist at     Katie Charbonneau is anAssociate at Th...
Upcoming SlideShare
Loading in...5
×

Social Media Monitoring - Finding Relationships

73,440

Published on

Early in 2011, our team began with the hypothesis that relationships with a brand can be found online and that finding these relationships would be critical to determining the value and ROI of social media investments to date.

With many in the industry moving to qualitative analysis of social media mentions (tagging by hand), we began to explore this as well at Thornley Fallis. But there was a problem. We were spending a lot of time and money tagging people's views of our client's products or offerings with no ability to measure and determine whether the brand had built more or less relationships of value.

We began to search for new tools. We quickly disregarded Klout, PeerIndex and other similar tools as means of finding relationships. These tools were better at aggregate or synthetic benchmarks of "influence," and our team was interested in finding relationships with a brand beyond the most "influential" web celebrities.

This deck outlines our approach and findings and how we were able to find what we are calling the consistently engaged. These people are showcasing their potential relationship with a brand, yet are often being ignored as a result of the tools and approaches currently available.

Published in: Business, Technology
21 Comments
110 Likes
Statistics
Notes
No Downloads
Views
Total Views
73,440
On Slideshare
0
From Embeds
0
Number of Embeds
32
Actions
Shares
0
Downloads
1,026
Comments
21
Likes
110
Embeds 0
No embeds

No notes for slide

Social Media Monitoring - Finding Relationships

  1. 1. Social Media MonitoringFinding RelationshipsA Pilot StudyJuly 4, 2011
  2. 2. Your brand is social.From toilet paperto luxury vehicles,social plays a partin the customerexperience of yourbrand.
  3. 3. People have alwaystalked about brandsand experiences
  4. 4. Only now these viewsand experiences arebeing shared online
  5. 5. And subsequently...Agencies and brands arestarting to take social mediaseriously.
  6. 6. With just abouteveryone offeringsome form ofmonitoring andanalysis.
  7. 7. We are starting to askbetter questions.Should we be only watching for brandand product mentions?What issues matter to our brand?What is the value of our social mediaefforts?
  8. 8. But we are ignoring akey question. ?
  9. 9. But we are ignoring akey question.Why are wethrowing awayall of the data?
  10. 10. Report 1Typically, a baseline social media audit iscreated based on an analysis of brandnames, competitors, and relevant issues.
  11. 11. Report 1 Report 2The next report, for a different time period, iscreated from new data. If comparisons to thefirst report are made, they are aggregate ortrend-based.
  12. 12. Report 1 Report 2 Report 3With each subsequent social media report,the process remains the same.
  13. 13. We have lots ofpretty chartsand surface-levelanalysis.
  14. 14. Pretty charts.“More people spoke positivelyabout kittens this week.” 1500 1000 Positive Negative 500 0 Week 1 Week 2 Week 3 Week 4
  15. 15. …and “analysis”.“Here are our top kitteninfluencers this month.” Twitter name Kitten Tweets Klout Score @justinbieber 618 90,194,000 @aplusk 6 12 @britneyspears 42 315 @oprah 9 120
  16. 16. But are all these kitten loversnet new people everymonth?Is this just a one time spikebecause of something in thenews?Are we building relationshipswith any of these people?
  17. 17. A Real-World ExampleWe decided to use Nikon (geo-filtered to Canada) as a pilotcase.We explored using both Radian6and Sysomos MAP.We settled on Sysomos MAP topull the data we needed due to afeature that allowed us to pull anindividual’s raw tweets with nosearch filters applied.
  18. 18. Some ChartsMost of the tools can give usaccess to data and clues that leadto insights, but the built-in chartsaren’t that helpful on their own.
  19. 19. Influence in SysomosSysomos gives us a list of the top Twitterinfluencers based on an algorithmic authorityscore of 7/10 or higher, sorted by volume.
  20. 20. It falls apart… With this chart, if we dive deeper and look at these users, we discover nearly all are spam or of little value to the brand. Are these truly the most passionate and influential Nikon brand advocates?
  21. 21. Influence in Radian6Some tools, like Radian6,integrate Klout or other similartheoretical metrics of absoluteinfluence.But our attempts to generate listsof people who care about abrand with these tools generatesprimarily spammers and bigname web celebrities.
  22. 22. We need deeper insights.With web analytics and emailmarketing, we track unique andrepeat visitors.And traditional CRM programstrack preferences, purchases, andengagement over time.
  23. 23. Deeper insights in social.Why not track the same thingson social media?Who are our true brandadvocates and what can we learnabout them beyond their interestin our brand?Do the people who arepassionate about our brand haveanything in common?
  24. 24. What about Social CRM? Some are looking at Social CRM to solve this problem. Most CRM tools were designed with the assumption of a near- perfect signal-to-noise ratio. To be useful, there should be zero noise in the system. These systems fall apart when you start throwing hundreds of thousands of users and tweets at them. Social CRM e.g. There was an estimated 501,618 “Nikon” tweets in the past 6 months.
  25. 25. A new approach.What if we started to wonderabout the people who areconsistently talking about ourbrand or issue?What could we learn if weweren’t wiping the slate cleanevery time we run a new search?
  26. 26. A new approach.We believe these are people whoare passionate about your brand.We call them the consistentlyengaged.They are NOT the most influentialKlout or PeerIndex users.They are the people who have anongoing relationship with yourbrand. Good, bad or otherwise.
  27. 27. Looking across periods. Report 1 Report 2 Report 3 Simply put, we find the individuals who are consistently talking about and engaging with your brand across time periods.
  28. 28. Our hypothesisThe consistently engaged wholove your brand are:•  Findable•  Of value to the brand (promotions, research, reach)•  Ignored by most brands
  29. 29. Looking across quarters.We extracted all tweets over atwo-quarter period for Nikon andlooked at two lists: 1.  Top Twitter users by volume (4+ mentions) 2.  Top Twitter users by volume (4+ mentions) who are also consistent across multiple quarters
  30. 30. Finding the consistently engaged users Volume ConsistentThe list on the left includes @bdicroce @dorisdays88people with the most volume @caltek79 @jedgar @CFN007 @justinlee_over the past six months, in @cicychan @maryellenphotosregards to the brand in @Digital_zin @msjconnollyquestion. @dorisdays88 @neek247 @ginette4 @nortonphoto @jedgar @jonah_lewisThe list on the right includes @JohnBiehler @quotetasticcpeople who consistently @justinlee_ @RajaKalsiengaged with or mentioned @jwsutts @RDslvathe brand a minimum of four @kinematicdigit @Redawna @KingKabuz @samobeidtimes in both quarters. @Kosmatos @scottoakley @Lalalalal8 @ShaniceAshley_ @maryellenphotos @stephaniefusco @missemcee @vickiesbphoto @missfish @wifewithknives @msjconnoly @ZtheWayfarer @neek247 @zeefred
  31. 31. Finding the consistently engaged users Volume ConsistentThe green boxes show the @bdicroce @dorisdays88people consistent between @caltek79 @jedgar @CFN007 @justinlee_the two methods. @cicychan @maryellenphotos @Digital_zin @msjconnollyIf you are using the standard @dorisdays88 @neek247 @ginette4 @nortonphotomethod (left side) then you @jedgar @jonah_lewisare ignoring up to 70% of the @JohnBiehler @quotetasticcpeople consistently engaging @justinlee_ @RajaKalsiwith your brand. @jwsutts @RDslva @kinematicdigit @Redawna @KingKabuz @samobeidWe need to focus on the @Kosmatos @scottoakley @Lalalalal8 @ShaniceAshley_users who are consistent in @maryellenphotos @stephaniefuscoorder to find the true brand @missemcee @vickiesbphotoadvocates. @missfish @wifewithknives @msjconnoly @ZtheWayfarer @neek247 @zeefred
  32. 32. Rethinking InfluenceThe list of influencers most socialmedia tools give us aren’t verymeaningful as they tend to usethe standard method on the leftor just find the big name webcelebrities.With our Nikon example, theyignore a huge segment of peoplewho are passionate about Nikonbut will never appear on any toplist.
  33. 33. The Consistently Engaged ConsistentFinding these people was just the @dorisdays88 @jedgarfirst step. @justinlee_ @maryellenphotos @msjconnollyNow we need to understand: @neek247 @nortonphoto1.  Who are these people? @jonah_lewis @quotetasticc2.  What are their other interests? @RajaKalsi3.  Their relationship to our brand @RDslva @Redawna4.  Their potential value @samobeid @scottoakley @ShaniceAshley_ @stephaniefusco @vickiesbphoto @wifewithknives @ZtheWayfarer @zeefred
  34. 34. Understanding these peopleAll social media monitoring toolsstart with a filter – a way tocross-section massive amountsof data (in this case a search for“Nikon”).Analyzing this data tounderstand who these people areis critically flawed. It will onlyshow us insights based on alimited set of their conversations– those that match our originalsearch terms.
  35. 35. It’s akin to doing an ethnographystudy where we ignore all thethings the individual does or saysthat don’t directly involve ourproduct. Not particularly valid.
  36. 36. So we remove the filter.The “from:username” operator inSysomos MAP allows us to pull alluser tweets over any period oftime (sample based in somecases).This is time consuming to do butnot overly difficult. But now wehave hundreds of thousands oflines of data.How do we analyze this?
  37. 37. Not in the SM tool, sadlyThe text analytics tools in Sysomos MAP quickly fallapart when the filter is removed and we are lookingat everything a group of users say.
  38. 38. So we need to export allthe activity and analyzeit using a qualitativetagging methodology
  39. 39. Qualitative vs. Quantitative ResearchQuantitative content analysis isabout counting content. Itprovides numbers that representfrequencies or occurrences.Qualitative content analysis isabout the quality of content. Itprovides insights into recurringthemes that can lead to thedevelopment of valuable insightsand recommendations.Source: Zhang, Y. , & Wildemuth, B. M. (2009). Qualitative analysis of content. In B. Wildemuth (Ed.), Applications ofSocial Research Methods to Questions in Information and Library
  40. 40. Qualitative vs. Quantitative ResearchRather than reporting how manytimes a brand has beenmentioned [quantitative], we canlook at the quality of themessage [qualitative].Rather than reportingfrequencies, the application ofqualitative tools to social mediadata will allow us to gain insightsfrom a data sample that istraditionally overlooked.
  41. 41. Conducting a Conducting aqualitative analysis qualitative analysis of isolated of all expressions individual from identified expressions of users of interest. interest.
  42. 42. Qualitative Analysis Approach1.  Identify your area of interest.2.  Identify goals: e.g., understanding what common characteristics and interests of a specific customer population might exist.3.  Translate your goals into a structured and hierarchical coding frame (either inductively or deductively).4.  Make both categories and individual codes as mutually exclusive as possible.5.  Create coding rules to ensure that multiple coders can consistently make the same coding decisions.6.  Test your coding frame by calculating inter-coder reliability (or other fancy reliability method).7.  Assign expressions (or whatever your agreed upon unit of analysis might be) to codes.8.  Analyse the coded data by individual category and code. Compare codes, find relationships, uncover themes, discover insights and develop recommendations. Source: Zhang, Y. , & Wildemuth, B. M. (2009). Qualitative analysis of content. In B. Wildemuth (Ed.), Applications of Social Research Methods to Questions in Information and Library
  43. 43. What did we find?For this pilot, we analyzed the top20 consistently engaged which wereresponsible for over 20,000 socialmedia mentions in the quartersanalyzed.Only a partial analysis wasperformed to validate that the mostconsistently engaged individualsidentified would be of value to thebrand.
  44. 44. What did we find?Nearly all of our consistently engagedusers sample self-identify as amateur orprofessional photographers.Most have a relationship with Nikon –either because they own Nikonproducts or discuss Nikon products andnews.1 out of 20 self-identified as aprofessional photographer and 14 out of20 stated they own Nikon equipment.
  45. 45. Their relationship with Nikon Wants to buy a Canon Recently bought a 60D but has an Nikon D3100 and interest in Nikon gear looking to purchase and often chats with some additional lenses Nikon users Professional Canon Angry with Nikon shooter but blogged Canada about a poor about a positive warranty service experience shooting experience with Nikon equipmentOwns a Nikon D300and mostly uses oldermanual-focus lenses. Hobbyist looking toJust bought first move up to pro-level“modern” Nikon lens. Nikon gear
  46. 46. Their other interestsUsers are more likely to talk about iPhone vs. BlackberryiPhones vs. BlackBerry devices –  74% of all iPhone mentions were positive in nature –  73% of BlackBerry mentions were positive iPhone in nature BlackBerryiPhone users more likely to talk aboutphoto related apps than BlackBerryusers –  Almost half of all iPhone mentions had to do with a photo-related app –  Only 4% of BlackBerry mentions were about photo-related apps
  47. 47. Their other interestsThe consistently engaged Nikon users Coffee Mentionsover the time period analyzed weremore likely to talk about Starbucks thanany other coffee brand Starbucks –  87.5% of these mentions were positive in Tim Hortons nature –  The second mentioned brand was Tim Hortons, but all mentions were neutral or negative in naturePeople spoke of coffee 1.7 times moreoften than tea.Of the tea mentions, DavidsTea was themost mentioned product/brand.
  48. 48. Quick Recap1.  The consistently engaged are a better way to find the relationships you are building (or not building) in social.2.  Finding the consistently engaged is simply a matter of not throwing the data away and paying attention to who is engaging with your brand across time periods.3.  Deeper analysis can lead to better insights into who your brand advocates are, their needs and their interests.
  49. 49. The “Secret” Sauce
  50. 50. Our MethodologyA)  Finding consistent users across two quarters1.  Extract two time periods of data from Sysomos MAP. Export.2.  Merge data into a single spreadsheet with each quarter in a separate column.3.  Cross-reference columns to find users who are consistent across quarters.4.  De-dupe results in the third “result” column to get a complete list of consistent users.
  51. 51. Our MethodologyB)  Determining tweet volume for consistent users1.  Merge Tweet content from both quarters into a single speadsheet column2.  Sort alphabetically and run subtotal based on usernames. Sort subtotals by volume.3.  Set a threshold (we used 4 tweets across quarters)4.  Cross-reference with list (result of part A) of consistent users across quarters.5.  Manually remove any spammy users above threshold.6.  Extract user list of top 20-30 “casually engaged.”
  52. 52. Our MethodologyC)  Removing the filter and exporting all user tweets for “casually engaged” list1.  Using the “from:username” operator in Sysomos MAP, extract all top 20-30 user tweets to CSV over same two quarter period (Export is limited to 5000 tweets so generally each user must be done separately)2.  Merge resulting CSV files for each user into a single spreadsheet. Discard all data except tweet content.3.  Set up qualitative tagging system and methodology.4.  Import data in NVivo or similar qualitative analysis tool.
  53. 53. Our MethodologyD)  Running qualitative analysis to find insights about users1.  Identify an area of interest and goals. Translate these into a structured coding frame.2.  Tag the data according to the coding frame.3.  Analyze the data based on the categories and codes. Pull insights and findings.4.  Put together recommendations based on key findings
  54. 54. ColophonSean Howard is a freelancer and Eric Portelance is a Strategist at Katie Charbonneau is anAssociate at Thornley Fallis and Thornley Fallis and a regular Account Coordinator atspends his life searching for what podcaster on the show Attention Thornley Fallis with an MSc indrives and identifies the most Surplus. He’s passionate about using Media and Communications.passionate online and offline. new technologies to build engaging She’s a data junkie with a keen online experiences. interest in American politics.Twitter: @passitalong Twitter: @eportelance
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×