TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
Measuring the Networked Nonprofit
1. Peer Exchange Group 2: Measuring the Networked Nonprofit: Proving Results To Improve Session 2: August 25, 2011 Aligning Social Media Measurement with Organizational Results Beth Kanter, Visiting Scholar, Social Media and Nonprofits The David and Lucile Packard Foundation Organizational Effectiveness Program
2. Welcome! If you experience any technical difficulties logging into the system, please contact Ready/Talk Customer support: 800.843.9166 Please use *6 to Mute your conference line While we are waiting, type into the chat:How does your organization’s social media practice align with your organization’s outcomes ? Social media – to what end?
3. This call is being recorded * 2 Flickr Photo by Malinki
4. Peer Exchange Group 2: Measuring the Networked Nonprofit: Proving Results To Improve Session 2: August 25, 2011 Aligning Social Media Measurement with Organizational Results Beth Kanter, Visiting Scholar, Social Media and Nonprofits The David and Lucile Packard Foundation Organizational Effectiveness Program
5. Don’t forget to jot down your reflections in your “wiki journal” On The Call Today Beth Kanter Becky Jain
6. Agenda A Few Reminders Last Month: Quick ReviewBeth’s Reflection/JournalMeasurement Pilot: Peer Share KD Paine’s Basic Measurement Steps Next Session Reflection Ask Your Questions and Share Your Insights in the Chat! Hashtag: #measurenp
7. Reminders Wiki JournalsFacebook GroupOffice HoursScoop.It Resources Don’t forget to jot down your reflections in your “wiki journal”
8. Last Month: Quick Review Social Media Maturity of Practice How to Define A Measurement Pilot Project for Peer Exchange Slides/Recording/Notes/Checklistshttp://bit.ly/measure-netnon-july-2011
9. PILOT Begin with baby steps Focus on smaller, doable activity to measure Don’t measure everything about it Go for the easy wins
10. Picking A Measurement Pilot Priority in work plan Keeps ED up at night Area of practice to improve
11.
12. Meeting To Agree on Measurable Objectives 1: Understand Background 2: Assemble Your Team 3: Meeting: Discuss Success/Failure 4: Brainstorm 5: Vote CHAT: Did you have a meeting to discuss the pilot? What happened? Source: KD Paine – Measure What Matters
13. Beth’s Journal At least 50% of participants implement a social media measurement pilot that helps document value/results or improve social media practice by end of the Peer Group 1/2012 At least 50% of participants, generate case studies and/or insightful quotes for the Measuring the Networked Nonprofit book by 1/2012 http://measure-netnon.wikispaces.com/Beth-Kanter-Journal
14. 14 out of 27 have identified or discussing pilot http://measure-netnon.wikispaces.com/Beth-Kanter-Journal
15. POLL -Define a pilot and write on wiki -Discussed a pilot internally, but have not decided or written on wiki -Have thought about the pilot, but not discussed or defined
16. CHAT: If you defined a pilot, what made it easy? Do you have a tip? If you discussed pilot, but haven’t decided what help do you need ? If you haven’t discussed pilot, what help do you need?
23. Key Result: Kids get health care Gets better at communication, proactive planning, partner engagement, message discipline and social media integration More and better partners, more and better relationships with reporters and more or better policy maker relationships Communications strategy has more impact More attention from policymakers Policies are adopted Kids get health care coverage
27. Target Audience: AdvocatesIntermediary Audience: Policy Makers Advocates send 200 emails, make 300 phone calls, and post on FB page to endorse an issue related to ACAIdentify and establish relationships with “influencers” (lawmakers, parents, etc) through Facebook so they spread stories of Children’s Health Care by 1/2012 Increase number of fans for Facebook page by 10% by 2012 Increase engagement with Facebook fans to 3 comments per post by 2012 Repurpose policy paper content into series of regular Facebook posts by 2012 Two aligned partners collaborate on an online event on Facebook to draw attention to issue by 2012
28. Benchmarks "The greatest danger for most of us is not that our aim is too high and we miss it but that it is too low and we reach it." Michelangelo
33. Define Your Key Performance Indicators What are the metrics you will report with?
34. There is no shortage of metrics you could use ……. 27. Social bookmarks 28. Subscriptions (RSS, podcasts, video series) 29. Pageviews (for blogs, microsites, etc) 30. Effective CPM based on spend per impressions received 31. Change in search engine rankings for the site linked to through social media 32. Change in search engine share of voice for all social sites promoting the brand 33. Increase in searches due to social activity 34. Percentage of buzz containing links 35. Links ranked by influence of publishers 36. Percentage of buzz containing multimedia (images, video, audio) 37. Share of voice on social sites when running earned and paid media in same environment 38. Influence of consumers reached 39. Influence of publishers reached (e.g., blogs) 40. Influence of brands participating in social channels 41. Demographics of target audience engaged with social channels 42. Demographics of audience reached through social media 43. Social media habits/interests of target audience 44. Geography of participating consumers 45. Sentiment by volume of posts 46. Sentiment by volume of impressions 47. Shift in sentiment before, during, and after social marketing programs 48. Languages spoken by participating consumers 49. Time spent with distributed content 50. Time spent on site through social media referrals 1. Volume of consumer-created buzz 2. Amount of buzz 3. Shift in buzz over time 4. Buzz by time of day 5. Seasonality of buzz 6. Competitive buzz 7. Buzz by category 8. Buzz by social channel 9. Buzz by stage in purchase funnel 10. Asset popularity 11. Mainstream media mentions 12. Fans 13. Followers 14. Friends 15. Growth rate of followers friends 16. Rate of pass-along 17. Change in rates 18. Second-degree reach 19. Embeds / Installs 20. Downloads 21. Uploads 22. User-initiated views 23. Ratio of embeds to views 24. Likes / favorites 25. Comments 26. Ratings Source: 100 Ways to Measure Social Media by David Berkowitz
35. There is no shortest of metrics you could use ……. 75. Customers assisted 76. Savings per customer assisted through direct social media interactions compared to other channels (e.g., call centers, in-store) 77. Savings generated by enabling customers to connect with each other 78. Impact on first contact resolution (FCR) (hat tip to Forrester Research for that one) 79. Customer satisfaction 80. Volume of customer feedback generated 81. Research & development time saved based on feedback from social media 82. Suggestions implemented from social feedback 83. Costs saved from not spending on traditional research 84. Impact on online sales 85. Impact on offline sales 86. Discount redemption rate 87. Impact on other offline behavior (e.g., TV tune-in) 88. Leads generated 89. Products sampled 90. Visits to store locator pages 91. Conversion change due to user ratings, reviews 92. Rate of customer/visitor retention 93. Impact on customer lifetime value 94. Customer acquisition / retention costs through social media 95. Change in market share 96. Earned media's impact on results from paid media 97. Responses to socially posted events 98. Attendance generated at in-person events 99. Employees reached (for internal programs) 100. Job applications received 51. Method of content discovery 52. Clicks 53. Percentage of traffic generated from earned media 54. View-throughs 55. Number of interactions 56. Interaction/engagement rate 57. Frequency of social interactions per consumer 58. Percentage of videos viewed 59. Polls taken / votes received 60. Brand association 61. Purchase consideration 62. Number of user-generated submissions received 63. Exposures of virtual gifts 64. Number of virtual gifts given 65. Relative popularity of content 66. Tags added 67. Attributes of tags 68. Registrations from third-party social logins 69. Registrations by channel ( 70. Contest entries 71. Number of chat room participants 72. Wiki contributors 73. Impact of offline marketing/events 74. User-generated content created that 75. Customers assisted What matters most? Source: 100 Ways to Measure Social Media by David Berkowitz
42. KD Paine’s Basic Steps Define ResultsStrategy BenchmarksMetrics – KPICosts Select Right Tool To Collect DataTurn Data in Action
43. Measure Value Direct RevenueCost Savings Traffic/Search Engine Rankings Social Capital
44. If you haven’t defined a social media measurement pilot, what is your next step? If you have defined a social media measurement pilot, what do you need to do to move it forward?
45. Questions? Next Session:September 22at 11:00 am PST/ 2:00 EST Homework: Define a social media pilot and share it on the wiki. Use the Social Media Pilot worksheet to flesh out your pilot design. Worksheets on Wiki
Editor's Notes
Welcome – count down
Remind people to call for tech support*6 to mute conference line*7unmute
http://www.flickr.com/photos/malinki/2621920871/sizes/o/Start recording about 2 minutes late to let people join *2
Official Welcome by Beth
Beth will read list of participantsBeth will introduce herself“The last few calls I realized that it was hard for me to moderate, work the software, take notes, read the chat and present. So, I’m lucky to have recruited a fabulous co-moderator, Becky Jain. She is going to help me with the back channel – the chat.Becky is a blogger and active on many social media communities. After studying at Wesleyan and the London School of Economics, she came to India to live with her husband, and to work in the development sector. Say hello!
This is our agenda – we’ll pause along the way for questions.Use this #measurenp on Twitter
If you haven’t started keeping your wiki journal, please try to spend a few minutes on the site.If you haven’t joined the Facebook Group, please do so https://www.facebook.com/groups/193416010707686?ap=1Remember, office hours if you’re feeling stuck. I’ve added some more optionshttp://measure-netnon.wikispaces.com/Office+Hours_Group+2As soon as we get the pilot projects organized, I’ll add some small group cohort coaching time
http://www.flickr.com/photos/striatic/107910471/Mention the work sheet
http://www.flickr.com/photos/striatic/107910471/http://www.flickr.com/photos/hendry/3979885054/sizes/l/in/photostream/You might be stepping on someone’s toes, challenge conventional wisdom, put someone else’s project on hold or challenge internal politics … You may get pushback. What are some strategies for dealing with it?
http://www.flickr.com/photos/striatic/107910471/This was all in the worksheet on the wiki, but did you have a meeting to discuss the pilot? What happened?
I’m keeping a public journal too – about the program and using it to reflect on what I’m learning about tracking the program against the SMART objectives. I will be tweaking as we go to get better results …. And welcome you to add your reflectionshttp://measure-netnon.wikispaces.com/Beth-Kanter-Journal
http://measure-netnon.wikispaces.com/Beth-Kanter-JournalEvent/Publication/Mini-Campaign Focus: Focus on measuring social media as part of a communications strategy for a single event. Measuring through the ladder of engagement.Leadership Learning Community – Social media integrated with launch of publicationAmerican Leadership Forum –Social media integrated with October event keyed to organizational outcomesSurfriderOne Channel Focus: Focusing on measuring one social media channel as part of an integrated campaign to focus on practice. Blog, Twitter, FacebookCommunity Catalyst – Twitter tied to working w/partners on one campaignMonitor Institute – Measure single topic blog as prelude to launching organizational wide blogSecond Harvest Food Bank - Measure one channel, FacebookSoutheast Asia Resource Action Center – Measure one channel, Twitter, to grow networkArts Council of Silicon Valley – Measure one channel, internal blog.Systems Improvement: Measuring pilot project is focused on designing and implementing or improving upon a cross-department dashboardGlobal Giving – Dashboard for social media metrics to inform marketing plan objectivesNational Wildlife Federation – Cross-Department dashboardSocial Media Proof of Concept: Focusing on a very focused and low-risk pilot that can document how social media can align with organizational goals to get buy-in for more investment.Leopold Leadership ProgramZER01The Trust for Hidden VillaBenchmark Study: Focusing on research project that collects and measures best practices on social media related to SMART objectives.Resource Legacy FundResource Mediahttp://measure-netnon.wikispaces.com/Beth-Kanter-JournalDefined Pilot Project12 out of the 27 have not15 out of the 27 have defined project or preliminary definitionCall Participation27 participated Call 126 participated Call 2Wiki Journal Entries7 out of 27 have not added anything10 out of 27 have added 1 entry10 out of 27 have added 2 entriesDefined Pilot Project12 out of the 27 have not15 out of the 27 have defined project or preliminary definitionCall Participation27 participated Call 126 participated Call 2Wiki Journal Entries7 out of 27 have not added anything10 out of 27 have added 1 entry10 out of 27 have added 2 entries
Measurement is a feedback loop KD Paine's Basic Steps for Social Media Measurementhttp://www.flickr.com/photos/aboyandhisbike/764888546/sizes/l/in/photostream/
In KD Paine’s decades of experience, the measurement process looks like this – no matter what you’re measuring to get at measuring what matters … The strategy piece includes creating a plan, it might include research (audience research or benchmarking w/peers). For some of you, your pilot might be “prospective” – as part of planning a future campaign or program. Or it might be analyzing the past – something you’ve already implemented but want to go back and measure results/value for planning next reiteration or to do present to senior management to pave the way for more incorporating social media into your program delivery or communications channel. The do part – your tactics, tools – The measure is your data collection – as part of your strategy you define this – it includes analysis – you don’t just collect data, you figure out what it means in terms of improving your results – and then you adapt your plan/strategy and the cycle continues.Make sense? Does this sound familiar? Is this way you measure other programs or communications efforts that do not include social media?
These are the basic steps that you will follow for your measurement pilot …. Or any project that involves social media ..The challenge here is that you are not just measuring, but measuring around your practice or strategy.The pilot is making it very simple.
Start with your results and incorporate social media into it .. Keep asking to what end? Why is this important? AwarenessReputationRelationshipsActionsDonationsVolunteersBehavior ChangePartner Engagement
Theory of Changehttp://www.bethkanter.org/sm-toc/A series of if, then statements that are laid out as a path …This might be a useful approach for those of you working more on policy or program outcomes – and how to integrate social media For example:Kansas Action for Children has helped shape policy that puts children first.
What are you going to do to get those results with an integrated social media plan?SMART ObjectivesMeasurement PlanAudience Definition: Target Audience InfluencersEnvironmentMessaging/ContentChannelsBudgetTimeline
A strategy is a plan of action designed to achieve a particular objective. Tactics and tools are the means by which a strategy is carried out – these are on the ground methods to executive strategy. Ways to be strategic …Smart Objectiveshttp://www.bethkanter.org/25-smart/How many by when?Results, Capacity, or TacticsGuides, not report cards
Key performance indicators are 3-5 metrics that are critical to knowing you have been reach your result or not ….
Key Performance Indicators: Key performance indicators are the most important metrics to understand how successful your are ..This is the conversation to have with your team …..Metricshttp://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=117581
USA for UNHCR (my client) is a 501(c)(3) headquartered in Washington, D.C. They raise funds and awareness in the United States for the lifesaving work that more than 6,000 staffers of Geneva-based UNHCR undertake for refugees around the world, 24/7. Given that there are more than 43.3 million refugees worldwide, this is pretty important work… and did I mention lifesaving? (Just look at what’s happening in Somalia right now.) The challenge is that typically refugees are so far removed from our “normal” lives that we don’t automatically think of giving to organizations that work to support them.USA for UNHCR created the Blue Key campaign as a way to drive awareness of this global issue in the US. The $5 blue key pin or pendant symbolizes the one thing most of us have and that refugees don’t: a key to their own home.My role is to work with USA for UNHCR on building out the digital and social media aspects of the campaign, particularly from an online community-building point of view. That is where the Blue Key Champion strategy came in; to bring on board US-based bloggers who are active online, and cause-passionate, to help spread the word and, hopefully, get more keys ordered.
The Blue Key site was only launched in December 2010, and its social/digital aspects were relatively new, so there was not a lot of data to base KPIs on. Overall, when we went into the first phase of the campaign, we had two goals: to secure at least three Blue Key Champions, and to get 6,000 keys ordered between May 9 and June 20 (World Refugee Day).http://www.bethkanter.org/un-blue-key/
http://www.flickr.com/photos/tjblackwell/5659432136/sizes/m/in/photostream/Cost to implement your social media pilot – including measurement time! We know that most of the software/platforms are free, so the cost is going to be an investment in staff time. What is the level of time?What is the opportunity cost?Are you adding resources or shifting them?What are the consequences?How can you be as efficient as possible in your execution time? Data collection time?You’ll need this for reporting … and also helps you get better and more efficient
http://www.flickr.com/photos/kaptainkobold/80911944/sizes/o/in/photostream/Your measurement tools are the techniques you will use to collect data – the key performance indicators – These are covered in a later session. Remember – any tool is useless unless it covers the sort of data that help you evaluate progress towards to your goalsContent analysis of social or traditional media- Primary audience via online, mail, or phone surveys- AnalyticsAffordable ….
http://www.flickr.com/photos/theimagegroup/369893824/Measurement is a continuous improvement process – feedback loopsAny measurement to work, you need to assess results, make changes, and see if those changes had impact, make more changes, and so on. Valid, actionable conclusionsAvoid focusing on only the most exciting, look for failures …You need a regular reporting schedule – not just do a data dump at the end – important for buy-in
These are the basic steps that you will follow for your measurement pilot ….
These are the basic steps that you will follow for your measurement pilot ….
Session 3: Why Does Bad Measurement Practice Happen To Good Nonprofits?September 22 at 11:00 am PST/ 2:00 ESThttp://measure-netnon.wikispaces.com/Grp+2+Session+3+Bad+Measurement