Measurement Peer Group #4
ā¢
0 likesā¢1,674 views
The document summarizes a session on benchmarking and key performance indicators (KPIs) for measuring social media efforts at nonprofits. Three organizations - the American Leadership Forum Silicon Valley, the National Wildlife Federation, and the Monterey Bay Aquarium - shared their experiences developing SMART objectives, identifying relevant peer organizations for benchmarking, and establishing KPIs to track performance. The session provided an overview of benchmarking and KPIs, and highlighted examples and challenges the organizations have faced in designing and implementing social media measurement pilots.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Measurement Peer Group #4
Similar to Measurement Peer Group #4 (20)
More from Beth Kanter
More from Beth Kanter (20)
Recently uploaded
Recently uploaded (20)
Measurement Peer Group #4
- 1. Peer Exchange Group 2: Measuring the Networked Nonprofit: Proving Results To Improve Session 4: October 27, 2011 Benchmarking: Networked Nonprofits Measure Social Media in Context Beth Kanter, Visiting Scholar, Social Media and Nonprofits The David and Lucile Packard Foundation Organizational Effectiveness Program
- 2. Welcome! If you experience any technical difficulties logging into the system, please contact Ready/Talk Customer support: 800.843.9166 Please use *6 to Mute your conference line While we are waiting, type into the chat: Have you finished designing your measurement pilot plan? What is most exciting about it? What is most challenging?
- 3. This call is being recorded *2 Flickr Photo by Malinki
- 4. Peer Exchange Group 2: Measuring the Networked Nonprofit: Proving Results To Improve Session 4: October 27, 2011 Benchmarking: Networked Nonprofits Measure Social Media in Context Beth Kanter, Visiting Scholar, Social Media and Nonprofits The David and Lucile Packard Foundation Organizational Effectiveness Program
- 5. On Theāwikito Today your reflections Donāt forget jot down in your Call journalā Beth Kanter Becky Jain
- 6. Agenda A Few Reminders Bethās Reflection/Journal Last Month: Quick Review Definitions: Benchmarking and KPIs Measurement Pilot: Peer Share Debbie Ford-Scriba, ALFSV Danielle Brigida, NWF Geoff Drake, MBAYAQ Next Session Reflection Ask Your Questions and Share Your Insights in the Chat! Hashtag: #measurenp
- 7. Reminders to jot down your reflections Donāt forget in your āwiki journalā Wiki Journals Facebook Group Office Hours Scoop.It Resources
- 8. Bethās Journal Program Outcomes At least 50% of 27 participants implement a social media measurement pilot that helps document value/results or improve social media practice by end of the Peer Group 1/2012 At least 50% of 27 participants, generate case studies and/or insightful quotes for the Measuring the Networked Nonprofit book by 1/2012 http://measure-netnon.wikispaces.com/Beth-Kanter-Journal
- 9. Bethās Journal 85% have written about their pilot in the wiki journal 44% have had used the office hours 90% have joined FB group 90% attendance on calls (playbacks) http://measure-netnon.wikispaces.com/Beth-Kanter-Journal
- 10. QUICK POLL -Have not started planning/designing -Have started planning/designing, but not finished because stuck or have questions -Finished designing, havenāt started implementation yet -Finished designing, started implementing -Finished implementing
- 11. CHAT: If you are finished designing, what helped you the most?
- 12. CHAT: If you have started planning/designing, but not finished - why? Are you stuck? Do you have questions? What do you need to move forward?
- 13. Strategy Plan Research Refine Do Adapt KD Paineās Basic Steps Measurement STEPS Analyze Measure
- 14. KD Paineās Basic Steps Define Results Strategy Benchmarks Metrics ā KPI Costs Select Right Tool To Collect Data Turn Data in Action
- 15. How will I know if I got taller next year? Measurement is a Comparable Tool
- 16. Benchmark: a point of reference from which measurements may be made The most effective comparisons are to peer organizations or to your organizationās past performance over time. What is important is to benchmark against what matters to your organization.. essentially whatever keeps the board and the executive director up at night.
- 17. Benchmark Study: Looks at larger group of organizations or departments using a metric and also learning about strategy and tactics. Prelude to measurement process, part of strategy formation and ongoing learning.
- 18. Key Peformance Indicators: Most important metrics based on data that you can collect to measure your progress towards reaching your SMART objectives. No more than 7! You become what you measure, so they have to be meaningful, actionable and relevant. Fundraising % increase in donations % increase in new donors or members % reduction in cost per member acquired Social Media % increase in share of desirable coverage (desirable can mean positive tone, favorable positioning, % increase in share of conversation % increase in number of supporting conversations (expressing support for the cause) % increase in conversation that contains our key messages
- 19. Linking Benchmarks and KPIs to SMART Objectives for Social Media Debbie Ford-Scriba, American Leadership Forum Silicon Valley
- 22. Objectives and Audience Defined
- 25. Peer Organization Peer Org Peer Org Our Org
- 28. National Wildlife Federationās Pilot Project Creating a learning process and metrics dashboard
- 29. What are the SMART objectives? Benchmark Study NWF Outreach 6 Regional Offices/Programs improve Educate x number of people about Twitter/FB practice by learning from NWF issues and viewpoints benchmarking study process NWF creates a shared dashboard that X number of share NWF messages easily allows programs to view data NWF facilitates dialogue between 6 X number of advocates are inspired to regional programs that leads to one take action (calling legislators, one- insight per month click actions, on FB, or Twitter) X number of people donate to NWF through social media channels
- 30. Where we startedā¦ ā¢ Monthly Blog Report ā Top visited posts ā Top shared posts ā¢ Quarterly Report ā Number of Followers/Fans ā Visited content ā Shared content ā Lessons Learned/Successes ā Tips/Tricks and Industry Trends
- 31. Ways We Measure Social Media ā¢ Web Analytics ā¢ Sharing Analytics ā¢ Subscribers ā¢ Linked Sites ā¢ Comments ā¢ Actions
- 32. We need to simplify!
- 33. Facebook/Twitter Presences All Over the Country @NWFgreatlakes @NWFCalifornia @NWFTribalLands @NWFPacific @OurPublicLands @wildlifeaction @NWFalaska @TXwater @restorewetlands
- 34. Goals Benchmarking Study: Create a process for collecting data across the organization and learning from it Design: Use our social KPIās and create a dashboard thatās online and easily accessed.
- 35. Gathering Input Facebook Twitter Klout # of Fans # of Followers Klout Score # of People Talking # of Mentions/RTs N/A About This # of Posts # of Posts N/A
- 36. Good Example
- 37. Challenges ā¢ Technology ā¢ Picking the right KPIās ā¢ Not taking on too much ā¢ Competition/resources
- 38. Monterey Bay Aquarium Social Media
- 39. Our Objectives: -To drive attendance to exhibits, programs, and activities at the Aquarium -To keep people connected to the Aquarium before, during, and after visit regardless of geography Key Facebook Measurements: - Facebook check-ins - Facebook Deal redemptions - Growth in Likes - Growth in Interactions (now āTalking Aboutā) - Comparison of content types (photos vs. videos, subject matter)
- 40. Benchmarking 1. St. Louis: 191,887 2. MBA: 115,391 3. Henry Doorly Zoo: 112,346 (NE) 4. San Diego Zoo: 106,727 5. Brookfield Zoo (IL): 89,263 6. Memphis Zoo: 70,881 7. Columbus Zoo: 69,419 8. Shedd Aquarium: 64,881 9. Georgia Aquarium: 60,614
- 41. What works: news about our animals and exhibitsā¦
- 42. Social media and storytellingā¦ Social media is the best and most immediate way to get news about our animals, exhibits, events, and conservation efforts.
- 43. How often and when we postā¦ ā¢ Facebook: 10 am and 2 pm ā¢ Twitter: ā All Facebook posts ā Conservation and other news throughout day (no limit) ā Use scheduling tool such as Tweetdeck
- 44. What we measure: overall fan growthā¦ MBA Facebook 120,000 100,000 80,000 60,000 40,000 20,000 0 4/13/09 8/11/09 12/9/09 4/8/10 8/6/10 12/4/10 4/3/11
- 45. What we measure: Facebook interactions, (now āTalking Aboutā)ā¦ MBA Facebook Interactions 3,500 3,000 2,500 2,000 1,500 1,000 500 0 2/8/10 5/9/10 8/7/10 11/5/10 2/3/11 5/4/11
- 46. Sample campaign: shark finningā¦ ā¢ 15 posts ā¢ 1.5 million impressions ā¢ 6,500 interactions
- 47. Our strategyā¦ ā¢ Translate social media success into onsite activity and conservation action ā¢ Work with departments throughout the Aquarium to implement goals ā¢ Measure, improve, measure some more!
- 48. Onsite promotion: World Oceans Day ā¢ Special promotion for Facebook ālikersā ā¢ Say the secret phrase, or check-in using GPS ā¢ Result: 305 store purchases
- 49. Whatās next? ā¢ Weāre working on the appropriate level of engagement for individuals at the Aquarium ā¢ Social media policy soon to be rolled out ā¢ Weāre making social media part of how we do business!
- 50. CHAT: Reflection Questions: What do you need to benchmark to put your SMART objectives in a context? What is an easy and simple way to implement benchmarking? What are your KPIs?
- 51. Next Session: Overview of Measurement Tools November 17th 11:00 am PST/ 2:00 EST Tool Share: Five Minute Presentations from participants Homework: Complete the description of your project using worksheet from Session 2. Start benchmarking and identifying KPIs Identify what you need to move forward ā whatās keeping you back Office Hours
Editor's Notes
- What are benchmarks? What are KPIs?How to define the perfect KPINetworked learning with benchmarksReflection Questions:What do you need to benchmark to put your SMART objectives in a context?What is an easy and simple way to implement benchmarking?What are your KPIs?
- Remind people to call for tech support*6 to mute conference line*7 unmuteFinish the plan for measurement pilot. Take the first steps. Figure out what's holding you back and do it. Set up an office session if you need it!
- http://www.flickr.com/photos/malinki/2621920871/sizes/o/Start recording about 2 minutes late to let people join *2
- What are benchmarks? What are KPIs?How to define the perfect KPINetworked learning with benchmarksReflection Questions:What do you need to benchmark to put your SMART objectives in a context?What is an easy and simple way to implement benchmarking?What are your KPIs?
- Beth will read list of participantsBeth will introduce herselfāThe last few calls I realized that it was hard for me to moderate, work the software, take notes, read the chat and present. So, Iām lucky to have recruited a fabulous co-moderator, Becky Jain. She is going to help me with the back channel ā the chat.Becky is a blogger and active on many social media communities. After studying at Wesleyan and the London School of Economics, she came to India to live with her husband, and to work in the development sector. Say hello!
- This is our agenda ā weāll pause along the way for questions.Use this #measurenp on Twitter
- If you havenāt started keeping your wiki journal, please try to spend a few minutes on the site.If you havenāt joined the Facebook Group, please do so https://www.facebook.com/groups/193416010707686?ap=1Remember, office hours if youāre feeling stuck. Iāve added some more optionshttp://measure-netnon.wikispaces.com/Office+Hours_Group+2As soon as we get the pilot projects organized, Iāll add some small group cohort coaching time
- Iām keeping a public journal too ā about the program and using it to reflect on what Iām learning about tracking the program against the SMART objectives. I will be tweaking as we go to get better results ā¦. And welcome you to add your reflectionshttp://measure-netnon.wikispaces.com/Beth-Kanter-Journal
- Iām keeping a public journal too ā about the program and using it to reflect on what Iām learning about tracking the program against the SMART objectives. I will be tweaking as we go to get better results ā¦. And welcome you to add your reflectionshttp://measure-netnon.wikispaces.com/Beth-Kanter-Journal
- In KD Paineās decades of experience, the measurement process looks like this ā no matter what youāre measuring to get at measuring what matters ā¦ The strategy piece includes creating a plan, it might include research (audience research or benchmarking w/peers). For some of you, your pilot might be āprospectiveā ā as part of planning a future campaign or program. Or it might be analyzing the past ā something youāve already implemented but want to go back and measure results/value for planning next reiteration or to do present to senior management to pave the way for more incorporating social media into your program delivery or communications channel. The do part ā your tactics, tools ā The measure is your data collection ā as part of your strategy you define this ā it includes analysis ā you donāt just collect data, you figure out what it means in terms of improving your results ā and then you adapt your plan/strategy and the cycle continues.Make sense? Does this sound familiar? Is this way you measure other programs or communications efforts that do not include social media?
- These are the basic steps that you will follow for your measurement pilot ā¦. Or any project that involves social media ..The challenge here is that you are not just measuring, but measuring around your practice or strategy.The pilot is making it very simple.What are benchmarks? What are KPIs?How to define the perfect KPINetworked learning with benchmarksReflection Questions:What do you need to benchmark to put your SMART objectives in a context?What is an easy and simple way to implement benchmarking?What are your KPIs?
- http://www.flickr.com/photos/kevlar/2636361561/sizes/o/in/faves-cambodia4kidsorg/Measurement is a comparable tool. One of the most common question that many nonprofits ask when crafting SMART objectives is, āHow do you know that weāve identified the right how many number?ā You always want to know not just the number of the month or the quarter, but whether that number is bigger or smaller than something else. Last month, or last quarter, or the peer organizations. So the next step in this process is to decide what you are going to compare yourself to. The most effective comparisons are to peer organizations or to your organizationās past performance over time. Sometimes the latter is difficult because social media is relatively new for many nonprofits. So most organizations begin by measuring over time, and then add in peer institutions or organizations with whom you might collaborate with ā¦ for share of volunteer hours or share of wallet. Again, what is important is to benchmark against what matters to your organization.. essentially whatever keeps the board and the executive director up at night. Doing a benchmark study of similar organizations doesnāt have to be an elaborate time consuming burden. Pang HouaMoua is the first communications director hired for SEARAC, a national organization that advances the interests of Cambodian, Laotian, and Vietnamese Americans by empowering communities through advocacy, leadership development, and capacity building to create a socially just and equitable society.āI didnāt want to pick a number of out of the air ā or one that was too high and created unrealistic expectations or a number that was so low that we easily made it.ā Ā
- Measurement is a comparable tool. āI didnāt want to pick a number of out of the air ā or one that was too high and created unrealistic expectations or a number that was so low that we easily made it.ā Ā Key Performance Indicators are numbers based on data points that you can collect to measure your progress towards reaching your SMART objectives. There are hundreds if not thousands of metrics you could collect. But since the average human can pay attention and remember at most about 7 things at a time, you have to whittle that list down to a couple of āKey Performance Indicatorsā or the most important metrics that you need to know that youāre on track to reach to your results. The formal term is Key Performance Indicators, but a more accurate term is āKick Butt Indexā -- in other words, if the boss comes in and says, āDamn it, weāre getting our butt kicked out thereā what does that mean? And if he/she says ā congratulations, youāre really kicking butt,ā what does that mean? So the fourth step in the process is to get broad agreement on what those metrics are. Typical KPIs are Ā The important thing to remember about KPIs is that you become what you measure, so they have to be meaningful, actionable and relevant. And, in fact, if youāve completed steps 1-3 your KPIs should fall naturally out of the earlier conversations about goals and stakeholder groups. It is just a question of translating the priorities and goals into a number you can calculate like: % increase in donations% increase in new donors or members % reduction in cost per member acquired For social media, typical KPIs are: % increase in share of desirable coverage (desirable can mean positive tone, favorable positioning, % increase in share of conversation% increase in number of supporting conversations (expressing support for the cause) % increase in conversation that contains our key messages http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=117581Ā
- Ā Ā There are hundreds if not thousands of metrics you could collect. But since the average human can pay attention and remember at most about 7 things at a time, you have to whittle that list down to a couple of āKey Performance Indicatorsā or the most important metrics that you need to know that youāre on track to reach to your results.
- Share our experience in developing our measurement project ..
- http://www.webanalyticsdemystified.com/ae/index.aspWe got help from the Analytics Exchange which provides volunteers who will help your nonprofit make better use of analyticsWe got a mentor and a āstudentā who the work of helping us think through the design of the project
- These were the project objectives ā¦..
- Describe how you came up with these .. Were these in your communications plan?
- Can you describe how you came up with this? Overview ..It would be fantastic if she would share the PPT ā this could be a great template for folks.
- For each of the objectives, the mentor/volunteer ā helped us identify a SMART Goal and KPIs for each of the objectivesDescribe the first one around awareness
- We didnāt set the numbers in isolated ā we did some benchmarking with peer organizations ā¦ describe
- We also looked at our past data ..Talk about what you collect hereWould you be willing to share this spreadsheet?
- We also talked about matching tools for the job, but Iām going to share what we come up and use in November ā thatās the session on tools
- work with 6-10 regional offices and programs to pick specific goals within the next six monthsa social media presence and network that educates an increasingly large group of people about our issues and viewpoints and ultimately drives more people to take action by passing on our message, acting as an advocate for the environment by responding to action requests, and donating money to NWF. To do that, we believe we need a suite of tools that, with personalized and compelling content, work together to increase traffic to our regional websites. We also need regional websites that provides visitors a fulfilling experience that allows them to support NWF in a variety of ways, including giving regionally.The fundamental premises of this plan are: 1) that social media provides an opportunity to reach people now and move them to action to protect wildlife now; 2) that social media will be a much more powerful and standard way to communicate in five years if not two years; 3) that people will increasingly make decisions to take action and to support non-profit organizations based on their social media relationships with organizations, and with friends and family who have social media relationships with organizations; and 4) that establishing a much stronger social media presence now will allow us to increase our reach and raise more money now, but is most important because it allows us to position ourselves for the future.
- With blogging, there are several ways to track your āsuccessā and follow how your posts are performing. These are some of the ways we look at, at the NWF. The most basic is Web Analytics, and while you may not be the people tracking the information, it will be useful for you to know what a well-received blog post looks like.
- Show of hands: how many on FB?Twitter? Tweet what had for breakfast?Two primary vehicles: Facebook and TwitterWe also are strongly represented on: SeaNotes blog, YouTube, Flickr, Yelpāplus now tumblr and Google+. Dizzying!SFW also has a strong presence; administration delegated to that team, with input/coordination from us
- Show of hands: how many on FB?Twitter? Tweet what had for breakfast?Two primary vehicles: Facebook and TwitterWe also are strongly represented on: SeaNotes blog, YouTube, Flickr, Yelpāplus now tumblr and Google+. Dizzying!SFW also has a strong presence; administration delegated to that team, with input/coordination from us
- Learned a few things over timeMore I learn the less I knowā¦.!
- Vicarious experience; a way to connect to a national audience
- Snapshot of where weāre atGrown sixtimes over since mid ā09; now over 125,000Second overall, top tier in our competitive set
- Snapshot of where weāre atGrown sixtimes over since mid ā09; now over 125,000Second overall, top tier in our competitive set
- Even more important: people are engaging with us, often over 1,000 times per weekThis is the real work of social media: listening and responding
- Session 3: Why Does Bad Measurement Practice Happen To Good Nonprofits?September 22 at 11:00 am PST/ 2:00 ESThttp://measure-netnon.wikispaces.com/Grp+2+Session+3+Bad+Measurement