Be Networked, Use Measurement,      and Make Sense of Your DataBeth Kanter, Author, Blogger, and Master Trainer           ...
Beth Kanter: Master Trainer, Blogger, Author, Speaker
Meet Keo SavonI’m donating my author royalties to the Sharing Foundation’s Education Program                            to...
Agenda   AGENDA                                                                 OUTCOMES                                  ...
Maturity of Practice Framework: Measure Progress          If you can’t fly then run, if you can’t run then walk, if       ...
Where to focus … CRAWL               WALK                      RUN                         FLY                 Linking Soc...
POLL: Where Is Your Organization?CrawlWalkRunFly
Maturity of Practice: Crawl-Walk-Run-Fly                                                   CRAWL -1   WALK-2   RUN-3   FLY...
The Data Informed Nonprofit
POLL: What’s Your Biggest Measurement Challenge? Lack of time Concern that social media does not return ROI Lack of Skills...
Denial         I don’t have the time              to measure.
Fear       What if my strategy       or program doesn’t         show success?
Confusion     I know I should             measure our social            media and network,            but not sure what or...
Delight          Hey check out            these cool           charts and             graphics!
Data Informed                Successful networks and                social media start with                    measurement
CWRF: Becoming Data Informed: What Does It look like?       Crawl                     Walk                        Run     ...
Data-Informed Culture: It starts from the top!                         Do Something.org
Tear down those silos and walls around data …
More time think about that the data, then collect it
Video
Why did it fail?What did we learn?What insights canuse next timearound?DoSomething.Org’s Fail Fest
CWRF: Becoming Data Informed: What Does It look like?       Crawl                     Walk                        Run     ...
POLL: Where Is Your Organization?CrawlWalkRunFly
How To Improve Measurement Practice                       • Use the 7 Steps of                         Measurement        ...
The 7 Simple Steps of Measurement                    Goal    Insight                      Audience  Tool                  ...
Measurement Pilots: Small Steps       Audience: Artists and people in their community       Show the human face of artists...
Define Success, Pick The Right Data Point
Results                               MetricIncrease donations                    % reduction in cost per dollar raisedInc...
Measuring Your Content: FlyingGoal: Grow the Movement   MomsRising is building a strong multicultural movement of people w...
Growing the Movement: Web Site and Email Metrics               Website Metrics                             Google Analytic...
Growing the Movement: Social Media Metrics               Social Media Metrics  Twitter  Facebook  Twitalyzer  Klout
Qualitative DataQualitative Feedback
What if you are crawling or walking?
Maturity of Practice: CWRF – Content  CRAWL                  WALK                    RUN                    FLY  Shares co...
POLL: Where Is Your Organization?CrawlWalkRunFly
Measuring Your Content: To What End?Result           Metrics       Analysis QuestionConsumption      Views         Does yo...
Collect Less, Think About It More
Review your Spreadsheet for 20 Minutes                     Look for patterns
Data Without Insight is Trivia
The Right Tool for the Job             • SentimentContent      • ThemesAnalysis     • Messaging Survey      • Attitudes   ...
Use Your Data For Decision-Making
Specific Time for Reflection and Improvement                  Step 7 – Analyze ResultsJoyful Funerals                 Metr...
Is the time youare spending on  social media    worth it?
How much did it cost?            Be honest – Social            Media is not “free”            Be transparent            Gi...
Results                               Value/Cost                              MetricIncrease donations                    ...
Was Your Time Worth It?800,000         Uniques                                           180,000700,000         Twitter Re...
Improving Your Measurement Practice!1. You identify success and failure first2. Spend more time identifying what you want ...
Thank you!www.bethkanter.orgwww.facebook.com/beth.kanter.blog@kanter on Twitter
Measurement webinar
Measurement webinar
Measurement webinar
Upcoming SlideShare
Loading in …5
×

Measurement webinar

1,433 views

Published on

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,433
On SlideShare
0
From Embeds
0
Number of Embeds
156
Actions
Shares
0
Downloads
16
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Worked in the nonprofit sector for over 33 years. Had a front row seat at the creation of a field – nonprofit technology – use of technology for mission-driven work. I’m a master trainer so I get to travel around the work and work with changemakers on how to use the tools for social change or mission driven work. Most recently, have designed and delivered curriculum for nonprofits to become networked nonprofit – Middle East, Africa, India, etc. There are wicked problems in the world -- I’m passionate about social change and strongly believe that two of the skills that nonprofits need to embrace to solve them. Also a share of the royalities are going
  • Meet KeoSavon. It is important to me that the book has a social change mission so I am donating my royalities to send her to college in Cambodia through supporting the Sharing Foundation program for education. It will make difference in her life.She is a civil engineering major and is 2nd in her class. I met her this summer when I visited Cambodia. She lives in the orphanage that my daughter came from in Cambodia – and KeoSavon also calls me “mom.” She told me she wants to go to graduate school in the US – MIT or Stanford. I told her that I would have to sell a lot of books!
  • http://www.flickr.com/photos/oreoqueen/3235090633/in/faves-cambodia4kidsorg/http://www.flickr.com/photos/jonathandesign/7031920221/in/faves-cambodia4kidsorg/http://www.flickr.com/photos/bdfbrasil/2416260064/sizes/m/in/faves-cambodia4kidsorg/http://www.flickr.com/photos/levymh/6891554365/in/faves-cambodia4kidsorg/
  • http://www.flickr.com/photos/firecloak/6774418629/sizes/l/in/photostream/
  • http://www.flickr.com/photos/hockeyshooter/4132732687/
  • http://www.flickr.com/photos/theimagegroup/369893824/
  • The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Runhttp://www.flickr.com/photos/clover_1/2647983567/Flyhttp://www.flickr.com/photos/micahtaylor/5018789937/
  • There’s another important organizational skill - data-informed this describes agile, responsive, and intelligent nonprofitsthat are better able to succeed in a rapidly changing environment and can fuel networks of networks. DoSomething.org has a big hairy social change goal:  To harnesses teenage energy and unleash it on causes teens care about by launching a national campaign per week.  The call to action is always something that has a real impact and does not require money, an adult, or a car.   Their measurable goal is to get 5 million active teen members engaged in social change campaigns by 2015.    Their use of social media, mobile, and data all strategically selected and use to reach that goal.They are a networked nonprofit with a data informed culture – and it started at the top with their board and advisors ..Reid Hoffman and DjPatil – “A Data Scientist” – have advised the CEO – Nancy Lublin – not only what infrastructure is needed to collect and make sense of data, but how she as the leader can’t rely on hunches – decisions – have to be informed by data.
  • http://www.flickr.com/photos/mkrigsman/3428179614/DoSomething has two data analyst positions on staff .. And they aren’t sitting in the corner playing with their spreadsheetsWhile a big part of their job is to become the stewards of the dashboard, they work with staff – so that making sense of data Is not an adhoc process, but one of continous improvement of the programs. The data analysts work collaboratively with staff to help them apply and understand their data.
  • One of their organizational mantra is “Spend More Time Thinking About The Data, Less On Collecting ItPregnancy Text” Campaign featured on their quarterly dashboard.    This clever sex education campaign is an updated version of the teen pregnancy education program where young people carried eggs around and pretend they are babies.   It was a text campaign where teens opted in to receive texts on their mobile phones from the “baby.”     Once they joined (and they could share it with their friends). they received regular annoying text messages at all hours from the “baby”  that poops, cries, and needs their immediate attention.The team at DoSomething.org uses data to base the program design, key performance indicators and a hypothesis to be tested.    They looked at  survey data from the National Campaign:  nearly 9 in 10 (87%) young people surveyed also say that it would be much easier for teens to delay sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents and/or friends.    So, success of this campaign would be mean that participants talk with their family or friends about the issue and delay sexual activity.The basic design had those who signed up challenge their friends to take care of a text baby either by (1) going to DoSomething website and selecting 5 friends to challenge or (2) after receiving a text from DoSomething (sent to DoSomething’s 300k mobile subscribers) would opt to challenge friends after reading a quick stat on US teen pregnancy.   Participants that accepted the challenge would then start receiving texts the following morning from the text-baby.  After completing the challenge user were prompted to send it to their own friends.DoSomething.org also followed up with 5k of the users with a text-based survey to measure impact.Once defining success and identifying the right data collect, here’s some of the insights they gleaned  according to Nancy Lublin, CEO of DoSomething and Jeffrey Bladt:SMS as a platform:  They are monitoring engagement per communication channel and it has revealed SMS to be 30xs more powerful for getting their users to take action as compared to emailChallenging 5 friends: we’ve tested various group sizes for SMS experience and have found the a group of 6 (1 alpha inviting friends) leads to the highest overall engagementResearch Based Messaging:  The general messaging for the campaign was based on survey findings that found (1) big scare tactics (e.g. getting pregnant = not going to college) we not as effective as highlighting who being a teen parent changes daily life (e.g can’t go to the movies because baby sitter cancelled); (2) a CDC report that found: “The impact of strong pregnancy prevention messages directed to teenagers has been credited with the [recent] teen birth rates decline.A/B Testing: They pre-tested different messages and frequency of sending the messages to smaller test groups of  teens to optimize the number of messages the baby would send during the day, as well as the content.   They ended up doubling the frequency and rewording several interactions as well as building in a response system (so the baby would respond if  teen texted an unsolicited response).  The insights from these tests pushed up engagement and likelihood of forwarding at the end.Impact:  They did a survey to measure this.   1 in 2 teens said that taking the Pregnancy Text made it more likely that they would talk about the issue of teen pregnancy with their family and friends.As you can see from the above insights,  DoSomething just not gather and analyze topline data:101,444 people took part in the campaign with 100,000 text-babies delivered171,000 unsolicited incoming messages, or 1 every 20 seconds for the duration of the campaign. During the initial launch period (first 2 weeks), a new text message was received every 10 seconds.For every 1 direct sign-up, DoSomething gained 2.3 additional sign-ups from forward to a friend functionality.  The viral coefficient was between 0.60 and 0.70 for the campaign.1 in 4 (24%) of teens could not finish a day with their text-baby (texted a stop word to the baby)DoSomething.org uses its data to continuously improve programs, develop content, and shape campaign strategies. So DoSomething.org wants its staff to spend more of its brainpower thinking about the data, rather than collecting it. To ensure that this happens, DoSomething.org’s Data Analyst Bob Filbin’s job is more than programming formulas in Excel spreadsheets. Says Filbin, “One of the biggest barriers in nonprofits is finding the time to collect data, the time to analyze, and the time to act on it. Unless someone is put in charge of data, and it’s a key part of their job description, accelerating along the path towards empowered data-informed culture is going to be hard, if not impossible.”
  • No addhttp://www.youtube.com/watch?v=QhgsJjNVbu0http://gawker.com/5950941/kathie-lee-dropped-a-puppy-on-his-head-on-live-tv-todayhttp://www.youtube.com/watch?v=sQzo_3yIc8M
  • Back in the office, the data scientists were looking at the data in real time to figure out what was driving people to their landing page and getting them to sign up.
  • Fail Fest And Pink Boas: Don’t Be Afraid To FailDoSomething.org doesn’t use its data to pat itself on the back or make the staff feel good. Lublin notes that they’re not afraid of failure. They hold regular “Fail Fest” meetings, where each person on staff has to present a campaign or program failure. They share three things they learned about themselves and three things the organization learned. To remove the stigma from failure, Lublin says, “We have to wear pink boas when we present.” http://www.flickr.com/photos/ruminatrix/2734602916/in/faves-cambodia4kidsorg/
  • The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Runhttp://www.flickr.com/photos/clover_1/2647983567/Flyhttp://www.flickr.com/photos/micahtaylor/5018789937/
  • They focused on developing a robust engagement and content strategy – that was integrated with other channels, all to support objectives in communications strategy and outcomes – and used measurement. They started with one channel – FB …
  • http://www.flickr.com/photos/40991157@N02/3923081100/
  • http://www.flickr.com/photos/kwl/4493219149/
  • http://bit.ly/network-leadership
  • Measurement webinar

    1. Be Networked, Use Measurement, and Make Sense of Your DataBeth Kanter, Author, Blogger, and Master Trainer February 20, 2013 Nonprofit Marketing Guide Webinar
    2. Beth Kanter: Master Trainer, Blogger, Author, Speaker
    3. Meet Keo SavonI’m donating my author royalties to the Sharing Foundation’s Education Program to send her to college!
    4. Agenda AGENDA OUTCOMES Leave webinar readyBecoming Data to take a small step toInformed improve how you measure and learn to improve your socialNonprofit Measurement media strategy!StoriesHow To Measure SocialMedia in 7 Easy Steps • Interactive: Ask Questions, Use Chat
    5. Maturity of Practice Framework: Measure Progress If you can’t fly then run, if you can’t run then walk, if you can’t walk then crawl, but whatever you do you have to keep moving forward.”
    6. Where to focus … CRAWL WALK RUN FLY Linking Social with Ladder of Network BuildingCommunications Results and EngagementStrategy Networks Many Free Agents work forDevelopment Content Strategy you Pilot: Focus oneCulture Change program or channel Best Practices Multi-Channel with measurement Engagement, Content, and Measurement and Measurement Incremental Capacity learning in all above Reflection and Continuous Improvement
    7. POLL: Where Is Your Organization?CrawlWalkRunFly
    8. Maturity of Practice: Crawl-Walk-Run-Fly CRAWL -1 WALK-2 RUN-3 FLY-4Categories Practices ScoreCULTURE Networked Mindset 1.14 Institutional Support 1.62CAPACITY Staffing 1.24 Communications Strategy 1.38MEASUREMENT Analysis 1.14 Tools 1.52 Adjustment 1.67LISTENING Brand Monitoring 1.19 Influencer Research 1.19CONTENT Integration and Optimization 1.29ENGAGEMENT Ladder of Engagement 1.14 NETWORK Champions/Aligned Partners 1.10 Relationship Mapping 1.29
    9. The Data Informed Nonprofit
    10. POLL: What’s Your Biggest Measurement Challenge? Lack of time Concern that social media does not return ROI Lack of Skills Defining success or results Identifying right KPI Tools to collect and analyze data Making sense and learning from the data
    11. Denial I don’t have the time to measure.
    12. Fear What if my strategy or program doesn’t show success?
    13. Confusion I know I should measure our social media and network, but not sure what or how?
    14. Delight Hey check out these cool charts and graphics!
    15. Data Informed Successful networks and social media start with measurement
    16. CWRF: Becoming Data Informed: What Does It look like? Crawl Walk Run Fly Lacks consistent data Data collection Data from multiple Org Wide KPIs collection consistent but not sources shared No reporting or Data not linked to System and structure for Organizational synthesis results, could be wrong data collection Dashboard with data different views, sharing Decisions based on gut Rarely makes decisions Discussed at staff Data visualization, real- to improve meetings, decisions time reporting, formal made using it reflection process Analysis Tools Sense-Making
    17. Data-Informed Culture: It starts from the top! Do Something.org
    18. Tear down those silos and walls around data …
    19. More time think about that the data, then collect it
    20. Video
    21. Why did it fail?What did we learn?What insights canuse next timearound?DoSomething.Org’s Fail Fest
    22. CWRF: Becoming Data Informed: What Does It look like? Crawl Walk Run Fly Lacks consistent data Data collection Data from multiple Org Wide KPIs collection consistent but not sources shared No reporting or Data not linked to System and structure for Organizational synthesis results, could be wrong data collection Dashboard with data different views, sharing Decisions based on gut Rarely makes decisions Discussed at staff Data visualization, real- to improve meetings, decisions time reporting, formal made using it reflection process Analysis Tools Sense-Making
    23. POLL: Where Is Your Organization?CrawlWalkRunFly
    24. How To Improve Measurement Practice • Use the 7 Steps of Measurement • Identify small pilots and iterate
    25. The 7 Simple Steps of Measurement Goal Insight Audience Tool Cost KPI Benchmark
    26. Measurement Pilots: Small Steps Audience: Artists and people in their community Show the human face of artists, remove the mystique, get audience to share their favorites, connect with other organizations. Focused on one channel (Facebook) to use best practices to: Increase engagement by comments per post Conversations that made the organization more accessible Increase enrollment in classes and attendance at events 10% new students /attenders say they heard about us through Facebook
    27. Define Success, Pick The Right Data Point
    28. Results MetricIncrease donations % reduction in cost per dollar raisedIncrease donor base % increase in new donorsIncrease number of volunteers % increase in volunteersIncrease awareness % increase in awareness, % increase in visibility/prominence, Positive correlation between increase in donors vs. visibilityImprove relationships with existing % improvement in relationshipdonors/volunteers scores, % increase in donation from existing donorsImprove engagement with % increase in engagementstakeholders (comments on YouTube, shares on Facebook, comments on blog, etc.Change in behavior % decrease in bad behavior, % increase in good behaviorChange in attitude about your % increase in trust score ororganization relationship scoreIncrease in skills and knowledge of Increase in revenue per employee,staff Learning % employees understanding their roles and organizational mission
    29. Measuring Your Content: FlyingGoal: Grow the Movement MomsRising is building a strong multicultural movement of people who care about family economic security and well-being. Need To Know KPI Are we adding new members? Increased New Members Are we losing members? Decreased Lapsed Members Are we diversifying Number of Collaborations membership? with multicultural orgs
    30. Growing the Movement: Web Site and Email Metrics Website Metrics Google Analytics & CMS Analytics
    31. Growing the Movement: Social Media Metrics Social Media Metrics Twitter Facebook Twitalyzer Klout
    32. Qualitative DataQualitative Feedback
    33. What if you are crawling or walking?
    34. Maturity of Practice: CWRF – Content CRAWL WALK RUN FLY Shares content that Uses an editorial Uses an editorial Uses an editorial may be relevant to calendar to align calendar to align calendar to align audience, but not content with content with content with consistently and not objectives and objectives and objectives and measuring audiences to publish audiences to publish audiences to publish across channels across channels across channels consistently – aligns consistently and consistently, with program and measures measures advocacy calendars performance performance, and uses data to plan content
    35. POLL: Where Is Your Organization?CrawlWalkRunFly
    36. Measuring Your Content: To What End?Result Metrics Analysis QuestionConsumption Views Does your audience care about the topics your Reach Followers content covers? Are they consuming your content?Engagement Re-tweets Does your content mean enough to your Shares Comments audience for them to share it or engage with it?Action Referrals Does your content help you achieve your goals? Sign Ups Phone CallsRevenue Dollars Does your content help you raise money, recruit Donors Volunteers volunteers or save time?
    37. Collect Less, Think About It More
    38. Review your Spreadsheet for 20 Minutes Look for patterns
    39. Data Without Insight is Trivia
    40. The Right Tool for the Job • SentimentContent • ThemesAnalysis • Messaging Survey • Attitudes • PreferencesResearch • Behavior • ReachAnalytics • Engagement • Action
    41. Use Your Data For Decision-Making
    42. Specific Time for Reflection and Improvement Step 7 – Analyze ResultsJoyful Funerals Metrics Mondays
    43. Is the time youare spending on social media worth it?
    44. How much did it cost? Be honest – Social Media is not “free” Be transparent Given your investment, are your expected results reasonable? Compare alternate ways to achieve goals
    45. Results Value/Cost MetricIncrease donations More efficient fund raising % reduction in cost per dollar raisedIncrease donor base More revenue from a more diverse % increase in new donors baseIncrease number of volunteers More gets done, % increase in volunteers Less burden on existing volunteers or staffIncrease awareness Increase donors/volunteers % increase in awareness, Change in behavior % increase in visibility/prominence, Positive correlation between increase in donors vs. visibilityImprove relationships with existing Better management, more stable % improvement in relationshipdonors/volunteers finances scores, % increase in donation from existing donorsImprove engagement with Better feedback and ideas for % increase in engagementstakeholders innovation (comments on YouTube, shares on Better understanding of attitudes Facebook, comments on blog, etc. and perceptions of stakeholdersChange in behavior Achieve the mission % decrease in bad behavior, % increase in good behaviorChange in attitude about your % likely to volunteer or donate % increase in trust score ororganization increases relationship scoreIncrease in skills and knowledge of Improved results from intangible to Increase in revenue per employee,staff Learning tangible % employees understanding their Using best practices, saving time roles and organizational mission
    46. Was Your Time Worth It?800,000 Uniques 180,000700,000 Twitter Referring Traffic 160,000 Facebook Referring Traffic 140,000600,000 120,000500,000 100,000400,000 80,000300,000 60,000200,000 40,000100,000 20,000 0 0 January February March April Tracked Results: Stage 1 – Integrated into staff Stage 2 – Hired social media staff
    47. Improving Your Measurement Practice!1. You identify success and failure first2. Spend more time identifying what you want tomeasure, not how to measure it3. Measure in context – don’t ever collect data unless you can connect it to your goals4. Don’t wait until the end to collect or analyze data5. Less is more6. Uses measurement pilots to create a habit of collecting and apply data7. Do the is it worth it math!
    48. Thank you!www.bethkanter.orgwww.facebook.com/beth.kanter.blog@kanter on Twitter

    ×