The Data Informed Nonprofit: SalesForce Foundation Webinar


Published on

Published in: Technology, Business
1 Comment
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  •’ve been watching you ….Some of you already know that ….
  • The maturing of practice framework includes looking at 7 best practice areas for networked approaches and social media – and some specific indicators – and looking at what they look at the different maturity levels. If you remember the application form, it asked you questions and that’s how I came up with the scoring system. If you were “crawl” you got 1, Walk 2, Run 3, and Fly 4 – and then I average the scores for the group. I also could come up with a score for your organization overall.So, if you got a 1.5, it means that you are on your way to walking.
  • The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Run
  • Bob Filbin from DoSomething is here at this meeting – so if you want more details be sure to talk to him today – and he can tweet more detailsDoSomething has a mission to get 1.5 million teens active on social change campaigns by 2015My talk from TED last year sort of summarized the whole thing. (Its only 5 mins.)Basically, it is a help line for kids by text. Terrific to give them support via a mechanism they prefer. Its private (noboy hears you talking.) Blah blahblah.But what makes this a baller idea? The data! We're going to be using natural language tagging (from the MIT Media Lab) to makr key words in real time--and map out youth issues. We'll finally have real data on every youth issue, every zip code, time of day, etc. This information will change EVERYTHING.
  • has two data analyst positions on staff .. And they aren’t sitting in the corner playing with their spreadsheetsWhile a big part of their job is to become the stewards of the dashboard, they work with staff – so that making sense of data Is not an adhoc process, but one of continous improvement of the programs. The data analysts work collaboratively with staff to help them apply and understand their data.
  • One of their organizational mantra is “Spend More Time Thinking About The Data, Less On Collecting ItPregnancy Text” Campaign featured on their quarterly dashboard.    This clever sex education campaign is an updated version of the teen pregnancy education program where young people carried eggs around and pretend they are babies.   It was a text campaign where teens opted in to receive texts on their mobile phones from the “baby.”     Once they joined (and they could share it with their friends). they received regular annoying text messages at all hours from the “baby”  that poops, cries, and needs their immediate attention.The team at uses data to base the program design, key performance indicators and a hypothesis to be tested.    They looked at  survey data from the National Campaign:  nearly 9 in 10 (87%) young people surveyed also say that it would be much easier for teens to delay sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents and/or friends.    So, success of this campaign would be mean that participants talk with their family or friends about the issue and delay sexual activity.The basic design had those who signed up challenge their friends to take care of a text baby either by (1) going to DoSomething website and selecting 5 friends to challenge or (2) after receiving a text from DoSomething (sent to DoSomething’s 300k mobile subscribers) would opt to challenge friends after reading a quick stat on US teen pregnancy.   Participants that accepted the challenge would then start receiving texts the following morning from the text-baby.  After completing the challenge user were prompted to send it to their own also followed up with 5k of the users with a text-based survey to measure impact.Once defining success and identifying the right data collect, here’s some of the insights they gleaned  according to Nancy Lublin, CEO of DoSomething and Jeffrey Bladt:SMS as a platform:  They are monitoring engagement per communication channel and it has revealed SMS to be 30xs more powerful for getting their users to take action as compared to emailChallenging 5 friends: we’ve tested various group sizes for SMS experience and have found the a group of 6 (1 alpha inviting friends) leads to the highest overall engagementResearch Based Messaging:  The general messaging for the campaign was based on survey findings that found (1) big scare tactics (e.g. getting pregnant = not going to college) we not as effective as highlighting who being a teen parent changes daily life (e.g can’t go to the movies because baby sitter cancelled); (2) a CDC report that found: “The impact of strong pregnancy prevention messages directed to teenagers has been credited with the [recent] teen birth rates decline.A/B Testing: They pre-tested different messages and frequency of sending the messages to smaller test groups of  teens to optimize the number of messages the baby would send during the day, as well as the content.   They ended up doubling the frequency and rewording several interactions as well as building in a response system (so the baby would respond if  teen texted an unsolicited response).  The insights from these tests pushed up engagement and likelihood of forwarding at the end.Impact:  They did a survey to measure this.   1 in 2 teens said that taking the Pregnancy Text made it more likely that they would talk about the issue of teen pregnancy with their family and friends.As you can see from the above insights,  DoSomething just not gather and analyze topline data:101,444 people took part in the campaign with 100,000 text-babies delivered171,000 unsolicited incoming messages, or 1 every 20 seconds for the duration of the campaign. During the initial launch period (first 2 weeks), a new text message was received every 10 seconds.For every 1 direct sign-up, DoSomething gained 2.3 additional sign-ups from forward to a friend functionality.  The viral coefficient was between 0.60 and 0.70 for the campaign.1 in 4 (24%) of teens could not finish a day with their text-baby (texted a stop word to the baby) uses its data to continuously improve programs, develop content, and shape campaign strategies. So wants its staff to spend more of its brainpower thinking about the data, rather than collecting it. To ensure that this happens,’s Data Analyst Bob Filbin’s job is more than programming formulas in Excel spreadsheets. Says Filbin, “One of the biggest barriers in nonprofits is finding the time to collect data, the time to analyze, and the time to act on it. Unless someone is put in charge of data, and it’s a key part of their job description, accelerating along the path towards empowered data-informed culture is going to be hard, if not impossible.”
  • This is an example of a recent campaign to help reduce the number of dogs/cats being killed in kill sheltersResearch found that this was happening because many aren’t posting good photos on social networks and the internetThey created an app to recruit “furtographers”
  • LauncheNo add
  • Back in the office, the data scientists were looking at the data in real time to figure out what was driving people to their landing page and getting them to sign up.
  • -Humane Society of US – Carie Lewis participated in the SXSW in 2009 and in 2013 we did the session again at SXSW-HSUS is an early adopter of social media – and in many areas of practice is flying, although they self-assessed their measurement practice at walking to running …-They have org wide KPIs for their social media – customer service wins, fundraising, and actions taken – plus associated metrics that help figure out whether their digital campaigns and social media integration is helping to push the needle on the KPIS
  • One reason is more cultural than anything else … Data collection is consistent – walking stage, and they are getting to running – getting data to be shared among departments.They have a cross-functional team in place with social media/digital in different departmentsThey have established regular 9 minutes meetings to debrief on campaigns, use a template/common language to collect data.
  • So, one of their KPIs is donations $ - but if their web department is not going to use source codes – how can they measure conversions from social media traffic referral? In 2011, they didn’t. Through the 9 minute meetings, web team began to understand the importance of doing this – and now can accurately track conversions from social media traffic referral – and make adjustments. They use a report template for all campaigns, all departments – right now a simple word document that summarizes data from excel – from free or low cost tools such as Google Analytics, FB Insights, Twitter Analytics, and Convio. They do an after action review for each campaign, write down what worked and what didn’t and use those reports when planning the next campaign.
  • Upwell is definitely flying …..Upwell is focused on Ocean Conservation – their goal is to increase engagement and conversation about ocean conversationThey focus on listening, using Radian 6 and monitoring key words like “Ocean” and look at the “chatter” out there on social networks about these topics. They have developed a baseline methodology so they know what the base is for “share of conversation” on a particular ocean conservation conversation they are monitoring. They identify opportunities to engage to “increase the conversation” on the topic and measure it. One might say they have one metric that matters or “Lean impact” - increase conversation about ocean conservation. As a networked nonprofit – and hoping to build a movement, they are also transparent and share practices - iterate
  • This chart is probably very appealing to all of you – and if you want details – Rachel is out there hanging out in our hashtag and can point you to more details ….This graphic is a snap shot of their social media monitoring of eight different ocean conservation areas ..Each line represents the social mention volume in one of our issue keyword sets.The pair of pink lines are mentions of sharks and cetaceans. Shark week makes big spikes, but cetaceans get more social mentions a day. Hanging out on the bottom of the graph are tuna, overfishing, the Gulf of mexico, ocean acidification, sustainable seafood and tiny tiny MPAs.
  • They were monitoring and saw this opportunity around the keyword “Shark” because of shark week was the biggest attention spike within the eight ocean issues they monitor – it provided a big opportunity to expand audiences, and to grow their distributed network. They campaign was to set an ambitious goal to spike a conversation around shark conversation.More detail on Shark Week:We tried about a dozen things to make that Shark Week conversation bump, including live tweeting ourselves, image macros, and a toolkit for shark evangelists. What really worked was the pair of sharkinars we hosted for shark evangelists.  We shared that the big attention spike was coming up, reviewed top hashtags, identified shark influencers, and that YAY chart was our tone/sentiment analysis of #sharkweek tweets. We taught the shark evangelists that it was mainly a FAN conversation on Twitter, not at FEAR (sensationalized) conversation.
  • They packaged content and worked with partners working on Shark – and were able to analyze and attribute the increase of conversation in 2012 to the campaign tactics. Through this, were able to target new activists/champions – not on their Radar through social media conversations.Then that bar chart with the knitting: the shark week conversation grew 109% over 2011, but the shark conservation mentions grew 210% year over year. That made us happy!
  • The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Run
  • HubSpot Sources tool brings it all together!
  • Easy to collect, difficult to actionUse
  • A lot of shiny object syndrome with metrics tools – big mistake is that they start with the tools – often free analytics – and that gets in the way of good measurement discipline or laddering up to big outcomes ….
  • 1.  Look Within Your Walls: The first place to look is down the hall or ask at your next board meeting.   There may be someone in another department who is a data nerd with expert excel skills.    Ask around.   Or maybe you have a board member who works in the business world and is or has connections to people who work in finance, market research, or analytics.2.  Recruit Through LinkedIn Board Connect: Earlier this fall, LinkedIn launched “Board Connect” that can facilitate recruitment of new board members or volunteers with professional skills.     I’ve said this many times, but if I was running a nonprofit today, I would sign up for this service and put together an advisory group of data nerds to help with my data and measurement needs.3.  Get Free Help with Your Google Analytics: TheAnalysis Exchange has a goal to “dramatically increase the number of people on Earth doing web analytics the right way.”  They provide free web analytics consulting to non-profits and NGOs around the world by matching analytics professionals, students, and charities.   The team works on a practical project that take less than four weeks to complete.They are teaching digital measurement best practices by connecting great causes with experienced mentors and motivated students.4.  Find a Data Scientist with a Heart: Data Scientists are in high demand and have an unusual skill set, including:  data jujitsu skills (combine data from different places, clean it, analyze it, and make sense of it).    The organization, DataKind, has the goal of matching Data Scientists with nonprofits to help them better use their data.    So, if you have a pile of data in spreadsheets that hasn’t been analyzed, go find your organization a data scientist.5.  Get Training : NTEN is offering regular webinars on the topic of how nonprofits can effectively use data.  Leap of Reason offers toolkits for boards, nonprofits, and foundations on “do it yourself” outcomes based measurement.   Or if you are good self-learner and just need to learn a few techniques for creating charts in excel, here’s some terrific video tutorials.6. Read Sector Blogs That Cover Data: If you want to stay current on data in the nonprofit and philanthropic sector, the best place to go is Lucy Bernholz’s Philanthropy 2173 Blog.   Start with this this post about Data as a buzz word, subscribe to Lucy’s blog, and read  ”Navigating the New Social Economy.”    Another place to keep current on data is Markets for Good, an initiative to discover how the social sector can better use and share information to improve outcomes and change lives.    NTEN is also publishing blog posts, articles, and reports and a good place to start is their September NTEN Journal  issue on data.7.  Hire A Consultant: NTEN’s annual nonprofit technology conference and other events,  you will find an ecosystem of consultants who do measurement, data analysis, and other skills required to make sense of your data.     If you are looking for an evaluation specialist, check out the American Evaluators Association directory.   Or ask around for consultants that your colleagues have used.   (And my co-author, KD Paine, has been doing measurement consulting for nonprofits and businesses for over 25 years)8.  Become Someone’s Homework: If you have a college or university in your town, why not become someone’s homework?  Both my books, “Networked Nonprofit,” and  ”Measuring the Networked Nonprofit” has been added to the syllabus of many college courses – from nonprofit management survey courses, philanthropy, communications,  measurement, and more.   I speak to college students regularly, many times through skype like this group of students in Indiana this past month who shared stories about their internships which often included measurement and spreadsheets.   Some courses, like this one for nonprofits and communications taught by my colleague Shonali Burke, often include a student project working with a nonprofit.9.   Attend a Data or Measurement Panel at Your Next Nonprofit Conference or Networking Event: This month, the Independent Sector had a packed house for the Data 360 Panel and put together this set of resources.   Last year, there was a panel at the NTC on Nonprofit Data Visualization and there will be many more in 2013.   If you go to a session at a nonprofit conference, you will probably not only find data nerds presenting, but the room might just be packed with them too.So, if you are not using data or measurement because your organization does not have someone with the skills,  there are ways around this challenge!   Has your organization from a data nerd to help you?  What’s your story?15 Responses
  • They focused on developing a robust engagement and content strategy – that was integrated with other channels, all to support objectives in communications strategy and outcomes – and used measurement. They started with one channel – FB …
  • The Data Informed Nonprofit: SalesForce Foundation Webinar

    1. The Data Informed NonprofitBeth Kanter, Author, Blogger, and Master TrainerJune 13, 2013Salesforce Foundation
    2. Beth Kanter: Master Trainer, Author, and Blogger@kanter
    3. Who are you?ANSWER THE QUESTIONS ON THE ONLINE POLL .…Budget SizeSocial Media ImplementationCurrently Measure?
    4. NetworkedNonprofitsDataInformedHow ToMeasureAgenda#netnonAsk your question in thechat
    5. Maturity of Practice Framework: Networked NonprofitsIf you can’t fly then run, if you can’t run then walk, ifyou can’t walk then crawl, but whatever you do youhave to keep moving forward.”
    6. CRAWL WALK RUN FLYWhere is your organization?Linking Social withResults andNetworksPilot: Focus oneprogram or channelwith measurementIncremental CapacityLadder ofEngagementContent StrategyBest PracticesMeasurement andlearning in all aboveCommunicationsStrategyDevelopmentCulture ChangeNetwork BuildingMany Free Agents work foryouMulti-Channel Engagement,Content, and MeasurementReflection and ContinuousImprovement
    7. Maturity of Practice: Crawl-Walk-Run-FlyCategories Practices AverageCULTURE Networked Mindset 2.3Institutional Support 1.5CAPACITY Staffing 1.8Strategy 1.5MEASUREMENT Analysis 1.5Tools 2.0Adjustment 1.8LISTENING Brand Monitoring 1.5Influencer Research 1.3ENGAGEMENT Ladder of Engagement 1.5CONTENT Integration/Optimization 1.8NETWORK Influencer Engagement 2.0Relationship Mapping 1.31 2 3 40.0 0.5 1.0 1.5 2.0 2.5Arts & Cultural Alliance ofCentral FloridaLA Stage AllianceThe Alliance of ResidentTheatres/New YorkAustin Creative AllianceTheatre Bay AreaC4 AtlantaAll Indicators
    8. The Data Informed Nonprofit
    9. Crawl Walk Run FlyLacks consistent datacollectionData collectionconsistent but notsharedData from multiplesourcesOrg Wide KPIsNo reporting orsynthesisData not linked toresults, could be wrongdataSystem and structure fordata collectionOrganizationalDashboard withdifferent views, sharingDecisions based on gut Rarely makes decisionsto improveDiscussed at staffmeetings, decisionsmade using itData visualization, real-time reporting, formalreflection processCWRF: Becoming Data Informed: What Does It look like?AnalysisToolsSense-Making
    10. Data-Informed Culture: It starts from the top!Do
    11. Data Nerds Partner with Staff
    12. Tear down those silos and walls around data …
    13. More time think about that the data, then collect it
    14. Video
    15. HSUS Analysis Process:• Everyone gathers their data• We sit in a room and analyze it• The project manager develops a report of“what we did/what we learned/what werecommend for next time “+ dataScaling Data-Informed
    16. Jogging!2011: Not Using Source Codes forAll Campaigns To Measure SocialMedia Conversion2013: Using Source Codes for AllCampaigns To Measure SocialMedia Conversion
    17. 140,000120,000100,00080,00060,00040,00020,000
    18. 140,000120,000100,00080,00060,00040,00020,000
    19. 133,167745,0301,683,6700200,000400,000600,000800,0001,000,0001,200,0001,400,0001,600,0001,800,000Shark Week 2010 Shark Week 2011 Shark Week 2012One Metric That Matters:Increase Shark Conservation Conversation
    20. Audience: Artists and people in their communityShow the human face of artists, remove the mystique, getaudience to share their favorites, connect with otherorganizations.Focused on one channel (Facebook) to use best practices to:Increase engagement by comments per postConversations that made the organization more accessibleIncrease enrollment in classes and attendance at events10% new students /attenders say they heard about us throughFacebookMeasurement Pilots: Small Steps
    21. Crawl Walk Run FlyLacks consistent datacollectionData collectionconsistent but notsharedData from multiplesourcesOrg Wide KPIsNo reporting orsynthesisData not linked toresults, could be wrongdataSystem and structure fordata collectionOrganizationalDashboard withdifferent views, sharingDecisions based on gut Rarely makes decisionsto improveDiscussed at staffmeetings, decisionsmade using itData visualization, real-time reporting, formalreflection processCWRF: Becoming Data Informed: What Does It look like?AnalysisToolsSense-Making
    22. Where is your organization?CRAWLWALKRUNFLY
    23. How To Improve Measurement Practice• Measurementdiscipline• Identify small pilotsand iterate• Learn and improve
    24. GoalAudienceCostBenchmarkKPIToolInsightThe 7 Simple Steps of Measurement
    25. Define Success, Pick The Right Data Point
    26. Outcomes MetricIncrease donations % reduction in cost per dollar raisedIncrease donor base % increase in new donorsIncrease number of volunteers % increase in volunteersIncrease awareness % increase in awareness,% increase in visibility/prominence,Positive correlation between increasein donors vs. visibilityImprove relationships with existingdonors/volunteers% improvement in relationship scores,% increase in donation from existingdonorsImprove engagement withstakeholders% increase in engagement (commentson YouTube, shares on Facebook,comments on blog, etc.Change in behavior % decrease in bad behavior,% increase in good behaviorChange in attitude about yourorganization% increase in trust score orrelationship scoreIncrease in skills and knowledge ofstaff LearningIncrease in revenue per employee,% employees understanding theirroles and organizational mission
    27. Hooking Up Your Measurement Dashboard
    28. Goal: Grow the MovementMomsRising is building a strong multicultural movement of people whocare about family economic security and well-being.Need To Know KPIAre we adding new members? Increased New MembersAre we losing members? Decreased Lapsed MembersAre we diversifyingmembership?Number of Collaborationswith multicultural orgsMeasuring Your Content: Flying
    29. Website MetricsGrowing the Movement: Web, Email, Social Media Metrics
    30. What do you not need to collect?Easy HardUsefulNotUseful
    31. The Tools
    32. • Sentiment• Themes• MessagingContentAnalysis• Attitudes• Preferences• BehaviorSurveyResearch• Reach• Engagement• ActionAnalyticsPick the Right Tool for the Job
    33. Skills
    34. Use Your Data For Decision-Making
    35. Start Small
    36. Review your Spreadsheet for 20 MinutesLook for patterns
    37. Step 7 – Analyze ResultsJoyful Funerals Metrics MondaysSpecific Time for Reflection and Improvement
    38. Is the time youare spending onsocial mediaworth it?
    39. Be honest – SocialMedia is not “free”Be transparentGiven yourinvestment, areyour expectedresults reasonable?Compare alternateways to achievegoalsHow much did it cost?
    40. Was Your Time Worth It?Traffic Referral: Unique ViewsLook at Results Against Amount of Staff Time020,00040,00060,00080,000100,000120,000140,000160,000180,0000100,000200,000300,000400,000500,000600,000700,000800,000January February March AprilUniquesTwitter Referring TrafficFacebook Referring Traffic
    41. 1. Measure in context – don’t ever collect dataunless you can connect it to your goals2. Have measurement discipline3. Pick the right measurement tool for the job4. Build measurement capacity within yourorganization5. Uses measurement pilots to create a habitof collecting and apply data and to learn6. Do the is it worth it math!Improving Your Measurement Practice!
    42. Thank you! on TwitterQuestions!