1. Peer Learning Group 1:
Measuring the Networked
Nonprofit:
Sense-Making
Session 5: May 29, 2013
Beth Kanter,
Visiting Scholar, Social Media and Nonprofits
The David and Lucile Packard Foundation
Organizational Effectiveness Program
2. Welcome!
If you experience any technical
difficulties logging into the
system, please contact Ready/Talk
Customer support: 800.843.9166
Please use *6 to Mute your
conference line
While we are waiting, play with the
chat: Type in your
name, organization, and location. I’ll
do the roll call. Take this time to jot
down notes in your wiki journal.
Only the
moderator
can see you
chats
3. Participants: Roll Call
AAPIP
American Civil Liberties Union
American Leadership Forum - Silicon Valley
Arts Council Silicon Valley
Community Foundation Santa Cruz County
COMPASS
Exhale
GlobalGiving
Grantmakers for Effective Organizations
Ibis Reproductive Health
International Women's Health Coalition
Kuumbwa Jazz
Leadership Learning Community
Leopold Leadership Program
Marine Science Institute
PACT
Population Action International
Roots of Change
Stanford Social Innovation Review
The Encore Fellowships Network (hosted by encore.org)
United Way Silicon Valley
Upwell, incubated by Ocean Conservancy
WildAid
Young Invincibles
*7 unmute
* 6 mute
5. Peer Learning Group 1:
Measuring the Networked
Nonprofit:
Sense-Making
Session 5: May 29, 2013
Beth Kanter,
Visiting Scholar, Social Media and Nonprofits
The David and Lucile Packard Foundation
Organizational Effectiveness Program
7. Agenda
Only the
moderator can
see you chats
Tweet your
insights
#netnon
• Roll Call/Recap
• It’s A Process
• Say It With Charts
• Data Visualization Tools
• Organizational Sense-Making
• Mini-Case Studies
• Next Steps
8. • 50% (12) of participants design, implement, and
document an action learning project that improve results
of social media strategy through measurement
• Participants generate six case studies of how
nonprofits can measure social media effectively that are
published on Beth’s Blog and/or presented during a call
• 50% (12) of participants improve baseline level of
maturity for one or more CWRF Measurement Indicators
and average for group increases by .5 point
Peer Learning Program Outcomes
9. Poll: Defining Your Action Learning Project
Case Study
Project Finished
Implementing, Not
Finished
Designed, Not
Implementing
Started designing
Not Started
10. Measurement Indicators: Sense-Making
Crawl: Does not use data to make planning decisions.
Walk: Uses data for decision-making but not a formal organizational
process.
Run: Reports are discussed at staff meetings and used to make decisions
that improve results.
Fly: Formal process for analyzing, discussing, and applying results. Data
visualization and formal reflection processes.
Score: 2.38
11. Sense-Making: It’s A Process
Sense
Making
Clean
Organize
Patterns
Context
Visualize
Apply
19. Visualize: Pick Right Chart Format: 4 Basic Types
Pie Chart: Parts of One Whole
Bar Chart: Comparison of Items
Column Chart: Time Series - Reset
Line Chart: Time Series -
Cumulative
http://www.bethkanter.org/chart-formats/
23. Look for Failure First, Successes Second
Mountains and Valleys
Then start digging …..
Apply: What will you change, keep, or not do?
24. Reflection
• What is works for you or your
organization in making sense of your
data? Why?
• What is the most challenging part of
sense-making of your data? Why?
• How can you do a better job of sense-
making?
26. Say It With Charts!
http://www.bethkanter.org/datanerd-charts/
Step 1:
Which Chart is Best?
Step 2:
Use Color To Emphasize
Step 3:
Delete Data You Don’t Need
Step 4:
Directly Label
Step 5:
Save As A Template
Step 6:
Annotate
27. My Data from Monthly Webinar Polls:
Action Learning Project Feb -4 Feb-25 Mar -18 Apr-15
Design not started 42% 4% 0% 0%
Design started, not finished 58% 63% 19% 4%
Design done, not implementing 0% 29% 33% 27%
Implementing, not finished 0% 4% 48% 59%
Finished implementation 0% 0% 0% 9%
28. What Chart Should I use?
1 - PIE 2 - BAR
3 - COLUMN
4 -LINE
POLL: What Chart Should I Use?
30. Measurement of Progress Towards Program Goals
Action Learning Project Feb -4 Feb-25 Mar -18 Apr-15
Design not started 42% 4% 0% 0%
Design started, not finished 58% 63% 19% 4%
Design done, not implementing 0% 29% 33% 27%
Implementing, not finished 0% 4% 48% 59%
Finished implementation 0% 0% 0% 9%
50% of participants design, implement, and document an action
learning project that improve results of social media strategy through
measurement
31. Use of Color and Metaphor: Red, Yellow, Green
50% of participants design, implement, and
document an action learning project that
improve results of social media strategy
through measurement
35. Action Learning Project: Reflection
• What do you need to finish your action
learning project by June call?
Only the
moderator can
see you chats
Type into Chat
*6 mute
* 7 unmute
36. June 24, 2013
1-2:30 PM PST
Continue to implement action learning project
Topic: Learning Culmination
Presentations
IWHC
Exhale
Leadership Learning Community
Others?
Need help? Book a coaching session
https://my.timedriver.com/4QHZG
Next Session
Editor's Notes
Welcome. This is the very session for this project and I’m thrilled that you have decided to participate in this learning journey. I look forward to learning a lot from you. Today’s call is an orientation to the program and an opportunity for you to ask questions.Give my gratitude the The David and Lucile Packard Foundation for supporting this project and my work …AgendaRoll Call/RecapFramework for Selecting Measurement ToolsTool Box ShareSmart Spreadsheet TricksROC - (Tracking Spreadsheet for influencers and content)Leadership Learning Community (Tracking/Spreadsheet)Upwell - Nodel XLMarine Science Institute - SurveyNext StepsHow To Be Prepared:Keep moving on implementation of your action learning project - book a coaching session with Beth Kanter if you need some helpHomework: Fill in the 2-3 PPT slides in this template (it won't take you long!)What measurement tools are you using and why?What data does it collect to help you understand whether you have reached your goal?Share your spreadsheet (not the data, but the structure)
Every few minutes as we get started, tech support reminder, type into the chat, roll call
Because this is our first call, I’m going to run down the names of the organizations and have everyone say their name – so we can hear each other’s voices. I won’t be doing this for every call – we will get into grove where you should arrive 5-10 minutes early and announcement yourself. If you arrive after the call is underway, let us know you are hear by using the chat.
http://www.flickr.com/photos/malinki/2621920871/sizes/o/Start recording about 2 minutes late to let people join *2
Welcome. This is the very session for this project and I’m thrilled that you have decided to participate in this learning journey. I look forward to learning a lot from you. Today’s call is an orientation to the program and an opportunity for you to ask questions.Give my gratitude the The David and Lucile Packard Foundation for supporting this project and my work …AgendaRoll Call/RecapFramework for Selecting Measurement ToolsTool Box ShareSmart Spreadsheet TricksROC - (Tracking Spreadsheet for influencers and content)Leadership Learning Community (Tracking/Spreadsheet)Upwell - Nodel XLMarine Science Institute - SurveyNext StepsHow To Be Prepared:Keep moving on implementation of your action learning project - book a coaching session with Beth Kanter if you need some helpHomework: Fill in the 2-3 PPT slides in this template (it won't take you long!)What measurement tools are you using and why?What data does it collect to help you understand whether you have reached your goal?Share your spreadsheet (not the data, but the structure)
Here’s a little bit about me – blogger, author, trainer.A lot of my work lately has been designing and facilitating peer learning networks about becoming networked nonprofits and social media– the photo there is a cluster of Packard Fdn. Grantees that focus on family planning … I was in Delhi in June for the start up – an intensive boot camp, followed by remote assistance. There’s were great lunches there, so to avoid people falling asleep … I made them move. The hotel had beautiful three story staircase and they had do laps … so if you do training – incorporating movement and interaction helps people learn and we’re going to do a lot of that today!
AgendaRoll Call/RecapFramework for Selecting Measurement ToolsTool Box ShareSmart Spreadsheet TricksROC - (Tracking Spreadsheet for influencers and content)Leadership Learning Community (Tracking/Spreadsheet)Upwell - Nodel XLMarine Science Institute - SurveyNext StepsHow To Be Prepared:Keep moving on implementation of your action learning project - book a coaching session with Beth Kanter if you need some helpHomework: Fill in the 2-3 PPT slides in this template (it won't take you long!)What measurement tools are you using and why?What data does it collect to help you understand whether you have reached your goal?Share your spreadsheet (not the data, but the structure)
This is really important – how you make sense and apply the data …….
http://www.flickr.com/photos/two-wrongs/165403877/sizes/o/AccurateFormatting correctlyNo cut and paste or export mistakes
88% of excel spreadsheets contain mistakesMental check .. If it is supposed to added up to 100% - it should
Ask “so what” three times. Once again, put on your board member hat. Summon up every ounce of skepticism you’ve ever had. For ever slide, chart, table or graph, ask “So What?” .. make sure you can answer the question and relate the numbers back to the mission of your organization or at least your department. So what if our stakeholders had less opportunities to hear about us? Does it affect our online donation? Our volunteer efforts? So what if we had more Facebook likes, what changed in our ability to fill the needs in our catch basin. So what if we didn’t get our messages out? Did that give greater visibility to opposition groups? Does it mean that we have a harder time attracting and keeping talent? http://www.flickr.com/photos/halloweenjack/2047851060/in/faves-cambodia4kidsorg/
Have the data ready when you are making decisionsData is like homemade bread. When it’s still in the over, not quite ready, the anticipation is huge. You can’t wait to see it. When you take it out of the oven, it’s perfect. You can use it for anything. You serve it with dinner, then have it for breakfast, and make sandwiches with it for lunch. After a while, it gets old and stale and you stick in in the freezer. A few months later you take it out and make bread pudding with it. When data is fresh, you can mine it for all kinds of data and insights, but the older it gets the less useful it is. Eventually, it makes for a good benchmark, but isn’t really that useful anymore. So make sure that your data is ready and at hand when you have to make decisions. http://www.flickr.com/photos/umpqua/388856350/sizes/l/in/photostream/
http://www.flickr.com/photos/lucaohman/4429882836/sizes/l/Pick right formatUse color to add meaningUse visual metaphors
http://www.flickr.com/photos/lucaohman/4429882836/sizes/l/Pick right formatUse color to add meaningUse visual metaphors
http://www.flickr.com/photos/lucaohman/4429882836/sizes/l/Pick right formatUse color to add meaningUse visual metaphors
Rod Stewart was right Every picture tells a story is more than just one of the best-selling albums in history. It’s valuable advice and when it comes to presenting results, every chart, dashboard or table should tell a story. Trend data over time to indicate progress (or lack thereof.) Comparing data to peers, or comparing campaigns tells a story. Pie charts do not. Yes, pie charts are simple ways to express data, but chances are, they don’t tell much of a story, especially if there are so many slices you can’t tell what is what, or if there is only one big slice. If a chart, graph or table doesn’t tell a story, it probably doesn’t belong in your report.
Look for Failure First, Successes Second Look at your benchmarks and ask yourself: What didn’t work, or if everything worked to a certain extent, what were the worst performing programs? Where do we need to pay attention? What can be improved?
