Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data Placemats: Construction and Practical Design Tips

3,346 views

Published on

Increasing stakeholder involvement throughout the evaluation lifecycle, not only enhances stakeholder buy-in to the final evaluation results, but it also ensures that the evaluator is taking into consideration multiple viewpoints to be able to provide a more comprehensive picture of a program or initiative. Data placemats, a data viz technique to improve stakeholder understanding of data, can be used to communicate preliminary evaluation results during the analysis phase of the evaluation life cycle. When done correctly, it offers stakeholders an opportunity to form their own judgments about the data and weigh in prior to the final report. In this session, the presenter will review the concept of data placemats, focusing specifically on the nuts and bolts of constructing a data placemat.

Published in: Data & Analytics
  • Be the first to comment

Data Placemats: Construction and Practical Design Tips

  1. 1. Construction & Practical Design Tips Data Placemats Veena Pankaj @VeenaPankaj Friday, November 13, 2015 Evaluation 2015, Chicago Illinois American Evaluation Association @InnoNet_Eval
  2. 2. Participa nts Round 1 Round 2 Round 3 WKCF 143 154 168 GKCF 34 45 102
  3. 3. Planning Analysis & Reflection Action & Improvement Data Collection
  4. 4. Participatory Evaluation Stakeholder Involvement Evaluation Use
  5. 5. The Learning JourneyData Placemats Pankaj & Emery, in press.
  6. 6. Created by Scott Lewis from the Noun Project
  7. 7. Created by Michela Tannoia, GB from the Noun Project Information Architect
  8. 8. Created by EliRatus, IL from the Noun Project Information Anxiety
  9. 9. Created by EliRatus, IL from the Noun Project Information Anxiety Data Knowledge
  10. 10. Unstructured Information Structured Information Knowledge
  11. 11. The Learning JourneyThe Learning Journey 1 2 3 Before the data interpretation meeting During the data interpretation meeting After the data interpretation meeting
  12. 12. The Learning JourneyThe Learning Journey 1 2 3 Before the data interpretation meeting During the data interpretation meeting After the data interpretation meeting
  13. 13. Before the Data Interpretation Meeting
  14. 14. Phases A Preliminary planning B Mapping, organizing and analyzing data C Designing the data placemat Before the Data Interpretation Meeting
  15. 15. Preliminary Planning A
  16. 16. Building a Data PlacematPreliminary PlanningA
  17. 17. What year did you participate in the fellowship program? (n=120) Class Total Class 10 (Year '03-04) 19 out of 23 fellows Class 11 (Year '04-'05) 19 out of 24 fellows Class 12 (Year '05-'06) 23 out of 24 fellows Class 13 (Year '06-'07) 20 out of 22 fellows Class 14 (Year '07-'08) 19 out of 19 fellows Class 15 (Year '08-'09) 20 out of 20 fellows Year of Participation (n = 120)4 Demographics and Involvement Constituency Size1 Before I entered the fellowship I was undecided about what I wanted to do …but being in DC and interviewing professionals doing policy work, I [realized] that I wanted to work at the neighborhood/community level. -Alumnus, Class 1 (Interviewee) Learning from the field and about policy was invaluable. I realized that while working at the DC policy level is a needed aspect of doing…social change work, I am better suited to do direct service and field organizing. -Alumnus, Class 2 (Interviewee) The program helped me realize my potential as a leader. As a person of color and a person who has experienced poverty first-hand, the program gave me the courage and skills necessary to utilize and share my experiences constructively with others to diversify the discourse of anti-hunger and anti- poverty. – Alumnus class 5, Survey Respondent Impact of Fellowship on Career Impact of Fellowship on Career2 Facebook likes over time5 Toolkit Utilization (n=120)6 Involvement with Programming3
  18. 18. Activities or Services Outputs Short- Term Outcomes Interim Outcomes Long- Term Outcomes Outcomes Evaluation Questions Data Collection Method Data Source Preliminary Planning
  19. 19. 1. What are the characteristics of program participants? 2. To what degree did socioeconomic status impact participation? 3. To what extent did geography play a role in the overall participant journey? 4. What were the barriers to participation? Evaluation Questions Created by Blake Thompson, US from the Noun Project
  20. 20. Mapping, Organizing and Analyzing Data B
  21. 21. 1 4 Mapping and Organizing Data Data Collection Instruments Survey Interview Protocol 1 2 3 1 2 3 What are the characteristics of program participants? To what degree did socioeconomic status impact participation? To what extent did geography play a role in the overall participant journey? What were the barriers to participation? Evaluation Questions
  22. 22. Mapping and Organizing Data
  23. 23. Survey Data Open-ended Responses Interview Analysis Pivot Tables and Graphs Analyze Data
  24. 24. Designing the Data Placemat C
  25. 25. Choose which pieces of data belong on your placemat
  26. 26. Pankaj & Emery, in press. Determine how to use color
  27. 27. Header/theme Supporting data Chart/graph titles Chronological labels for placemat elements Components of a data placemat
  28. 28. 1 are a means to an end Keep in mind, data placemats ….. 2 are a communication tool 4 offer an opportunity to collect additional context about the data 3 provide a chance to test initial evaluator assumptions
  29. 29. Sample Data Placemats
  30. 30. Accessibility and Satisfaction
  31. 31. During the Data Interpretation Meeting
  32. 32. Phases A Facilitative capacities of the evaluator B Facilitation tips Guiding questions During the Data Interpretation Meeting Sample data placemats
  33. 33. Technical Capacities  Analyzing data  Designing data placemats
  34. 34. Adaptive Capacities  Perceiving and interpreting  Flexibility  Nurture productive dialogue  Rely on intuition and instinct
  35. 35. Purpose Format
  36. 36. Walk through each Placemat
  37. 37. What does this data tell you?
  38. 38. What surprises you about this data?
  39. 39. What factors may explain some of the trends we are seeing?
  40. 40. Does this lead to any new questions?
  41. 41. come prepared with your back pocket themes ask questions and gather additional context During the data interpretation meeting … make a list of all the additional analyses that you will conduct following the meeting Created by Scott Lewis from the Noun Project
  42. 42. After the Data Interpretation Meeting 1 2 3
  43. 43. Phases A Conduct additional analyses B Prepare final deliverable After the Data Interpretation Meeting
  44. 44. Additional Analysis Created by Mark Shorter, US; Creative Stall, PK; Milky Digital innovation, FR from the Noun Project
  45. 45. Prepare Final Deliverable
  46. 46. The Learning JourneyThe Learning Journey 1 2 3 Before the data interpretation meeting During the data interpretation meeting After the data interpretation meeting
  47. 47. The Learning JourneyThe Learning Journey Before the data interpretation meeting Preliminary planning Mapping, organizing and analyzing data Designing the placemat
  48. 48. The Learning JourneyThe Learning Journey During the data interpretation meeting Facilitative capacities of evaluator Facilitation tips
  49. 49. The Learning JourneyThe Learning Journey After the data interpretation meeting Conduct additional analyses Prepare final deliverable
  50. 50. Benefits of Participatory Data Analysis Interest & Engagement1 2 3 Evaluation Use High Quality Analysis
  51. 51. Data Placemats: Construction & Practical Design Tips Thank You! Veena Pankaj @VeenaPankaj Friday, November 13, 2015 Evaluation 2015, Chicago Illinois American Evaluation Association @InnoNet_Eval

×