Recommended
Recommended
More Related Content
Viewers also liked
Similar to HSSi Philippines Social Impact Evaluation Project, August 2016
Similar to HSSi Philippines Social Impact Evaluation Project, August 2016 (20)
Recently uploaded
Recently uploaded (20)
HSSi Philippines Social Impact Evaluation Project, August 2016
- 1. SOCIAL IMPACT EVALUATIONLissa Glasgo for Hybrid Social Solutions, Inc. (HSSi) | Funded by Yale University’s Jackson Institute for Global Affairs and the Coca-‐‑Cola World Fund| August 6, 2016 summer project sum-‐‑up:
- 2. 1. What We Wanted To Do 2. What We Accomplished 3. What We Designed 4. What We Learned game plan:
- 3. WHAT WE WANTED TO DO: OBJECTIVES 1
- 4. ü Design a system so that HSSi can gather and analyze social impact data regularly. ü Test it out (and update what we know about HSSi’s social impact in the process). two objectives:
- 5. Spending on energy WHAT WE ASSESS Education & health Feeling of safety Experience with light
- 6. why do we even care about social impact evaluation? so…
- 7. DATA Shows our partners how our products help them reach their goals Helps us improve our technical support systems and marketing Gives us “street cred” with funders and other social enterprises Makes us happy by showing us that what we do matters
- 8. WHAT WE ACCOMPLISHED: STATUS UPDATE 2
- 9. PREPARATION• Researched what other solar companies evaluate, what HSSi has evaluated in the past • Wrote a new version of the survey • Developed a field research plan for the summer • Coordinated with branch managers to find interpreters
- 10. field work IN CATARMAN, CALBAYOG, AND BALER AREAS
- 11. challenges: • Timing is tough. To get the pre-purchase interviews, we have to meet customers after they sign up for a light but before they receive it. Getting to them in that timespan is tricky and requires tight coordination with loan officers. • Distance can delay. Because many of our customers live in rural areas, it takes time to get between meeting centers, limiting the number of interviews we can do per day. • Absences happen (a lot). While the plan was to meet up with pre-purchase respondents after a month for post- purchase surveys, many were not at group meetings when we went back. We found some of them, but not many.
- 12. conducted 103 interviews (37 PRE-PURCHASE + 66 POST-PURCHASE ACROSS REGIONS)
- 13. also: Additional deliverables included: - Final surveys in English, Tagalog, Waray - Google-based data entry system - Social impact evaluation manual - Data collector training module - Partner interviews in Calbayog, Catarman, Baler - Partner satisfaction interview guide - Trained data collector (Region 8) - HSSi Impact Story Form - PowerPoint-Ready Photo Bank
- 14. WHAT WE DESIGNED: SOCIAL IMPACT EVALUATION SYSTEM 3
- 15. Goal: 100 Matched Interviews Per Hub 50 PRE-PURCHASE Ÿ 50 FOLLOW-UP POST-PURCHASE Ÿ EVERY SIX MONTHS
- 16. 4. When all hub data has been entered/ checked, RC & data analyst crunch numbers. 5. RC updates PowerPoint slide deck and data summary report, submits all to Jim. 1. Research Coordinator (RC) hires and trains a Data Collector (DC) for each hub. 2. DCs conduct 50 post-purchase surveys (follow- ups from last round) + 50 post-purchase surveys. 3. DC enters data into Google Form system + best stories into HSSi Impact Story form. If potential error: RC checks data & follows up to fix if needed. the system DATA COLLECTION & ANALYSIS PROCESS
- 17. challenges: • Timing is tough. à Every afternoon, check in with the next day’s loan officer to develop a list of customers who have recently started paperwork to purchase one of our products. • Distance can delay. à Map barangays at the beginning of the research round and plan shortest distances in an area each day. (This one is tough to mitigate.) • Absences happen (a lot). à Cell phone numbers will be critical for reminders the day before post-purchase interviews. If a customer does not have a cell phone, ask for a neighbor’s. addressed.
- 18. WHAT WE LEARNED: STORIES AND DATA 4
- 19. DESCRIBING THE SAMPLE: who did we talk to? PRE-PURCHASE POST-PURCHASE SAMPLE SIZE 37 surveys 66 surveys GENDER BREAKDOWN Female: 37 Female: 59, Male: 7 ACQUISITION METHOD Loan: 37 Loan: 58, Cash: 8 AVG HOUSEHOLD INCOME 11,241.38 PHP 10,023.46 PHP % OF HOUSEHOLD INCOME BY RESPONDENT 24% 42% (Women only: 35.11%) MODEL OWNED SunKing Pro 2: 17 SunKing Home: 19 SunKing Pro 2: 17 SunKing Home: 19 SunKing Mobile: 9 Other: 14 (Niwa + d.light) LOCATIONS COVERED Northern Samar, Western Samar, Aurora TOP OCCUPATIONS Sari-‐‑Sari Store, Housewife, Food Vendor, Laundry, Farmer
- 20. DESCRIBING THE SAMPLE: who did we talk to? PRE-PURCHASE POST-PURCHASE TIME AFTER PURCHASE -‐‑-‐‑ 0-‐‑1 Months: 16 2-‐‑6 Months: 34 6-‐‑12 Months: 10 1+ Years: 2 FREQUENCY OF PAYMENT -‐‑-‐‑ Weekly: 90.9% Every two weeks: 7.3% Monthly: 1.82% AVG WEEKLY PAYMENT -‐‑-‐‑ 115.11 PHP SOLAR LIGHT USE -‐‑-‐‑ Majority: 7+ hours/night Light user (0-‐‑3h): 20.0% Medium user (4-‐‑6h): 23.1% Heavy user (7+h): 56.9%
- 21. Spending on energy Education & health Feeling of safety Experience with light
- 22. Spending on energy Education & health Feeling of safety Experience with light
- 23. energy savings Customers spent an average of 134.44 PHP less per month on kerosene after solar light purchase.
- 24. Before the light, we paid for kerosene, charging large batteries, and charging our cell phones. Now, we save all of that money. After we pay for the solar light, we can buy more food. We have so much more and better food now. “ ”
- 25. My 5-year-old granddaughter is so amazed by how bright the light is, and it cut our electricity bill in half. It brought me the luck of money -- my pockets were empty, but now I can fill them again. With the money I save, I can buy lipstick! “ ”
- 26. Spending on energy Education & health Feeling of safety Experience with light
- 27. Spending on energy Education & health Feeling of safety Experience with light
- 28. 3.23 HOURS respondents reported an extra of study per week after purchasing HSSi solar. (…and 47.6% of post-purchase respondents reported using only solar for children’s study.)
- 29. 84.6% of respondents reported an improvement in study time for children
- 30. When my child was studying at the university, the only thing that helped her study at night is our solar light. Now, she has graduated. “ ”
- 31. blackening on walls from kerosene smoke was 15.1% lower after purchase of a solar light
- 32. 62.7% of respondents reported better in-home air quality since purchasing HSSi solar
- 33. I use my solar light when my baby wakes up at night so that we can see him and so that he feels safe. It also helps me breastfeed him at night. “ ”
- 34. Spending on energy Education & health Feeling of safety Experience with light
- 35. Spending on energy Education & health Feeling of safety Experience with light
- 36. Respondents felt 11.75% safer from fuel-related skin burns after purchase of a solar light (from 59.5% to 71.2% safer).
- 37. When a brownout occurs, my children don't panic because it's not hard for them to look for the light -- the button lights up so that it's easy to switch it on. It's also easy to use when my child needs to go to the comfort room at night-- he can now manage without me. “ ”
- 38. I don't like to sleep in bright light or in total darkness, so I'm very happy that this light has a dim setting. I keep it on all night, and it's safe when I fall asleep reading the Bible or praying before bed. “ ”
- 39. Spending on energy Education & health Feeling of safety Experience with light
- 40. Spending on energy Education & health Feeling of safety Experience with light
- 41. Every. Single. One. When asked if they would recommend HSSi’s solar light to friends and family, 100% of customers said yes.
- 42. We use the solar light for our piggery -- when the pigs give birth, we use the lamp. With kerosene, the lantern was always tipping over. My husband bought a cheap solar light from the market, but it broke. Our HSSi solar light is much better -- we trust the quality more. “ ”
- 43. The light is important to me because it charges my cell phone in brownouts. My husband works in Manila, so having a phone for communication is very important to us, and with solar, I can always talk to him. “ ”
- 44. Customers listed the most important advantages of HSSi solar lights: ü feeling safer in emergencies ü brighter light in their households ü lower bills from electricity / other energy sources ü more reliable light ü easier to charge cell phone TOP BENEFITS Out of 66 interviews, only two respondents could come up with disadvantages to owning HSSi solar: one wished the light were less yellow, and another wished it would turn off automatically. TOP DRAWBACKS
- 45. On average, HSSI’s solar lights increase the time customers have per week for: MORE HOURS IN THE WEEK ü work / job (12.5 h) ü socializing (9.7 h) ü chores (8.4 h) ü religious activity (2.7 h) ü cooking (3.7 h) ü study (3.2 h)
- 46. Before when we didn't have it, we had to close our store every time there was a brownout. Now, we're always open. Plus, the air in the store is cleaner because there is no more smoke from lanterns. “ ”
- 47. When my husband gets coconuts, we use the solar light to process them at night. We’ve been able to improve our income because of extra working hours at night. “ ”
- 48. 96.2% of respondents reported more reliable lighting in their homes
- 49. We don't have electricity because my neighbor doesn't want to let us connect to their cable, and before that was a big problem for my family. But now with solar, that same neighbor asks why we have light even in brownouts! “ ”
- 50. credits Game Plan by Darren Barone from the Noun Project | Architect by Augusto Zamperlini from the Noun Project | Survey by Brennan Novak from the Noun Project | Philippine Peso by Randolph Novino from the Noun Project | Caution by José Hernandez from the Noun Project | Crowd by Magicon from the Noun Project | Books by Jakub Caja from the Noun Project | JasonDavies.com/wordcloud | philippines by Ted Grajeda from the Noun Project | Pen by Chad Wimberly from the Noun Project | Fire by Carla Dias from the Noun Project | Kerosene Lantern Lamp by Sri Kadimisetty from the Noun Project | study by Bonegolem from the Noun Project | design inspiration, as always, from Sophie Savage