INNOVATIVE
APPROACHES TO M&E
AND PROJECT DESIGN

Anahi Ayala Iacucci
Senior Innovation Advisor
Internews
USING ICT FOR M&E
IN DADAAB, KENYA
OVERVIEW OF THE HUMANITARIAN DATA
TOOLKIT PILOT PROJECT - JANUARY 2013
1. How do we collect data in real time
and assure the quality of our dataset?
2. How can we analyze data faster and
withou...
We need a ready to deploy kit to do
surveys
We need a methodology “out of the
shelf” that we can replicate and teach in
li...
THE PARTNERS
1. An open source, free hardware and
software package to be deployed in
the field
2. A creative commons methodology to
do ...
Internet cables to connect the Wifi modem
A laptop working also as server for FormHub.
The computer has an extra battery t...
Form is
downloaded
into the
phones

Form is created in XLS
format and uploaded into
FormHub

THE WORKFLOW
Data is download...
Paper forms are
prepared and blank
form is loaded into
Captricity

Paper forms are uploaded into
Captricity for digitaliza...
THE RESULTS

What isn’t visible in the graph is the qualitative improvement that
we observed each day as well. There was a...
HARNESSING
DESIGN FOR MEDIA
DEVELOPMENT
OVERVIEW OF HUMAN CENTERED DESIGN PILOT
- SEPTEMBER 2012
AN ASIA TEAM/ICIL
‘EXPERIMENT/PILOT’

An IVR system to deliver election/
civics information to information
‘dark’ areas of...
How do we know IVR is the most
appropriate tech to use?
What if we try a different approach?
Thinking about user-centered ...
What information do communities in
FATA and KPK need to make better
decisions that can improve their lives?
What are the m...
‣Uses

ethnographic research approaches to
better understand people
‣Help

us learn about and interpret people’s
needs, mo...
KEY TOOLS FOR THIS STUDY

SHADOWING
OBSERVATION
INTERVIEWS
SURVEYING
SERVICE TRIAL
USER DIARIES
Photo by Jan Chipchase under a Creative Commons License.
ARTIFACT COLLECTION

PHOTOGRAPHY

NOTE-TAKING
THEME 1: INFORMATION FLOWS
From what sources does a person get the information he or she
needs? Once they get a piece of i...
THEME 2: TRUST
How do people determine whether a piece of news or
information is – or a source – is credible or trustworth...
THEME 3: INFLUENCE
What is influence and reach of different information
sources? How is influence determined and measured?
THEME 4: DISPLACEMENT
How does migration and displacement – both conflictrelated and work-related – impact how FATA popula...
THEME 5: TECHNOLOGY
& NEW MEDIA
How is new technology changing the ways people access,
share, create, and evaluate informa...
BENEFITS OF THIS APPROACH
‣NEW

ARE:

AND IMPROVED PROGRAMS/INITIATIVES THAT

‣

Improved, flexible, appropriate solutions...
BENEFITS OF THIS APPROACH
‣SUPPORTS,

VALIDATES AND ENHANCES OUR
UNDERSTANDING
‣

What we know and what we think we know

...
DESIGN RESEARCH
Put people at the heart of problem-solving

Takes a systems approach to solutions

Identifies opportunitie...
BENEFITS OF OUR APPROACH TO
INNOVATION
‣THE

IMPORTANT OF EXPERIMENTATION

‣

A safe space for people to try, experiment a...
STAY TUNED!

THANK YOU
THANK YOU
Upcoming SlideShare
Loading in …5
×

Innovative Approaches to M&E and Project Design

872 views

Published on

This presentation uses two examples of projects covered by Internews to talk about the use of ICTs for M&E and innovative approaches to evaluate and collect data for Monitoring and Evaluation purposes.

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
872
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
17
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Guided conversations that allow us to discover and probe for respondents’ attitudes and thought processes
    Ideally, conducted in private and in a natural setting
    Can be scheduled or ad hoc
    Can do several with one respondent
    Approximately 1 hour in length
    Uses a set of questions as a guide, not as a fixed rule
    Will be a key tool throughout this project
  • Respondents self-report their responses to a specific question (or set of questions) to help us understand a particular habit, behavior, or process over time
    Written responses
    Short interviews at regular intervals
    Photo or video diaries
    Well-suited to young people
  • Documents and artifacts can tell us a lot about the people and cultures that produce or use them, based on how they are designed, distributed, and/or used:
    Documents may include posters, brochures, advertisements, and other informational material aimed at our respondents
    Artifacts may be anything that our respondents may use to access, share, or store information
  • Start 11:30am / 3 minutes each
    What was the last piece of information you needed to get, that you had to search for?
    How did you search for it? Once you had it, did you share it with anyone?
    (We want to understand how information moves, and how do people choose certain sources, etc. Not just focused on media.)
  • What sources do you trust? What sources do you always question? Why?
    Photo –Daily Mashrique Popular newspaper Mohmand
  • Protests in Mohmand – against movie Sept 2012
  • Is solution oriented: not research for the sake of research
  • Innovative Approaches to M&E and Project Design

    1. 1. INNOVATIVE APPROACHES TO M&E AND PROJECT DESIGN Anahi Ayala Iacucci Senior Innovation Advisor Internews
    2. 2. USING ICT FOR M&E IN DADAAB, KENYA OVERVIEW OF THE HUMANITARIAN DATA TOOLKIT PILOT PROJECT - JANUARY 2013
    3. 3. 1. How do we collect data in real time and assure the quality of our dataset? 2. How can we analyze data faster and without internet? 3. How do we harvest the knowledge of the local population when doing data collection? THE PROBLEMS
    4. 4. We need a ready to deploy kit to do surveys We need a methodology “out of the shelf” that we can replicate and teach in little time while guaranteeing the quality We need to use a technology that can be customized and adapted to the local situation THE NEEDS
    5. 5. THE PARTNERS
    6. 6. 1. An open source, free hardware and software package to be deployed in the field 2. A creative commons methodology to do surveys in the field using local communities 3. An offline/online system for data gathering and data aggregation using both mobile phones and papers THE SOLUTION
    7. 7. Internet cables to connect the Wifi modem A laptop working also as server for FormHub. The computer has an extra battery that allows it to work for 24 hours without electricity Wi-fi modem Power strips that can recharge also via USB. THE KIT A mini scanner that can also be powered via USB Multi USB Port Android phones Paper forms
    8. 8. Form is downloaded into the phones Form is created in XLS format and uploaded into FormHub THE WORKFLOW Data is downloaded in XLS format Data collected is uploaded into FormHub Data is collected on the ground
    9. 9. Paper forms are prepared and blank form is loaded into Captricity Paper forms are uploaded into Captricity for digitalization THE WORKFLOW Data is downloaded in XLS format Paper forms are used to collect data in the field
    10. 10. THE RESULTS What isn’t visible in the graph is the qualitative improvement that we observed each day as well. There was a clear improvement in the enumerators’ facility and comfort with the phones, and also in their ability to correctly and efficiently do the paper-based surveys.
    11. 11. HARNESSING DESIGN FOR MEDIA DEVELOPMENT OVERVIEW OF HUMAN CENTERED DESIGN PILOT - SEPTEMBER 2012
    12. 12. AN ASIA TEAM/ICIL ‘EXPERIMENT/PILOT’ An IVR system to deliver election/ civics information to information ‘dark’ areas of FATA IDEA
    13. 13. How do we know IVR is the most appropriate tech to use? What if we try a different approach? Thinking about user-centered design research how might ICIL approach this question? QUESTIONS
    14. 14. What information do communities in FATA and KPK need to make better decisions that can improve their lives? What are the most effective ways to get them critical information? What sources and channels are used and trusted? How is technology changing how people access or share information? What will these behaviors look like in the next few years?
    15. 15. ‣Uses ethnographic research approaches to better understand people ‣Help us learn about and interpret people’s needs, motivations, aspirations, and how they impact their behavior ‣Over time, process reveals the complex ecosystems in which people operate DESIGN RESEARCH APPROACH
    16. 16. KEY TOOLS FOR THIS STUDY SHADOWING OBSERVATION INTERVIEWS
    17. 17. SURVEYING SERVICE TRIAL USER DIARIES Photo by Jan Chipchase under a Creative Commons License.
    18. 18. ARTIFACT COLLECTION PHOTOGRAPHY NOTE-TAKING
    19. 19. THEME 1: INFORMATION FLOWS From what sources does a person get the information he or she needs? Once they get a piece of information, how do they choose who to share it with?
    20. 20. THEME 2: TRUST How do people determine whether a piece of news or information is – or a source – is credible or trustworthy?
    21. 21. THEME 3: INFLUENCE What is influence and reach of different information sources? How is influence determined and measured?
    22. 22. THEME 4: DISPLACEMENT How does migration and displacement – both conflictrelated and work-related – impact how FATA populations access and use information?
    23. 23. THEME 5: TECHNOLOGY & NEW MEDIA How is new technology changing the ways people access, share, create, and evaluate information? What new media channels are people using, and for what purposes? Impact: Design for Social Change | SVA | August 4, 2011
    24. 24. BENEFITS OF THIS APPROACH ‣NEW ARE: AND IMPROVED PROGRAMS/INITIATIVES THAT ‣ Improved, flexible, appropriate solutions ‣ Based on the actual needs of local communities ‣ Based on the actual capacities of local communities ‣ Informed by a deep understanding of the cultural and political context ‣ Sustainable, based on observed trends of information and technology behaviors into the future ‣ Higher probability of success/impact
    25. 25. BENEFITS OF THIS APPROACH ‣SUPPORTS, VALIDATES AND ENHANCES OUR UNDERSTANDING ‣ What we know and what we think we know ‣ Surface the unknown ‣ADDS TO AND ENHANCES CURRENT RESEARCH ENDEAVORS ‣NEW TOOLS AND APPROACHES FOR M&E: ‣ more insights into impacts and how to measure ‣ More potent and relevant measures of impact useful to us and to funders ‣ Blends beautifully with participatory approaches
    26. 26. DESIGN RESEARCH Put people at the heart of problem-solving Takes a systems approach to solutions Identifies opportunities for impact
    27. 27. BENEFITS OF OUR APPROACH TO INNOVATION ‣THE IMPORTANT OF EXPERIMENTATION ‣ A safe space for people to try, experiment and risk ‣ The ability to act outside projects funding mechanisms ‣ICT is not a silver bullet but it is a tool which use cannot be avoided ‣NEW TOOLS AND APPROACHES FOR M&E: ‣ more DATA and better QUALITY ‣ Tap into the local knowledge and make the local communities the center of the system ‣ Move the focus -M&E/research that looks to the future rather than reporting past MOVING FORWARD
    28. 28. STAY TUNED! THANK YOU THANK YOU

    ×