SlideShare a Scribd company logo
Going Digital:
Using technology to monitor
ECD in South Africa
26 October 2017
SAMEA Conference 2017
01 02 03 04
Further
reading
How it works What we’ve
learned
05
Background Why use
mobile data
collection?
In 2012, 5.9 billion active
mobile connections globally
(Naef et al, 2014)
Forecast for 2017, 7.6 billion
mobile connections globally
Data Collection
past VS now
Data Collection Evolution
1086
Great survey in
England
1937
Unemployment
survey US census
Late 1980s
PDAs & “pocket
computers”
Mid 1990s
Teleform
2007
Rise of smartphones
Future??
Use mobile data collection as alternative
to paper surveys
What is mobile
data collection?
Targeted gathering of structured information using
mobile phones, tablets or other devices using a
software application
Where we’ve used mobile
data collection
Government of South Africa
National Development
Plan 2030
“The goal is to have universal access to
quality early childhood development with
a strong nutrition and educational focus.”
The NDP also emphasizes the need to invest in training early
childhood development practitioners.
Other national
policy documents
 Children’s Act No. 38 of 2005
 National Plan of Action for Children in South Africa: 2012–2017
 South African National Curriculum Framework for Children from
Birth to Four
 Curriculum Assessment Policy for Grades R–12 (CAPS): Grade R-3
 National Integrated Early Childhood Development Policy
 Policy on Minimum Requirements for Programmes Leading to
Qualifications in Higher Education for Practitioners and Educators
in Early Childhood Care and Education
 No data on number of registered/funded ECD centres and
programmes
 No data on how many children access ECD services
 No data on quality of ECD services
Current Challenges
No administrative data system for ECD similar
to those used by health and education
Why national ECD
Monitoring System?
When we have scarce resources, we need data to
ensure coverage AND appropriate resource targeting
Clear need to
invest
in ECD and M&E System
Khulisa is assisting the South African Department of
Basic Education and UNICEF to develop a national ECD
M&E System
Rationale
 Standardise ECD indicators across provinces
 Target implementation for DBE and DSD
 Make district and provincial reporting easier
 Integrate M&E data into existing frameworks
and policies
Why mobile
data collection?
Provides high quality data
reliability
accuracy timeliness
validity integrity
security/
confidentiality
How can mobile
data collection
help?
Using mobile devices makes
managing data collection easier
Data is submitted in real time
to a central online database
Managers can see:
 Pace of data collection
 Coverage
 What data is being submitted
 Location
Allows for real time data quality assurance
Makes entering and
aggregating data easier
Leads to cleaner data as responses can have
pre-determined limits (e.g. only enter a number)
and automated skip patterns
(e.g. only ask the next question if response was yes)
Ability to collect and integrate new
types of data
 Access data faster with less effort
 Reduce cost (minimal printing; no data entry costs)
 No need for double entry of forms
 Data aggregated automatically
Save time and money
A 2011 World Bank study found that mobile data
collection reduced the average interview cost by
approximately 70%
Schuster & Brito, in Satterlee et. al 2015
 Make data more user friendly
 Create demand for data
Data visualisation
How it
works
Software Options
Software Options
Our approach
Use Open Data Kit (ODK) on Android tablets/smart phones
to collect information
Spend one hour in each school or ECD centre
Open Data Kit
ODK is a free and open-source set of
tools which help researchers author,
field, and manage mobile data
collection
It allows data collection using mobile
devices and data submission to an
online server, even without an
Internet connection or mobile carrier
service at the time of data collection
Process
Data collectors pull forms
from cloud repository
called ODK Aggregate
Use ODK Build to convert
paper questionnaires to
e-forms or e-surveys
Install ODK Collect on
phones or tablets for
data collectors
Consider
No need for internet connection during data
collection, but will need internet to upload form
Mobile data collection works well for quantitative
data, but not as well for qualitative data
ODK only works on Android devices, so need to
consider if method is fit for your purposes
Our experience
20 ECD
20 Schools
20 ECD
20 Schools
10 ECD
21 Schools
20 ECD
21 Schools
15 ECD
18 Schools
20 ECD
20 Schools
20 ECD
16 Schools
20 ECD
19 Schools
20 ECD
20 Schools
Tool Pilot
340 sites
Trained government ECD officials
Overwhelming excitement
around potential of using
mobile data collection
Example:
Can use photos taken through ODK to
validate data entered
GPS coordinates can assist to
create an ECD centre database
February 2013
February 2017
Benefit
Get standard routine data faster linked to
images, GIS and crucial indicators
With routine data, the DBE and provinces can
make better decisions and allocate resources
more effectively
Lessons Learned
While overall enthusiasm, success requires:
Mobile devices that meet requirements
Access to internet (data or Wi-Fi)
Build capacity of ECD officials to collect data
What now?
Getting officials and others
to play around with ODK
and provide feedback
Goal
Government receives
and manages ECD
M&E data
Government and
stakeholders use data
for decision making
This results in
improved ECD
implementation
Overall, there is
improved transparency
and accountability
Further reading
• http://www.betterevaluation.org/en/evaluation-options/mobile_data_collection
• https://opendatakit.org/
• Latif Jameel A. (2013). Mobile-Based Technology for Monitoring and Evaluation. Poverty
Action Lab, Institute for Financial Management and Research, Regional Centers for
Learning on Evaluation and Results, Fieldata, Innovations for Poverty Action. Available
from: https://www.theclearinitiative.org/resources/mobile-based-technology-for-
monitoring-and-evaluation
• Satterlee, E., McCullough, L., Dawson, M. and Cheung, K. (2015). Paper-to-mobile data
collection: a manual. Available from:
https://www.fhi360.org/sites/default/files/media/documents/Paper_to_Mobile_Data_Collec
tion_Manual_1.0.pdf
Want to try it out?
Visit us at our Data Café!
11:30 – 13:00pm Friday
27 October 2017
Tau Meeting Room, Hilton Sandton
Thank You!
Questions?Leticia Taimo
+27 11 447 6464
ltaimo@khulisa.com
26 Seventh Avenue,
Parktown North,
Johannesburg
www.khulisa.com

More Related Content

Similar to Going Digital: Using Mobile Data Collection to Monitor ECD in South Africa by Leticia Taimo

Digital Data Collection
Digital Data CollectionDigital Data Collection
Digital Data Collection
clearsateam
 
digital.pptx
digital.pptxdigital.pptx
digital.pptx
natnaelmamuye
 
Predictive analytics in uae government organizations
Predictive analytics in uae government organizationsPredictive analytics in uae government organizations
Predictive analytics in uae government organizations
Saeed Al Dhaheri
 
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
e-Democracy Conference
 
Presentation by OECD - Session 1 towards a new generation of indicators measu...
Presentation by OECD - Session 1 towards a new generation of indicators measu...Presentation by OECD - Session 1 towards a new generation of indicators measu...
Presentation by OECD - Session 1 towards a new generation of indicators measu...
OECD Governance
 
Presentation by the OECD - Session 1: Towards a new generation of indicators ...
Presentation by the OECD - Session 1: Towards a new generation of indicators ...Presentation by the OECD - Session 1: Towards a new generation of indicators ...
Presentation by the OECD - Session 1: Towards a new generation of indicators ...
Marie-Claude Gohier
 
Knowledge Matters Issue 15 - Technology at Concern
Knowledge Matters Issue 15 - Technology at ConcernKnowledge Matters Issue 15 - Technology at Concern
Knowledge Matters Issue 15 - Technology at ConcernEllen Ward
 
Social Cops Field Data Collection
Social Cops Field Data CollectionSocial Cops Field Data Collection
Social Cops Field Data Collection
Vikas Plakkot
 
Use of Technology for field data capture and compilation : Technical Session 17
Use of Technology for field data capture and compilation : Technical Session 17Use of Technology for field data capture and compilation : Technical Session 17
Use of Technology for field data capture and compilation : Technical Session 17
FAO
 
Big Data and Cloud Readiness
Big Data and Cloud ReadinessBig Data and Cloud Readiness
Big Data and Cloud Readiness
AIRCC Publishing Corporation
 
BIG DATA AND CLOUD READINESS
BIG DATA AND CLOUD READINESSBIG DATA AND CLOUD READINESS
BIG DATA AND CLOUD READINESS
ijcsit
 
Use of Technology for field data capture and compilation : Technical Session 16c
Use of Technology for field data capture and compilation : Technical Session 16cUse of Technology for field data capture and compilation : Technical Session 16c
Use of Technology for field data capture and compilation : Technical Session 16c
FAO
 
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conferenceNational Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
Peter Kua
 
Data Management Principles and Trusted Data Repositories/Lynn Woolfrey
Data Management Principles and Trusted Data Repositories/Lynn WoolfreyData Management Principles and Trusted Data Repositories/Lynn Woolfrey
Data Management Principles and Trusted Data Repositories/Lynn Woolfrey
Academy of Science of South Africa (ASSAf)
 
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...CityAge
 
How to Improve Your Data Collection Using Mobile Phones
How to Improve Your Data Collection Using Mobile PhonesHow to Improve Your Data Collection Using Mobile Phones
How to Improve Your Data Collection Using Mobile Phones
SocialCops
 
ThaiNSO Statistics Sharing Hub
ThaiNSO Statistics Sharing HubThaiNSO Statistics Sharing Hub
ThaiNSO Statistics Sharing Hub
TaweesapSrikwan
 
Data Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV ProgramsData Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV Programs
MEASURE Evaluation
 
Enabling Data-Driven Real-Time Governance
Enabling Data-Driven Real-Time GovernanceEnabling Data-Driven Real-Time Governance
Enabling Data-Driven Real-Time Governance
SocialCops
 
Introduction to-data-science
Introduction to-data-scienceIntroduction to-data-science
Introduction to-data-science
Ahmad karawash
 

Similar to Going Digital: Using Mobile Data Collection to Monitor ECD in South Africa by Leticia Taimo (20)

Digital Data Collection
Digital Data CollectionDigital Data Collection
Digital Data Collection
 
digital.pptx
digital.pptxdigital.pptx
digital.pptx
 
Predictive analytics in uae government organizations
Predictive analytics in uae government organizationsPredictive analytics in uae government organizations
Predictive analytics in uae government organizations
 
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
[2011] SPACE - A Computer Aided Environment for e Government and eBusiness ag...
 
Presentation by OECD - Session 1 towards a new generation of indicators measu...
Presentation by OECD - Session 1 towards a new generation of indicators measu...Presentation by OECD - Session 1 towards a new generation of indicators measu...
Presentation by OECD - Session 1 towards a new generation of indicators measu...
 
Presentation by the OECD - Session 1: Towards a new generation of indicators ...
Presentation by the OECD - Session 1: Towards a new generation of indicators ...Presentation by the OECD - Session 1: Towards a new generation of indicators ...
Presentation by the OECD - Session 1: Towards a new generation of indicators ...
 
Knowledge Matters Issue 15 - Technology at Concern
Knowledge Matters Issue 15 - Technology at ConcernKnowledge Matters Issue 15 - Technology at Concern
Knowledge Matters Issue 15 - Technology at Concern
 
Social Cops Field Data Collection
Social Cops Field Data CollectionSocial Cops Field Data Collection
Social Cops Field Data Collection
 
Use of Technology for field data capture and compilation : Technical Session 17
Use of Technology for field data capture and compilation : Technical Session 17Use of Technology for field data capture and compilation : Technical Session 17
Use of Technology for field data capture and compilation : Technical Session 17
 
Big Data and Cloud Readiness
Big Data and Cloud ReadinessBig Data and Cloud Readiness
Big Data and Cloud Readiness
 
BIG DATA AND CLOUD READINESS
BIG DATA AND CLOUD READINESSBIG DATA AND CLOUD READINESS
BIG DATA AND CLOUD READINESS
 
Use of Technology for field data capture and compilation : Technical Session 16c
Use of Technology for field data capture and compilation : Technical Session 16cUse of Technology for field data capture and compilation : Technical Session 16c
Use of Technology for field data capture and compilation : Technical Session 16c
 
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conferenceNational Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
National Big Data Analytics (BDA) Initiative - //bina/ 2014 conference
 
Data Management Principles and Trusted Data Repositories/Lynn Woolfrey
Data Management Principles and Trusted Data Repositories/Lynn WoolfreyData Management Principles and Trusted Data Repositories/Lynn Woolfrey
Data Management Principles and Trusted Data Repositories/Lynn Woolfrey
 
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...
The Data Effect: Canadian Big Data & Analytics Update - Dr. Alison Brooks Dir...
 
How to Improve Your Data Collection Using Mobile Phones
How to Improve Your Data Collection Using Mobile PhonesHow to Improve Your Data Collection Using Mobile Phones
How to Improve Your Data Collection Using Mobile Phones
 
ThaiNSO Statistics Sharing Hub
ThaiNSO Statistics Sharing HubThaiNSO Statistics Sharing Hub
ThaiNSO Statistics Sharing Hub
 
Data Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV ProgramsData Visualization for Decision Making in HIV Programs
Data Visualization for Decision Making in HIV Programs
 
Enabling Data-Driven Real-Time Governance
Enabling Data-Driven Real-Time GovernanceEnabling Data-Driven Real-Time Governance
Enabling Data-Driven Real-Time Governance
 
Introduction to-data-science
Introduction to-data-scienceIntroduction to-data-science
Introduction to-data-science
 

More from Khulisa Management Services

Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
Khulisa Management Services
 
Using Intercept Interviews to Survey Vulnerable Populations
Using Intercept Interviews to Survey Vulnerable PopulationsUsing Intercept Interviews to Survey Vulnerable Populations
Using Intercept Interviews to Survey Vulnerable Populations
Khulisa Management Services
 
2022 gLOCAL Khulisa QASP Presentation
2022 gLOCAL Khulisa QASP Presentation2022 gLOCAL Khulisa QASP Presentation
2022 gLOCAL Khulisa QASP Presentation
Khulisa Management Services
 
gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
 gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
Khulisa Management Services
 
Visual Methodologies in Evaluations
Visual Methodologies in Evaluations Visual Methodologies in Evaluations
Visual Methodologies in Evaluations
Khulisa Management Services
 
What will be the most interesting changes after COVID-19?
What will be the most interesting changes after COVID-19? What will be the most interesting changes after COVID-19?
What will be the most interesting changes after COVID-19?
Khulisa Management Services
 
Engendering evaluation
Engendering evaluationEngendering evaluation
Engendering evaluation
Khulisa Management Services
 
Mapping Professional /Skills pathways for Young and Emerging Evaluators
Mapping Professional /Skills pathways for Young and Emerging EvaluatorsMapping Professional /Skills pathways for Young and Emerging Evaluators
Mapping Professional /Skills pathways for Young and Emerging Evaluators
Khulisa Management Services
 
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan LadoYoung and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
Khulisa Management Services
 
Beneficiaries voices in evaluation - Kris Eale
Beneficiaries voices in evaluation - Kris EaleBeneficiaries voices in evaluation - Kris Eale
Beneficiaries voices in evaluation - Kris Eale
Khulisa Management Services
 
The ins and outs of validating a school functionality tool for evaluations - ...
The ins and outs of validating a school functionality tool for evaluations - ...The ins and outs of validating a school functionality tool for evaluations - ...
The ins and outs of validating a school functionality tool for evaluations - ...
Khulisa Management Services
 
Khulisa Management Services: 25 years of accurately measuring progress
Khulisa Management Services: 25 years of accurately measuring progressKhulisa Management Services: 25 years of accurately measuring progress
Khulisa Management Services: 25 years of accurately measuring progress
Khulisa Management Services
 
Khulisa 25 birthday brunch
Khulisa 25 birthday brunchKhulisa 25 birthday brunch
Khulisa 25 birthday brunch
Khulisa Management Services
 
Khulisa management services report 2015 17
Khulisa management services report 2015 17Khulisa management services report 2015 17
Khulisa management services report 2015 17
Khulisa Management Services
 
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Khulisa Management Services
 
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
Khulisa Management Services
 
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Khulisa Management Services
 
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer BisgardSAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
Khulisa Management Services
 
M&E Challenges in Measuring Results for YouthPower & Positive Youth Development
M&E Challenges in Measuring Results for YouthPower & Positive Youth DevelopmentM&E Challenges in Measuring Results for YouthPower & Positive Youth Development
M&E Challenges in Measuring Results for YouthPower & Positive Youth Development
Khulisa Management Services
 
Data Visualization: How to make data attractive
Data Visualization: How to make data attractiveData Visualization: How to make data attractive
Data Visualization: How to make data attractive
Khulisa Management Services
 

More from Khulisa Management Services (20)

Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
Data-led Learning for Adaptive Evaluation Processes: Lessons From an Early Gr...
 
Using Intercept Interviews to Survey Vulnerable Populations
Using Intercept Interviews to Survey Vulnerable PopulationsUsing Intercept Interviews to Survey Vulnerable Populations
Using Intercept Interviews to Survey Vulnerable Populations
 
2022 gLOCAL Khulisa QASP Presentation
2022 gLOCAL Khulisa QASP Presentation2022 gLOCAL Khulisa QASP Presentation
2022 gLOCAL Khulisa QASP Presentation
 
gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
 gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
gLOCAL 2021 WhatsApp Analysis webinar presentation KhulisaMS
 
Visual Methodologies in Evaluations
Visual Methodologies in Evaluations Visual Methodologies in Evaluations
Visual Methodologies in Evaluations
 
What will be the most interesting changes after COVID-19?
What will be the most interesting changes after COVID-19? What will be the most interesting changes after COVID-19?
What will be the most interesting changes after COVID-19?
 
Engendering evaluation
Engendering evaluationEngendering evaluation
Engendering evaluation
 
Mapping Professional /Skills pathways for Young and Emerging Evaluators
Mapping Professional /Skills pathways for Young and Emerging EvaluatorsMapping Professional /Skills pathways for Young and Emerging Evaluators
Mapping Professional /Skills pathways for Young and Emerging Evaluators
 
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan LadoYoung and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
Young and Emerging Evaluators - Mayibongwe Manyoba & Susan Lado
 
Beneficiaries voices in evaluation - Kris Eale
Beneficiaries voices in evaluation - Kris EaleBeneficiaries voices in evaluation - Kris Eale
Beneficiaries voices in evaluation - Kris Eale
 
The ins and outs of validating a school functionality tool for evaluations - ...
The ins and outs of validating a school functionality tool for evaluations - ...The ins and outs of validating a school functionality tool for evaluations - ...
The ins and outs of validating a school functionality tool for evaluations - ...
 
Khulisa Management Services: 25 years of accurately measuring progress
Khulisa Management Services: 25 years of accurately measuring progressKhulisa Management Services: 25 years of accurately measuring progress
Khulisa Management Services: 25 years of accurately measuring progress
 
Khulisa 25 birthday brunch
Khulisa 25 birthday brunchKhulisa 25 birthday brunch
Khulisa 25 birthday brunch
 
Khulisa management services report 2015 17
Khulisa management services report 2015 17Khulisa management services report 2015 17
Khulisa management services report 2015 17
 
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
 
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
Measuring Positive Youth Development (PYD) Training Workshop - Dr Bardini and...
 
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
 
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer BisgardSAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
SAMEA EvalCafe 2017 | 8th International AfrEA Conference by Jennifer Bisgard
 
M&E Challenges in Measuring Results for YouthPower & Positive Youth Development
M&E Challenges in Measuring Results for YouthPower & Positive Youth DevelopmentM&E Challenges in Measuring Results for YouthPower & Positive Youth Development
M&E Challenges in Measuring Results for YouthPower & Positive Youth Development
 
Data Visualization: How to make data attractive
Data Visualization: How to make data attractiveData Visualization: How to make data attractive
Data Visualization: How to make data attractive
 

Recently uploaded

Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023
ARCResearch
 
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOMonitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Christina Parmionova
 
Donate to charity during this holiday season
Donate to charity during this holiday seasonDonate to charity during this holiday season
Donate to charity during this holiday season
SERUDS INDIA
 
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptxPD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
RIDPRO11
 
Transit-Oriented Development Study Working Group Meeting
Transit-Oriented Development Study Working Group MeetingTransit-Oriented Development Study Working Group Meeting
Transit-Oriented Development Study Working Group Meeting
Cuyahoga County Planning Commission
 
ZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdfZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdf
Saeed Al Dhaheri
 
2024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 382024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 38
JSchaus & Associates
 
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdfPNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
ClaudioTebaldi2
 
2024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 372024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 37
JSchaus & Associates
 
NHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdfNHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdf
AjayVejendla3
 
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
850fcj96
 
Government Service OPSI Playbook FINAL.pdf
Government Service OPSI Playbook FINAL.pdfGovernment Service OPSI Playbook FINAL.pdf
Government Service OPSI Playbook FINAL.pdf
MoffatNyamadzawo2
 
kupon sample qurban masjid indonesia terbaru.pptx
kupon sample qurban masjid indonesia terbaru.pptxkupon sample qurban masjid indonesia terbaru.pptx
kupon sample qurban masjid indonesia terbaru.pptx
viderakai
 
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
850fcj96
 
Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200
GrantManagementInsti
 
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
johnmarimigallon
 
Understanding the Challenges of Street Children
Understanding the Challenges of Street ChildrenUnderstanding the Challenges of Street Children
Understanding the Challenges of Street Children
SERUDS INDIA
 
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Congressional Budget Office
 
Get Government Grants and Assistance Program
Get Government Grants and Assistance ProgramGet Government Grants and Assistance Program
Get Government Grants and Assistance Program
Get Government Grants
 
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
Congressional Budget Office
 

Recently uploaded (20)

Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023
 
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOMonitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
 
Donate to charity during this holiday season
Donate to charity during this holiday seasonDonate to charity during this holiday season
Donate to charity during this holiday season
 
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptxPD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
PD-1602-as-amended-by-RA-9287-Anti-Illegal-Gambling-Law.pptx
 
Transit-Oriented Development Study Working Group Meeting
Transit-Oriented Development Study Working Group MeetingTransit-Oriented Development Study Working Group Meeting
Transit-Oriented Development Study Working Group Meeting
 
ZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdfZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdf
 
2024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 382024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 38
 
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdfPNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
 
2024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 372024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 37
 
NHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdfNHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdf
 
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
 
Government Service OPSI Playbook FINAL.pdf
Government Service OPSI Playbook FINAL.pdfGovernment Service OPSI Playbook FINAL.pdf
Government Service OPSI Playbook FINAL.pdf
 
kupon sample qurban masjid indonesia terbaru.pptx
kupon sample qurban masjid indonesia terbaru.pptxkupon sample qurban masjid indonesia terbaru.pptx
kupon sample qurban masjid indonesia terbaru.pptx
 
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
 
Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200
 
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
 
Understanding the Challenges of Street Children
Understanding the Challenges of Street ChildrenUnderstanding the Challenges of Street Children
Understanding the Challenges of Street Children
 
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
 
Get Government Grants and Assistance Program
Get Government Grants and Assistance ProgramGet Government Grants and Assistance Program
Get Government Grants and Assistance Program
 
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
 

Going Digital: Using Mobile Data Collection to Monitor ECD in South Africa by Leticia Taimo

  • 1. Going Digital: Using technology to monitor ECD in South Africa 26 October 2017 SAMEA Conference 2017
  • 2. 01 02 03 04 Further reading How it works What we’ve learned 05 Background Why use mobile data collection?
  • 3. In 2012, 5.9 billion active mobile connections globally (Naef et al, 2014) Forecast for 2017, 7.6 billion mobile connections globally
  • 5. Data Collection Evolution 1086 Great survey in England 1937 Unemployment survey US census Late 1980s PDAs & “pocket computers” Mid 1990s Teleform 2007 Rise of smartphones Future??
  • 6. Use mobile data collection as alternative to paper surveys
  • 7. What is mobile data collection? Targeted gathering of structured information using mobile phones, tablets or other devices using a software application
  • 8. Where we’ve used mobile data collection
  • 9. Government of South Africa National Development Plan 2030 “The goal is to have universal access to quality early childhood development with a strong nutrition and educational focus.” The NDP also emphasizes the need to invest in training early childhood development practitioners.
  • 10. Other national policy documents  Children’s Act No. 38 of 2005  National Plan of Action for Children in South Africa: 2012–2017  South African National Curriculum Framework for Children from Birth to Four  Curriculum Assessment Policy for Grades R–12 (CAPS): Grade R-3  National Integrated Early Childhood Development Policy  Policy on Minimum Requirements for Programmes Leading to Qualifications in Higher Education for Practitioners and Educators in Early Childhood Care and Education
  • 11.  No data on number of registered/funded ECD centres and programmes  No data on how many children access ECD services  No data on quality of ECD services Current Challenges No administrative data system for ECD similar to those used by health and education
  • 12. Why national ECD Monitoring System? When we have scarce resources, we need data to ensure coverage AND appropriate resource targeting
  • 13. Clear need to invest in ECD and M&E System
  • 14. Khulisa is assisting the South African Department of Basic Education and UNICEF to develop a national ECD M&E System
  • 15. Rationale  Standardise ECD indicators across provinces  Target implementation for DBE and DSD  Make district and provincial reporting easier  Integrate M&E data into existing frameworks and policies
  • 17. Provides high quality data reliability accuracy timeliness validity integrity security/ confidentiality
  • 18. How can mobile data collection help?
  • 19. Using mobile devices makes managing data collection easier
  • 20. Data is submitted in real time to a central online database Managers can see:  Pace of data collection  Coverage  What data is being submitted  Location Allows for real time data quality assurance
  • 22. Leads to cleaner data as responses can have pre-determined limits (e.g. only enter a number) and automated skip patterns (e.g. only ask the next question if response was yes)
  • 23. Ability to collect and integrate new types of data
  • 24.  Access data faster with less effort  Reduce cost (minimal printing; no data entry costs)  No need for double entry of forms  Data aggregated automatically Save time and money
  • 25. A 2011 World Bank study found that mobile data collection reduced the average interview cost by approximately 70% Schuster & Brito, in Satterlee et. al 2015
  • 26.  Make data more user friendly  Create demand for data Data visualisation
  • 30. Our approach Use Open Data Kit (ODK) on Android tablets/smart phones to collect information Spend one hour in each school or ECD centre
  • 31. Open Data Kit ODK is a free and open-source set of tools which help researchers author, field, and manage mobile data collection It allows data collection using mobile devices and data submission to an online server, even without an Internet connection or mobile carrier service at the time of data collection
  • 32. Process Data collectors pull forms from cloud repository called ODK Aggregate Use ODK Build to convert paper questionnaires to e-forms or e-surveys Install ODK Collect on phones or tablets for data collectors
  • 33. Consider No need for internet connection during data collection, but will need internet to upload form Mobile data collection works well for quantitative data, but not as well for qualitative data ODK only works on Android devices, so need to consider if method is fit for your purposes
  • 35. 20 ECD 20 Schools 20 ECD 20 Schools 10 ECD 21 Schools 20 ECD 21 Schools 15 ECD 18 Schools 20 ECD 20 Schools 20 ECD 16 Schools 20 ECD 19 Schools 20 ECD 20 Schools Tool Pilot 340 sites
  • 37. Overwhelming excitement around potential of using mobile data collection
  • 38. Example: Can use photos taken through ODK to validate data entered GPS coordinates can assist to create an ECD centre database
  • 40. Benefit Get standard routine data faster linked to images, GIS and crucial indicators With routine data, the DBE and provinces can make better decisions and allocate resources more effectively
  • 41. Lessons Learned While overall enthusiasm, success requires: Mobile devices that meet requirements Access to internet (data or Wi-Fi) Build capacity of ECD officials to collect data
  • 42. What now? Getting officials and others to play around with ODK and provide feedback
  • 43. Goal Government receives and manages ECD M&E data Government and stakeholders use data for decision making This results in improved ECD implementation Overall, there is improved transparency and accountability
  • 44. Further reading • http://www.betterevaluation.org/en/evaluation-options/mobile_data_collection • https://opendatakit.org/ • Latif Jameel A. (2013). Mobile-Based Technology for Monitoring and Evaluation. Poverty Action Lab, Institute for Financial Management and Research, Regional Centers for Learning on Evaluation and Results, Fieldata, Innovations for Poverty Action. Available from: https://www.theclearinitiative.org/resources/mobile-based-technology-for- monitoring-and-evaluation • Satterlee, E., McCullough, L., Dawson, M. and Cheung, K. (2015). Paper-to-mobile data collection: a manual. Available from: https://www.fhi360.org/sites/default/files/media/documents/Paper_to_Mobile_Data_Collec tion_Manual_1.0.pdf
  • 45. Want to try it out? Visit us at our Data Café! 11:30 – 13:00pm Friday 27 October 2017 Tau Meeting Room, Hilton Sandton
  • 46. Thank You! Questions?Leticia Taimo +27 11 447 6464 ltaimo@khulisa.com 26 Seventh Avenue, Parktown North, Johannesburg www.khulisa.com

Editor's Notes

  1. Mobile phones are more accessible than ever before!
  2. 1086 – great survey in England 1937 – unemployment survey US census bureau Late 1980s – PDAs and “pocket computers” Mid 1990s – using teleform to collect data 2007 – to date – rise of smartphones as we know today and apps for data collection Future??
  3. Mobile data collection activities have existed in various forms for thousands of years (the Egyptians were famously data-centric in managing their empire).  “great survey” ordered in 1086 in England by King William the Conqueror, which sent data collectors all over the country to find out how many people and livestock there were (among other “indicators) – and which resulted in the “Domesday Book” of data. 1937 unemployment survey US census bureau (during great depression: In the early 20th century people like Jerzy Neyman helped to develop the statistics, and selection and sampling methods that formed part of the much-improved survey methods of the 20th century – and this brought about a “big paper” revolution in the amount and quality of data collected  Note: Pen and paper considered “mobile”, we’re really talking about mobile electronic data collection using mobile phones, SMS, and other technologies that were only invented, or made widely available, in the last two decades or so. 3. TeleForm is a highly intelligent data capture system designed to reduce data entry and manual processes associated with paper based forms projects. The software offers unrivalled flexibility in capturing handwritten data from paper and seamlessly incorporate the data output into secure, automated business applications. Through the scan and verification interface, forms and associated documents are classified, recognized, verified and transferred into reliable, accurate, searchable and highly structured electronic data critical to business processes.
  4. We’ve used mobile data collection in South Africa, Malawi, Kenya, Uganda, Tanzania, Ethiopia and India
  5. Data reliability (will we get the same data, when collected again?) Data validity (Are we measuring what we say we are measuring?) Data integrity (Is the data free of manipulation?) Data accuracy/precision (Is the data measuring the “indicator” accurately?) Data timeliness (Are you getting the data in time?) Data security/confidentiality (Loss of data / loss of privacy)
  6. For example, when we were collecting data in Uganda, our colleague who was managing the data from our office here in Johannesburg was able to pick up that a fieldworker was collecting data way faster than others. As a result, he was able to tell he had just been sitting under a tree and fabricating data. This led us to take prompt action and terminate his contract and replace him with another fieldworker.
  7. This also leads to eliminating errors in data capturing and data entering (as we remove the human element - no data entry reduces error)
  8. GIS, audio, photos, time it took to collect data, date and time of data collection, etc
  9. Leads back to the “timeliness of data”. For instance, with the DHIS 1 system used by the department of health, there is a delay from the time data is collected to the time it is actually seen and acted upon. Mobile data collection can accelerate this process! Ultimately, we want the relevant stakeholders to make decisions based on the data collected, and they can’t do that if the data isn’t available when it is needed (e.g. when it’s time for budget decisions, etc)
  10. 1. Through removing paper surveys, can make data collection process less tedious. At the end of the day, data collection needs to be easy! 2. Through visualising data through dashboards, can ensure that the data is actually used by those who can act upon it and ultimately create a demand for data.
  11. Before considering using mobile data collection, need to see if it fits your data collection needs.
  12. Officials saw how variety of data could assist in their decision-making and resource allocation
  13. ECD officials saw the benefit