Final outline plan for webinar evaluation and impact assessment mof 2004
ReillyT CV
1. TIMOTHY B. REILLY
6021 Berkshire Drive, Bethesda MD 20814
Cell: 415-515-6041; Email: timbreilly@gmail.com
EDUCATION
University of London, School of Oriental and African Studies M.A., 2008
London, UK
Major: African Studies
Columbia University School of Law J.D., 2001
New York, NY
Miami University of Ohio B.A., 1998
Oxford, OH
Major: B.A., Political Science Minor: East Asian Studies
EMPLOYMENT
Management Systems International, London, UK and Washington, DC 2008 – Present
Senior Manager/Evaluation Specialist
Senior Manager in the Governance and then Monitoring and Evaluation practices of Coffey UK and
its sister company Management Systems International in the United States.
Manage assessments and large-scale evaluations of USAID and UK DFID education, governance
and environmental conservation initiatives worldwide, including Ethiopia, Kenya, Peru, Tanzania
and Zambia.
Provide technical evaluation advice to donor and NGO clients on the development of theories of
change, logical frameworks, indicators selection and designs for impact and performance
evaluations.
Held several, often overlapping, management positions including Sr. Manager in the Evaluation
Practice, Interim Practice Manager for the Governance Practice, Organizational Conflict of Interest
Coordinator and Corporate Risk Manager.
Donald P. McCullum Youth Court Program, Oakland, CA 2005-06
Program Manager/ Civics Teacher
Directed and administered alternative criminal sentencing program for largest Bay Area youth
criminal offender diversion program (in conjunction with the Alameda District Attorney’s Office).
Responsible for training youth participants and volunteers in restorative justice, managing the
criminal diversion proceedings, and relationship building and outreach to Alameda County
community-based organizations, schools, youth groups, students and parents.
Dewey Ballantine LLP, New York, NY 2001-04
Litigation Associate
Litigation associate at large US law firm working in a variety of fields, including bankruptcy,
securities fraud lawsuits and investigations, international trade appeals and criminal defense.
Responsibilities included drafting court motions, briefs and discovery requests, interviewing and
preparing witnesses for trial and depositions, preparing and conducting an internal investigation on
the behalf of a the audit committee of a large multi-national corporation.
Pro bono work included representing a criminal defendant on appeal through the Office of the
Appellate Defender, and representing a prisoner in sexual harassment litigation against a prison
contract agency.
PROFESSIONAL CERTIFICATIONS & MEMBERSHIPS
Member, American Evaluation Association
Admitted to the New York State Bar (February 2002).
Mediation Certification Training for community mediators serving the New York State Unified
Court System and community dispute resolution centers, Crown Heights Community Mediation
Center (June 2003).
2. PROJECT EXPERIENCE
Multi-Country: Ex-post Evaluation of Sustained Outcomes in Basic Education
Evaluation Manager/Specialist: Managed and developed the evaluation strategy and design for USAID $2m
evaluation of factors that contribute to the sustainability of USAID development interventions. The
evaluation strategy employed an ex-post case study design with typical case sampling and relied upon
systems thinking research and analytical approaches such as outcome harvesting and causal loop diagrams.
Tasks have included developing the design for the evaluation, managing an evaluability assessment of
USAID activities for inclusion in the study and conducting primary research with key stakeholders (USAID
2014-2016)
Kazakhstan: Evaluation of the UNDP Improving Climate Resilience of the Wheat Sector
Evaluation Manager/Specialist: Managed and provided technical inputs to evaluate the relevance,
effectiveness, sustainability and impact of this USAID-funded UNDP program design to improve
Kazakhstan agro-meteorological practices and promote the adoption of climate resilient farming practices.
Tasks included developing the design and research instruments for the evaluation, conducting primary
research with key stakeholders, developing a framework for analyzing the sustainability of capacity-building
interventions and analyzing the evaluation data and contributing to the final evaluation report (USAID 2014-
2015)
United States: Literature Review of Sustainability Factors in Basic Education
Researcher: Undertook a literature review is to identify existing research, literature and evidence or evidence
gaps on the programmatic and contextual factors that contribute to the sustainability of outcomes in basic
education programming. This purpose of the literature review was to better understand what USAID and its
implementing partners could do to promote sustainable outcomes in development programs (USAID 2014-
2015).
Multi-country: Mid-Term Evaluation of the Initiative for Conservation in the Andean Amazon
Evaluation Manager/Specialist: Managed and provided technical inputs into a mid-term evaluation of a
USAID multi-country program to support conservation efforts in the countries of Colombia, Ecuador and
Peru. Tasks included developing the design and research instruments for the evaluation, conducting primary
research with key stakeholders, analyzing cross-country data to develop holistic evaluation findings and
contributing to the final report. (USAID 2014-2015).
Multi-Country: Monitoring, Evaluation and Learning Support Program
Evaluation Specialist: Provided advice to NGO short-listed applicants for Comic Relief funding on the
development of their monitoring and evaluation frameworks. The NGO projects covered multiple sectors
including community mobilization and research, governance and education. The advice was provided on a
one-to-one basis and covered all aspects of project M&E and lesson learning, although the focus was on
monitoring indicators and evaluation design (Comic Relief, 2013- 2014).
Multi-country: Evaluation of the Girls Education Challenge Fund
Project Manager/ Evaluation Specialist: Managed and provided technical inputs to the $14m evaluation of
the DFID Girls’ Education Challenge Fund (GEC). The GEC seeks to improve educational outcomes for
over one million marginalized girls in 20 countries worldwide. The evaluation, now in its second year, will
assess the effectiveness and impact of individual projects and of the GEC as a whole. The evaluation
employs a quasi-experimental design and various research methods including the Early Grade Reading and
Math Assessment, quantitative household surveys, in-depth interviews, longitudinal studies with cohort
tracking and ethnographic research. In addition to managing the project since inception, I have contributed
to the evaluation strategy and design, advised Fund grantees on M&E approaches, quality assured project
M&E frameworks and undertaken analysis of the baseline qualitative data (DFID, 2012 - 2014).
Ghana: Process and Impact Evaluation of DFID’s Ghana Electoral Support Program
Project Manager/ Evaluation Specialist: Managed and contributed to the evaluation design of DFID’s two-
year Ghana Election Support Program (GESP). GESP was delivered through multiple Ghanaian and
international partners including an advocacy network of NGOs, the Ghana Electoral Commission and the
Ghanaian security services. Based on the timing of the evaluation, the team relied on a theory-based
evaluation to assess the strategic rationale behind the program design, the implementation of the program
and its contribution to the election process. The research methodologies included conducting key informant
interviews, election observation, media analysis and surveys of select groups of GESP beneficiaries. In
addition to managing the evaluation from inception, drafted the evaluation strategy and undertook the value
for money/ efficiency assessment of GESP (DFID, 2012-2013).
3. United Kingdom: Study on Integrated Planning and M&E in Stabilization Contexts
Evaluation Specialist: Undertook a study on practical approaches to more fully integrating monitoring and
evaluation into stabilization planning and program design in conflict-affected contexts. The research
examined existing literature and relied on interviews conducted with DFID, FCO and Stabilisation Unit
advisors. The final report made recommendations to ensure good practice in M&E is integrated into the
planning process under alternative planning scenarios ranging from an ‘ideal’ scenario where there is scope
to consider M&E at the outset of the process and the more typical scenario where M&E is only considered at
the end of stabilization planning (UK Stabilisation Unit, 2012).
Somalia: Developing a Joint Monitoring and Evaluation Framework for Governance and Peace
Building Programs in Somalia
Evaluation Specialist: Developed a monitoring framework for use by donors supporting Somalia’s
governance and peace building programs, including proposals for tools and methodologies to track the
implementation, performance and achievements of the activities delivered. The development of the
monitoring framework required: interviewing stakeholders across donors and NGOs to map existing
monitoring frameworks that were relevant to governance and peace building programs; developing a costed
proposal for a joint donor Somalia M&E framework; and facilitating a workshop consultation on the
proposals with the aim of achieving agreement by key donors to take the monitoring framework forward
(DFID, 2011).
Afghanistan: Helmand Monitoring and Evaluation Program
Project Manager: Managed this program to develop a monitoring and evaluation framework to evaluate the
efficacy of donor programming in Helmand to achieve the goals set out in the Helmand Road Map and
stabilization generally. The program was designed to assist stabilization and development programs in
Helmand to make more effective use of monitoring and evaluation tools. As Program Manager at inception
and thereafter on a cover basis, was responsible for delivering baselines for PRT programs, developing an
Oracle and GIS database to collate data for the measurement of indicators over time and overseeing data
collection and verification (DFID, 2009, 2011).
Tanzania: Diagnostic Study of Corruption in the Police and Judiciary
Project Manager: Responsible for designing the approach and methodology and oversight of quality of
project deliverables for study of corruption in Tanzania focusing on three institutions: the Tanzania Police
Force, the judiciary, and the Prevention and Combating of Corruption Bureau. The study analysed the
underlying causes and drivers of corruption in these sectors, the effects of corruption in terms of revenue and
socio-economic benefits lost to society as a result (DFID, 2011).
Afghanistan: Justice Sector Mapping in Helmand Province
Project Manager: Responsible for the delivery of a programme to analyse the informal and formal justice
sectors in Helmand Province. The project sought to map the informal justice sector in Helmand and different
types of non-formal justice provision and include an assessment of the strengths and weaknesses of the
identified informal dispute resolution systems. The mapping included an assessment of relations and
interactions with the formal justice sector including referrals between the systems, provisions for oversight
and accountability of the systems and available of choice for users of the justice systems. The project also
reviewed the current programmes of support and made recommendations for future support to the formal
and informal justice systems (DFID, 2010).
Uganda: Post-Conflict Recovery to Northern Uganda
Project Manager: Responsible for managing the design of a £100 million project improve the capacity of the
Government of Uganda to deliver basic services and long-term development to the norther regions. The
program focused equally on tackling vulnerability through social protection, rebuilding livelihoods and
mitigating the root causes of conflict in northern Uganda. Responsibilities included managing the design
team, quality assuring project deliverables and developing the logframe and monitoring indicators and
mechanisms for the project (DFID, 2009).