This poster will be presented at the American Evaluation Association Conference by Karuna Chibber on October 31. Getting To Zero (GTZ) Santa Clara County and Silicon Valley is a Collective Impact collaborative with partners from the County of Santa Clara public health department, health care systems, providers, community-based organizations, academia, education, and advocacy. JSI was engaged to lead the action research and evaluation of the GTZ collaborative from 2017- 2020. Evaluation objectives include: (1) To design and support process and outcomes evaluation to track progress and assess impact (2) To compile data, analyze and disseminate findings real-time for ongoing strategy refinement

1. Using Developmental Evaluation To Evaluate An HIV/AIDS Collective Impact Collaborative
Authors: Karuna S. Chibber1 DrPH, Sarah C. Lewis2, MD MPH, and Mia L. Bladin1, BA
1 John Snow Inc. (JSI), 2County of Santa Clara Public Health Department
THE PROJECT
EVALUATION RESULTS
LESSONS LEARNED FROM USING DEVELOPMENTAL EVALUATION3
THE EVALUATION CHALLENGE
Multi-sector collaboratives can be critical in addressing complex and deeply entrenched health
issues.1 Health conditions such as HIV/AIDS rarely occur in isolation.2 Pathways exist to and from a
whole spectrum of individual, social, and structural issues putting some individuals at
disproportionately higher risk of HIV exposure and making them less likely to receive timely and
quality care. Multiple sectors—government, health departments, providers, philanthropy, business,
education, community agencies and citizens— all need to come together to tackle HIV/AIDS from
multiple angles and create lasting change.
Getting To Zero (GTZ) Santa Clara County and Silicon Valley is a Collective Impact collaborative
with partners from the County of Santa Clara public health department, health care systems,
providers, community-based organizations, academia, education, and advocacy.
Surveillance and
Pharmaceutical
Data
Tracking Data: Activities,
Reach and Engagement
Surveys and
Interviews with
Partners and
Community
Simple, online data collection tools were
developed and mapped to partner
measures and data sources.
Office hours and technical assistance
were offered to support data collection,
maintain quality and provide data analysis
support.
Real-time findings shared through visuals
and dashboards, giving partners what they
need to communicate ongoing impact.
1. FRAME–REFRAME THE EVALUATION
PURPOSE
Repeated efforts were needed at time of launch and continue
throughout implementation to frame the value and purpose of
the evaluation.
The purpose of the GTZ evaluation is:
 Continuous learning and evidence collection not
establishing proof of impact
 Identifying strategies that are most effective
 Demonstrating value
 Supporting development of new strategies
 Identifying what needs to be sustained in order to
create lasting change
4. USE MIXED METHODS TO INFUSE
RIGOR AND SUPPORT STORYTELLING
A wide range of methods and triangulation across methods
data sources are employed to demonstrate ongoing progress
and impact, and address diverse audiences needs.
2. BE PART OF THE TEAM: EMBED EVALUATIVE THINKING
INTO DESIGN
JSI’s evaluation team is an active participant of the GTZ collaborative. Monthly
meetings, work group calls, and strategic planning events routinely include sharing of
data and emerging findings, allowing partners to reflect on:
 What strategies are working, how, why and for whom
 Shifting conditions and contexts including trust and relationships
 Unanticipated outcomes
 Strategies to drop, refine, and scale
 New developments
5. COLLECTIVELY DEFINE ROBUST AND
RIGHT-SIZED MEASURES
Annual evaluation planning workshops are held for partners to
collectively develop and refine process and short-to-medium
term outcome measures. Measures development prioritizes:
 Alignment with activities
 Objectivity
 Audience needs
 Alignment with Collective Impact stage of
development
 SMART measures
 Progress tracking
 Intermediate impact
Early Years
1-2
Middle Years
3-5
Late Years
5+
CI Design and
Implementation
Collective Impact Capacity
Evidence Building and
Learning Culture
Reach/Engagement
Intermediate
Outcomes
Behavioral Changes
Systems Changes
Organizational Policy
Impact
Zero New HIV
Infections
Zero HIV-Related
Deaths
Zero HIV Stigma
and Discrimination
No proven theory of change or set of strategies to test
New questions, challenges and opportunities emerge  Shifting strategies and outcomes
Data collection and evaluation capacity vary across partners
Differing perceptions of measures, outcomes, and realistic and important measures
Hard to establish causality and isolate impact with many sectors and strategies at play
Outcomes accrue differentially across partners
GETTING
TO ZERO
3. USE SIMPLE AND REAL-TIME DATA COLLECTION AND
SHARING STRATEGIES
REFERENCES
1 Kottke TE, Stiefel M, Pronk NP. “Well-Being in All Policies”: Promoting Cross-sectoral Collaboration to Improve People’s Lives. National Academy of Medicine, April 14, 2016. Available from: http://nam.edu/well-being-in-all-
policiespromoting-cross-sectoral-collaboration-to-improve-peoples-lives/.
2 Zahner S, Oliver T, Siemering K. The Mobilizing Action Toward Community Health Partnership Study: Multisector Partnerships in US Counties with Improving Health Metrics. Prev Chronic Dis. 2014 Jan 09;10:E05.
3 Patton, MQ. Developmental Evaluation. Applying Complexity Concepts to Enhance Innovation Use. 2011. The Guilford Press.
JSI was engaged to lead the action research and evaluation of the GTZ collaborative from 2017-
2020. Evaluation objectives include:
(1) To design and support process and outcomes evaluation to track progress and assess impact
(2) To compile data, analyze and disseminate findings real-time for ongoing strategy refinement
Lack of alignment between timeframe for decision making versus outcomes accrual
GTZ reached the community and target population through numerous events, trainings, and
awareness-raising initiatives. More than 10,000 community members were reached by GTZ
events or activities, not including those reached by media campaigns.
PrEP/PEP navigation system
Provider trainings and protocols established. Access to PrEP/PEP doubled in two years.