SlideShare a Scribd company logo
1 of 61
Case Study: Plummer Youth Promise
How to Measure Outcomes in Apricot Software
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
On the webinar today…
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise2
Jeffrey Haguewood
Apricot Software Consultant
Sidekick Solutions
jeff@sidekicksolutionsllc.com
Sarah Morrill
Director of Outcomes and Evaluations
Plummer Youth Promise
smorrill@plummeryouthpromise.org
How to design a program and
outcomes model, and then set up a
data system that enables the model?
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise3
Agenda
• Part 1: Designing the program and outcomes model
• Part 2: Assessing gaps in the initial data system’s design
• Part 3: System redesign for integration with the model
4
Today’s presentation will be a mix of strategy and technical.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise5
Founded in 1854
Key questions
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise6
• How well did we do? OUTCOMES
• How satisfied are clients after working with us? SATISFACTION
• How much did we do? OUTPUTS
• What difference do we make? IMPACT
• How true to the model are our practices? FIDELITY
• How do we compare? COMPARISON
Permanency
7 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
An enduring family relationship that:
• Is safe and lifelong;
• Offers legal rights and social status of full family membership
• Provides for physical, emotional, social, cognitive, and spiritual well
being; and
• Assures life long connections to birth and extended family, siblings
and other significant adults, family history and traditions, race and
ethnic heritage, culture, religion, and language.
Call to Action: An Integrated Approach to Youth Permanency and Preparation for Adulthood. Casey Family Services in collaboration with
California Permanency for Youth Project, Casey Family Programs, and The Jim Casey Youth Opportunities Initiative
The intervention and outcome model
comes first, preceding the data
system for tracking the model.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise8
How we got started
9 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
• We started with our experience, anecdotes and stories
• We knew families were key to permanency
…but we had little data to support our beliefs
Our approach
1. External research
2. Internal discovery
10 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
…data system would come later
Data gathering questions
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise11
• What problem are we trying to
address?
• What does best practice research tell
us?
• How do we stack up?
• What makes our clients the same or
different?
• What makes our services different?
• What do we believe about our
program participants?
• What does success look like for
program participants?
• Which activities/practices/interventions
drive success?
• How do we know success when we
see it?
What we believe it takes…
12 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
• to have permanency through a safe emotionally secure
parenting relationship with a life-long, preferably, legal family;
• to be prepared by having the skills and support to meet
his/her/their physical, emotional, educational, and economic
needs; and
• to be connected to his/her/their community by having a safe
place to live, a sense of belonging and a chance to positively
contribute to the community.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise13
Takeaway: Prioritize research and discovery
• What is known about the problem we are trying to solve?
• External: What does best practice tell us?
• Internal: What do we know about what we already do?
• Create a “body of knowledge” of your practice area
14 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
Takeaway: Develop strong support
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise15
Takeaway: Merge evidence and performance
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise16
Performance-based:
1. to collect data that measures program outcomes and the
indicators that lead to positive outcomes
2. and to demonstrate, over time, continuously improving
trends in performance
Performance-based principles can lead to innovation.
Takeaway: Universal + document heavily
• Universal intake and discharge (with supplements)
• Shared treatment planning process
• Consistent assessment scales (the 4-point “Matrix”)
• All-staff and all-shift progress note template
• Documentation of the model is key 
17 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
Data system
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise18
Keys:
 Easy to use
 Transition from paper
 Budget friendly
We wanted Apricot to…
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise19
• Support compliance requirements
• Collect, manage, and report on outcomes data
• Reinforce our clinical practice
…but how do we configure it without concrete examples?
Challenges with initial Apricot design
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise20
• Difficult to track multiple enrollments per youth
• Overwriting historical status to update current status
• Unable to correlate data without heavy lifts in reporting
• Forms were getting larger, staff complaints getting louder
Apricot database “spec”
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise21
Why map Apricot’s data model?
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise22
• What reports are possible or not possible?
• How are those reports configured?
• How efficient it is to build a report?
• Can we report on outcomes?
Initial observations
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise23
• Unable to scale system with new programs long term
• No program enrollment for “continuity of service”
• No workflow systems to support clinical practice
• Data needed export for reporting, highly inefficient
Existing vs. Vision ERD
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise24
The decision of whether or not to
proceed with redesign of our Apricot
from 1.0 to 2.0 was a significant
decision for us.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise25
Our decision was between two options
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise26
1. Stay with current system
2. Redesign for a new system 
o Budget constraints
o Timeline considerations
o Fears + goals
Priorities for redesign (the best path)
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise27
• Staggered implementation approach (easier to digest)
• No data migration, start fresh (lower one-time cost)
• Build from conclusions of spec project (reduce fears and
address goals)
Takeaway: Define what’s what
• Define the current state or status quo
• Define a vision of the future opportunity
• Compare the two to develop the roadmap
28 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
If the assessment validates your challenges with
opportunities for resolution, then the conclusions of the
assessment are relevant in next steps (i.e. an action plan).
Takeaway: Run a value equation
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise29
• Time
• Cost
• Accuracy (decision making)
• Energy (stress and focus)
Learn more at https://www.sidekicksolutionsllc.com/apricot/evaluating-for-purchase#the-business-case-
for-new-social-work-case-management-software
Takeaway: Data migration isn’t only option
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise30
Redesign 12-months
(end of split reporting)
24-months
(complete data set)
• Archive in place, view-only for reference
• Transition on fiscal or calendar year break
• Data always there to migrate if needed in the future
The redesign of Apricot must enable
our practice and provide for a
complete data set to measure
progress and outcomes.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise31
Feature: Universal system design
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise32
• Referral tracking with source and eligibility reporting
• Face sheet with standardized demographics and profile
• Consolidated intake and discharge (enrollment) 
• Single Tx Plan, progress note template, and assessment
Feature: Program enrollment
• Multiple, simultaneous, and repeat enrollments 
• Track continuity of service (transitions)
• Global reporting across programs
• Operational consistency
• Scalable architecture as programs change 
33 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
Feature: Enrollment supplements
• Wizard linked form (or workflow tool)
• 1-to-1 linking (no multiples in reports)
• Data quality where incomplete
34 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
Feature: Workflow design for the model
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise35
Feature: Active status dashboard
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise36
• Open cases by program and staff assigned
• Progress review/updates to do by staff assigned
• Tx plans to do by staff assigned
• Outcomes assessments to do by staff assigned
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise37
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise38
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise39
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise40
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise41
Feature: Indicators at interval
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise42
• Behaviors
• Services
• Milestones
• Domain area ratings (“Matrix”)
• Goal status
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise43
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise44
31
2
Aggregate reporting and interval correlation
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise45
Feature: Youth and program-specific data
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise46
• Team form (relationships)
• Global, correlate with all programs
• Track entities as T2 form
Feature: Youth Summary Report (YSR)
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise47
Feature: Leadership team reports
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise48
• Active youth as of today
• Discharged youth with date filter
• Referrals (incoming) with date filter
• Youth that participated in range
Feature: Printable templates
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise49
Feature: Case reviews and accreditation
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise50
Our Apricot by the numbers…
• 49 active users
• 6 programs with shared design
• 100% staff engagement
• Aligned with model
51 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
How we know the culture has changed…
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise52
Positives
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise53
• Apricot design reinforces intervention and outcomes model
• Fewer reports all filtered by program, more efficient
• More time available on capacity building
• Adding new programs is an overlay on current design
• User-driven data quality reports and quality assurance
Areas of improvement
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise54
• Vocabulary and category changes in field sets
• Measured approach when planning for new programs
• Staff onboarding and ongoing training
• Updating data policies and procedures for accreditation
Next steps
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise55
• Supervisory tools to further support clinical practice
• Build out of more report tools for analysis
• Refining case study practice for accreditation
• Itemize financial benefit of our intervention
• Grow data set for evaluation studies and peer collaboration
What we learned in this process
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise56
Apricot is most valuable when specifically using it as a tool to measure your vision.
Step 1: Articulate who you are
Step 2: Understand what you do
Step 3: Check in with stakeholders both internal and external
Step 4: Write down what you hope to report out at the end of the quarter/year/decade
Step 5: Articulate program activities that implement the mission and reach the vision
Step 6: Document behavior changes indicating success
Step 7: Check in with staff and map strategic priorities
Step 8: Document required reporting for compliance, funding, or any others
Step 9: Write logic models by program
Step 10: Design a data model, reporting platform, and client case management system reflective of Steps 1-9
We invested more in our data,
analytics, and people systems than we
originally planned, but have found it
necessary to progress in our work.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise57
We’re continuously learning
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise58
• How well did we do? OUTCOMES
• How satisfied are clients after working with us? SATISFACTION
• How much did we do? OUTPUTS
• What difference do we make? IMPACT
• How true to the model are our practices? FIDELITY
• How do we compare? COMPARISON
Thank you for joining us today!
Recording and slides will be sent to you via email.
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise59
Open door to connect…
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise60
Jeffrey Haguewood
Apricot Software Consultant
Sidekick Solutions
jeff@sidekicksolutionsllc.com
Sarah Morrill
Director of Outcomes and Evaluations
Plummer Youth Promise
smorrill@plummeryouthpromise.org
Questions?
© 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise61

More Related Content

What's hot

Aceicon Enterprise Management Software
Aceicon Enterprise Management Software Aceicon Enterprise Management Software
Aceicon Enterprise Management Software
Sho singh
 
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
Mike Otranto
 
KVP Corporate presentation-2012
KVP Corporate presentation-2012KVP Corporate presentation-2012
KVP Corporate presentation-2012
Nripendra Tamang
 

What's hot (20)

Addressing the most common PM Pains with Microsoft Project Online and Office 365
Addressing the most common PM Pains with Microsoft Project Online and Office 365Addressing the most common PM Pains with Microsoft Project Online and Office 365
Addressing the most common PM Pains with Microsoft Project Online and Office 365
 
How to Get to ‘One Source of Truth’ on Large, Multi-Year Programs
How to Get to ‘One Source of Truth’ on Large, Multi-Year ProgramsHow to Get to ‘One Source of Truth’ on Large, Multi-Year Programs
How to Get to ‘One Source of Truth’ on Large, Multi-Year Programs
 
Collaboration and Work Management
Collaboration and Work ManagementCollaboration and Work Management
Collaboration and Work Management
 
The Empowered PMO: How to Get Your PMO On Board
The Empowered PMO: How to Get Your PMO On BoardThe Empowered PMO: How to Get Your PMO On Board
The Empowered PMO: How to Get Your PMO On Board
 
Zero to PMO Hero
Zero to PMO HeroZero to PMO Hero
Zero to PMO Hero
 
Aceicon Enterprise Management Software
Aceicon Enterprise Management Software Aceicon Enterprise Management Software
Aceicon Enterprise Management Software
 
Oracle Financial Close Management: Streamline Your Close Process
Oracle Financial Close Management: Streamline Your Close ProcessOracle Financial Close Management: Streamline Your Close Process
Oracle Financial Close Management: Streamline Your Close Process
 
Bodhtree Corporate Deck
Bodhtree Corporate DeckBodhtree Corporate Deck
Bodhtree Corporate Deck
 
Keep your project moving with aconex contract administration webinar slides
Keep your project moving with aconex contract administration webinar slidesKeep your project moving with aconex contract administration webinar slides
Keep your project moving with aconex contract administration webinar slides
 
Oracle Fusion v/s Workday
Oracle Fusion v/s WorkdayOracle Fusion v/s Workday
Oracle Fusion v/s Workday
 
Birkbeck University of London explains Operational Excellence at IRM BPM 2015
Birkbeck University of London explains Operational Excellence at IRM BPM 2015Birkbeck University of London explains Operational Excellence at IRM BPM 2015
Birkbeck University of London explains Operational Excellence at IRM BPM 2015
 
Extending Microsoft Project into a Unified Work Management Solution
Extending Microsoft Project into a Unified Work Management SolutionExtending Microsoft Project into a Unified Work Management Solution
Extending Microsoft Project into a Unified Work Management Solution
 
Mark Fowlers Initiative Catalog V2
Mark Fowlers Initiative Catalog V2Mark Fowlers Initiative Catalog V2
Mark Fowlers Initiative Catalog V2
 
Accelerating SDLC for Large Public Sector Enterprise Applications
Accelerating SDLC for Large Public Sector Enterprise ApplicationsAccelerating SDLC for Large Public Sector Enterprise Applications
Accelerating SDLC for Large Public Sector Enterprise Applications
 
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
Top Trends for Agile Transformation in 2018: People, Processes, and Technolog...
 
Deltek Ajera SaaS admin webinar
Deltek Ajera SaaS admin webinarDeltek Ajera SaaS admin webinar
Deltek Ajera SaaS admin webinar
 
How Oracle Sales Cloud Release 12 Will Boost Sales Productivity
How Oracle Sales Cloud Release 12 Will Boost Sales ProductivityHow Oracle Sales Cloud Release 12 Will Boost Sales Productivity
How Oracle Sales Cloud Release 12 Will Boost Sales Productivity
 
SharePoint Services
SharePoint ServicesSharePoint Services
SharePoint Services
 
KVP Corporate presentation-2012
KVP Corporate presentation-2012KVP Corporate presentation-2012
KVP Corporate presentation-2012
 
DannyWahl
DannyWahlDannyWahl
DannyWahl
 

Similar to Case Study: Plummer Youth Promise, How to Measure Outcomes in Apricot Software

Case Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
Case Study: Plummer Youth Promise, Program Outcome Models in Apricot SoftwareCase Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
Case Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
Jeffrey Haguewood
 
Social Solutions Apricot 360: Client Case Management Software
Social Solutions Apricot 360: Client Case Management SoftwareSocial Solutions Apricot 360: Client Case Management Software
Social Solutions Apricot 360: Client Case Management Software
Jeffrey Haguewood
 

Similar to Case Study: Plummer Youth Promise, How to Measure Outcomes in Apricot Software (20)

Case Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
Case Study: Plummer Youth Promise, Program Outcome Models in Apricot SoftwareCase Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
Case Study: Plummer Youth Promise, Program Outcome Models in Apricot Software
 
Social Solutions Apricot 360: Client Case Management Software
Social Solutions Apricot 360: Client Case Management SoftwareSocial Solutions Apricot 360: Client Case Management Software
Social Solutions Apricot 360: Client Case Management Software
 
Rally Webinar: Proven Practices to Increase Apply Flow
Rally Webinar: Proven Practices to Increase Apply FlowRally Webinar: Proven Practices to Increase Apply Flow
Rally Webinar: Proven Practices to Increase Apply Flow
 
Rise of Talent Operations - What Good Looks Like
Rise of Talent Operations - What Good Looks LikeRise of Talent Operations - What Good Looks Like
Rise of Talent Operations - What Good Looks Like
 
Prosci Change Measurement Framework and Scorecard - Draft
Prosci Change Measurement Framework and Scorecard - DraftProsci Change Measurement Framework and Scorecard - Draft
Prosci Change Measurement Framework and Scorecard - Draft
 
Df18 Fundraising Made Easy
Df18 Fundraising Made Easy Df18 Fundraising Made Easy
Df18 Fundraising Made Easy
 
A Systems Thinking Approach to Benefits Realization Planning
A Systems Thinking Approach to Benefits Realization PlanningA Systems Thinking Approach to Benefits Realization Planning
A Systems Thinking Approach to Benefits Realization Planning
 
Ina Gjikondi & Sheryl Vogt: Lean Six Sigma & the Balanced Scorecard
Ina Gjikondi & Sheryl Vogt: Lean Six Sigma & the Balanced ScorecardIna Gjikondi & Sheryl Vogt: Lean Six Sigma & the Balanced Scorecard
Ina Gjikondi & Sheryl Vogt: Lean Six Sigma & the Balanced Scorecard
 
Lean Project Management PowerPoint Presentation Slides
Lean Project Management PowerPoint Presentation Slides Lean Project Management PowerPoint Presentation Slides
Lean Project Management PowerPoint Presentation Slides
 
Connected Campus: Building Custom Apps on the Platform
Connected Campus: Building Custom Apps on the PlatformConnected Campus: Building Custom Apps on the Platform
Connected Campus: Building Custom Apps on the Platform
 
How to Drive Maximum Business Value from IT Investments with the Flow Framework
How to Drive Maximum Business Value from IT Investments with the Flow FrameworkHow to Drive Maximum Business Value from IT Investments with the Flow Framework
How to Drive Maximum Business Value from IT Investments with the Flow Framework
 
A Practitioner’s Guide to Successful S&OP and Demand Management
A Practitioner’s Guide to Successful S&OP and Demand ManagementA Practitioner’s Guide to Successful S&OP and Demand Management
A Practitioner’s Guide to Successful S&OP and Demand Management
 
Hiring: Structuring and Recruiting A Customer Success Team to Scale
Hiring: Structuring and Recruiting A Customer Success Team to ScaleHiring: Structuring and Recruiting A Customer Success Team to Scale
Hiring: Structuring and Recruiting A Customer Success Team to Scale
 
Tyler M
Tyler MTyler M
Tyler M
 
Employee ownership: Protect your legacy even in challenging times (thriving t...
Employee ownership: Protect your legacy even in challenging times (thriving t...Employee ownership: Protect your legacy even in challenging times (thriving t...
Employee ownership: Protect your legacy even in challenging times (thriving t...
 
Lean Project Management Powerpoint Presentation Slide
Lean Project Management Powerpoint Presentation SlideLean Project Management Powerpoint Presentation Slide
Lean Project Management Powerpoint Presentation Slide
 
Leveraging the Benefits of the Hybrid Workplace
Leveraging the Benefits of the Hybrid Workplace Leveraging the Benefits of the Hybrid Workplace
Leveraging the Benefits of the Hybrid Workplace
 
Lean Project Management PowerPoint Presentation Slide
Lean Project Management PowerPoint Presentation SlideLean Project Management PowerPoint Presentation Slide
Lean Project Management PowerPoint Presentation Slide
 
Remote but Still Resilient: Zynga and XactShare their Stories on People Analy...
Remote but Still Resilient: Zynga and XactShare their Stories on People Analy...Remote but Still Resilient: Zynga and XactShare their Stories on People Analy...
Remote but Still Resilient: Zynga and XactShare their Stories on People Analy...
 
Leveraging the Benefits of the Hybrid Workplace
Leveraging the Benefits of the Hybrid Workplace Leveraging the Benefits of the Hybrid Workplace
Leveraging the Benefits of the Hybrid Workplace
 

More from Jeffrey Haguewood

Introduction to CRM Automation with Zapier
Introduction to CRM Automation with ZapierIntroduction to CRM Automation with Zapier
Introduction to CRM Automation with Zapier
Jeffrey Haguewood
 
eTapestry + Zapier: Automated Integration with Any App
eTapestry + Zapier: Automated Integration with Any AppeTapestry + Zapier: Automated Integration with Any App
eTapestry + Zapier: Automated Integration with Any App
Jeffrey Haguewood
 

More from Jeffrey Haguewood (9)

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
 
Automation for Bonterra Impact Management (fka Apricot)
Automation for Bonterra Impact Management (fka Apricot)Automation for Bonterra Impact Management (fka Apricot)
Automation for Bonterra Impact Management (fka Apricot)
 
CauseVox and Zapier Automations
CauseVox and Zapier AutomationsCauseVox and Zapier Automations
CauseVox and Zapier Automations
 
Introduction to CRM Automation with Zapier
Introduction to CRM Automation with ZapierIntroduction to CRM Automation with Zapier
Introduction to CRM Automation with Zapier
 
Case Study: eTapestry MailChimp Integration with Zapier
Case Study: eTapestry MailChimp Integration with ZapierCase Study: eTapestry MailChimp Integration with Zapier
Case Study: eTapestry MailChimp Integration with Zapier
 
Case Study: eTapestry QuickBooks Online Integration with Zapier
Case Study: eTapestry QuickBooks Online Integration with ZapierCase Study: eTapestry QuickBooks Online Integration with Zapier
Case Study: eTapestry QuickBooks Online Integration with Zapier
 
Case Study: eTapestry Eventbrite Integration with Zapier
Case Study: eTapestry Eventbrite Integration with ZapierCase Study: eTapestry Eventbrite Integration with Zapier
Case Study: eTapestry Eventbrite Integration with Zapier
 
eTapestry + Zapier: Automated Integration with Any App
eTapestry + Zapier: Automated Integration with Any AppeTapestry + Zapier: Automated Integration with Any App
eTapestry + Zapier: Automated Integration with Any App
 

Recently uploaded

JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
Max Lee
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
Alluxio, Inc.
 

Recently uploaded (20)

how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdf
 
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
KLARNA -  Language Models and Knowledge Graphs: A Systems ApproachKLARNA -  Language Models and Knowledge Graphs: A Systems Approach
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
 
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purityAPVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
The Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion ProductionThe Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion Production
 
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdfMicrosoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
 
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesGraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
AI Hackathon.pptx
AI                        Hackathon.pptxAI                        Hackathon.pptx
AI Hackathon.pptx
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Kraków
 
INGKA DIGITAL: Linked Metadata by Design
INGKA DIGITAL: Linked Metadata by DesignINGKA DIGITAL: Linked Metadata by Design
INGKA DIGITAL: Linked Metadata by Design
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
 
A Guideline to Gorgias to to Re:amaze Data Migration
A Guideline to Gorgias to to Re:amaze Data MigrationA Guideline to Gorgias to to Re:amaze Data Migration
A Guideline to Gorgias to to Re:amaze Data Migration
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
AI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning FrameworkAI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning Framework
 
What need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersWhat need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java Developers
 
OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024OpenChain @ LF Japan Executive Briefing - May 2024
OpenChain @ LF Japan Executive Briefing - May 2024
 

Case Study: Plummer Youth Promise, How to Measure Outcomes in Apricot Software

  • 1. Case Study: Plummer Youth Promise How to Measure Outcomes in Apricot Software © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 2. On the webinar today… © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise2 Jeffrey Haguewood Apricot Software Consultant Sidekick Solutions jeff@sidekicksolutionsllc.com Sarah Morrill Director of Outcomes and Evaluations Plummer Youth Promise smorrill@plummeryouthpromise.org
  • 3. How to design a program and outcomes model, and then set up a data system that enables the model? © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise3
  • 4. Agenda • Part 1: Designing the program and outcomes model • Part 2: Assessing gaps in the initial data system’s design • Part 3: System redesign for integration with the model 4 Today’s presentation will be a mix of strategy and technical. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 5. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise5 Founded in 1854
  • 6. Key questions © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise6 • How well did we do? OUTCOMES • How satisfied are clients after working with us? SATISFACTION • How much did we do? OUTPUTS • What difference do we make? IMPACT • How true to the model are our practices? FIDELITY • How do we compare? COMPARISON
  • 7. Permanency 7 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise An enduring family relationship that: • Is safe and lifelong; • Offers legal rights and social status of full family membership • Provides for physical, emotional, social, cognitive, and spiritual well being; and • Assures life long connections to birth and extended family, siblings and other significant adults, family history and traditions, race and ethnic heritage, culture, religion, and language. Call to Action: An Integrated Approach to Youth Permanency and Preparation for Adulthood. Casey Family Services in collaboration with California Permanency for Youth Project, Casey Family Programs, and The Jim Casey Youth Opportunities Initiative
  • 8. The intervention and outcome model comes first, preceding the data system for tracking the model. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise8
  • 9. How we got started 9 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise • We started with our experience, anecdotes and stories • We knew families were key to permanency …but we had little data to support our beliefs
  • 10. Our approach 1. External research 2. Internal discovery 10 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise …data system would come later
  • 11. Data gathering questions © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise11 • What problem are we trying to address? • What does best practice research tell us? • How do we stack up? • What makes our clients the same or different? • What makes our services different? • What do we believe about our program participants? • What does success look like for program participants? • Which activities/practices/interventions drive success? • How do we know success when we see it?
  • 12. What we believe it takes… 12 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise • to have permanency through a safe emotionally secure parenting relationship with a life-long, preferably, legal family; • to be prepared by having the skills and support to meet his/her/their physical, emotional, educational, and economic needs; and • to be connected to his/her/their community by having a safe place to live, a sense of belonging and a chance to positively contribute to the community.
  • 13. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise13
  • 14. Takeaway: Prioritize research and discovery • What is known about the problem we are trying to solve? • External: What does best practice tell us? • Internal: What do we know about what we already do? • Create a “body of knowledge” of your practice area 14 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 15. Takeaway: Develop strong support © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise15
  • 16. Takeaway: Merge evidence and performance © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise16 Performance-based: 1. to collect data that measures program outcomes and the indicators that lead to positive outcomes 2. and to demonstrate, over time, continuously improving trends in performance Performance-based principles can lead to innovation.
  • 17. Takeaway: Universal + document heavily • Universal intake and discharge (with supplements) • Shared treatment planning process • Consistent assessment scales (the 4-point “Matrix”) • All-staff and all-shift progress note template • Documentation of the model is key  17 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 18. Data system © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise18 Keys:  Easy to use  Transition from paper  Budget friendly
  • 19. We wanted Apricot to… © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise19 • Support compliance requirements • Collect, manage, and report on outcomes data • Reinforce our clinical practice …but how do we configure it without concrete examples?
  • 20. Challenges with initial Apricot design © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise20 • Difficult to track multiple enrollments per youth • Overwriting historical status to update current status • Unable to correlate data without heavy lifts in reporting • Forms were getting larger, staff complaints getting louder
  • 21. Apricot database “spec” © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise21
  • 22. Why map Apricot’s data model? © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise22 • What reports are possible or not possible? • How are those reports configured? • How efficient it is to build a report? • Can we report on outcomes?
  • 23. Initial observations © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise23 • Unable to scale system with new programs long term • No program enrollment for “continuity of service” • No workflow systems to support clinical practice • Data needed export for reporting, highly inefficient
  • 24. Existing vs. Vision ERD © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise24
  • 25. The decision of whether or not to proceed with redesign of our Apricot from 1.0 to 2.0 was a significant decision for us. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise25
  • 26. Our decision was between two options © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise26 1. Stay with current system 2. Redesign for a new system  o Budget constraints o Timeline considerations o Fears + goals
  • 27. Priorities for redesign (the best path) © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise27 • Staggered implementation approach (easier to digest) • No data migration, start fresh (lower one-time cost) • Build from conclusions of spec project (reduce fears and address goals)
  • 28. Takeaway: Define what’s what • Define the current state or status quo • Define a vision of the future opportunity • Compare the two to develop the roadmap 28 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise If the assessment validates your challenges with opportunities for resolution, then the conclusions of the assessment are relevant in next steps (i.e. an action plan).
  • 29. Takeaway: Run a value equation © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise29 • Time • Cost • Accuracy (decision making) • Energy (stress and focus) Learn more at https://www.sidekicksolutionsllc.com/apricot/evaluating-for-purchase#the-business-case- for-new-social-work-case-management-software
  • 30. Takeaway: Data migration isn’t only option © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise30 Redesign 12-months (end of split reporting) 24-months (complete data set) • Archive in place, view-only for reference • Transition on fiscal or calendar year break • Data always there to migrate if needed in the future
  • 31. The redesign of Apricot must enable our practice and provide for a complete data set to measure progress and outcomes. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise31
  • 32. Feature: Universal system design © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise32 • Referral tracking with source and eligibility reporting • Face sheet with standardized demographics and profile • Consolidated intake and discharge (enrollment)  • Single Tx Plan, progress note template, and assessment
  • 33. Feature: Program enrollment • Multiple, simultaneous, and repeat enrollments  • Track continuity of service (transitions) • Global reporting across programs • Operational consistency • Scalable architecture as programs change  33 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 34. Feature: Enrollment supplements • Wizard linked form (or workflow tool) • 1-to-1 linking (no multiples in reports) • Data quality where incomplete 34 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 35. Feature: Workflow design for the model © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise35
  • 36. Feature: Active status dashboard © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise36 • Open cases by program and staff assigned • Progress review/updates to do by staff assigned • Tx plans to do by staff assigned • Outcomes assessments to do by staff assigned
  • 37. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise37
  • 38. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise38
  • 39. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise39
  • 40. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise40
  • 41. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise41
  • 42. Feature: Indicators at interval © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise42 • Behaviors • Services • Milestones • Domain area ratings (“Matrix”) • Goal status
  • 43. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise43
  • 44. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise44 31 2
  • 45. Aggregate reporting and interval correlation © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise45
  • 46. Feature: Youth and program-specific data © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise46 • Team form (relationships) • Global, correlate with all programs • Track entities as T2 form
  • 47. Feature: Youth Summary Report (YSR) © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise47
  • 48. Feature: Leadership team reports © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise48 • Active youth as of today • Discharged youth with date filter • Referrals (incoming) with date filter • Youth that participated in range
  • 49. Feature: Printable templates © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise49
  • 50. Feature: Case reviews and accreditation © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise50
  • 51. Our Apricot by the numbers… • 49 active users • 6 programs with shared design • 100% staff engagement • Aligned with model 51 © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise
  • 52. How we know the culture has changed… © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise52
  • 53. Positives © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise53 • Apricot design reinforces intervention and outcomes model • Fewer reports all filtered by program, more efficient • More time available on capacity building • Adding new programs is an overlay on current design • User-driven data quality reports and quality assurance
  • 54. Areas of improvement © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise54 • Vocabulary and category changes in field sets • Measured approach when planning for new programs • Staff onboarding and ongoing training • Updating data policies and procedures for accreditation
  • 55. Next steps © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise55 • Supervisory tools to further support clinical practice • Build out of more report tools for analysis • Refining case study practice for accreditation • Itemize financial benefit of our intervention • Grow data set for evaluation studies and peer collaboration
  • 56. What we learned in this process © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise56 Apricot is most valuable when specifically using it as a tool to measure your vision. Step 1: Articulate who you are Step 2: Understand what you do Step 3: Check in with stakeholders both internal and external Step 4: Write down what you hope to report out at the end of the quarter/year/decade Step 5: Articulate program activities that implement the mission and reach the vision Step 6: Document behavior changes indicating success Step 7: Check in with staff and map strategic priorities Step 8: Document required reporting for compliance, funding, or any others Step 9: Write logic models by program Step 10: Design a data model, reporting platform, and client case management system reflective of Steps 1-9
  • 57. We invested more in our data, analytics, and people systems than we originally planned, but have found it necessary to progress in our work. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise57
  • 58. We’re continuously learning © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise58 • How well did we do? OUTCOMES • How satisfied are clients after working with us? SATISFACTION • How much did we do? OUTPUTS • What difference do we make? IMPACT • How true to the model are our practices? FIDELITY • How do we compare? COMPARISON
  • 59. Thank you for joining us today! Recording and slides will be sent to you via email. © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise59
  • 60. Open door to connect… © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise60 Jeffrey Haguewood Apricot Software Consultant Sidekick Solutions jeff@sidekicksolutionsllc.com Sarah Morrill Director of Outcomes and Evaluations Plummer Youth Promise smorrill@plummeryouthpromise.org
  • 61. Questions? © 2020 Sidekick Solutions LLC | © 2020 Plummer Youth Promise61