SlideShare a Scribd company logo
Social services innovation
An evidence-based approach
Alfonso Lara Montero,
Policy Director, Deputy CEO
Congreso del CGTS, 20 October 2017
esn-eu.org
The European Social
Network
esn-eu.org
Independent network for public social services organisations:
Social services directors and professionals associations
Social services departments in local & regional
governments
Inspection agencies
Research organisations
125 members in 34 countries
EaSI funded
Peer learning & knowledge exchange
Policy development
The European Social
Network in Spain
esn-eu.org
Departamentos de Bienestar en las CCAA de Galicia,
Asturias, Navarra, País Vasco, Catalunya, Castilla-La-Mancha,
Andalucía
Diputaciones de Barcelona, Bizkaia, Gipuzkoa, SUMAR
Vitoria
Meridianos
SIIS, Instituto Donabedian
Consejo General del Trabajo Social
The European Social
Services Conference
esn-eu.org
Sevilla, 28-30 Mayo 2017
Junta de Andalucía, Diputación de Sevilla, Obra Social La
Caixa
Inversión social frente a austeridad
Innovación para mejorar la calidad de vida
Paradigm change
in social services
esn-eu.org
• From intervention to prevention
• From rights implementation to lives’ improvement
• Social services on equal footing with health and
education
• From measuring outputs and processes to
measing outcomes
Paradigm change
Main elements
esn-eu.org
• The need for social services to be evaluated
• Not only output but also outcome indicators
• Use not only common sense but also test and
verification
• Selecting most effective interventions
• Ethical principle of ‘no harm’
• Work with other disciplines e.g. pay attention to
scientific approaches from health
Our point of view
esn-eu.org
• From intervention to prevention
• From rights implementation to lives’ improvement
• Social services on equal footing with health and
education
• From measuring outputs and processes to
measing outcomes
Introduction
Evidence-based social services
• International review of
evidence-based hubs
• Templates with key questions for
planning & evaluating services
0
10
20
30
40
50
60
70
80
90
100
2007
2010
2013
Evidence-based social
services in other countries
Sweden
Joint initiative
Evidence-based social
services in other countries
The Netherlands
Challenges
esn-eu.org
• Language & culture differences
Challenges
esn-eu.org
• Different values
• Lack of continuity because of lack of funding & project-
based services
• Reluctance to implement EBP from abroad (USA)
• Lack of information for programme implementation
• Implementation fidelity
• Local adaptation
Types of knowledge
for service planning & evaluation
esn-eu.org
Types of knowledge
esn-eu.org
1. Target population
• What’s the problem?
• What’s the scope?
• What are the risk &
protective factors?
2. Type of intervention
• Primary?
• Secundary?
• Tertiary?
Types of knowledge
esn-eu.org
3. Programme implementation
• Is the context favourable for implementation?
• Does the programme follow a specific model?
• Who is leading and managing the initiative?
• How is engagement of users, families or carers facilitated?
• Has the programme been implemented elsewhere? And
evaluated?
Types of knowledge
esn-eu.org
4. Effects
• What were the effects
sought with the
programme?
• What’s the evaluation
plan?
• Before/After
• Controlled group
• RCT
• Mixed
5. Costs & Benefits
What are the
programme/evaluation
costs?
What are the potential
benefits?
Example of EBP in social
services
esn-eu.org
II: Community intervention teams in Sweden (K3)
• Quasi-experimental with experimental and control group
• 20 towns/100 young people in each group
• Measurement 1 (before the intervention): anti-social behaviour,
behavioural challenge, drug and alcohol abuse, family and peer
relations, work with social workers
• Measurement 2 (after the intervention): At 6th, 24th and 60th
month, delinquency, mental health, addictions.
Text and content copyright © 2014 Project Oracle. All rights reserved.
A children and youth Evidence Hub
18
Example II: Project Oracle
WORKING WITH
CHILDREN AND
YOUTH SECTOR
ACROSS LONDON
(Project delivery by borough)
Ecosystem
approach
Text and content copyright © 2014 Project Oracle. All rights reserved. 19
Evidence standards of project Oracle
Text and content copyright © 2014 Project Oracle. All rights reserved.
L1 L2 L3 L4
6. Lack of understanding of cost-
benefits analyses
7. Difficulties to access Universities
and external experts
5. Lack of knowledge of
comparison groups
methodologies
1. Lack of qualitative/quantitative evaluation skills
3. Unable to access data collection tools of high
quality
8. Not knowing where to go for support
4. Limited resources to access an external evaluator
2. Limited understanding of what quality
evaluation means
Challenges
Conclusion
esn-eu.org
• Five types of knowledge for the development of EBP
social services programmes
• Implementation fidelity & local adaptation
• Evaluation needs to be planned at the initial phase and
should include pre-, during and post-assessment
• Indicators should be agreed and maintained throughout
the process
• Train professionals who need to collect data
• Cooperate actively with service professionals and users
Muchas gracias por
vuestra atención y nos
vemos en Sevilla
@A_LMontero

More Related Content

Similar to Evidence-based social services for children and families

Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
EDUNET
 
Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
EDUNET
 
Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
Victor Dudau
 
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] PresentationWhat Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
WhatWorksWellbeingLeedsBeckett
 
Responsible Research and Innovation at Scientix 2014
Responsible Research and Innovation at Scientix 2014Responsible Research and Innovation at Scientix 2014
Responsible Research and Innovation at Scientix 2014
RRI Tools
 
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
Brussels, Belgium
 
Evaluating digital inclusion projects in practice
Evaluating digital inclusion projects in practiceEvaluating digital inclusion projects in practice
Evaluating digital inclusion projects in practice
Good Things Foundation
 
Reaching the Voice of the Customer: Experiences in Local and International Te...
Reaching the Voice of the Customer: Experiences in Local and International Te...Reaching the Voice of the Customer: Experiences in Local and International Te...
Reaching the Voice of the Customer: Experiences in Local and International Te...
Ulster University
 
Tackling societal challenges through digital transformation
Tackling societal challenges through digital transformationTackling societal challenges through digital transformation
Tackling societal challenges through digital transformation
Games for Health Europe
 
Ia4 si networing event_passani
Ia4 si networing event_passaniIa4 si networing event_passani
Ia4 si networing event_passani
Wikiprogress_slides
 
Ia4 si networing event_passani
Ia4 si networing event_passaniIa4 si networing event_passani
Ia4 si networing event_passani
Wikiprogress_slides
 
PortalEIR: Tools for tutoring residents
PortalEIR: Tools for tutoring residentsPortalEIR: Tools for tutoring residents
PortalEIR: Tools for tutoring residents
José Luis de la Rosa
 
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
cienciaicontroversia
 
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
OECD Directorate for Financial and Enterprise Affairs
 
Case studies-assistive-technology-research
Case studies-assistive-technology-researchCase studies-assistive-technology-research
Case studies-assistive-technology-research
Ulster University
 
The Role of the Living Labs – Co-design to Improve Product Development, Consu...
The Role of the Living Labs – Co-design to Improve Product Development, Consu...The Role of the Living Labs – Co-design to Improve Product Development, Consu...
The Role of the Living Labs – Co-design to Improve Product Development, Consu...
European Network of Living Labs (ENoLL)
 
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES ProjectSI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
Social Innovation Exchange
 
ocial support and long term care for older people – Ghenta
ocial support and long term care for older people – Ghentaocial support and long term care for older people – Ghenta
ocial support and long term care for older people – Ghenta
CARER+ Project
 
Universities & Public Engagement
Universities & Public EngagementUniversities & Public Engagement
Universities & Public Engagement
European University Association
 
OER: Key Issues & The "Big Picture"
OER: Key Issues & The "Big Picture"OER: Key Issues & The "Big Picture"
OER: Key Issues & The "Big Picture"
Robert Farrow
 

Similar to Evidence-based social services for children and families (20)

Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
 
Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
 
Presentation of the iene 7 project
Presentation of the iene 7 projectPresentation of the iene 7 project
Presentation of the iene 7 project
 
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] PresentationWhat Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
What Works Wellbeing Stakeholder Engagement Workshop [Leeds] Presentation
 
Responsible Research and Innovation at Scientix 2014
Responsible Research and Innovation at Scientix 2014Responsible Research and Innovation at Scientix 2014
Responsible Research and Innovation at Scientix 2014
 
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
R. Malagrida: Responsible Research and Innovation, a new paradigm in Horizon ...
 
Evaluating digital inclusion projects in practice
Evaluating digital inclusion projects in practiceEvaluating digital inclusion projects in practice
Evaluating digital inclusion projects in practice
 
Reaching the Voice of the Customer: Experiences in Local and International Te...
Reaching the Voice of the Customer: Experiences in Local and International Te...Reaching the Voice of the Customer: Experiences in Local and International Te...
Reaching the Voice of the Customer: Experiences in Local and International Te...
 
Tackling societal challenges through digital transformation
Tackling societal challenges through digital transformationTackling societal challenges through digital transformation
Tackling societal challenges through digital transformation
 
Ia4 si networing event_passani
Ia4 si networing event_passaniIa4 si networing event_passani
Ia4 si networing event_passani
 
Ia4 si networing event_passani
Ia4 si networing event_passaniIa4 si networing event_passani
Ia4 si networing event_passani
 
PortalEIR: Tools for tutoring residents
PortalEIR: Tools for tutoring residentsPortalEIR: Tools for tutoring residents
PortalEIR: Tools for tutoring residents
 
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
Com apropar la recerca a l’educació mitjançant la Recerca i la Innovació Resp...
 
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
Integrating Consumer Behaviour Insights in Competition Enforcement - Chiara V...
 
Case studies-assistive-technology-research
Case studies-assistive-technology-researchCase studies-assistive-technology-research
Case studies-assistive-technology-research
 
The Role of the Living Labs – Co-design to Improve Product Development, Consu...
The Role of the Living Labs – Co-design to Improve Product Development, Consu...The Role of the Living Labs – Co-design to Improve Product Development, Consu...
The Role of the Living Labs – Co-design to Improve Product Development, Consu...
 
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES ProjectSI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
SI LIVE Spotlight on Portugal - Nuno Frazao on MIES Project
 
ocial support and long term care for older people – Ghenta
ocial support and long term care for older people – Ghentaocial support and long term care for older people – Ghenta
ocial support and long term care for older people – Ghenta
 
Universities & Public Engagement
Universities & Public EngagementUniversities & Public Engagement
Universities & Public Engagement
 
OER: Key Issues & The "Big Picture"
OER: Key Issues & The "Big Picture"OER: Key Issues & The "Big Picture"
OER: Key Issues & The "Big Picture"
 

Recently uploaded

Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
TechSoup
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
Celine George
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Excellence Foundation for South Sudan
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
Liberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdfLiberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdf
WaniBasim
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
Celine George
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
Jyoti Chand
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Denish Jangid
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
HajraNaeem15
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
adhitya5119
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Diana Rendina
 

Recently uploaded (20)

Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
Liberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdfLiberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdf
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
Wound healing PPT
Wound healing PPTWound healing PPT
Wound healing PPT
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
 

Evidence-based social services for children and families

  • 1. Social services innovation An evidence-based approach Alfonso Lara Montero, Policy Director, Deputy CEO Congreso del CGTS, 20 October 2017 esn-eu.org
  • 2. The European Social Network esn-eu.org Independent network for public social services organisations: Social services directors and professionals associations Social services departments in local & regional governments Inspection agencies Research organisations 125 members in 34 countries EaSI funded Peer learning & knowledge exchange Policy development
  • 3. The European Social Network in Spain esn-eu.org Departamentos de Bienestar en las CCAA de Galicia, Asturias, Navarra, País Vasco, Catalunya, Castilla-La-Mancha, Andalucía Diputaciones de Barcelona, Bizkaia, Gipuzkoa, SUMAR Vitoria Meridianos SIIS, Instituto Donabedian Consejo General del Trabajo Social
  • 4. The European Social Services Conference esn-eu.org Sevilla, 28-30 Mayo 2017 Junta de Andalucía, Diputación de Sevilla, Obra Social La Caixa Inversión social frente a austeridad Innovación para mejorar la calidad de vida
  • 5. Paradigm change in social services esn-eu.org • From intervention to prevention • From rights implementation to lives’ improvement • Social services on equal footing with health and education • From measuring outputs and processes to measing outcomes
  • 6. Paradigm change Main elements esn-eu.org • The need for social services to be evaluated • Not only output but also outcome indicators • Use not only common sense but also test and verification • Selecting most effective interventions • Ethical principle of ‘no harm’ • Work with other disciplines e.g. pay attention to scientific approaches from health
  • 7. Our point of view esn-eu.org • From intervention to prevention • From rights implementation to lives’ improvement • Social services on equal footing with health and education • From measuring outputs and processes to measing outcomes
  • 8. Introduction Evidence-based social services • International review of evidence-based hubs • Templates with key questions for planning & evaluating services
  • 10. Joint initiative Evidence-based social services in other countries The Netherlands
  • 12. Challenges esn-eu.org • Different values • Lack of continuity because of lack of funding & project- based services • Reluctance to implement EBP from abroad (USA) • Lack of information for programme implementation • Implementation fidelity • Local adaptation
  • 13. Types of knowledge for service planning & evaluation esn-eu.org
  • 14. Types of knowledge esn-eu.org 1. Target population • What’s the problem? • What’s the scope? • What are the risk & protective factors? 2. Type of intervention • Primary? • Secundary? • Tertiary?
  • 15. Types of knowledge esn-eu.org 3. Programme implementation • Is the context favourable for implementation? • Does the programme follow a specific model? • Who is leading and managing the initiative? • How is engagement of users, families or carers facilitated? • Has the programme been implemented elsewhere? And evaluated?
  • 16. Types of knowledge esn-eu.org 4. Effects • What were the effects sought with the programme? • What’s the evaluation plan? • Before/After • Controlled group • RCT • Mixed 5. Costs & Benefits What are the programme/evaluation costs? What are the potential benefits?
  • 17. Example of EBP in social services esn-eu.org II: Community intervention teams in Sweden (K3) • Quasi-experimental with experimental and control group • 20 towns/100 young people in each group • Measurement 1 (before the intervention): anti-social behaviour, behavioural challenge, drug and alcohol abuse, family and peer relations, work with social workers • Measurement 2 (after the intervention): At 6th, 24th and 60th month, delinquency, mental health, addictions.
  • 18. Text and content copyright © 2014 Project Oracle. All rights reserved. A children and youth Evidence Hub 18 Example II: Project Oracle WORKING WITH CHILDREN AND YOUTH SECTOR ACROSS LONDON (Project delivery by borough) Ecosystem approach
  • 19. Text and content copyright © 2014 Project Oracle. All rights reserved. 19 Evidence standards of project Oracle
  • 20. Text and content copyright © 2014 Project Oracle. All rights reserved. L1 L2 L3 L4 6. Lack of understanding of cost- benefits analyses 7. Difficulties to access Universities and external experts 5. Lack of knowledge of comparison groups methodologies 1. Lack of qualitative/quantitative evaluation skills 3. Unable to access data collection tools of high quality 8. Not knowing where to go for support 4. Limited resources to access an external evaluator 2. Limited understanding of what quality evaluation means Challenges
  • 21. Conclusion esn-eu.org • Five types of knowledge for the development of EBP social services programmes • Implementation fidelity & local adaptation • Evaluation needs to be planned at the initial phase and should include pre-, during and post-assessment • Indicators should be agreed and maintained throughout the process • Train professionals who need to collect data • Cooperate actively with service professionals and users
  • 22. Muchas gracias por vuestra atención y nos vemos en Sevilla @A_LMontero