SlideShare a Scribd company logo
Evidence based commissioning -
now and moving forward
Anne Gray, Knowledge Officer, Arden & GEM CSU
HLG Conference September 2016
What is commissioning?
• Commissioning is the process of procuring health
services.
• It is a complex process, involving the assessment
and understanding of a population’s health needs,
the planning of services to meet those needs and
securing services on a limited budget, then
monitoring the services procured.
[Faculty of Medical Leadership and Management, 2012]
A “plurality” of sources
[Swan 2012]
Analysis of items in 4 Knowledge@lerts July 2016
• 20 - “expert” groups (Kings Fund, Nuffield Trust, Health
Foundation, NIHR)
• 13 - NHS England/DH/PHE
• 10 – clinical peer groups (Royal Colleges, Diabetes UK
etc)
• 6 – Guidelines/standards (NICE,CQC,NHS Improvement)
• 5 – Local Government Association
• 3 - case studies (CCG board papers, magazines)
• 1 – peer reviewed journal
Looking for the evidence
What the research says:
• Commissioners look for themselves or rely on
colleagues
• Email discussion lists & alerts
• NHS sources are constantly changing and confusing
• Difficult to find commissioning/ management evidence
• Don’t ask the library unless they have had previous
contact
• Library staff also found it difficult
[Edwards 2013, Wye 2015]
[Wye et al. 2015, Wilson 2016]
Using the evidence
A Commissioning Librarian
• Service model to help my customer
• Searching skills to identify the plurality of
evidence
• Report formats to meet the business need
Lessons learnt – Know your customer
• What is business critical?
• Understand national and local drivers
• Speak the language
• Tailored service
Rather than merely searching for relevant articles,
Anne reflected on the problem areas, searched
for evidence of a range of successful
interventions achieved elsewhere and provided a
new measurable solutions for the CCG to adopt.
This saved me time and added real value and a
new angle of approach. CCG Director
Lessons learnt – Searching
Health Serv Deliv Res
Lessons learnt – Synthesis&Summary
• “Highlights …with an overview but also a link so I
can go into more depth if interested
• For busy people, as we all are, the snippets are
great as you don’t have to wade through a whole
load of words to understand what the info is about
• Having everything in one email instead of having to
remember where I saw this that and the other!!!”
[Ass Dir CCG]
Resources to build on
• Alerting services (CASH, Kings Fund)
• Evidence Works Toolkit (Avon Primary
Care Research Collaborative)
• Commissioning Handbook for Librarians
• Mailing lists
• Embedded librarians / knowledge services
Skills to build on
• Graduate Evidence Assistant pilot (Avon
Primary Care Research Collaborative)
• Knowledge for Healthcare
– Synthesis techniques
– Evidence for managers/commissioners training
• Communities of practice across NHS
knowledge staff
Moving forward
• What can your library build on?
• How can you work with other libraries?
• What can you do next week?
Bibliography 1/2
• Faculty of Medical Leadership and Management, 2012
http://www.nhs.uk/NHSEngland/thenhs/about/Documents/Commissi
oning-FINAL-2015.pdf
• Epilepsy Commissioning Toolkit http://www.epilepsytoolkit.org.uk/
• Swann J et al Evidence in Management Decisions (EMD) NIHR
Health Services and Delivery Research programme; 2012.
http://www2.warwick.ac.uk/fac/soc/wbs/projects/emd
• Wye et al. BMC Health Services Research (2015) 15:430
http://www.biomedcentral.com/1472-6963/15/430
• Wilson PM, Effects of a demand led knowledge translation service
on the uptake and use of research evidence by NHS commissioners
compared with lower intensity untargeted alternatives. HS&DR -
12/5002/18 http://www.nets.nihr.ac.uk/projects/hsdr/12500218
Bibliography 2/2
• Edwards et al Explaining Health Managers’ Information Seeking
Behaviour and Use. Final report. NIHR Service Delivery and
Organisation programme; 2013)
http://www.nets.nihr.ac.uk/projects/hsdr/081808243
• CASH portal http://www.netvibes.com/keeping-up-to-date#Home
• Evidence Works (Avon Primary Care Research Collaborative) (Avon
Primary Care Research Collaborative, AHSN, NIHR CLAHRC West
http://www.nhsevidencetoolkit.net/
• Commissioning Handbook for Librarians (NHS Librarians)
http://commissioning.libraryservices.nhs.uk/
• KfH Learning Zone http://kfh.libraryservices.nhs.uk/learning-
zone/specialist-and-technical-skills/

More Related Content

What's hot

There are ten kinds of people in the word - which one are you?
There are ten kinds of people in the word - which one are you?There are ten kinds of people in the word - which one are you?
There are ten kinds of people in the word - which one are you?
Health and Care Innovation Expo
 
An online Allied Health Palliative Care Resource
An online Allied Health Palliative Care ResourceAn online Allied Health Palliative Care Resource
An online Allied Health Palliative Care Resource
CareSearch palliative care knowledge network
 
Redesigning care - Nigel Edwards
Redesigning care - Nigel EdwardsRedesigning care - Nigel Edwards
Redesigning care - Nigel Edwards
Nuffield Trust
 
Accelerating care: new-models.digital
Accelerating care: new-models.digital Accelerating care: new-models.digital
Accelerating care: new-models.digital
Health and Care Innovation Expo
 
jan sobieraj collaborative launch
jan sobieraj collaborative launchjan sobieraj collaborative launch
jan sobieraj collaborative launch
NHS Improving Quality
 
Delivering the Five Year Forward View: Working collaboratively to prevent stroke
Delivering the Five Year Forward View: Working collaboratively to prevent strokeDelivering the Five Year Forward View: Working collaboratively to prevent stroke
Delivering the Five Year Forward View: Working collaboratively to prevent stroke
Health and Care Innovation Expo
 
Strategic Directions for User Experience
Strategic Directions for User ExperienceStrategic Directions for User Experience
Strategic Directions for User Experience
Tracy Sutherland
 
NHS partnership with Virginia Mason Institute - our journey so far
NHS partnership with Virginia Mason Institute - our journey so farNHS partnership with Virginia Mason Institute - our journey so far
NHS partnership with Virginia Mason Institute - our journey so far
Health and Care Innovation Expo
 
Making difficult decisions to ensure the future of quality health care for you
Making difficult decisions to ensure the future of quality health care for youMaking difficult decisions to ensure the future of quality health care for you
Making difficult decisions to ensure the future of quality health care for you
Derbyshire Dales District Council
 
Extended Primary Care Access in Southwark
Extended Primary Care Access in Southwark Extended Primary Care Access in Southwark
Extended Primary Care Access in Southwark
Nuffield Trust
 
Improvement analytics: innovation to improve care and efficiency
Improvement analytics: innovation to improve care and efficiencyImprovement analytics: innovation to improve care and efficiency
Improvement analytics: innovation to improve care and efficiency
Health and Care Innovation Expo
 
Building a Culture of Assessment @ ZSR
Building a Culture of Assessment @ ZSRBuilding a Culture of Assessment @ ZSR
Building a Culture of Assessment @ ZSR
Susan Smith
 
How community pharmacies support STPs and vanguards
How community pharmacies support STPs and vanguardsHow community pharmacies support STPs and vanguards
How community pharmacies support STPs and vanguards
Health and Care Innovation Expo
 
Driving progress in healthcare through NHS research
Driving progress in healthcare through NHS researchDriving progress in healthcare through NHS research
Driving progress in healthcare through NHS research
Health and Care Innovation Expo
 
Collaborative Solutions eHealth Event - St Vincents and Mater Health
Collaborative Solutions eHealth Event - St Vincents and Mater HealthCollaborative Solutions eHealth Event - St Vincents and Mater Health
Collaborative Solutions eHealth Event - St Vincents and Mater HealthCollaborative Solutions
 
Local Care Organisations
Local Care OrganisationsLocal Care Organisations
Local Care Organisations
Health and Care Innovation Expo
 
Data-driven population health
Data-driven population healthData-driven population health
Data-driven population health
Health and Care Innovation Expo
 
Miranda Davies: Self-report questionnaire
Miranda Davies: Self-report questionnaire Miranda Davies: Self-report questionnaire
Miranda Davies: Self-report questionnaire
Nuffield Trust
 
Embracing digital to unlock health system collaboration
Embracing digital to unlock health system collaborationEmbracing digital to unlock health system collaboration
Embracing digital to unlock health system collaboration
Health and Care Innovation Expo
 

What's hot (20)

There are ten kinds of people in the word - which one are you?
There are ten kinds of people in the word - which one are you?There are ten kinds of people in the word - which one are you?
There are ten kinds of people in the word - which one are you?
 
An online Allied Health Palliative Care Resource
An online Allied Health Palliative Care ResourceAn online Allied Health Palliative Care Resource
An online Allied Health Palliative Care Resource
 
Redesigning care - Nigel Edwards
Redesigning care - Nigel EdwardsRedesigning care - Nigel Edwards
Redesigning care - Nigel Edwards
 
Accelerating care: new-models.digital
Accelerating care: new-models.digital Accelerating care: new-models.digital
Accelerating care: new-models.digital
 
jan sobieraj collaborative launch
jan sobieraj collaborative launchjan sobieraj collaborative launch
jan sobieraj collaborative launch
 
Delivering the Five Year Forward View: Working collaboratively to prevent stroke
Delivering the Five Year Forward View: Working collaboratively to prevent strokeDelivering the Five Year Forward View: Working collaboratively to prevent stroke
Delivering the Five Year Forward View: Working collaboratively to prevent stroke
 
Strategic Directions for User Experience
Strategic Directions for User ExperienceStrategic Directions for User Experience
Strategic Directions for User Experience
 
NHS partnership with Virginia Mason Institute - our journey so far
NHS partnership with Virginia Mason Institute - our journey so farNHS partnership with Virginia Mason Institute - our journey so far
NHS partnership with Virginia Mason Institute - our journey so far
 
Making difficult decisions to ensure the future of quality health care for you
Making difficult decisions to ensure the future of quality health care for youMaking difficult decisions to ensure the future of quality health care for you
Making difficult decisions to ensure the future of quality health care for you
 
Extended Primary Care Access in Southwark
Extended Primary Care Access in Southwark Extended Primary Care Access in Southwark
Extended Primary Care Access in Southwark
 
Baird2006
Baird2006Baird2006
Baird2006
 
Improvement analytics: innovation to improve care and efficiency
Improvement analytics: innovation to improve care and efficiencyImprovement analytics: innovation to improve care and efficiency
Improvement analytics: innovation to improve care and efficiency
 
Building a Culture of Assessment @ ZSR
Building a Culture of Assessment @ ZSRBuilding a Culture of Assessment @ ZSR
Building a Culture of Assessment @ ZSR
 
How community pharmacies support STPs and vanguards
How community pharmacies support STPs and vanguardsHow community pharmacies support STPs and vanguards
How community pharmacies support STPs and vanguards
 
Driving progress in healthcare through NHS research
Driving progress in healthcare through NHS researchDriving progress in healthcare through NHS research
Driving progress in healthcare through NHS research
 
Collaborative Solutions eHealth Event - St Vincents and Mater Health
Collaborative Solutions eHealth Event - St Vincents and Mater HealthCollaborative Solutions eHealth Event - St Vincents and Mater Health
Collaborative Solutions eHealth Event - St Vincents and Mater Health
 
Local Care Organisations
Local Care OrganisationsLocal Care Organisations
Local Care Organisations
 
Data-driven population health
Data-driven population healthData-driven population health
Data-driven population health
 
Miranda Davies: Self-report questionnaire
Miranda Davies: Self-report questionnaire Miranda Davies: Self-report questionnaire
Miranda Davies: Self-report questionnaire
 
Embracing digital to unlock health system collaboration
Embracing digital to unlock health system collaborationEmbracing digital to unlock health system collaboration
Embracing digital to unlock health system collaboration
 

Viewers also liked

Knowledge@lerts for commissioners, tfpl June 2012
Knowledge@lerts for commissioners, tfpl June 2012Knowledge@lerts for commissioners, tfpl June 2012
Knowledge@lerts for commissioners, tfpl June 2012
Anne Gray
 
Information needs of health service commissioners
Information needs of health service commissioners Information needs of health service commissioners
Information needs of health service commissioners
Anne Gray
 
Qualty MK website April 2010
Qualty MK website  April 2010Qualty MK website  April 2010
Qualty MK website April 2010
Anne Gray
 
MIlton Keynes LKS support for evidence based pathways, 2008
MIlton Keynes LKS support for evidence based pathways, 2008MIlton Keynes LKS support for evidence based pathways, 2008
MIlton Keynes LKS support for evidence based pathways, 2008
Anne Gray
 
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
Anne Gray
 
Information Needs of Commissioners, CHfL workshop May 2013
Information Needs of Commissioners, CHfL workshop May 2013Information Needs of Commissioners, CHfL workshop May 2013
Information Needs of Commissioners, CHfL workshop May 2013
Anne Gray
 
Making Library & Knowledge Services Business critical
Making Library & Knowledge Services Business criticalMaking Library & Knowledge Services Business critical
Making Library & Knowledge Services Business critical
Anne Gray
 

Viewers also liked (7)

Knowledge@lerts for commissioners, tfpl June 2012
Knowledge@lerts for commissioners, tfpl June 2012Knowledge@lerts for commissioners, tfpl June 2012
Knowledge@lerts for commissioners, tfpl June 2012
 
Information needs of health service commissioners
Information needs of health service commissioners Information needs of health service commissioners
Information needs of health service commissioners
 
Qualty MK website April 2010
Qualty MK website  April 2010Qualty MK website  April 2010
Qualty MK website April 2010
 
MIlton Keynes LKS support for evidence based pathways, 2008
MIlton Keynes LKS support for evidence based pathways, 2008MIlton Keynes LKS support for evidence based pathways, 2008
MIlton Keynes LKS support for evidence based pathways, 2008
 
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
Quality MK : a whole system approach to quality improvement. CKO Workshop,Lon...
 
Information Needs of Commissioners, CHfL workshop May 2013
Information Needs of Commissioners, CHfL workshop May 2013Information Needs of Commissioners, CHfL workshop May 2013
Information Needs of Commissioners, CHfL workshop May 2013
 
Making Library & Knowledge Services Business critical
Making Library & Knowledge Services Business criticalMaking Library & Knowledge Services Business critical
Making Library & Knowledge Services Business critical
 

Similar to Evidence based commissioning - now and moving forward

Bringing knowledge to bear: MK revised Feb 2011 v7
Bringing knowledge to bear: MK revised Feb 2011 v7Bringing knowledge to bear: MK revised Feb 2011 v7
Bringing knowledge to bear: MK revised Feb 2011 v7suelb
 
Bringing knowledge to bear in a primary care organisaiton Feb 2011
Bringing knowledge to bear in a primary care organisaiton Feb 2011Bringing knowledge to bear in a primary care organisaiton Feb 2011
Bringing knowledge to bear in a primary care organisaiton Feb 2011
suelb
 
Leading a library review and developing a strategic plan through evidence and...
Leading a library review and developing a strategic plan through evidence and...Leading a library review and developing a strategic plan through evidence and...
Leading a library review and developing a strategic plan through evidence and...
Anne Murphy
 
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
GuíaSalud
 
Elective Care Conference: keynote speech from Adam Sewell-Jones
Elective Care Conference: keynote speech from Adam Sewell-JonesElective Care Conference: keynote speech from Adam Sewell-Jones
Elective Care Conference: keynote speech from Adam Sewell-Jones
NHS Improvement
 
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
Julie Cooper
 
Evidence to Care: Mobilizing Childhood Disability Research into Practice
Evidence to Care: Mobilizing Childhood Disability Research into PracticeEvidence to Care: Mobilizing Childhood Disability Research into Practice
Evidence to Care: Mobilizing Childhood Disability Research into Practice
Institute for Knowledge Mobilization
 
EMRAN Launch Event February 2015
EMRAN Launch Event February 2015EMRAN Launch Event February 2015
EMRAN Launch Event February 2015
CCraig138
 
SJA Mencap
SJA MencapSJA Mencap
SJA MencapCSV_UK
 
A4 - Community Practice
A4 - Community PracticeA4 - Community Practice
A4 - Community Practice
HospiceNZConference
 
PEN Awards Webinar series 2 of 6
PEN Awards Webinar series 2 of 6PEN Awards Webinar series 2 of 6
PEN Awards Webinar series 2 of 6
NHS Improving Quality
 
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slidesAHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
NEQOS
 
Towards informed and innovative commissioning, Workshop for LKS October 2013
Towards informed and innovative commissioning, Workshop for LKS October 2013Towards informed and innovative commissioning, Workshop for LKS October 2013
Towards informed and innovative commissioning, Workshop for LKS October 2013
suelb
 
Strategy For Evidence Based Health Services
Strategy For Evidence Based Health ServicesStrategy For Evidence Based Health Services
Strategy For Evidence Based Health ServicesØystein Eiring
 
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
Kim Mears
 
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Philip Wainwright
 
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
NHS Improving Quality
 
Sharing and Learning Together to Deliver High Quality End of Life Care for All
Sharing and Learning Together to Deliver High Quality End of Life Care for AllSharing and Learning Together to Deliver High Quality End of Life Care for All
Sharing and Learning Together to Deliver High Quality End of Life Care for All
NHS Improving Quality
 
North West London Research Symposium for health professions 2015
North West London Research Symposium for health professions 2015North West London Research Symposium for health professions 2015
North West London Research Symposium for health professions 2015
Professor Priscilla Harries
 
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
Julie Cooper
 

Similar to Evidence based commissioning - now and moving forward (20)

Bringing knowledge to bear: MK revised Feb 2011 v7
Bringing knowledge to bear: MK revised Feb 2011 v7Bringing knowledge to bear: MK revised Feb 2011 v7
Bringing knowledge to bear: MK revised Feb 2011 v7
 
Bringing knowledge to bear in a primary care organisaiton Feb 2011
Bringing knowledge to bear in a primary care organisaiton Feb 2011Bringing knowledge to bear in a primary care organisaiton Feb 2011
Bringing knowledge to bear in a primary care organisaiton Feb 2011
 
Leading a library review and developing a strategic plan through evidence and...
Leading a library review and developing a strategic plan through evidence and...Leading a library review and developing a strategic plan through evidence and...
Leading a library review and developing a strategic plan through evidence and...
 
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
IMPLEMENTACIÓN DE GUÍAS DE PRÁCTICA CLÍNICA. LA EXPERIENCIA DEL NICE (Reino U...
 
Elective Care Conference: keynote speech from Adam Sewell-Jones
Elective Care Conference: keynote speech from Adam Sewell-JonesElective Care Conference: keynote speech from Adam Sewell-Jones
Elective Care Conference: keynote speech from Adam Sewell-Jones
 
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
 
Evidence to Care: Mobilizing Childhood Disability Research into Practice
Evidence to Care: Mobilizing Childhood Disability Research into PracticeEvidence to Care: Mobilizing Childhood Disability Research into Practice
Evidence to Care: Mobilizing Childhood Disability Research into Practice
 
EMRAN Launch Event February 2015
EMRAN Launch Event February 2015EMRAN Launch Event February 2015
EMRAN Launch Event February 2015
 
SJA Mencap
SJA MencapSJA Mencap
SJA Mencap
 
A4 - Community Practice
A4 - Community PracticeA4 - Community Practice
A4 - Community Practice
 
PEN Awards Webinar series 2 of 6
PEN Awards Webinar series 2 of 6PEN Awards Webinar series 2 of 6
PEN Awards Webinar series 2 of 6
 
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slidesAHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
AHSN NENC Stakeholder Engagement Event, 11th February 2014: Presentation slides
 
Towards informed and innovative commissioning, Workshop for LKS October 2013
Towards informed and innovative commissioning, Workshop for LKS October 2013Towards informed and innovative commissioning, Workshop for LKS October 2013
Towards informed and innovative commissioning, Workshop for LKS October 2013
 
Strategy For Evidence Based Health Services
Strategy For Evidence Based Health ServicesStrategy For Evidence Based Health Services
Strategy For Evidence Based Health Services
 
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
The Many Faces of Embedded Librarianship: How do we Evaluate Effectiveness?
 
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
 
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
Long Term Conditions Year of Care Commissioning Programme - Early Implementer...
 
Sharing and Learning Together to Deliver High Quality End of Life Care for All
Sharing and Learning Together to Deliver High Quality End of Life Care for AllSharing and Learning Together to Deliver High Quality End of Life Care for All
Sharing and Learning Together to Deliver High Quality End of Life Care for All
 
North West London Research Symposium for health professions 2015
North West London Research Symposium for health professions 2015North West London Research Symposium for health professions 2015
North West London Research Symposium for health professions 2015
 
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
iHV regional conference: Josephine Johnson - Health Visitors as leaders in th...
 

Recently uploaded

Antibiotic Stewardship by Anushri Srivastava.pptx
Antibiotic Stewardship by Anushri Srivastava.pptxAntibiotic Stewardship by Anushri Srivastava.pptx
Antibiotic Stewardship by Anushri Srivastava.pptx
AnushriSrivastav
 
ABDOMINAL COMPARTMENT SYSNDROME
ABDOMINAL COMPARTMENT SYSNDROMEABDOMINAL COMPARTMENT SYSNDROME
ABDOMINAL COMPARTMENT SYSNDROME
Rommel Luis III Israel
 
CANCER CANCER CANCER CANCER CANCER CANCER
CANCER  CANCER  CANCER  CANCER  CANCER CANCERCANCER  CANCER  CANCER  CANCER  CANCER CANCER
CANCER CANCER CANCER CANCER CANCER CANCER
KRISTELLEGAMBOA2
 
the IUA Administrative Board and General Assembly meeting
the IUA Administrative Board and General Assembly meetingthe IUA Administrative Board and General Assembly meeting
the IUA Administrative Board and General Assembly meeting
ssuser787e5c1
 
10 Ideas for Enhancing Your Meeting Experience
10 Ideas for Enhancing Your Meeting Experience10 Ideas for Enhancing Your Meeting Experience
10 Ideas for Enhancing Your Meeting Experience
ranishasharma67
 
Empowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
Empowering ACOs: Leveraging Quality Management Tools for MIPS and BeyondEmpowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
Empowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
Health Catalyst
 
Artificial Intelligence to Optimize Cardiovascular Therapy
Artificial Intelligence to Optimize Cardiovascular TherapyArtificial Intelligence to Optimize Cardiovascular Therapy
Artificial Intelligence to Optimize Cardiovascular Therapy
Iris Thiele Isip-Tan
 
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdfCHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
Sachin Sharma
 
Nursing Care of Client With Acute And Chronic Renal Failure.ppt
Nursing Care of Client With Acute And Chronic Renal Failure.pptNursing Care of Client With Acute And Chronic Renal Failure.ppt
Nursing Care of Client With Acute And Chronic Renal Failure.ppt
Rommel Luis III Israel
 
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
ranishasharma67
 
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
o6ov5dqmf
 
Navigating Women's Health: Understanding Prenatal Care and Beyond
Navigating Women's Health: Understanding Prenatal Care and BeyondNavigating Women's Health: Understanding Prenatal Care and Beyond
Navigating Women's Health: Understanding Prenatal Care and Beyond
Aboud Health Group
 
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
Dr. David Greene Arizona
 
ventilator, child on ventilator, newborn
ventilator, child on ventilator, newbornventilator, child on ventilator, newborn
ventilator, child on ventilator, newborn
Pooja Rani
 
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
ranishasharma67
 
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdfDemystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
SasikiranMarri
 
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptxR3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
R3 Stem Cell
 
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICEJaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
ranishasharma67
 
Navigating Healthcare with Telemedicine
Navigating Healthcare with  TelemedicineNavigating Healthcare with  Telemedicine
Navigating Healthcare with Telemedicine
Iris Thiele Isip-Tan
 
Myopia Management & Control Strategies.pptx
Myopia Management & Control Strategies.pptxMyopia Management & Control Strategies.pptx
Myopia Management & Control Strategies.pptx
RitonDeb1
 

Recently uploaded (20)

Antibiotic Stewardship by Anushri Srivastava.pptx
Antibiotic Stewardship by Anushri Srivastava.pptxAntibiotic Stewardship by Anushri Srivastava.pptx
Antibiotic Stewardship by Anushri Srivastava.pptx
 
ABDOMINAL COMPARTMENT SYSNDROME
ABDOMINAL COMPARTMENT SYSNDROMEABDOMINAL COMPARTMENT SYSNDROME
ABDOMINAL COMPARTMENT SYSNDROME
 
CANCER CANCER CANCER CANCER CANCER CANCER
CANCER  CANCER  CANCER  CANCER  CANCER CANCERCANCER  CANCER  CANCER  CANCER  CANCER CANCER
CANCER CANCER CANCER CANCER CANCER CANCER
 
the IUA Administrative Board and General Assembly meeting
the IUA Administrative Board and General Assembly meetingthe IUA Administrative Board and General Assembly meeting
the IUA Administrative Board and General Assembly meeting
 
10 Ideas for Enhancing Your Meeting Experience
10 Ideas for Enhancing Your Meeting Experience10 Ideas for Enhancing Your Meeting Experience
10 Ideas for Enhancing Your Meeting Experience
 
Empowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
Empowering ACOs: Leveraging Quality Management Tools for MIPS and BeyondEmpowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
Empowering ACOs: Leveraging Quality Management Tools for MIPS and Beyond
 
Artificial Intelligence to Optimize Cardiovascular Therapy
Artificial Intelligence to Optimize Cardiovascular TherapyArtificial Intelligence to Optimize Cardiovascular Therapy
Artificial Intelligence to Optimize Cardiovascular Therapy
 
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdfCHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdf
 
Nursing Care of Client With Acute And Chronic Renal Failure.ppt
Nursing Care of Client With Acute And Chronic Renal Failure.pptNursing Care of Client With Acute And Chronic Renal Failure.ppt
Nursing Care of Client With Acute And Chronic Renal Failure.ppt
 
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
Haridwar ❤CALL Girls 🔝 89011★83002 🔝 ❤ℂall Girls IN Haridwar ESCORT SERVICE❤
 
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
一比一原版纽约大学毕业证(NYU毕业证)成绩单留信认证
 
Navigating Women's Health: Understanding Prenatal Care and Beyond
Navigating Women's Health: Understanding Prenatal Care and BeyondNavigating Women's Health: Understanding Prenatal Care and Beyond
Navigating Women's Health: Understanding Prenatal Care and Beyond
 
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
Leading the Way in Nephrology: Dr. David Greene's Work with Stem Cells for Ki...
 
ventilator, child on ventilator, newborn
ventilator, child on ventilator, newbornventilator, child on ventilator, newborn
ventilator, child on ventilator, newborn
 
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
💘Ludhiana ℂall Girls 📞]][89011★83002][[ 📱 ❤ESCORTS service in Ludhiana💃💦Ludhi...
 
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdfDemystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
Demystifying-Gene-Editing-The-Promise-and-Peril-of-CRISPR.pdf
 
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptxR3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
R3 Stem Cells and Kidney Repair A New Horizon in Nephrology.pptx
 
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICEJaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
Jaipur ❤cALL gIRLS 89O1183002 ❤ℂall Girls IN JaiPuR ESCORT SERVICE
 
Navigating Healthcare with Telemedicine
Navigating Healthcare with  TelemedicineNavigating Healthcare with  Telemedicine
Navigating Healthcare with Telemedicine
 
Myopia Management & Control Strategies.pptx
Myopia Management & Control Strategies.pptxMyopia Management & Control Strategies.pptx
Myopia Management & Control Strategies.pptx
 

Evidence based commissioning - now and moving forward

  • 1. Evidence based commissioning - now and moving forward Anne Gray, Knowledge Officer, Arden & GEM CSU HLG Conference September 2016
  • 2. What is commissioning? • Commissioning is the process of procuring health services. • It is a complex process, involving the assessment and understanding of a population’s health needs, the planning of services to meet those needs and securing services on a limited budget, then monitoring the services procured. [Faculty of Medical Leadership and Management, 2012]
  • 3. A “plurality” of sources [Swan 2012]
  • 4. Analysis of items in 4 Knowledge@lerts July 2016 • 20 - “expert” groups (Kings Fund, Nuffield Trust, Health Foundation, NIHR) • 13 - NHS England/DH/PHE • 10 – clinical peer groups (Royal Colleges, Diabetes UK etc) • 6 – Guidelines/standards (NICE,CQC,NHS Improvement) • 5 – Local Government Association • 3 - case studies (CCG board papers, magazines) • 1 – peer reviewed journal
  • 5. Looking for the evidence What the research says: • Commissioners look for themselves or rely on colleagues • Email discussion lists & alerts • NHS sources are constantly changing and confusing • Difficult to find commissioning/ management evidence • Don’t ask the library unless they have had previous contact • Library staff also found it difficult [Edwards 2013, Wye 2015]
  • 6. [Wye et al. 2015, Wilson 2016] Using the evidence
  • 7. A Commissioning Librarian • Service model to help my customer • Searching skills to identify the plurality of evidence • Report formats to meet the business need
  • 8. Lessons learnt – Know your customer • What is business critical? • Understand national and local drivers • Speak the language • Tailored service Rather than merely searching for relevant articles, Anne reflected on the problem areas, searched for evidence of a range of successful interventions achieved elsewhere and provided a new measurable solutions for the CCG to adopt. This saved me time and added real value and a new angle of approach. CCG Director
  • 9. Lessons learnt – Searching Health Serv Deliv Res
  • 10. Lessons learnt – Synthesis&Summary • “Highlights …with an overview but also a link so I can go into more depth if interested • For busy people, as we all are, the snippets are great as you don’t have to wade through a whole load of words to understand what the info is about • Having everything in one email instead of having to remember where I saw this that and the other!!!” [Ass Dir CCG]
  • 11. Resources to build on • Alerting services (CASH, Kings Fund) • Evidence Works Toolkit (Avon Primary Care Research Collaborative) • Commissioning Handbook for Librarians • Mailing lists • Embedded librarians / knowledge services
  • 12. Skills to build on • Graduate Evidence Assistant pilot (Avon Primary Care Research Collaborative) • Knowledge for Healthcare – Synthesis techniques – Evidence for managers/commissioners training • Communities of practice across NHS knowledge staff
  • 13. Moving forward • What can your library build on? • How can you work with other libraries? • What can you do next week?
  • 14. Bibliography 1/2 • Faculty of Medical Leadership and Management, 2012 http://www.nhs.uk/NHSEngland/thenhs/about/Documents/Commissi oning-FINAL-2015.pdf • Epilepsy Commissioning Toolkit http://www.epilepsytoolkit.org.uk/ • Swann J et al Evidence in Management Decisions (EMD) NIHR Health Services and Delivery Research programme; 2012. http://www2.warwick.ac.uk/fac/soc/wbs/projects/emd • Wye et al. BMC Health Services Research (2015) 15:430 http://www.biomedcentral.com/1472-6963/15/430 • Wilson PM, Effects of a demand led knowledge translation service on the uptake and use of research evidence by NHS commissioners compared with lower intensity untargeted alternatives. HS&DR - 12/5002/18 http://www.nets.nihr.ac.uk/projects/hsdr/12500218
  • 15. Bibliography 2/2 • Edwards et al Explaining Health Managers’ Information Seeking Behaviour and Use. Final report. NIHR Service Delivery and Organisation programme; 2013) http://www.nets.nihr.ac.uk/projects/hsdr/081808243 • CASH portal http://www.netvibes.com/keeping-up-to-date#Home • Evidence Works (Avon Primary Care Research Collaborative) (Avon Primary Care Research Collaborative, AHSN, NIHR CLAHRC West http://www.nhsevidencetoolkit.net/ • Commissioning Handbook for Librarians (NHS Librarians) http://commissioning.libraryservices.nhs.uk/ • KfH Learning Zone http://kfh.libraryservices.nhs.uk/learning- zone/specialist-and-technical-skills/

Editor's Notes

  1. My experience supporting day to day activity in a PCT/CCG But this should be useful to librarians from across the NHS especially in the light of current government policies such as Sustainability & Transformation Plans (STPs) and the Carter review which affect every NHS trust. Managers across the NHS will be looking for evidence to support transition, not just commissioners.
  2. As EPB is about ensuring the best practice for individual patients, Evidence based commissioning is about doing the best for the whole population, taking into account local and national context, public and patient opinions, demography and of course money. So if we think about the environment commissioners (and trust managers) are working in, health services are a business with business pressures, and activity targets and financial targets. They have political constraints as well as workforce and demographic issues. Commissioners are constantly in meetings, reading and writing reports with tight schedules, CCGs have many legal obligations around managing their business as well as issues relating to wider services, and shifting political goal posts.
  3. A study by Swann surveyed 345 individuals across 11 PCTs in 2010. - Demonstrated a plurality of evidence Clinical evidence we would all recognize, guidelines, clinical research, Royal Colleges, professional peer groups. Non clinical evidence – supporting evidence in terms of policies, toolkits, intelligence , benchmarking. Implementation Narrative resources –Include opinions, advice, stories, case studies. While clinical research usually aims to eliminate confounders and variables, these variables of setting are critical to understanding the workings of health services across different geographies. For example service availability, distances, workforce, and demography. You rarely get this level of detail when people describe services in research. Therefore case studies or talking to people may be the best way to understand the “evidence” behind a service.
  4. I looked at my weekly alerting bulletins for commissioners and CCGs over July. These do not include items on clinical practice, but service delivery. Out of 58 items non clinical “expert” groups comprise nearly a third, many of which will include case studies. The significance of much of this evidence is determined by who wrote it. Definitely not resources you find through an HDAS search alone.
  5. Clearly commissioners rely heavily on colleagues and personal experience. Informal sharing is an important part of the commissioning process. Mailing lists / alerts – keeping ahead of the curve/horizon scanning are important They look for the evidence themselves and that means google and all of its pitfalls, but judicious use of google is a good way to get some of the evidence they need. The research into info seeking behaviour always highlights how difficult it is to find the evidence. It is not conveniently placed or organised. NHS sources are constantly changing – think of NeLH, Specialist Collections, NHS Improvement (the old one), NHS III and the DH website itself. The exception is public health trained staff who have had training in finding and appraising evidence. But since the HSC Act and their move to LA they are one step removed from the informal commissioning discussions. Commissioners don’t think to ask libraries for this type of evidence, unless they have had previous contact with the library – a training course, induction etc. Finally- librarians too find it difficult to locate evidence for commissioners and managers.
  6. It is interesting to look at how evidence is used during the commissioning process. The epilepsy commissioning cycle I showed you earlier made the process moving evidence through the commissioning pipeline look smooth and unaffected by organisational processes. But, the reality is different. Evidence is constantly modified, added, discarded and reshaped throughout the commissioning process. The lack of evidence can lead to lengthy discussions do not lead to consensus and delays. Research shows that evidence is both gathered and used in a non systematic way throughout commissioning. All of this research matches my experience on the ground So how can librarians help?
  7. Over my time supporting commissioners I worked to develop: Develop a service model tailored to this customer base understand their information needs to provide the evidence is the most appropriate way. Some of the lessons I learnt:
  8. Find out what is business critical to my commissioners. Specific issues eg A&E, services under development, QIPP plans CQUINs, co-commissioning, NHS Improvement, Keogh, vanguards, PACS, MDT, Five year forward View, STP, Carter So if you are asked you understand the issues and ask sensible questions and tailor your services
  9. How are you going to find this evidence? HSJ (no print after next year). The key news resource Most commissioners/managers will get the daily news alerts. Their comms people should be keeping them abreast of the news and media stuff. Dig down to find the documents behind the story eg CCG board paper, report etc. Also helps up keep up to date with what is going on National policies -NHS E/ CQC /PHE/ NHS Improvement Expert bodies eg KF, Nuffield, Royal Colleges etc. Magazines/board papers – to find case studies Google – a key resource to dig into board papers and reports, much better than search engines on websites. Become a google expert. A real mixture of resources which you should not try to scan yourself. Use existing RSS feeds or alerting services eg NHS England has a number of different bulletins, Kings Fund Health Management & Policy Alert is a key resource both for their own and other resources. But sometimes it is useful to know if a page is updated, rather than an RSS feed, I use Watch That page where you are alerting if a particular page changes.
  10. Research says that for day to day business they want business style reports. And preferably before they know they need it. Commissioners want evidence presented in such a way that they can pick up the key points at a glance, can read a little more if it is interesting then look further using any links they are given. Look at Kings Fund reports – headlines in the form of bullet points, an executive summary and then the full report with references. The style I developed was very much in this pattern, both for research reports and alerting services. In CAS I aim for a title, author, date and three lines max (in which I make it clear why I have included the item) and a link. The research reports I produce usually took between 3 and 8 hours, so quite short. Clarify the topic, note exclusions and sources checked. Bring related material together (could be different reports, a website and case study) and highlight what makes the item relevant. I often include extracts from the reports themselves. That means you have to read the resources but commissioner may not. Organise the material in a logical way (theme, format, data) geographically or by topic. But it is important that it can be skimmed quickly. Include how long it has taken to prepare.
  11. Alerting services – really important to commissioners. Available to commissioners/manager and library staff. A quick win if you get it on target. Tell your contacts about alerts you think are relevant to them eg Kings Fund Health Management Alert, KF Integrated Care Bulletin. Sign up yourself. Don’t duplicate this scanning work. Current Alerting Service for Health (CASH) site under Health Functions & Management. Evidence Works Toolkit (Avon Primary Care Research Collaborative) - a guide to finding, appraising and applying the evidence aimed at commissioners across the West of England. A sister website on evaluations. Includes links to local NHS librarians. Commissioning Handbook - A resource specially for NHS Library Knowledge and Information staff to help you support commissioners more effectively. Brings together useful resources about the NHS, commissioning process and relating to specific diseases, populations and services. Includes searching advice and hot topics. Mailing lists – Commissioning list, LIS Medical Embedded librarians / Library services – need to be protected because experience is vital.
  12. Talking of skills Graduate evidence analyst pilot evaluation - the Assistant comments on the range of practical skills she had gained since taking on the role as well as knowledge of public health, epidemiology, evidence-based healthcare, local authority structure, local and national NHS and public health structure. This role encouraged evidence based commissioning and gave commissioners confidence in evidence questioning and gathering skills. KfH opportunities Don’t forget that there are knowledge staff sitting outside NHS library services.
  13. Bearing in mind the developments which are coming as a result of STPs and the new standards as result of Carter review on procurement librarians have a lot to offer to help managers by bringing together the important stuff they need to do their job. Every trust will be involved in these discussions, and every nHS library could be supporting the development of the new services. Build on existing relationships, knowledge, resources Work with other libraries – eg across your STP footprint, region Start asap, STP plan are due go out to consultation at end of October, we should be ready to answer the questions as they arise.