My presentation from the Health Libraries Group 2016 conference #hlg2016. Examines range of publications around impact measures and quality assurance mostly from within libraries and higher education. Uses these to establish a set of four over arching principles for considering metrics - Meaningful, Actionable, Reproducible and Comparable. Discusses these with a worked example using a metrics creation / recording template.
Slides for my presentation at the #NHSHE2016 conference. Looks at a more visual style to replace the required annual report for NHS libraries. The points are more widely applicable - it is about providing something meaningful to your audience. More about the why and visually appealing.
From annual report bore chore to action and engagementAlan Fricker
Objective: Annual reports are a required element for most Library Services yet these documents are
frequently uninspiring and largely unread. Why not maximise them as an opportunity for engagement?
Methods / Description: This presentation will discuss how we drew on the model of departmental action
plans used by some academic libraries to create a more engaging annual report for our work with
hospital Trusts.
We will consider the core elements that have proved useful along with some of the difficulties
encountered in pulling it together.
We will explore how the selection of content is underpinned by the principles for good metrics
developed for the NHS in England.
Results: Drawing on three years of experience we will consider the difference that the use of this format
has made locally. The more engaging style has prompted interest from other libraries and we will look at
how it has been received elsewhere.
Presentation to the 2017 European Association for Health Information and Libraries Conference Dublin. An update on work of the Health Education England group working on improving the use of metrics by helping people define better metrics and then put them to use
How can we use metrics to better monitor, develop and discuss our services? Building on past experience in NHS Libraries and the wider sector a set of principles for good metrics are described. These are illustrated using data generated by running. The quality metric template is introduced as a tool to help the definition and sharing of metrics.
Considering metrics for NHS Library ServicesAlan Fricker
The document discusses metrics that are used to measure the performance of NHS library services. A survey was conducted to understand the types of metrics currently in use. The most commonly reported metrics involved usage data for resources like e-journals and databases, as well as turnaround times for document delivery and literature searches. Cost per download was also widely cited as it can be used to inform decision making and demonstrate value. The variety of metrics indicated that services are looking for ways to show their impact, satisfy stakeholders, and gain insights into user behavior.
1) The document summarizes a presentation given by Debra Thornton, the Library & Knowledge Services Manager at Blackpool Teaching Hospitals Foundation Trust, about the clinical librarian service provided to the trust.
2) The service conducts literature searches and evidence reviews to support various departments, committees, and projects within the trust related to quality improvement, cost-savings, clinical pathways, and more.
3) Feedback provided indicates the service helps the trust make more evidence-based decisions and improve patient care and outcomes.
Changing Role of Librarian - 2013 Survey on Librarian in China, CALIS Annual ...ProQuest
A presentation by Boe Horton, Vice President, Asia Pacific at ProQuest, on the changing role of librarians in China. Presented at the 2013 CALIS Annual Meeting.
PROGRESS is a diagnostic tool that has been developed over 10 years working with 90 schools to assess a school's learning culture from the perspectives of staff, students, and parents. Several Whole Education schools have committed to trialing PROGRESS to see how it can help schools deliver a Whole Education approach. The trial will involve schools using PROGRESS Exploration freely this year and providing data that will be used to shorten the student survey. Schools in the trial will have opportunities to connect with each other and the PROGRESS team through webinars and workshops. Technical support is available through the PROGRESS website and specific contacts.
Slides for my presentation at the #NHSHE2016 conference. Looks at a more visual style to replace the required annual report for NHS libraries. The points are more widely applicable - it is about providing something meaningful to your audience. More about the why and visually appealing.
From annual report bore chore to action and engagementAlan Fricker
Objective: Annual reports are a required element for most Library Services yet these documents are
frequently uninspiring and largely unread. Why not maximise them as an opportunity for engagement?
Methods / Description: This presentation will discuss how we drew on the model of departmental action
plans used by some academic libraries to create a more engaging annual report for our work with
hospital Trusts.
We will consider the core elements that have proved useful along with some of the difficulties
encountered in pulling it together.
We will explore how the selection of content is underpinned by the principles for good metrics
developed for the NHS in England.
Results: Drawing on three years of experience we will consider the difference that the use of this format
has made locally. The more engaging style has prompted interest from other libraries and we will look at
how it has been received elsewhere.
Presentation to the 2017 European Association for Health Information and Libraries Conference Dublin. An update on work of the Health Education England group working on improving the use of metrics by helping people define better metrics and then put them to use
How can we use metrics to better monitor, develop and discuss our services? Building on past experience in NHS Libraries and the wider sector a set of principles for good metrics are described. These are illustrated using data generated by running. The quality metric template is introduced as a tool to help the definition and sharing of metrics.
Considering metrics for NHS Library ServicesAlan Fricker
The document discusses metrics that are used to measure the performance of NHS library services. A survey was conducted to understand the types of metrics currently in use. The most commonly reported metrics involved usage data for resources like e-journals and databases, as well as turnaround times for document delivery and literature searches. Cost per download was also widely cited as it can be used to inform decision making and demonstrate value. The variety of metrics indicated that services are looking for ways to show their impact, satisfy stakeholders, and gain insights into user behavior.
1) The document summarizes a presentation given by Debra Thornton, the Library & Knowledge Services Manager at Blackpool Teaching Hospitals Foundation Trust, about the clinical librarian service provided to the trust.
2) The service conducts literature searches and evidence reviews to support various departments, committees, and projects within the trust related to quality improvement, cost-savings, clinical pathways, and more.
3) Feedback provided indicates the service helps the trust make more evidence-based decisions and improve patient care and outcomes.
Changing Role of Librarian - 2013 Survey on Librarian in China, CALIS Annual ...ProQuest
A presentation by Boe Horton, Vice President, Asia Pacific at ProQuest, on the changing role of librarians in China. Presented at the 2013 CALIS Annual Meeting.
PROGRESS is a diagnostic tool that has been developed over 10 years working with 90 schools to assess a school's learning culture from the perspectives of staff, students, and parents. Several Whole Education schools have committed to trialing PROGRESS to see how it can help schools deliver a Whole Education approach. The trial will involve schools using PROGRESS Exploration freely this year and providing data that will be used to shorten the student survey. Schools in the trial will have opportunities to connect with each other and the PROGRESS team through webinars and workshops. Technical support is available through the PROGRESS website and specific contacts.
This document provides guidance on using data visualization to effectively communicate information through presentations and reports. It discusses choosing the appropriate chart type based on the data, including pie charts for comparing parts of a whole, line charts for comparing changes over time, and maps for geographic data. Basic rules for making clear and informative charts are outlined, such as checking the data, including labels and sources. Tools for creating different chart types are presented, like Juicy Labs' Chart Chooser and Google Sheets. Guidance is also provided on creating word clouds and data maps, with examples like Tagul and Google Fusion Tables. The document concludes with recommendations on selecting informative color schemes and additional readings on data visualization.
This document discusses approaches to measuring social impact. It outlines the differences between metrics, analytics, and big data, as well as transactions, interactions, and social impact. It then describes the social impact creation cycle and challenges to measuring social impact. The document recommends a comprehensive approach that uses metrics, analytics, and strategic planning to identify clear goals and assess high-value initiatives. It emphasizes measuring success in increasing social impact as the ultimate goal.
Creating a Print-on-Demand Initiative for Open Educational ResourcesJeremy Anderson
Presentation delivered at the Northeast OER Summit on the work of Bay Path University to generate a print option for digital open educational resources in service of a diverse student population.
In 2018, the SciELO Program will celebrate 20 years of operation, in full alignment with the advances of open science.
The SciELO 20 Years Conference will address and debate – during its three-day program – the main political, methodological and technological issues that define today’s state of the art in scholarly communication and the trends and innovations that is shaping the future of the universal openness of scholarly publishing and its relationship with today’s Open Access journals, in particular those of the SciELO Network.
The program of the conference is organized around the alignment of SciELO journals and operations with the best practices on communication of open science, such as publishing research data, expediting editorial processes and communication through the continuous publication of articles and the adoption of preprints, maximizing the transparency of research evaluation and the flow of scholarly communication, and searching for more comprehensive systems for assessing research, articles and journals.
A two-day meeting of the coordinators of the national collections of the SciELO Network will take place prior to the Conference with focus on the evaluation of SciELO journals and the SciELO Program and their improvement following the lines of action that will guide their development in the forthcoming five years.
The celebration of SciELO’s 20-year anniversary constitutes an important landmark in SciELO’s evolution, and an exceptional moment to promote the advancement of an inclusive, global approach to scholarly communication and to the open access movement while respecting the diversities of thematic and geographic areas, as well as of languages of scientific research.
Sju ifla presentation patron driven acquisitions of e-journal articles-1mamboxena
The document discusses the use of patron-driven acquisitions (PDA) of ejournal articles as an alternative to large "Big Deal" subscription packages. It describes how St. John's University Libraries in New York implemented a PDA program through Wiley-Blackwell, purchasing article tokens to provide access to a wider range of journals. An analysis found that 50% of accessed articles were from non-subscribed journals, demonstrating PDA increased access while saving 40% of costs compared to the previous Big Deal subscription. The document also discusses challenges encountered and opportunities for improvements in PDA programs.
This document discusses outcome-based evaluation and provides examples from Vancouver Public Library programs. Outcome-based evaluation assesses the effectiveness of programs by tracking qualitative and quantitative changes in the community. It is most useful for evaluating a program's goals, effectiveness, and impact. The document summarizes evaluations of the Alligator Pie early literacy program, Aboriginal Storyteller in Residence program, and Vancouver Inspiration Pass program. Evaluations found that Alligator Pie and the Storyteller increased literacy and social skills, while the Pass increased cultural participation and community connectedness especially for low-income residents. The toolkit for outcome-based evaluation is available online.
Talis Insight Asia-Pacific 2018 - Craig Milne and Kelly Johson, Griffith Univ...Talis
This document discusses Griffith University's use of reading list data from their Talis platform to improve management of electronic resources and drive cultural changes. Key points:
- Griffith implemented trimesters in 2017, complicating management of reading lists across multiple time periods.
- Their Talis platform rolls over reading lists each trimester but they clean, analyze, and transform the data using Excel and Tableau to calculate metrics like the percentage of required readings available online.
- This has helped them target conversion of print to electronic resources, identify issues if databases were cancelled, and get a better understanding of resource use to influence selection practices.
- Future goals include providing dashboard access to the data, analyzing usage at the school
Determining and demonstrating value rebecca jones and moe hosseiniStephen Abram
The document discusses using a logic model framework to demonstrate value and measure impact. It provides an example of a job skills training program logic model with inputs, outputs, outcomes and impacts defined. It also shares an example logic model for a public library program encouraging girls to pursue STEM careers which outlines short, mid and long term impacts. The document emphasizes starting with the end in mind and understanding stakeholders when developing logic models and measuring value.
The document discusses metrics for measuring learning objects and repositories. It examines metrics like the size and growth of repositories, distribution of objects and contributors, and reuse of learning objects. The document proposes that studying empirical patterns in learning object data can help understand influence and impact, and defines this field of research as 'Learnometrics'.
Sju ifla presentation patron driven acquisitions of e-journal articles-1mamboxena
The document discusses St. John's University Libraries' experience unbundling from a large "Big Deal" journal package with Wiley-Blackwell and implementing a patron-driven acquisitions (PDA) model using article tokens. Key points:
1) "Big Deals" were taking up a large portion of the serials budget with many seldom-used titles. PDA allowed access to a wider range of articles while saving 40% of costs.
2) A pilot with 1,000 article tokens from Wiley found they were all used within a month, with 50% from non-subscribed titles.
3) Issues included a lack of perpetual access, usability problems with the interface,
NComapss Live - July 17, 2019
http://nlc.nebraska.gov/NCompassLive/
Join us to learn about the new Project Outcome for Academic Libraries surveys and resources. Project Outcome is a free toolkit that helps libraries measure four key learning outcomes – knowledge, confidence, application, and awareness – across seven library program and service areas.
Presenter: Sara S. Goek, Program Manager, Association of College & Research Libraries
This document discusses innovation in livestock systems to enhance the livelihoods of livestock-dependent poor people. It defines innovation and how ILRI adds value through projects that situate work in broader contexts. It examines changing livestock systems and challenges, the need for enhanced ability to innovate through knowledge use, and characterization of livestock innovation contexts. The document also discusses policy, institutional environments, actors and arrangements that drive innovation, as well as principles, partnerships, management, communication, sustainability, intensification challenges, and ILRI's current portfolio and outcomes.
In November 2013, UKSG published a UKSG and Jisc-funded research project “Impact of Library Discovery Technology” that evaluates the impact of library discovery technologies, specifically Resources Discovery Systems, on the usage of academic content. The report provides a wealth of useful information and a practical set of recommendations for actions that libraries, publishers and others in the academic information supply chain should take to engage with such technologies to best support the discovery of resources for teaching, learning and research.
Valérie Spezi discussed the key findings of the report and the implications of these findings for librarians, publishers and content providers, RDS suppliers and other national and international organisations with an interest in the information chain.
How can a health trust foster evidence-baced practice? The presentation gives an overview on how a norwegian health trust, in a region with 400 000 inhabitants, systematically works to get new knowledge into practice.
The document summarizes the results of a survey on liaison responsibilities in collection management. It found that liaison work is performed throughout libraries by staff in different departments. Respondents indicated they would like more training opportunities, as there is no clear standard for liaison responsibilities. The document provides practical advice for liaison work, such as building relationships, being open-minded, and utilizing multiple communication avenues. It also outlines what faculty want from librarians, such as clear communication and subject expertise.
Ontology-Based Quality Evaluation of VGHs for Data AnonymizationVanessa Ayala-Rivera
This document summarizes a research paper on evaluating the quality of value generalization hierarchies (VGHs) used for data anonymization. The researchers propose a new method that uses ontologies and semantic similarity metrics to calculate a Generalization Semantic Loss score for VGHs. This score quantifies how much semantic information is lost during data generalization using a particular VGH. Lower scores indicate higher quality VGHs that better preserve data semantics. The researchers empirically evaluate this approach on different VGHs and find it helps identify those that retain more meaningful and accurate results after anonymization.
Simtegr8 presentation patient workshops night nursingMarianne Bamkin
This document outlines a simulation project called SIMTEGR8 to evaluate ways to reduce emergency admissions to hospitals. The project received £100k in funding and aims to develop a computer simulation of the current patient pathway, evaluate how admissions can be reduced through new interventions, and improve the patient experience. A workshop will bring together users to discuss the patient journey, potential changes needed, and effectiveness of current resources through group discussions and feedback. Patient satisfaction will also be measured based on quality, speed, dependability and flexibility of care.
Results from Digital Curation Centre's 2015 survey of UK universities and Higher Education Institutions on development of RDM (research data management) support services
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)Anna Perricci
How do you get 40 diverse libraries to agree on a model for shared print retention in 8 weeks? This lively overview demonstrates the process of forming and refining such a model for retention of monographs, using collection analysis and visualization software (GreenGlass). The Eastern Academic Scholars' Trust (EAST) is a partnership of 48 academic libraries, 40 of which are committing to retain titles on behalf of all EAST members for a minimum of 15 years. EAST seeks to maintain access to the scholarly record through sustained cooperation between partner libraries.
Hear how the project team worked with partner libraries, the vendor for collection analysis software (Sustainable Collection Services), working group members and EAST governance to refine and adopt a model for retaining over 6 million scholarly monographs. The key elements of the final model are covered as well major lessons learned.
The document summarizes an independent review of the role of metrics in research assessment and management in the UK. It provides an overview of the review's approach, including gathering evidence through a literature review, public call for evidence, and stakeholder workshops. Preliminary findings indicate metrics can potentially enhance peer review if used responsibly and with transparency. The review will issue a final report in July with recommendations for universities, funders, and other groups on responsible use of quantitative and qualitative data in research evaluation.
The mission statement sets the direction and priority for developing and implementing the quality plan. It clearly states the nature of the organization’s commitment to quality and should then be tied to the organizational operations through programs, projects, actions and rewards/recognition.
This document provides guidance on using data visualization to effectively communicate information through presentations and reports. It discusses choosing the appropriate chart type based on the data, including pie charts for comparing parts of a whole, line charts for comparing changes over time, and maps for geographic data. Basic rules for making clear and informative charts are outlined, such as checking the data, including labels and sources. Tools for creating different chart types are presented, like Juicy Labs' Chart Chooser and Google Sheets. Guidance is also provided on creating word clouds and data maps, with examples like Tagul and Google Fusion Tables. The document concludes with recommendations on selecting informative color schemes and additional readings on data visualization.
This document discusses approaches to measuring social impact. It outlines the differences between metrics, analytics, and big data, as well as transactions, interactions, and social impact. It then describes the social impact creation cycle and challenges to measuring social impact. The document recommends a comprehensive approach that uses metrics, analytics, and strategic planning to identify clear goals and assess high-value initiatives. It emphasizes measuring success in increasing social impact as the ultimate goal.
Creating a Print-on-Demand Initiative for Open Educational ResourcesJeremy Anderson
Presentation delivered at the Northeast OER Summit on the work of Bay Path University to generate a print option for digital open educational resources in service of a diverse student population.
In 2018, the SciELO Program will celebrate 20 years of operation, in full alignment with the advances of open science.
The SciELO 20 Years Conference will address and debate – during its three-day program – the main political, methodological and technological issues that define today’s state of the art in scholarly communication and the trends and innovations that is shaping the future of the universal openness of scholarly publishing and its relationship with today’s Open Access journals, in particular those of the SciELO Network.
The program of the conference is organized around the alignment of SciELO journals and operations with the best practices on communication of open science, such as publishing research data, expediting editorial processes and communication through the continuous publication of articles and the adoption of preprints, maximizing the transparency of research evaluation and the flow of scholarly communication, and searching for more comprehensive systems for assessing research, articles and journals.
A two-day meeting of the coordinators of the national collections of the SciELO Network will take place prior to the Conference with focus on the evaluation of SciELO journals and the SciELO Program and their improvement following the lines of action that will guide their development in the forthcoming five years.
The celebration of SciELO’s 20-year anniversary constitutes an important landmark in SciELO’s evolution, and an exceptional moment to promote the advancement of an inclusive, global approach to scholarly communication and to the open access movement while respecting the diversities of thematic and geographic areas, as well as of languages of scientific research.
Sju ifla presentation patron driven acquisitions of e-journal articles-1mamboxena
The document discusses the use of patron-driven acquisitions (PDA) of ejournal articles as an alternative to large "Big Deal" subscription packages. It describes how St. John's University Libraries in New York implemented a PDA program through Wiley-Blackwell, purchasing article tokens to provide access to a wider range of journals. An analysis found that 50% of accessed articles were from non-subscribed journals, demonstrating PDA increased access while saving 40% of costs compared to the previous Big Deal subscription. The document also discusses challenges encountered and opportunities for improvements in PDA programs.
This document discusses outcome-based evaluation and provides examples from Vancouver Public Library programs. Outcome-based evaluation assesses the effectiveness of programs by tracking qualitative and quantitative changes in the community. It is most useful for evaluating a program's goals, effectiveness, and impact. The document summarizes evaluations of the Alligator Pie early literacy program, Aboriginal Storyteller in Residence program, and Vancouver Inspiration Pass program. Evaluations found that Alligator Pie and the Storyteller increased literacy and social skills, while the Pass increased cultural participation and community connectedness especially for low-income residents. The toolkit for outcome-based evaluation is available online.
Talis Insight Asia-Pacific 2018 - Craig Milne and Kelly Johson, Griffith Univ...Talis
This document discusses Griffith University's use of reading list data from their Talis platform to improve management of electronic resources and drive cultural changes. Key points:
- Griffith implemented trimesters in 2017, complicating management of reading lists across multiple time periods.
- Their Talis platform rolls over reading lists each trimester but they clean, analyze, and transform the data using Excel and Tableau to calculate metrics like the percentage of required readings available online.
- This has helped them target conversion of print to electronic resources, identify issues if databases were cancelled, and get a better understanding of resource use to influence selection practices.
- Future goals include providing dashboard access to the data, analyzing usage at the school
Determining and demonstrating value rebecca jones and moe hosseiniStephen Abram
The document discusses using a logic model framework to demonstrate value and measure impact. It provides an example of a job skills training program logic model with inputs, outputs, outcomes and impacts defined. It also shares an example logic model for a public library program encouraging girls to pursue STEM careers which outlines short, mid and long term impacts. The document emphasizes starting with the end in mind and understanding stakeholders when developing logic models and measuring value.
The document discusses metrics for measuring learning objects and repositories. It examines metrics like the size and growth of repositories, distribution of objects and contributors, and reuse of learning objects. The document proposes that studying empirical patterns in learning object data can help understand influence and impact, and defines this field of research as 'Learnometrics'.
Sju ifla presentation patron driven acquisitions of e-journal articles-1mamboxena
The document discusses St. John's University Libraries' experience unbundling from a large "Big Deal" journal package with Wiley-Blackwell and implementing a patron-driven acquisitions (PDA) model using article tokens. Key points:
1) "Big Deals" were taking up a large portion of the serials budget with many seldom-used titles. PDA allowed access to a wider range of articles while saving 40% of costs.
2) A pilot with 1,000 article tokens from Wiley found they were all used within a month, with 50% from non-subscribed titles.
3) Issues included a lack of perpetual access, usability problems with the interface,
NComapss Live - July 17, 2019
http://nlc.nebraska.gov/NCompassLive/
Join us to learn about the new Project Outcome for Academic Libraries surveys and resources. Project Outcome is a free toolkit that helps libraries measure four key learning outcomes – knowledge, confidence, application, and awareness – across seven library program and service areas.
Presenter: Sara S. Goek, Program Manager, Association of College & Research Libraries
This document discusses innovation in livestock systems to enhance the livelihoods of livestock-dependent poor people. It defines innovation and how ILRI adds value through projects that situate work in broader contexts. It examines changing livestock systems and challenges, the need for enhanced ability to innovate through knowledge use, and characterization of livestock innovation contexts. The document also discusses policy, institutional environments, actors and arrangements that drive innovation, as well as principles, partnerships, management, communication, sustainability, intensification challenges, and ILRI's current portfolio and outcomes.
In November 2013, UKSG published a UKSG and Jisc-funded research project “Impact of Library Discovery Technology” that evaluates the impact of library discovery technologies, specifically Resources Discovery Systems, on the usage of academic content. The report provides a wealth of useful information and a practical set of recommendations for actions that libraries, publishers and others in the academic information supply chain should take to engage with such technologies to best support the discovery of resources for teaching, learning and research.
Valérie Spezi discussed the key findings of the report and the implications of these findings for librarians, publishers and content providers, RDS suppliers and other national and international organisations with an interest in the information chain.
How can a health trust foster evidence-baced practice? The presentation gives an overview on how a norwegian health trust, in a region with 400 000 inhabitants, systematically works to get new knowledge into practice.
The document summarizes the results of a survey on liaison responsibilities in collection management. It found that liaison work is performed throughout libraries by staff in different departments. Respondents indicated they would like more training opportunities, as there is no clear standard for liaison responsibilities. The document provides practical advice for liaison work, such as building relationships, being open-minded, and utilizing multiple communication avenues. It also outlines what faculty want from librarians, such as clear communication and subject expertise.
Ontology-Based Quality Evaluation of VGHs for Data AnonymizationVanessa Ayala-Rivera
This document summarizes a research paper on evaluating the quality of value generalization hierarchies (VGHs) used for data anonymization. The researchers propose a new method that uses ontologies and semantic similarity metrics to calculate a Generalization Semantic Loss score for VGHs. This score quantifies how much semantic information is lost during data generalization using a particular VGH. Lower scores indicate higher quality VGHs that better preserve data semantics. The researchers empirically evaluate this approach on different VGHs and find it helps identify those that retain more meaningful and accurate results after anonymization.
Simtegr8 presentation patient workshops night nursingMarianne Bamkin
This document outlines a simulation project called SIMTEGR8 to evaluate ways to reduce emergency admissions to hospitals. The project received £100k in funding and aims to develop a computer simulation of the current patient pathway, evaluate how admissions can be reduced through new interventions, and improve the patient experience. A workshop will bring together users to discuss the patient journey, potential changes needed, and effectiveness of current resources through group discussions and feedback. Patient satisfaction will also be measured based on quality, speed, dependability and flexibility of care.
Results from Digital Curation Centre's 2015 survey of UK universities and Higher Education Institutions on development of RDM (research data management) support services
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)Anna Perricci
How do you get 40 diverse libraries to agree on a model for shared print retention in 8 weeks? This lively overview demonstrates the process of forming and refining such a model for retention of monographs, using collection analysis and visualization software (GreenGlass). The Eastern Academic Scholars' Trust (EAST) is a partnership of 48 academic libraries, 40 of which are committing to retain titles on behalf of all EAST members for a minimum of 15 years. EAST seeks to maintain access to the scholarly record through sustained cooperation between partner libraries.
Hear how the project team worked with partner libraries, the vendor for collection analysis software (Sustainable Collection Services), working group members and EAST governance to refine and adopt a model for retaining over 6 million scholarly monographs. The key elements of the final model are covered as well major lessons learned.
The document summarizes an independent review of the role of metrics in research assessment and management in the UK. It provides an overview of the review's approach, including gathering evidence through a literature review, public call for evidence, and stakeholder workshops. Preliminary findings indicate metrics can potentially enhance peer review if used responsibly and with transparency. The review will issue a final report in July with recommendations for universities, funders, and other groups on responsible use of quantitative and qualitative data in research evaluation.
The mission statement sets the direction and priority for developing and implementing the quality plan. It clearly states the nature of the organization’s commitment to quality and should then be tied to the organizational operations through programs, projects, actions and rewards/recognition.
HRCU 351 Week 6 Paper 2 EthicsGuidelines and Grading RubricPazSilviapm
HRCU 351 Week 6: Paper 2 Ethics
Guidelines and Grading Rubric
Length: 3-4 double-spaced pages (excluding title and references pages)
Due: Week 6 by Sunday Midnight
Value: 110 Points
Post: Week 6 Assignments
Prepare a 3 – 4 page (not including cover or reference pages) research-based paper that: 1) identifies two (2) recent examples of actual ethical workforce planning issues 2) details and explain the ethical issues and impact on the workplace 3) makes specific recommendations for solving/avoiding these ethical issues and 4) identifies two (2) insights gained into navigating workplace and staffing issues. Students should integrate 4 or more scholarly sources including 3 journal articles and at least one direct quote from the course textbook.
The analysis should:
· Identify two (2) recent examples of actual ethical workforce planning issues
· Detail and analyze the ethical issues and impact on the workplace
· Make specific recommendations for solving/avoiding these ethical issues
· Identify two (2) insights gained into navigating workplace and staffing issues.
· 4 or more scholarly sources including 3 journal articles.
· At least one direct quote from our course textbook.
Rubric: Evaluation Criteria
CriteriaExemplaryProficientDevelopingEmergingNo credit
Ethical Examples
20 - 23
Clearly and concisely describes 2 examples of a ethical workplace issues.
22 - 17
Fairly clearly describes 2 best practices
16 - 12
Somewhat clearly describes 1 - 2 best practices
11- 1
Limited if any description of best practices
0
Assignment, meeting grading criteria, was not submitted.
Analysis
20 - 23
Provides a thorough analysis of each ethical issue that is supported by citations of expert theories and research. Defines and uses all key terms comprehensively.
22 - 17
Mostly provides a thorough analysis of each ethical issue that is supported by citations of expert theories and research. Defines most key terms and explains them to somewhat comprehensively.
16 - 12
Analysis of each ethical issue that is supported by some citations of expert theories and research. May not define key terms and/or discuss why practices are effective.
11- 1
Analysis is not supported by research or citations. Does not define key terms and/or discuss why practices are effective.
Assignment, meeting grading criteria, was not submitted.
Recommendations
20 - 23
Accurately uses findings of comparing best and actual organizational practices to make specific recommendations that would strengthen ethical staffing strategies or practices.
22 - 17
Fairly accurately uses findings of comparing best and actual organizational practices to make fairly specific recommendations that may strengthen ethical staffing strategies or practices.
16 - 12
Somewhat uses findings of comparing best and actual organizational practices to make general recommendations; that may or may not strengthen ethical staffing strategies or practices.
11- 1
Recommendations if made to improve employ ...
Healthcare quality improvement for meaningful useSamantha Haas
The document discusses meaningful use of electronic health records and quality improvement processes for healthcare providers. Meaningful use involves using certified electronic health records to improve care quality, engage patients, improve care coordination, and maintain privacy. Providers must meet objectives across three stages related to clinical quality reporting. The quality improvement process involves defining aims, measuring baselines, analyzing processes, testing changes through PDSA cycles, and tracking results. Resources for meaningful use and quality improvement include the CMS website and regional extension centers.
This document discusses principles for effective research assessment and funding systems. It argues that assessing quality can provide accountability, identify strengths and weaknesses, and encourage improvement. Linking assessment to funding provides stronger incentives to raise standards. An effective system is objective, consistent, fit for purpose, and accepted as credible. Peer review informed by quantitative indicators can best capture diversity across disciplines. Disciplines and research units must be appropriately defined. Management and communication must be transparent to maintain fairness and confidence in the system. Assessment should precede funding decisions to reduce gaming and allow funding to follow excellence.
FOCUSING YOUR RESEARCH EFFORTS Planning Your Research ShainaBoling829
FOCUSING YOUR RESEARCH
EFFORTS
Planning Your Research Project Chapter Four
What is the Research Design?
The research design is the general strategy that
provides the overall structures for the procedures
used in the research project. It is the planning
guide.
The Basic Format of the Research
Design
The question
The question converted to a research problem
A temporary hypothesis
Literature search
Data collection
Organization of the data
Analysis of the data
Interpretation of the data
The data either support or do not support the
hypothesis
Planning vs. Methodology
The general approach
to planning research is
similar across all
disciplines
The strategies used to
collect and analyze
data may be specific
to a particular
academic discipline
Research Planning Research Methodology
General Criteria for a Research Project
Universality (can be carried out by any competent
researcher)
Replication
Control (important for replication)
Measurement
The Nature and Role of Data
Data (plural) ‘data are’
Data ARE NOT absolute reality
Data are transient and ever changing
Primary Data are closest to truth
No researcher can glimpse ABSOLUTE TRUTH
Criteria for the Admissibility of Data
Any research effort should be replicable
Restrictions we identify are the criteria for the
admissibility of data
Standardize the data
Planning for Data Collection
What data are needed?
Where is the data located?
How will data be obtained?
How will data be interpreted?
Defining Measurement
Measurement is limiting the data of any
phenomenon – substantial or insubstantial – so that
those data may be interpreted and ultimately
compared to a particular qualitative or quantitative
standard
Measurement is ultimately a comparison: a think or
concept measured against a point of limitation
Types of Measurement Scales
Nominal Scales
Ordinal Scales
Interval Scales
Ratio Scales
Nominal Scales
A nominal scale limits the data
Nominal measurement is simplistic, but it does divide
data into discrete categories that can be compared
to one another.
Only a few statistical procedures are appropriate
for analyzing nominal data (a) mode, (b)
percentage, and (c) chi-square test
Ordinal Scales
Ordinal scales allow us to rank-order data
In addition to using statistics we can use with
nominal data, we can also use statistical procedures
to determine (a) the median, (b) the percentile rank,
and (c) Spearman’s rank order correlation
Interval Scales
An interval scale is characterized by two features:
(a) it has equal units of measurement, and (b) its
zero point has been established arbitrarily
Interval scales allow statistical analyses that are not
possible with nominal and ordinal data
Because an interval scale reflects equal distances ...
Nottingham Trent University and Alexander Street have
partnered to pilot an in-depth view on analytics, demonstrating
user engagement and impact of use. They will share findings
on how e-resources were used and how these analytics can
go beyond simple cost-per-use evaluation to support effective
decision making on the marketing and promotion of resources
and improve our understanding of how library users are
engaging with the resources we provide.
This document discusses adapting VALUE rubrics for assessing information literacy skills at individual campuses. It describes a project that developed analytic rubrics for information literacy, analyzed rubric scores for reliability and validity, and created training materials. The project aimed to determine how rubric assessment can improve instruction and services, whether librarians and faculty can reliably score students using rubrics, and what skills are needed for reliable scoring. The document discusses challenges in rubric assessment and provides examples of campus collaborations to adapt rubrics for local use.
Speaker presentation from U.S. News Healthcare of Tomorrow leadership summit, Nov. 17-19, 2019 in Washington, DC. Find out more about this forum at www.usnewshot.com.
This document discusses information products to drive decision making in health systems. It summarizes research conducted in Kenya and Tanzania on the availability and use of information products from routine health information systems. Key findings include that staff value regular, standardized information products that provide feedback on performance against targets and recommendations for improvement. However, limited workforce and technical capacity are barriers to effective data use. The presentation provides examples of how information products can be designed and tested to promote greater use of routine health data for decision making.
Gather evidence to demonstrate the impact of your researchIUPUI
This workshop is the 3rd in a series of 4 titled "Maximize your impact" offered by the IUPUI University Library Center for Digital Scholarship. Faculty must provide strong evidence of impact in order to achieve promotion and tenure. Having strong evidence in year 5 is made easier by strategic dissemination early in your tenure track. In this hands-on workshop, we will introduce key sources of evidence to support your case, demonstrate strategies for gathering this evidence, and provide a variety of examples. These sources include citation metrics, article level metrics, and altmetrics as indicators of impact to support your narrative of excellence.
This document discusses fostering research for policy and practitioners through cohort and longitudinal studies. It provides an overview of CIFF's mission and strategic priority areas. CIFF seeks transformational impact through a systematic approach across sectors like education, nutrition, health, and climate change. CIFF currently has a portfolio of 57 investments totaling $560 million spread across innovation, pilot programs, delivery at scale, and systems change. The document discusses challenges in achieving scale and uptake of research findings, and how CIFF is approaching these challenges through clear theories of change, cost evaluations, communication of evidence, and partnerships.
Closing the Gap Between Clinician Education and Quality Improvement Through an Evidence-Based Taxonomy That Links Terms and Interventions: A Two-Part Brainstorming Session for the Alliance for CEhp Quality Improvement Education (QIE) Initiative
How to Assess and Continuously Improve Maturity of Health Information Systems...MEASURE Evaluation
This document describes a new toolkit for assessing and continuously improving health information systems (HIS) to achieve better health outcomes. The toolkit includes:
1) A five-stage scale to measure the maturity of six HIS components, from emerging to optimized.
2) An assessment tool that maps the current and desired future stages to guide improvement planning. It is administered through key informant interviews and a stakeholder workshop.
3) The goal is to help countries strengthen their HIS through a collaborative, participatory process focused on setting priorities and tracking progress over time.
This document discusses evaluation methods for health informatics projects. It defines evaluation and evaluation research, and describes formative and summative evaluation approaches. Formative evaluation occurs during a project to provide feedback, while summative evaluation assesses effectiveness at the end. Both qualitative and quantitative methods can be used to collect data to evaluate projects. Logic models are developed to identify inputs, activities, outputs and desired outcomes. Evaluation questions are then used to guide data collection and assessment of key aspects of the project.
The document discusses strategies and technologies for comprehensive assessment programs in academic libraries. It provides examples from Cowles Library at Drake University which structured its assessment process around a data repository, training programs, and linking goals to measurable outcomes. Assessment activities at Cowles led to changes like redesigning service areas and increasing resources in high-need fields based on user survey feedback. The document advocates for libraries to systematically assess user needs and integrate findings into strategic planning to demonstrate their value.
A user based approach to implementation of a maternity electronic health record. Presented by Debra Fenton, Counties Manukau Health, at HINZ 2014, 11 November 2014, 11.15am, Plenary Room 2
Microsoft: A Waking Giant in Healthcare Analytics and Big DataDale Sanders
Ten years ago, critics didn’t believe that Microsoft could scale in the second generation of relational data warehouses, but they did. More recently, many of these same pundits have criticized Microsoft for missing the technology wave du jour in cloud offerings, mobile technology, and big data. But, once again, Microsoft has been quietly reengineering its culture and products, and as a result, they now offer the best value and most visionary platform for cloud services, big data, and analytics in healthcare.
Similar to Principles for good metrics: theory to practice (20)
A LibUX experiment goes wrong / right / trickyAlan Fricker
This document outlines an agenda for a library UX training hour that includes examples of techniques like graffiti walls, cognitive mapping, and love/break-up letters. It then discusses using a graffiti wall method where paper and pens are left out for comments, with the pros being funny and immediate feedback from users, especially young ones, and the ability to ask questions about library space, though it risks being left blank or misused. It also cautions to think carefully about questions asked, consider likely feedback and politics, and what changes may actually be possible when using these techniques.
Presentation to the London and South East NHS / HE Conference November 2017. Discusses user satisfaction and impact work by libraries working with the NHS in South London
Simple title scheme for simpler guideline retrievalAlan Fricker
A simple title scheme was proposed to simplify retrieving guidelines. It focuses document titles on the core topic and activity, removes redundant terms, standardizes document types, and includes the creation date. This scheme was presented to the Clinical Guidance Group who requested its adoption. The new scheme will be applied to new and revised guidance going forward, with potential later changes to existing titles. The goal is to help users quickly locate the guidance needed by improving search and standardizing inconsistent document descriptions.
Extending ejournals to NHS partners (UKSG version)Alan Fricker
Slides from a talk I gave at UKSG 2015 conference in Glasgow. Revises talk given at HLG 2014 on same topic. Considers ejournal procurement across NHS and attempts at joint procurement with HE. Looks at how we have addressed improving access and the impact of our actions.
Quick introduction to critical appraisal of quantitative researchAlan Fricker
1) The document provides an introduction to critically appraising quantitative research for healthcare. It discusses key concepts such as levels of evidence, validity, reliability, and transferability.
2) Critical appraisal involves assessing a study's validity, rigor, and relevance through a structured process using checklists to evaluate aspects like research design, sample size, randomization, and potential for bias.
3) Statistical measures like p-values, confidence intervals, and effect sizes are important to consider, but clinical significance is also key when determining if results can be applied to practice.
How we redesigned a tired Library Space as a 24 hour knowledge hubAlan Fricker
Talk for London Health Libraries workshop on redesigning library space. I user a small amount of money to make changes to a small reading room making it much more popular.
(The) health informaticist: collaborative blogging for health, fun and, erm, ...Alan Fricker
Given with Hanna at Health Libraries Group Conference 2010. Talked about our participation in a group blog (the) health informaticist (now defunct). Advantages and issues with group blogging
From Concept to reality : Implementing Lean Managements DMAIC Methodology for...Rokibul Hasan
The Ready-Made Garments (RMG) industry in Bangladesh is a cornerstone of the economy, but increasing costs and stagnant productivity pose significant challenges to profitability. This study explores the implementation of Lean Management in the Sampling Section of RMG factories to enhance productivity. Drawing from a comprehensive literature review, theoretical framework, and action research methodology, the study identifies key areas for improvement and proposes solutions.
Through the DMAIC approach (Define, Measure, Analyze, Improve, Control), the research identifies low productivity as the primary problem in the Sampling Section, with a PPH (Productivity per head) of only 4.0. Using Lean Management techniques such as 5S, Standardized work, PDCA/Kaizen, KANBAN, and Quick Changeover, the study addresses issues such as pre and post Quick Changeover (QCO) time, improper line balancing, and sudden plan changes.
The research employs regression analysis to test hypotheses, revealing a significant correlation between reducing QCO time and increasing productivity. With a regression equation of Y = -0.000501X + 6.72 and an R-squared value of 0.98, the study demonstrates a strong relationship between the independent variables (QCO downtime and improper line balancing downtime) and the dependent variable (productivity per head).
The findings suggest that by implementing Lean Management practices and addressing key productivity inhibitors, RMG factories can achieve substantial improvements in efficiency and profitability. The study provides valuable insights for practitioners, policymakers, and researchers seeking to enhance productivity in the RMG industry and similar manufacturing sectors.
Maximize Your Efficiency with This Comprehensive Project Management Platform ...SOFTTECHHUB
In today's work environment, staying organized and productive can be a daunting challenge. With multiple tasks, projects, and tools to juggle, it's easy to feel overwhelmed and lose focus. Fortunately, liftOS offers a comprehensive solution to streamline your workflow and boost your productivity. This innovative platform brings together all your essential tools, files, and tasks into a single, centralized workspace, allowing you to work smarter and more efficiently.
m249-saw PMI To familiarize the soldier with the M249 Squad Automatic Weapon ...LinghuaKong2
M249 Saw marksman PMIThe Squad Automatic Weapon (SAW), or 5.56mm M249 is an individually portable, gas operated, magazine or disintegrating metallic link-belt fed, light machine gun with fixed headspace and quick change barrel feature. The M249 engages point targets out to 800 meters, firing the improved NATO standard 5.56mm cartridge.The SAW forms the basis of firepower for the fire team. The gunner has the option of using 30-round M16 magazines or linked ammunition from pre-loaded 200-round plastic magazines. The gunner's basic load is 600 rounds of linked ammunition.The SAW was developed through an initially Army-led research and development effort and eventually a Joint NDO program in the late 1970s/early 1980s to restore sustained and accurate automatic weapons fire to the fire team and squad. When actually fielded in the mid-1980s, the SAW was issued as a one-for-one replacement for the designated "automatic rifle" (M16A1) in the Fire Team. In this regard, the SAW filled the void created by the retirement of the Browning Automatic Rifle (BAR) during the 1950s because interim automatic weapons (e.g. M-14E2/M16A1) had failed as viable "base of fire" weapons.
Early in the SAW's fielding, the Army identified the need for a Product Improvement Program (PIP) to enhance the weapon. This effort resulted in a "PIP kit" which modifies the barrel, handguard, stock, pistol grip, buffer, and sights.
The M249 machine gun is an ideal complementary weapon system for the infantry squad platoon. It is light enough to be carried and operated by one man, and can be fired from the hip in an assault, even when loaded with a 200-round ammunition box. The barrel change facility ensures that it can continue to fire for long periods. The US Army has conducted strenuous trials on the M249 MG, showing that this weapon has a reliability factor that is well above that of most other small arms weapon systems. Today, the US Army and Marine Corps utilize the license-produced M249 SAW.
A comprehensive-study-of-biparjoy-cyclone-disaster-management-in-gujarat-a-ca...Samirsinh Parmar
Disaster management;
Cyclone Disaster Management;;
Biparjoy Cyclone Case Study;
Meteorological Observations;
Best practices in Disaster Management;
Synchronization of Agencies;
GSDMA in Cyclone disaster Management;
History of Cyclone in Arabian ocean;
Intensity of Cyclone in Gujarat;
Cyclone preparedness;
Miscellaneous observations - Biparjoy cyclone;
Role of social Media in Disaster Management;
Unique features of Biparjoy cyclone;
Role of IMD in Biparjoy Prediction;
Lessons Learned; Disaster Preparedness; published paper;
Case study; for disaster management agencies; for guideline to manage cyclone disaster; cyclone management; cyclone risks; rescue and rehabilitation for cyclone; timely evacuation during cyclone; port closure; tourism closure etc.
This presentation, "The Morale Killers: 9 Ways Managers Unintentionally Demotivate Employees (and How to Fix It)," is a deep dive into the critical factors that can negatively impact employee morale and engagement. Based on extensive research and real-world experiences, this presentation reveals the nine most common mistakes managers make, often without even realizing it.
The presentation begins by highlighting the alarming statistic that 70% of employees report feeling disengaged at work, underscoring the urgency of addressing this issue. It then delves into each of the nine "morale killers," providing clear explanations and illustrative examples.
1. Ignoring Achievements: The presentation emphasizes the importance of recognizing and rewarding employees' efforts, tailored to their individual preferences.
2. Bad Hiring/Promotions & Broken Promises: It reveals the detrimental effects of poor hiring and promotion decisions, along with the erosion of trust that results from broken promises.
3. Treating Everyone Equally & Tolerating Poor Performance: This section stresses the need for fair treatment while acknowledging that employees have different needs. It also emphasizes the importance of addressing poor performance promptly.
4. Stifling Growth & Lack of Interest: The presentation highlights the importance of providing opportunities for learning and growth, as well as showing genuine care for employees' well-being.
5. Unclear Communication & Micromanaging: It exposes the frustration and resentment caused by vague expectations and excessive control, advocating for clear communication and employee empowerment.
The presentation then shifts its focus to the power of recognition and empowerment, highlighting how a culture of appreciation can fuel engagement and motivation. It provides actionable takeaways for managers, emphasizing the need to stop demotivating behaviors and start actively fostering a positive workplace culture.
The presentation concludes with a strong call to action, encouraging viewers to explore the accompanying blog post, "9 Proven Ways to Crush Employee Morale (and How to Avoid Them)," for a more in-depth analysis and practical solutions.
Neal Elbaum Shares Top 5 Trends Shaping the Logistics Industry in 2024Neal Elbaum
In the ever-evolving world of logistics, staying ahead of the curve is crucial. Industry expert Neal Elbaum highlights the top five trends shaping the logistics industry in 2024, offering valuable insights into the future of supply chain management.
Designing and Sustaining Large-Scale Value-Centered Agile Ecosystems (powered...Alexey Krivitsky
Is Agile dead? It depends on what you mean by 'Agile'. If you mean that the organizations are not getting the promised benefits because they were focusing too much on the team-level agile "ways of working" instead of systemic global improvements -- then we are in agreement. It is a misunderstanding of Agility that led us down a dead-end. At Org Topologies, we see bright sparks -- the signs of the 'second wave of Agile' as we call it. The emphasis is shifting towards both in-team and inter-team collaboration. Away from false dichotomies. Both: team autonomy and shared broad product ownership are required to sustain true result-oriented organizational agility. Org Topologies is a package offering a visual language plus thinking tools required to communicate org development direction and can be used to help design and then sustain org change aiming at higher organizational archetypes.
Many companies have perceived CRM that accompanied by numerous
uncoordinated initiatives as a technological solution for problems in
individual areas. However, CRM should be considered as a strategy when
a company decides to implement it due to its humanitarian, technological
and process-related effects (Mendoza et al., 2007, p. 913). CRM is
evolving today as it should be seen as a strategy for maintaining a longterm relationship with customers.
A CRM business strategy includes the internet with the marketing,
sales, operations, customer services, human resources, R&D, finance, and
information technology departments to achieve the company’s purpose and
maximize the profitability of customer interactions (Chen and Popovich,
2003, p. 673).
After Corona Virus Disease-2019/Covid-19 (Coronavirus) first
appeared in Wuhan, China towards the end of 2019, its effects began to
be felt clearly all over the world. If the Coronavirus crisis is not managed
properly in business-to-business (B2B) and business-to-consumer
(B2C) sectors, it can have serious negative consequences. In this crisis,
companies can typically face significant losses in their sales performance,
existing customers and customer satisfaction, interruptions in operations
and accordingly bankruptcy
Small Business Management An Entrepreneur’s Guidebook 8th edition by Byrd tes...ssuserf63bd7
Small Business Management An Entrepreneur’s Guidebook 8th edition by Byrd test bank.docx
https://qidiantiku.com/test-bank-for-small-business-management-an-entrepreneurs-guidebook-8th-edition-by-mary-jane-byrd.shtml
team presentation of the role and responsibility of HSE teamreviewed.pptx
Principles for good metrics: theory to practice
1. Principles for good metrics:
theory to practice
Alan Fricker - Head of NHS Partnership
& Liaison, King’s College London
Richard Parker – Knowledge Manager,
Heart of England NHSFT
2. Why Metrics?
• How are we doing?
• How do we compare?
• Have changes made a
difference?
• Something to talk about
@NHS_HealthEdEng #heelks
3. Defining terms
• "A metric is criteria against which something is
measured" (Ben Showers (2015) Library Analytics
and Metrics)
• "a criterion or set of criteria stated in quantifiable
terms" (OED)”
@NHS_HealthEdEng #heelks
4. Our task
• Take a look around
• Identify appropriate methodologies
and mechanisms
• Help people get better with metrics
• Support Knowledge for Healthcare
@NHS_HealthEdEng #heelks
5. Your favourite metric
• First one that comes to mind
• Pop it on a sticky for later
@NHS_HealthEdEng #heelks
10. @NHS_HealthEdEng #heelks
NHS explorations
Library Quality Assurance Framework (LQAF)
• Replaced HeLICon (2010 onwards)
• 48 criteria across 5 domains
– Strategic Management
– Finance and Service Level Agreements
– Human Resources and staff management
– Infrastructure and facilities
– Library/ Knowledge Services Delivery and Development
• Annual submission
11. @NHS_HealthEdEng #heelks
NHS explorations
LQAF
Pro • Rigorous
• Regular
• Linked to
stakeholders
• Growing pool of
data
Con
• Inconsistent
compliance
regimes
• Self assessment
subjective
• Burden of evidence
collection
12. @NHS_HealthEdEng #heelks
NHS explorations
SHALL National KPI
• 2011 consultation on 6 national KPI
• Revised to 4 (not all from original list)
– % of the organisation’s workforce (headcount) who are registered library
members.
– % of the organisation’s workforce (headcount) who have registered as a
library member in the last year.
– % of the organisation’s workforce (headcount) who have used ATHENS in
the last year.
– % increase in compliance with the Library Quality Assurance Framework
(LQAF) compared with the previous year.
• Not implemented
13. Current practice in the NHS
• Brief KfH survey on metrics in use
• 150 responses but only 47 offered a metric
• 117 metrics suggested
@NHS_HealthEdEng #heelks
14. Areas of focus and approaches
0 5 10 15 20 25 30
Access
Book/physical
Current awareness
Document Supply/ILLs
Enquiries
E-Resource Use
Literature Searches
Outreach
Quality assurance
Training
Unclear
User registration
Website
Impact LQAF Satisfaction Timely Response Usage statistics Value Not stated
15. Reasons for choosing metrics
Code Definition M etrics
Easy to understand Metric clear to them and/or stakeholders 4
Impact Used for impact work 15
Satisfaction Satisfaction or quality related 11
Simple to collect Metric felt easy to get data for 10
Stakeholder agreed Requested / required by stakeholder 18
Timely response Measuresof speed of response 20
Usage Measuresof usage 52
User insight Understand user behaviour (and segment users) 41
Value Value for money 26
@NHS_HealthEdEng #heelks
16. Serendipity
• Areas for focus (Van Loo in Haines-Taylor &
Wilson, 1990):
– time consuming
– space intensive
– high cost
– affect most users
– directly linked to library objectives
– well defined and easy to describe
– relatively easy to collect
– are in areas where library staff have some
control to make changes
@NHS_HealthEdEng #heelks
17. @NHS_HealthEdEng #heelks
Wider world - libraries
International standard (ISO 11620:2014)
• Generic approach to performance
indicators
• Well defined terms
– Resources
– Use (activity)
– Efficiency (cost)
– Potentials and Development (value added work)
• 52 indicators offered
18. @NHS_HealthEdEng #heelks
Wider world - libraries
International standard - criteria
Informative content (provides information for decision
making
Reliability (produces same result when repeated)
Validity (measures what it is intended to measure –
though indirect measures can be valid)
Appropriateness (units and methods of measurement
appropriate to purpose)
Practicality (does not require unreasonable staff or user
time)
Comparability (the extent to which a score will mean the
same for different services – standard is clear you should
only compare similar services)
19. @NHS_HealthEdEng #heelks
Wider world - libraries
RLUK – service standards
• Pilot of 8 initial standards
• “We will achieve X% in Y”
• Shift to benchmarking
approach
• Potential kite mark
20. @NHS_HealthEdEng #heelks
Wider world
The Metric Tide - dimensions
“Robustness: basing metrics on the best possible data
in terms of accuracy and scope
Humility: recognising that quantitative evaluation should
support – but not supplant – qualitative, expert
assessment
Transparency: keeping data collection and analytical
processes open and transparent, so that those being
evaluated can test and verify the results
Diversity: accounting for variation by field, and using a
range of indicators to reflect and support a plurality of
research and researcher career paths across the system
Reflexivity: recognising and anticipating the systemic
and potential effects of indicators, and updating them in
response.”
21. @NHS_HealthEdEng #heelks
Wider world
HSCIC – Quality Assurance Indicators Tool
Relevance (Does it meet user need? Is it actionable?)
Accurate and reliable (Quality of data? Is it a good estimate of reality?)
Timeliness and Punctuality (How long after the event is data available / collected?)
Accessibility and clarity (How easy is to access the data? How easy is it to
interpret?)
Coherence and comparability (Are data from different sources on the same topic
similar? Can it be compared over time?)
Trade-offs (Would improving this metric have a negative impact on another?)
Assessment of user needs and perceptions (What do stakeholders think?)
Performance, cost and respondent burden (How much work is involved in
collection?)
Confidentiality and transparency
23. @NHS_HealthEdEng #heelks
Principles for good metrics
Meaningful
• Relates to goals of organisation
• Relates to needs of stake holders
• Re-examined over time to ensure
still valid
24. @NHS_HealthEdEng #heelks
Principles for good metrics
Actionable
• Measures what matters
• Measures something you can
influence
• Drives changes to behaviour /
services
• Investigate not assume
25. @NHS_HealthEdEng #heelks
Principles for good metrics
Reproducible
• Clearly defined in advance
• Transparent
• Can be replicated
• Best available data
• Non burdensome (to allow repetition)
26. @NHS_HealthEdEng #heelks
Principles for good metrics
Comparable
• Valid over time for internal use
• Valid externally for benchmarking
• Respect diversity of services
31. Definition of the Indicator or Measure: GMC Survey scores against Access to Educational Resources and sub questions on Library Services,
Online Journals and Space for Private Study. Overall score, specialty outliers, positive versus negative satisfaction ratings.
Which LQAF Sections does this link to?
1.2e Service development informed by evidence
1.3c Positive impact
Data Source Reason Indicator is
tracked
How to Calculate How to interpret Targets Link to strategic
directions
GMC Survey
delivered annually
with results publicly
available
http://www.gmc-
uk.org/education/sur
veys.asp
High quality national
data with good
granularity from a core
user group (can look at
Trust, Site and
Specialty).
Very high participation
rate. Consistent year
on year application.
Not Library delivered
reducing bias.
Data from GMC Survey site.
- Overall score for Trust for
Access to Educational
Resources from Summary
page.
- Download scores for
individual sub questions
(click through the overall
Access to the Educational
Resources Score)
- site by site data available
but some question marks
over accuracy of coding to
sites.
- Specialty data for outliers
should be examined
- Sentiment analysis by
calculating (Very good +
Good) – (Very Poor + poor) =
sentiment score
Compare performance on
different measures year
on year
Compare shifts within
specialties that have been
targeted following red
flags in previous years
Compare sites for local
issues
Benchmark against
equivalent organisations
Be aware of wider issues
within Trust / Specialties
that may have negative
halo
Have useful
conversation
with Medical
Education
Zero red flags for
specialties
Improve
absolute
performance
Improve
performance
against
benchmark
Trusts
Support key
stakeholders
and funders
Increase
satisfaction with
online offer
Provide high
quality study
space
Plans for performance improvement: Subject to areas highlighted and research on benchmark services
Where are the results reported and how regularly: Results included in annual report. Annual GMS Survey Report prepared for each Trust and
discussed at Library User Boards. Annual benchmarking report prepared for Library Leadership Team / wider Library Services
32. @NHS_HealthEdEng #heelks
Have a go
Make a metric
• Paper templates to scribble on
• Ask for electronic
• Ask for help
• Share your metrics #heelks
33. Thanks
Alan Fricker - Head of NHS Partnership & Liaison,
King’s College London
Alan.Fricker@kcl.ac.uk
Richard Parker – Knowledge Manager, Heart of
England NHSFT
Richard.Parker2@heartofengland.nhs.uk
@NHS_HealthEdEng #heelks
Editor's Notes
You could say Something to argue with
This was my first thought in a hot summer office!
We started by considering where metrics (and quality assurance / KPI) had been discussed in the NHS previously – we stuck with major initiatives and did not seek out an exhaustive picture of local work.
Helicon roots back in original LINC health panel accreditation checklist and toolkit (1996-1998)
Example of use of these figures in the NLH finance report
How have we addressed the cons?
Previous attempt to address this issue. Feel very culpable here as one of the people who shot holes in things. Basically – I could game almost every single one – the question was – did they matter?
First six
KPI1. Percentage of the organisation’s workforce (headcount) which are “active* library users.(Indicates penetration of library service).
KPI2. Percentage of the organisation’s workforce (headcount) which are registered ATHENS users.(Indicates use of e-resources)(E.g., 1000 Athens users in an organisation of 10,000 staff = 10% )
KPI3. Re-current expenditure commitment on library services based on the organisation's workforce (WTE). (Indicates Trust commitment to Library Services).(E.g., £100,000 spent on Library services in a Trust of 10,000 staff = £10 is spent on library services per WTE)
KPI4. Number of information consultancy enquiries per member of staff based on the organisation's workforce (WTE).(Indicates penetration level of Library enquiries on the organisation).(E.g., 400 enquiries in an organisation with 1,000 staff = a penetration level of 0.4)
KPI5. Percentage of the organisation's workforce (headcount) that subscribe to current awareness services. (Indicates penetration level of current awareness services on the organisation).
KPI6. Percentage of organisation's workforce (headcount) which have received information skills training in one year.(Indicates penetration of information skills/information literacy training on organisation).
Why so few metrics? Issue with tool? Survey overload? Discomfort with metrics?
Lots of people offering pure usage without the context to make it a metric. Cost per download widely used for collection development and VFM evidence. Speed felt important for users but contested – we always negotiate deadlines.
Discovered on the discard pile – describe what we were seeing in the survey data perfectly
Bingo! Powerful way to think about
Research Libraries UK. Targets set across the piece do not make sense.
Debate in HE around use of Metrics – post REF 2014 and in an increasingly numbers driven approach to career futures.
Now Known as NHS Digital. National Library of quality assurance indicators – task under the 2012 Health and Social Care Act – aimed at healthcare delivery and performance but work for our quality purposes too
People care about this metric
This metric makes a difference
You could repeat my metric and the results would be consistent
Take care with comparisons!
Doing this is not easy! The template is there to help
Main template
Checklist – good enough for Gawande and the WHO – good enough for me