Targeted follow-up meetings in general practice are important and missed often, because of both patient and general practitioners (GPs) related reasons. In this paper, we present a proof-of-concept interactive visualization dashboard that provides GPs with a powerful, yet easy to use method to identify those patients in need of follow-up. We applied a user centered, rapid prototyping methodology with 12 information visualization students and 15 GPs. We evaluated the final design using the evaluation framework by O’Leary et al., as well as a System Usability Scale questionnaire. Results indicate that there is indeed a need for a follow-up tool and that a dashboard is a right kind of tool. Our proof-of-concept shows useful insights into patient records and can indeed help GPs recognize patients in need of follow-up. The major strengths of the design are the ease with which GPs can query patient records using interactive visualizations, such as parallel coordinates, and the ability to check if the number of patients diagnosed with certain diseases differs from the amount predicted in evidence-based guidelines.
Building capacity for evidence-informed public health decision makingHealth Evidence™
From 2009-2013, Health Evidence partnered with three Ontario health departments on a Canadian Institutes of Health Research (CIHR) “Partnerships for Health System Improvement” grant, studying the impact of tailored, knowledge translation and exchange interventions on evidence-informed decision making in public health. On June 10, 2014, Dr. Maureen Dobbins presented the results from this study and lead an interactive discussion on the implications for this work to a broader public health and knowledge translation audience.
For a recording of this webinar, visit: https://www.youtube.com/watch?v=PbQR-cRgrKI&feature=youtu.be.
Cette exemple de feuille de réponse correspond au huitième webinaire de la série club de lecture en ligne, « Comment les jeunes interprètent-ils les données probantes relatives au cannabis? »
Le Centre de collaboration nationale des méthodes et outils est financé par l’Agence de la santé publique du Canada et affilié à l’Université McMaster. Les vues exprimées ici ne reflètent pas nécessairement la position officielle de l’Agence de la santé publique du Canada.
Le CCNMO est l’un des six centres de collaboration nationale en santé publique au Canada. Les Centres encouragent et améliorent l’utilisation des connaissances provenant de la recherche scientifique et des autres savoirs afin de renforcer la pratique et les politiques de santé publique au Canada.
Valuing the EQ-5D-Y Principles, methods and current researchKerry Sheppard
Nancy Devlin & Koonal Shah, OHE - Valuing Youth Health,
Methodological issues and current state of research on EQ-5D-Y - 2nd EuroQol Academy Meeting, Noordwijk, 8 March 2017
Building capacity for evidence-informed public health decision makingHealth Evidence™
From 2009-2013, Health Evidence partnered with three Ontario health departments on a Canadian Institutes of Health Research (CIHR) “Partnerships for Health System Improvement” grant, studying the impact of tailored, knowledge translation and exchange interventions on evidence-informed decision making in public health. On June 10, 2014, Dr. Maureen Dobbins presented the results from this study and lead an interactive discussion on the implications for this work to a broader public health and knowledge translation audience.
For a recording of this webinar, visit: https://www.youtube.com/watch?v=PbQR-cRgrKI&feature=youtu.be.
Cette exemple de feuille de réponse correspond au huitième webinaire de la série club de lecture en ligne, « Comment les jeunes interprètent-ils les données probantes relatives au cannabis? »
Le Centre de collaboration nationale des méthodes et outils est financé par l’Agence de la santé publique du Canada et affilié à l’Université McMaster. Les vues exprimées ici ne reflètent pas nécessairement la position officielle de l’Agence de la santé publique du Canada.
Le CCNMO est l’un des six centres de collaboration nationale en santé publique au Canada. Les Centres encouragent et améliorent l’utilisation des connaissances provenant de la recherche scientifique et des autres savoirs afin de renforcer la pratique et les politiques de santé publique au Canada.
Valuing the EQ-5D-Y Principles, methods and current researchKerry Sheppard
Nancy Devlin & Koonal Shah, OHE - Valuing Youth Health,
Methodological issues and current state of research on EQ-5D-Y - 2nd EuroQol Academy Meeting, Noordwijk, 8 March 2017
Augmenting Healthcare by Supporting General Practitioners and Disclosing Hea...Robin De Croon
Slides used during my public PhD defence at KU Leuven on June 23, 2017.
This PhD explores, designs, develops and evaluates a suite of information visualization tools for understanding, exploring, explaining and disclosing health information. This toolset is aimed at both general practitioners and patients and is driven by three underlying research goals: augmenting traditional practitioners’ workflows, boosting patient empowerment, and investigating novel opportunities in devices for supporting communication and collaboration between practitioners and patients.
A Proof-of-Concept Visualization to Increase Comprehension of Personal Medica...Robin De Croon
In this paper, we investigate how information visualization techniques can be leveraged to increase patient comprehension of personal medication schemes in order to make it easier for them to explore, explain and understand drug information. Using computer vision techniques, our solution is able to recognize medication boxes, or so-called pharmaceutical packages, which are laid on an ordinary table. A projector visualizes drug information such as interactions, adverse drug reactions, intolerances and the dosage regimen around corresponding boxes. Five prototypes are designed and evaluated following a user-centered, rapid-prototyping methodology. Test participants in our study included both general practitioners (GPs) and patients. Results are promising and clearly indicate that information visualization techniques are an effective means to explore and understand drug information. Even if this system was originally envisaged to be used as a means to improve `therapy dialogue' between GPs and their patients during consultations, our results show that both GPs and patients think it would be highly beneficial if patients were able to use the system at home.
An Introduction to Evaluation in Medical VisualizationNoeska Smit
Slides for my presentation at EuroRV3 2016
Paper: https://www.researchgate.net/publication/303080505_An_Introduction_to_Evaluation_in_Medical_Visualization
Abstract:
Medical visualization papers often deal with data that is interpreted by medical domain experts in a research or clinical context. Since visualizations are by definition designed to be interpreted by a human observer, often an evaluation is performed to confirm the utility of a presented method. The exact type of evaluation required is not always clear, especially to new researchers. With this paper, we hope to clarify the different types of evaluation methods that exist and provide practical guidelines to choose the most suitable evaluation method to increase the value of the work.
Interested in a tool to appraise all types of public health evidence?
Do you appraise public health evidence? Are you interested in a single tool that can appraise many different types of evidence and study designs? Join us for a webinar to learn about the MetaQAT.
This tool was developed by Public Health Ontario.
How can the MetaQAT help you?
Many different types of evidence and study designs may be used to answer a single public health question. The MetaQAT provides a single process that can be used to appraise these different types of evidence. This supports the use of evidence to formulate recommendations and develop public health actions.
The MetaQAT consists of a four domain appraisal framework that includes relevance, reliability, validity, and applicability. A suite of design-specific companion tools are included to provide further guidance to assess validity of common designs.
This webinar includes an overview of the MetaQAT by its developer, Dr. Laura Rosella, followed by a presentation from Dr. Catherine Bornbaum, who used the MetaQAT in conducting a systematic review.
To see the summary statement of this tool developed by NCCMT, click here: http://www.nccmt.ca/resources/search/243
The National Collaborating Centre for Methods and Tools is funded by the Public Health Agency of Canada and affiliated with McMaster University. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada.
NCCMT is one of six National Collaborating Centres (NCCs) for Public Health. The Centres promote and improve the use of scientific research and other knowledge to strengthen public health practices and policies in Canada.
Opening/Framing Comments: John Behrens, Vice President, Center for Digital Data, Analytics, & Adaptive Learning Pearson
Discussion of how the field of educational measurement is changing; how long held assumptions may no longer be taken for granted and that new terminology and language are coming into the.
Panel 1: Beyond the Construct: New Forms of Measurement
This panel presents new views of what assessment can be and new species of big data that push our understanding for what can be used in evidentiary arguments.
Marcia Linn, Lydia Liu from UC Berkeley and ETS discuss continuous assessment of science and new kinds of constructs that relate to collaboration and student reasoning.
John Byrnes from SRI International discusses text and other semi-structured data sources and different methods of analysis.
Kristin Dicerbo from Pearson discusses hidden assessments and the different student interactions and events that can be used in inferential processes.
Panel 2: The Test is Just the Beginning: Assessments Meet Systems Context
This panel looks at how assessments are not the end game, but often the first step in larger big-data practices at districts/state/national levels.
Gerald Tindal from the University of Oregon discusses State data systems and special education, including curriculum-based measurement across geographic settings.
Jack Buckley Commissioner of the National Center for Educational Statistics discussing national datasets where tests and other data connect.
Lindsay Page, Will Marinell from the Strategic Data Project at Harvard discussing state and district datasets used for evaluating teachers, colleges of education, and student progress.
Panel 3: Connecting the Dots: Research Agendas to Integrate Different Worlds
This panel will look at how research organizations are viewing the connections between the perspectives presented in Panels 1 and 2; what is known, what is still yet to be discovered in order to achieve the promised of big connected data in education.
Andrea Conklin Bueschel Program Director at the Spencer Foundation
Ed Dieterle Senior Program Officer at the Bill and Melinda Gates Foundation
Edith Gummer Program Manager at National Science Foundation
Presented to Northeast Ohio Usability Professionals' Association (NEOUPA) on Wednesday, April 25, 2012 at Cleveland Clinic.
Two main themes in the presentation:
1. Tailor UX study to get stakeholder buy-in, in the unique corporate culture of Cleveland Clinic.
2. We invented our own methods to extract insights from quantitative open card sort to establish corporate-wide standard sitemap.
First, the new methods contribute to determine navigation menu naming convention and cross-reference points.
Secondly, I'd like to propose the UX & HCI community to include "Cell Plot Analysis" as a new statistical analysis when analyzing quantitative open card sorts.
I have not seen any of the above mentioned in prior literature before.
Feedback welcome.
The next appearance of this presentation will be UPA's International Conference in June 2012.
Digital Age Evidence and the Living Lab: Keynote for SICSA MadnessJames Stewart
These slides introduce the concept of evidence to counterbalance too much talk about 'data'. It focuses on the socially constructed nature of Evidence, and how it needs to be in the right form at the right time and the right place to have impact on decision making. Evidence is expensive, and relies on legitimising agents. Intro digital world we have many new ways of creating evidence - from the original data sources to the final communication form. What tools and practices are needed to make the creation of evidence more effective and more easily accessible?
The slides outlines how a Living Lab and crowdsourcing could be used create new forms of evidence for science and policy
Todd Carpenter's presentation at the Electronic Resources in Libraries (ER&L) conference in Austin, TX, February 23, 2015. Todd discussed how new forms of assessment are entering the mainstream and how those metrics shouldn't be considered "alternative" any longer. The session also covered the advancements made in 2014 on the NISO Alternative Assessment initiative, that was generously funded by the Alfred P. Sloan Foundation.
Peter Levesque explores the critical areas of measuring, interpreting, and analyzing results to ensure continual improvement of KT activities to produce intended results.
Assessment Analytics - EUNIS 2015 E-Learning Task Force WorkshopLACE Project
This presentation is to introduce a discussion session at the 2015 EUNIS Congress workshop session of the E-Learning Task Force. The LACE Project is very briefly introduced, followed by an explanation of the presenter's view of learning analytics and a critique of some common themes. Assessment Analytics is presented as an antithesis to these themes and an assessment lifecycle model (used in the Jisc Electronic Management of Assessment Programme) is used to outline some ways in which assessment analytics can be realised, as stimulus for discussion.
Do you need help with quality appraisal of different types of non-research evidence? This webinar will walk you through case examples showing how to use NCCMT’s Quality Assessment of Community Evidence (QACE) and Resource Planning and Assessment (RPA) tools to assess the quality of contextual evidence, including local health issues, community and political preferences and actions, and financial and human resources. Alongside the webinar, we are offering Knowledge Brokering mentorship to support post-webinar use of the tools.
Augmenting Healthcare by Supporting General Practitioners and Disclosing Hea...Robin De Croon
Slides used during my public PhD defence at KU Leuven on June 23, 2017.
This PhD explores, designs, develops and evaluates a suite of information visualization tools for understanding, exploring, explaining and disclosing health information. This toolset is aimed at both general practitioners and patients and is driven by three underlying research goals: augmenting traditional practitioners’ workflows, boosting patient empowerment, and investigating novel opportunities in devices for supporting communication and collaboration between practitioners and patients.
A Proof-of-Concept Visualization to Increase Comprehension of Personal Medica...Robin De Croon
In this paper, we investigate how information visualization techniques can be leveraged to increase patient comprehension of personal medication schemes in order to make it easier for them to explore, explain and understand drug information. Using computer vision techniques, our solution is able to recognize medication boxes, or so-called pharmaceutical packages, which are laid on an ordinary table. A projector visualizes drug information such as interactions, adverse drug reactions, intolerances and the dosage regimen around corresponding boxes. Five prototypes are designed and evaluated following a user-centered, rapid-prototyping methodology. Test participants in our study included both general practitioners (GPs) and patients. Results are promising and clearly indicate that information visualization techniques are an effective means to explore and understand drug information. Even if this system was originally envisaged to be used as a means to improve `therapy dialogue' between GPs and their patients during consultations, our results show that both GPs and patients think it would be highly beneficial if patients were able to use the system at home.
An Introduction to Evaluation in Medical VisualizationNoeska Smit
Slides for my presentation at EuroRV3 2016
Paper: https://www.researchgate.net/publication/303080505_An_Introduction_to_Evaluation_in_Medical_Visualization
Abstract:
Medical visualization papers often deal with data that is interpreted by medical domain experts in a research or clinical context. Since visualizations are by definition designed to be interpreted by a human observer, often an evaluation is performed to confirm the utility of a presented method. The exact type of evaluation required is not always clear, especially to new researchers. With this paper, we hope to clarify the different types of evaluation methods that exist and provide practical guidelines to choose the most suitable evaluation method to increase the value of the work.
Interested in a tool to appraise all types of public health evidence?
Do you appraise public health evidence? Are you interested in a single tool that can appraise many different types of evidence and study designs? Join us for a webinar to learn about the MetaQAT.
This tool was developed by Public Health Ontario.
How can the MetaQAT help you?
Many different types of evidence and study designs may be used to answer a single public health question. The MetaQAT provides a single process that can be used to appraise these different types of evidence. This supports the use of evidence to formulate recommendations and develop public health actions.
The MetaQAT consists of a four domain appraisal framework that includes relevance, reliability, validity, and applicability. A suite of design-specific companion tools are included to provide further guidance to assess validity of common designs.
This webinar includes an overview of the MetaQAT by its developer, Dr. Laura Rosella, followed by a presentation from Dr. Catherine Bornbaum, who used the MetaQAT in conducting a systematic review.
To see the summary statement of this tool developed by NCCMT, click here: http://www.nccmt.ca/resources/search/243
The National Collaborating Centre for Methods and Tools is funded by the Public Health Agency of Canada and affiliated with McMaster University. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada.
NCCMT is one of six National Collaborating Centres (NCCs) for Public Health. The Centres promote and improve the use of scientific research and other knowledge to strengthen public health practices and policies in Canada.
Opening/Framing Comments: John Behrens, Vice President, Center for Digital Data, Analytics, & Adaptive Learning Pearson
Discussion of how the field of educational measurement is changing; how long held assumptions may no longer be taken for granted and that new terminology and language are coming into the.
Panel 1: Beyond the Construct: New Forms of Measurement
This panel presents new views of what assessment can be and new species of big data that push our understanding for what can be used in evidentiary arguments.
Marcia Linn, Lydia Liu from UC Berkeley and ETS discuss continuous assessment of science and new kinds of constructs that relate to collaboration and student reasoning.
John Byrnes from SRI International discusses text and other semi-structured data sources and different methods of analysis.
Kristin Dicerbo from Pearson discusses hidden assessments and the different student interactions and events that can be used in inferential processes.
Panel 2: The Test is Just the Beginning: Assessments Meet Systems Context
This panel looks at how assessments are not the end game, but often the first step in larger big-data practices at districts/state/national levels.
Gerald Tindal from the University of Oregon discusses State data systems and special education, including curriculum-based measurement across geographic settings.
Jack Buckley Commissioner of the National Center for Educational Statistics discussing national datasets where tests and other data connect.
Lindsay Page, Will Marinell from the Strategic Data Project at Harvard discussing state and district datasets used for evaluating teachers, colleges of education, and student progress.
Panel 3: Connecting the Dots: Research Agendas to Integrate Different Worlds
This panel will look at how research organizations are viewing the connections between the perspectives presented in Panels 1 and 2; what is known, what is still yet to be discovered in order to achieve the promised of big connected data in education.
Andrea Conklin Bueschel Program Director at the Spencer Foundation
Ed Dieterle Senior Program Officer at the Bill and Melinda Gates Foundation
Edith Gummer Program Manager at National Science Foundation
Presented to Northeast Ohio Usability Professionals' Association (NEOUPA) on Wednesday, April 25, 2012 at Cleveland Clinic.
Two main themes in the presentation:
1. Tailor UX study to get stakeholder buy-in, in the unique corporate culture of Cleveland Clinic.
2. We invented our own methods to extract insights from quantitative open card sort to establish corporate-wide standard sitemap.
First, the new methods contribute to determine navigation menu naming convention and cross-reference points.
Secondly, I'd like to propose the UX & HCI community to include "Cell Plot Analysis" as a new statistical analysis when analyzing quantitative open card sorts.
I have not seen any of the above mentioned in prior literature before.
Feedback welcome.
The next appearance of this presentation will be UPA's International Conference in June 2012.
Digital Age Evidence and the Living Lab: Keynote for SICSA MadnessJames Stewart
These slides introduce the concept of evidence to counterbalance too much talk about 'data'. It focuses on the socially constructed nature of Evidence, and how it needs to be in the right form at the right time and the right place to have impact on decision making. Evidence is expensive, and relies on legitimising agents. Intro digital world we have many new ways of creating evidence - from the original data sources to the final communication form. What tools and practices are needed to make the creation of evidence more effective and more easily accessible?
The slides outlines how a Living Lab and crowdsourcing could be used create new forms of evidence for science and policy
Todd Carpenter's presentation at the Electronic Resources in Libraries (ER&L) conference in Austin, TX, February 23, 2015. Todd discussed how new forms of assessment are entering the mainstream and how those metrics shouldn't be considered "alternative" any longer. The session also covered the advancements made in 2014 on the NISO Alternative Assessment initiative, that was generously funded by the Alfred P. Sloan Foundation.
Peter Levesque explores the critical areas of measuring, interpreting, and analyzing results to ensure continual improvement of KT activities to produce intended results.
Assessment Analytics - EUNIS 2015 E-Learning Task Force WorkshopLACE Project
This presentation is to introduce a discussion session at the 2015 EUNIS Congress workshop session of the E-Learning Task Force. The LACE Project is very briefly introduced, followed by an explanation of the presenter's view of learning analytics and a critique of some common themes. Assessment Analytics is presented as an antithesis to these themes and an assessment lifecycle model (used in the Jisc Electronic Management of Assessment Programme) is used to outline some ways in which assessment analytics can be realised, as stimulus for discussion.
Do you need help with quality appraisal of different types of non-research evidence? This webinar will walk you through case examples showing how to use NCCMT’s Quality Assessment of Community Evidence (QACE) and Resource Planning and Assessment (RPA) tools to assess the quality of contextual evidence, including local health issues, community and political preferences and actions, and financial and human resources. Alongside the webinar, we are offering Knowledge Brokering mentorship to support post-webinar use of the tools.
Similar to Design and evaluation of an interactive proof-of-concept dashboard for general practitioners (20)
Medical dashboard - case study Robin De CroonRobin De Croon
Auxiliary slides I used work during the infovis course of prof. Erik Duval, containing a high level overview of the rationale of my current medical dashboard.
A paradigm shift of GP generations and the implications on the evaluation of ...Robin De Croon
Pecha Kucha presented during the workshop on designing the future of mobile healthcare support in Toronto during MobileHCI.
http://www3.ocadu.ca/mobilehealthcare/
Visualizing quantified self and objective patient dataRobin De Croon
Slides for the Doctoral Consortium at IEEE ICHI 2014 in Verona: http://ichi2014.di.univr.it/wp-content/uploads/2014/09/The-Doctoral-Consortium-of-ICHI-2014-Programme.pdf
CHAPTER 1 SEMESTER V - ROLE OF PEADIATRIC NURSE.pdfSachin Sharma
Pediatric nurses play a vital role in the health and well-being of children. Their responsibilities are wide-ranging, and their objectives can be categorized into several key areas:
1. Direct Patient Care:
Objective: Provide comprehensive and compassionate care to infants, children, and adolescents in various healthcare settings (hospitals, clinics, etc.).
This includes tasks like:
Monitoring vital signs and physical condition.
Administering medications and treatments.
Performing procedures as directed by doctors.
Assisting with daily living activities (bathing, feeding).
Providing emotional support and pain management.
2. Health Promotion and Education:
Objective: Promote healthy behaviors and educate children, families, and communities about preventive healthcare.
This includes tasks like:
Administering vaccinations.
Providing education on nutrition, hygiene, and development.
Offering breastfeeding and childbirth support.
Counseling families on safety and injury prevention.
3. Collaboration and Advocacy:
Objective: Collaborate effectively with doctors, social workers, therapists, and other healthcare professionals to ensure coordinated care for children.
Objective: Advocate for the rights and best interests of their patients, especially when children cannot speak for themselves.
This includes tasks like:
Communicating effectively with healthcare teams.
Identifying and addressing potential risks to child welfare.
Educating families about their child's condition and treatment options.
4. Professional Development and Research:
Objective: Stay up-to-date on the latest advancements in pediatric healthcare through continuing education and research.
Objective: Contribute to improving the quality of care for children by participating in research initiatives.
This includes tasks like:
Attending workshops and conferences on pediatric nursing.
Participating in clinical trials related to child health.
Implementing evidence-based practices into their daily routines.
By fulfilling these objectives, pediatric nurses play a crucial role in ensuring the optimal health and well-being of children throughout all stages of their development.
How many patients does case series should have In comparison to case reports.pdfpubrica101
Pubrica’s team of researchers and writers create scientific and medical research articles, which may be important resources for authors and practitioners. Pubrica medical writers assist you in creating and revising the introduction by alerting the reader to gaps in the chosen study subject. Our professionals understand the order in which the hypothesis topic is followed by the broad subject, the issue, and the backdrop.
https://pubrica.com/academy/case-study-or-series/how-many-patients-does-case-series-should-have-in-comparison-to-case-reports/
ICH Guidelines for Pharmacovigilance.pdfNEHA GUPTA
The "ICH Guidelines for Pharmacovigilance" PDF provides a comprehensive overview of the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) guidelines related to pharmacovigilance. These guidelines aim to ensure that drugs are safe and effective for patients by monitoring and assessing adverse effects, ensuring proper reporting systems, and improving risk management practices. The document is essential for professionals in the pharmaceutical industry, regulatory authorities, and healthcare providers, offering detailed procedures and standards for pharmacovigilance activities to enhance drug safety and protect public health.
Deep Leg Vein Thrombosis (DVT): Meaning, Causes, Symptoms, Treatment, and Mor...The Lifesciences Magazine
Deep Leg Vein Thrombosis occurs when a blood clot forms in one or more of the deep veins in the legs. These clots can impede blood flow, leading to severe complications.
Explore our infographic on 'Essential Metrics for Palliative Care Management' which highlights key performance indicators crucial for enhancing the quality and efficiency of palliative care services.
This visual guide breaks down important metrics across four categories: Patient-Centered Metrics, Care Efficiency Metrics, Quality of Life Metrics, and Staff Metrics. Each section is designed to help healthcare professionals monitor and improve care delivery for patients facing serious illnesses. Understand how to implement these metrics in your palliative care practices for better outcomes and higher satisfaction levels.
Global launch of the Healthy Ageing and Prevention Index 2nd wave – alongside...ILC- UK
The Healthy Ageing and Prevention Index is an online tool created by ILC that ranks countries on six metrics including, life span, health span, work span, income, environmental performance, and happiness. The Index helps us understand how well countries have adapted to longevity and inform decision makers on what must be done to maximise the economic benefits that comes with living well for longer.
Alongside the 77th World Health Assembly in Geneva on 28 May 2024, we launched the second version of our Index, allowing us to track progress and give new insights into what needs to be done to keep populations healthier for longer.
The speakers included:
Professor Orazio Schillaci, Minister of Health, Italy
Dr Hans Groth, Chairman of the Board, World Demographic & Ageing Forum
Professor Ilona Kickbusch, Founder and Chair, Global Health Centre, Geneva Graduate Institute and co-chair, World Health Summit Council
Dr Natasha Azzopardi Muscat, Director, Country Health Policies and Systems Division, World Health Organisation EURO
Dr Marta Lomazzi, Executive Manager, World Federation of Public Health Associations
Dr Shyam Bishen, Head, Centre for Health and Healthcare and Member of the Executive Committee, World Economic Forum
Dr Karin Tegmark Wisell, Director General, Public Health Agency of Sweden
Health Education on prevention of hypertensionRadhika kulvi
Hypertension is a chronic condition of concern due to its role in the causation of coronary heart diseases. Hypertension is a worldwide epidemic and important risk factor for coronary artery disease, stroke and renal diseases. Blood pressure is the force exerted by the blood against the walls of the blood vessels and is sufficient to maintain tissue perfusion during activity and rest. Hypertension is sustained elevation of BP. In adults, HTN exists when systolic blood pressure is equal to or greater than 140mmHg or diastolic BP is equal to or greater than 90mmHg. The
Design and evaluation of an interactive proof-of-concept dashboard for general practitioners
1. DESIGNAND EVALUATIONOF AN
INTERACTIVE PROOF-OF-CONCEPT
DASHBOARD FOR GENERAL
PRACTITIONERS
Robin De Croon,Joris Klerkx, Erik Duval
robin.decroon@cs.kuleuven.be
IEEE International Conference on Healthcare Informatics 2015, Dallas
2. Patient follow-up
Patients
• forget follow-up meetings
• do not considera follow-up necessary
• do not want tospend additionalmoney
• have the impression treatment is not working
General practitioners
• hard to find patientsin need of follow-up
• are toobusy to accommodateaprompt visit
• do not have enoughtime
Wednesday, October 21, 2015 2
3. How to improve follow-up quality?
Patient oriented
• Stimulate patient empowerment
General practitionerdriven
• Provide better tools to augment workflow
Wednesday, October 21, 2015 3
5. Research question
“How do we help general practitioners
identify patients in need of follow-up
using interactive visualizations?”
Wednesday, October 21, 2015 5
6. Research question
“How do we help general practitioners
identify patients in need of follow-up
using interactive visualizations?”
Wednesday, October 21, 2015 6
7. Research question
“How do we help general practitioners
identify patients in need of follow-up
using interactive visualizations?”
Wednesday, October 21, 2015 7
8. Research question
“How do we help general practitioners
identify patients in need of follow-up
using interactive visualizations?”
Wednesday, October 21, 2015 8
9. User centered, rapid prototyping
Wednesday, October 21, 2015 9
Initial
design
Prototype 2
- Content
- Missingdata
Result
Final Design
- Updated table
- Consistency
- bugs
Prototype 3
- Internal changes
Academic Center
General Practice
3 GPs 12 infovis students 9 GPs
design phase usability phase evaluation phase
10. User centered, rapid prototyping
Wednesday, October 21, 2015 10
Initial
design
Prototype 2
- Content
- Missingdata
Result
Final Design
- Updated table
- Consistency
- bugs
Prototype 3
- Internal changes
Academic Center
General Practice
3 GPs 12 infovis students 9 GPs
design phase usability phase evaluation phase
11. Visualization concepts
• Overview first, zoom and filter, then details-on-demand
• Data ink ratio
• Stevens’ model
Wednesday, October 21, 2015 11
Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information
Visualizations. In Proceedings of the IEEE Symposium on Visual Languages, pages 336-
343, Washington. IEEE Computer Society Press, 1996
Edward Tufte. The Visual Display of Quantitative Information. 1983
S. Stevens, “On the theory of scales of measurement.” Science
(New York, N.Y.), vol. 103, no. 2684, pp. 677–680, 1946
15. User centered, rapid prototyping
Wednesday, October 21, 2015 15
Initial
design
Prototype 2
- Content
- Missingdata
Result
Final Design
- Updated table
- Consistency
- bugs
Prototype 3
- Internal changes
Academic Center
General Practice
3 GPs 12 infovis students 9 GPs
design phase usability phase evaluation phase
16. AcademicCenter for General Practice
What
• 3 general practitioners+2 electronic medical recordexperts
• already perform audits on general practices
• Perceived usefulness
Result
• Too much demographics
• Medication (groups)more important
• primary and secondary condition
• Deal with noise in data
• outliers, missing elements
Wednesday, October 21, 2015 16
17.
18. User centered, rapid prototyping
Wednesday, October 21, 2015 18
Initial
design
Prototype 2
- Content
- Missingdata
Result
Final Design
- Updated table
- Consistency
- bugs
Prototype 3
- Internal changes
Academic Center
General Practice
3 GPs 12 infovis students 9 GPs
design phase usability phase evaluation phase
19. Usability iteration
What
• 12 information visualization students
• 10 tasks
• time-to-task & error-rate & perceiveddifficulty
• ± 60 minutes
• Questionnaires
• initial& closing&System UsabilityScale
Wednesday, October 21, 2015 19
22. User centered, rapid prototyping
Wednesday, October 21, 2015 22
Initial
design
Prototype 2
- Content
- Missingdata
Result
Final Design
- Updated table
- Consistency
- bugs
Prototype 3
- Internal changes
Academic Center
General Practice
3 GPs 12 infovis students 9 GPs
design phase usability phase evaluation phase
23. Final evaluation
• 9 general practitioners
• 7 male + 2 females
• ConcurrentThinkAloud protocol
• short introduction, free interaction, 15 ~ 20 minutes
C. Lewis, Using the"thinking Aloud" Method inCognitiveInterfaceDesign, (ibm resea ed., ser. Research
report. Yorktown Heights, NY: IBMT.J. Watson ResearchCenter
• SystemUsability Scale
Brooke, John. "SUS-Aquickand dirty usability scale."Usability evaluation inindustry 189.194 (1996): 4-7
• Questionsfrom O’Leary et al. à likert questions
O’Leary, P., Carroll, N., & Richardson, I. (2014). The Practitioner’s Perspective on Clinical Pathway
Support Systems. In 2014 IEEE International Conference onHealthcare Informatics (pp. 194–201)
• SWOTanalysis
Wednesday, October 21, 2015 23
24. System Usability Scale
Wednesday, October 21, 2015
74
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores
mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123
25. System Usability Scale
Wednesday, October 21, 2015 25
1 2 3 4 5
Learn a lot of things
Confident using the system
Very cumbersome to use
Learn to use this system very quickly
Too much inconsistency
Functions well integrated
Need the support of a technical person
Easy to use
Unnecessarily complex
Like to use this system frequently
26. Likert questions
Wednesday, October 21, 2015 26
1
1
2
3
5
1
3
6
4
2
2
3
3
5
6
3
3
4
2
5
2
4
2
0% 20% 40% 60% 80% 100%
Need for follow-up tool
Follow best practice
TrainGPs
Correct level of detail
Recognize follow-up patients
Reducing mistakes
Useful feedback
Right kind of tool
totally disagree disagree neutral agree totally agree
O’Leary, P., Carroll, N., & Richardson, I. (2014). The Practitioner’s Perspective on Clinical Pathway Support
Systems. In 2014 IEEE International Conference onHealthcare Informatics (pp. 194–201)
27. SWOT analysis
272
2
3
4
3
4
5
2
3
4
4
2
2
3
3
4
5
Control system
Privacy
Too little time
Averages can be dangerous
Can be improved with patient collected data
Triggers self-reflection
Ideal for research
Not needed often
Not clear which content too show
Not much structured data available
Map uses too much screenestate
No pseudo code needed
Improves team communication
Visual overview
Augment work
Check with guidelines
Easeto select patients
29. Limitations
• Sample size
• total 15 GPsà exploratory study
• Semi realisticdata
• anonymous& assess perceived usefulness
• Requirements gathering
• user centered, rapid prototyping
• Evaluation setting
• limited time à perceived usefulness
Wednesday, October 21, 2015 29
30. Conclusion
• Powerful, yet easy to use
• Reduces burden to analyze patient records
• Recognize patients in need of follow-up
• Query patient with visual filters
• Needs to adapt to specific use cases
• Biggest opportunity is in research
Wednesday, October 21, 2015 30
http://cdn.makeuseof.com/wp-content/uploads/2012/12/3D-Man-Presenting-Intro-Image.jpg?a53b57
31. Looking for collaborations!
• Make the dashboard available in general practice
• evaluate impact on collaboration
• evaluate if self-reflectionistriggered
• Continue working with academic GPs
Wednesday, October 21, 2015 31
32. Acknowledgements
Wednesday, October 21, 2015 32
Research grand: IWT 120896
Access to their products and expertise
For their experienced feedback
+ All participants!
33. Thank you!
Wednesday, October 21, 2015 33
http://2.bp.blogspot.com/-gZjNR3XVULs/T_ZOVgE-5lI/AAAAAAAAAg8/6YVmd5Q064o/s1600/questions11.jpg
robin.decroon@cs.kuleuven.be
34. information seeking mantra
34
Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations.
In Proceedings of the IEEE Symposium on Visual Languages, pages 336-343, Washington. IEEE
Computer Society Press, 1996.
35. data ink ratio
Wednesday, October 21, 2015 35
Edward Tufte. The Visual Display of Quantitative Information. 1983
36. target user
Target Audience
Wednesday, October 21, 2015 36
• General Practitioners (in Belgium)
Independentof:
• Experience & age
• Individual or group practice
• ICT-knowledge
• Current medical software
http://marketingyoucanuse.com/wp-content/uploads/2010/12/HittingTarget.jpg
37. Related work: Eventflow
Wednesday, October 21, 2015 37
Monroe, M., Lan, R., Plaisant, C., Shneiderman, B. (May 2013) Temporal
Event Sequence Simplification In IEEE Trans. Visualization and Computer
Graphics, 19, 12 (2013), 2227-36. HCIL-2013-11
38. AS-IS
• Audit byAcademicCenter forGeneral Practice
• perceived as control
• Limited tools available:
Wednesday, October 21, 2015 38
query window from Medidoc