Your SlideShare is downloading. ×
  Associate Professor  Department of Health Policy, Management and Evaluation, University of Toronto; Senior Scientist ,  ...
CDC http://www.webcitation.org/5h4wOBpC1 Swine Flu / H1N1 Posible caso de influenza, (C) Hello32020,  licensed under CC-by...
Count what is countable, measure what is measurable. What is not measurable, make measurable.  [Galileo Galilei]
The premise <ul><li>“ The Internet has made measurable what was previously immeasurable: The distribution of health inform...
“ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g...
“ Infodemiology” the epidemiology of information   Describing and analyzing information & communication patterns and its r...
Infoveillance = “using infodemiology data for surveillance purposes” Eysenbach G Infodemiology and Infoveillance: Framewor...
Infovigil - an infoveillance prototype Centre for Global eHealth Innovation, Toronto,  in collaboration with OAHPP Infovig...
http://www.jmir.org/2009/1/e11/
Infodemiology *  Application Areas <ul><li>detecting and quantifying disparities in health information availability </li><...
“ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g...
Information prevalence (plotted against disease incidence)
Information occurance ratios: Linguistic/cultural differences and inequalities in health information availability
Co-occurance ratios as metric for knowledge translation/uptake
Methodological Challenges <ul><li>Search engines such as Google provide estimates (vary from day-to-day or hour-to-hour) <...
http://www.webcitation.org/5h43hTpxz
Swineflu vs H1N1 terminology on Twitter
“ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g...
 
 
 
Drawback of surveys <ul><li>Not real-time data </li></ul><ul><li>Measure what people say they do (rather than measuring wh...
A “demand metric”:  Health-related searches on the web Eysenbach G, Köhler C. What is the Prevalence of Health-related Sea...
Breakdown of health-related search engine queries by category  Eysenbach G, Köhler C. Health-Related Searches on the Inter...
Daily searches on Google.ca for “flu” or “flu symptoms” 2003/2004 2007/2008 2004/2005 2005/2006 2006/2007 Impressions (sea...
Why Syndromic Surveillance? <ul><li>“ The fundamental objective of syndromic surveillance is to identify illness clusters ...
“ before  diagnoses are confirmed” In reality, many syndromic surveillance systems tap into clinical data - we know little...
“ I have an idea -- let’s start thinking outside the box”
What is the first thing many people do before they see a doctor (or call Telehealth Ontario), or take OTC medicines?
Before seeing/calling a doctor  many people do this:
Confirmed diagnoses Preliminary  diagnoses Orders Laboratory tests Physician office visits EMS activity ED visits, Hospita...
Two examples Demand-based infoveillance: Google Supply-based infoveillance: Twitter
Demand-based infoveillance Google searches
Infodemiology: Tracking demand for health information for syndromic surveillance Eysenbach G. Infodemiology. Proc AMIA Fal...
What is the correlation between <ul><li>Traditional flu surveillance metrics (per week) </li></ul><ul><ul><li>ILI:  Influe...
Correlation clicks vs next wk cases Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
Correlation sentinel physicians ILI reports vs next wk cases Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
Eysenbach G. Infodemiology and Infoveillance: Framework for an Emerging Set of Public Health Informatics Methods to Analyz...
J Ginsberg  et al.   Nature  2009  doi:10.1038/nature07634 A comparison of model estimates for the mid-Atlantic  region (b...
Wilson K, Brownstein JS. Early detection of disease outbreaks using the Internet. CMAJ 2009. DOI: 10.1503/cmaj.1090215
Supply-based infoveillance Example: Twitter status updates
 
 
 
 
 
 
 
 
 
 
 
 
 
The next step:  Involving consumers, guiding consumer actively to questionnaires to solicit additional information
 
 
 
Syndromic Surveillance 2.0 Actively involving the public
 
 
 
 
Internet (Twitter/Google)-based  surveillance  esp. appropriate for <ul><li>Symptoms which are  noticable  for the consume...
Real outbreak or “epidemic of fear”? Public Health response to suspected outbreak Public Health response to surge in infor...
Infoveillance <ul><li>Applicable for infectious diseases </li></ul><ul><li>But also for chronic conditions (monitor misinf...
Questions I have <ul><li>Partners? (you?) </li></ul><ul><li>Funders? </li></ul><ul><li>Application Areas:  For which condi...
“ Your proposal is innovative. Unfortunately, we won’t be able to use it because we never tried it’s something before.”
Infodemiology *  Application Areas <ul><li>detecting and quantifying disparities in health information availability </li><...
Thanks for your attention !
  Associate Professor  Department of Health Policy, Management and Evaluation, University of Toronto; Senior Scientist ,  ...
Upcoming SlideShare
Loading in...5
×

Infodemiology, Infoveillance, Twitter- and Google-based Surveillance: The Infovigil System

2,222

Published on

Seminar talk at the University of Twente, presenting preliminary infoveillance results, using Twitter and Google

Published in: Health & Medicine, Education
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,222
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • Transcript of "Infodemiology, Infoveillance, Twitter- and Google-based Surveillance: The Infovigil System"

    1. 1. Associate Professor  Department of Health Policy, Management and Evaluation, University of Toronto; Senior Scientist ,  Centre for Global eHealth Innovation, Division of Medical Decision Making and Health Care Research;  Toronto General Research Institute of the UHN, Toronto General Hospital, Canada [email_address] Gunther Eysenbach MD MPH Gunther Eysenbach MD MPH Infodemiology and Infoveillance Infodemiology and Infoveillance
    2. 2. CDC http://www.webcitation.org/5h4wOBpC1 Swine Flu / H1N1 Posible caso de influenza, (C) Hello32020, licensed under CC-by license
    3. 3. Count what is countable, measure what is measurable. What is not measurable, make measurable. [Galileo Galilei]
    4. 4. The premise <ul><li>“ The Internet has made measurable what was previously immeasurable: The distribution of health information in a population, tracking (in real time) health information trends over time, and identifying gaps between information supply and demand. “ </li></ul>Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
    5. 5. “ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g. on the Web) for public health purposes Demand Metrics (search & navigation) Supply Metrics (what’s published) Gunther Eysenbach J Med Internet Res 2009;11(1):e11
    6. 6. “ Infodemiology” the epidemiology of information Describing and analyzing information & communication patterns and its relationship to population health status The science of distribution and determinants of disease in populations Epidemiology Public Health Professionals Policy Makers Public Health Interventions Policy Decisions Population Health Status The notion of “infodemiology” G. Eysenbach. Infodemiology. American Journal of Medicine , 2002;113(0):763-765 Information & Communication patterns
    7. 7. Infoveillance = “using infodemiology data for surveillance purposes” Eysenbach G Infodemiology and Infoveillance: Framework for an Emerging Set of Public Health Informatics Methods to Analyze Search, Communication and Publication Behavior on the Internet J Med Internet Res 2009;11(1):e11 URL: http://www.jmir.org/2009/1/e11 doi: 10.2196/jmir.1157
    8. 8. Infovigil - an infoveillance prototype Centre for Global eHealth Innovation, Toronto, in collaboration with OAHPP Infovigil Aggregator/ Datamining/ Vizualisation Public, Clinicians, Epidemiologists Websites Filter Keywords / Concepts of Interest Online Questionnaires
    9. 9. http://www.jmir.org/2009/1/e11/
    10. 10. Infodemiology * Application Areas <ul><li>detecting and quantifying disparities in health information availability </li></ul><ul><li>identifying and monitoring of public health relevant publications on the Internet </li></ul><ul><li>measure information diffusion and knowledge translation, and tracking the effectiveness of health marketing campaigns. </li></ul><ul><li>Monitoring health-related behavior </li></ul><ul><li>Syndromic surveillance </li></ul>* science of distribution and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy.
    11. 11. “ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g. on the Web) Demand Metrics Supply Metrics Gunther Eysenbach Infodemiology: the epidemiology of (mis)information American Journal of Medicine , 2002;113(0):763-765
    12. 12. Information prevalence (plotted against disease incidence)
    13. 13. Information occurance ratios: Linguistic/cultural differences and inequalities in health information availability
    14. 14. Co-occurance ratios as metric for knowledge translation/uptake
    15. 15. Methodological Challenges <ul><li>Search engines such as Google provide estimates (vary from day-to-day or hour-to-hour) </li></ul><ul><li>“ hits” (word occurrences) instead of semantic occurrences </li></ul><ul><li>=> Infovigil infodemiology system: Dedicated system to collect metrics across different search engines and continuously </li></ul>
    16. 16. http://www.webcitation.org/5h43hTpxz
    17. 17. Swineflu vs H1N1 terminology on Twitter
    18. 18. “ Infodemiology” the epidemiology of information Describing and analyzing health information & communication patterns (e.g. on the Web) Demand Metrics Supply Metrics Gunther Eysenbach Infodemiology: the epidemiology of (mis)information American Journal of Medicine , 2002;113(0):763-765
    19. 22. Drawback of surveys <ul><li>Not real-time data </li></ul><ul><li>Measure what people say they do (rather than measuring what people actually do) </li></ul><ul><li>Biases (social desirability bias etc.) </li></ul><ul><li>Expensive </li></ul>
    20. 23. A “demand metric”: Health-related searches on the web Eysenbach G, Köhler C. What is the Prevalence of Health-related Searches on the World Wide Web? Qualitative and Quantitative Analysis of Search Engine Queries on the Internet. Proc AMIA Annu Fall Symp ; 2003: 225-229 Eysenbach G, Köhler C. Health-Related Searches on the Internet JAMA , Jun 2004; 291: 2946. Method also used by e.g.: Cobb NK, Graham AL Characterizing Internet Searchers of Smoking Cessation Information J Med Internet Res 2006;8(3):e17 <URL: http://www.jmir.org/2006/3/e17/>
    21. 24. Breakdown of health-related search engine queries by category Eysenbach G, Köhler C. Health-Related Searches on the Internet JAMA 2004; 291:2946
    22. 25. Daily searches on Google.ca for “flu” or “flu symptoms” 2003/2004 2007/2008 2004/2005 2005/2006 2006/2007 Impressions (searches)
    23. 26. Why Syndromic Surveillance? <ul><li>“ The fundamental objective of syndromic surveillance is to identify illness clusters early, before diagnoses are confirmed and reported to public health agencies, and to mobilize a rapid response, thereby reducing morbidity and mortality.” (Kelly J. Henning, MMWR 2004, http://www. webcitation .org/5fde6JBKx ) </li></ul>
    24. 27. “ before diagnoses are confirmed” In reality, many syndromic surveillance systems tap into clinical data - we know little what is going on at people’s home when they first notice symptoms, before they see/call a doctor
    25. 28. “ I have an idea -- let’s start thinking outside the box”
    26. 29. What is the first thing many people do before they see a doctor (or call Telehealth Ontario), or take OTC medicines?
    27. 30. Before seeing/calling a doctor many people do this:
    28. 31. Confirmed diagnoses Preliminary diagnoses Orders Laboratory tests Physician office visits EMS activity ED visits, Hospitalizations Incubation Period Exposure Symptom onset Health behavior Information seeking (web clickstream, etc.) Over the counter and prescription medications School and work absenteeism Nurse triage telephone calls Health and healthcare behaviors Healthcare encounter Surveillance of citizen self-assessments & status updates Initial findings Data types Timeline Biological sensors Syndromic Surveillance Diagnostics Final diagnosis Medical evaluation Additional evaluation Adapted from Mandl 2007
    29. 32. Two examples Demand-based infoveillance: Google Supply-based infoveillance: Twitter
    30. 33. Demand-based infoveillance Google searches
    31. 34. Infodemiology: Tracking demand for health information for syndromic surveillance Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
    32. 35. What is the correlation between <ul><li>Traditional flu surveillance metrics (per week) </li></ul><ul><ul><li>ILI: Influenza-like illness (ILI) consultation rates (rate per 1.000 visits) </li></ul></ul><ul><ul><li>Total number of influenza tests performed in testing laboratories </li></ul></ul><ul><ul><li>Number of positive lab tests (“cases”) </li></ul></ul><ul><li>Google metrics (searches + ad clicks) </li></ul><ul><ul><li>Impressions (ad views, correlates with number of flu-related search queries entered) </li></ul></ul><ul><ul><li>Click-thru-rate </li></ul></ul><ul><ul><li>Clicks on “do you have the flu?” ad </li></ul></ul>Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
    33. 36. Correlation clicks vs next wk cases Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
    34. 37. Correlation sentinel physicians ILI reports vs next wk cases Eysenbach G. Infodemiology. Proc AMIA Fall Symp 2006
    35. 38. Eysenbach G. Infodemiology and Infoveillance: Framework for an Emerging Set of Public Health Informatics Methods to Analyze Search, Communication and Publication Behavior on the Internet. J Med Internet Res 2009;11(1):e11 URL: http://www.jmir.org/2009/1/e11 doi: 10.2196/jmir.1157
    36. 39. J Ginsberg et al. Nature 2009 doi:10.1038/nature07634 A comparison of model estimates for the mid-Atlantic region (black) against CDC-reported ILI percentages (red), including points over which the model was fit and validated.
    37. 40. Wilson K, Brownstein JS. Early detection of disease outbreaks using the Internet. CMAJ 2009. DOI: 10.1503/cmaj.1090215
    38. 41. Supply-based infoveillance Example: Twitter status updates
    39. 55. The next step: Involving consumers, guiding consumer actively to questionnaires to solicit additional information
    40. 59. Syndromic Surveillance 2.0 Actively involving the public
    41. 64. Internet (Twitter/Google)-based surveillance esp. appropriate for <ul><li>Symptoms which are noticable for the consumer (and bothersome enough to microblog about it or search information) </li></ul><ul><li>Conditions with long lag time between preclinical symptoms and presentation at Emergency Department / Physician </li></ul><ul><li>Symptoms in younger people (18-55 yrs) </li></ul><ul><li>Can obtain further information (ask about other symptoms) through rapid online questionnaire and/or direct consumer to interventions </li></ul>
    42. 65. Real outbreak or “epidemic of fear”? Public Health response to suspected outbreak Public Health response to surge in information needs Other traditional surveillance data Infoveillance Data <ul><li>Even in the absence of any predictive value </li></ul><ul><li>for outbreaks data can be used: </li></ul><ul><li>-to improve health communication </li></ul><ul><li>Learn about population behavior + knowledge </li></ul><ul><li>Build consumer health vocabulary </li></ul>Real epidemic Epidemic of fear
    43. 66. Infoveillance <ul><li>Applicable for infectious diseases </li></ul><ul><li>But also for chronic conditions (monitor misinformation, consumer information needs, information gaps) </li></ul>
    44. 67. Questions I have <ul><li>Partners? (you?) </li></ul><ul><li>Funders? </li></ul><ul><li>Application Areas: For which conditions (concepts) is “infoveillance” useful? </li></ul><ul><ul><li>Which keywords/syndromes should we monitor? </li></ul></ul><ul><ul><li>What further information should we gather (rapid questionnaires)? </li></ul></ul><ul><ul><li>What are the interventions we should consumers guide to? </li></ul></ul>
    45. 68. “ Your proposal is innovative. Unfortunately, we won’t be able to use it because we never tried it’s something before.”
    46. 69. Infodemiology * Application Areas <ul><li>detecting and quantifying disparities in health information availability </li></ul><ul><li>identifying and monitoring of public health relevant publications on the Internet </li></ul><ul><li>measure information diffusion and knowledge translation, and tracking the effectiveness of health marketing campaigns. </li></ul><ul><li>Monitoring health-related behavior </li></ul><ul><li>Syndromic surveillance </li></ul>* science of distribution and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy.
    47. 70. Thanks for your attention !
    48. 71. Associate Professor  Department of Health Policy, Management and Evaluation, University of Toronto; Senior Scientist ,  Centre for Global eHealth Innovation, Division of Medical Decision Making and Health Care Research;  Toronto General Research Institute of the UHN, Toronto General Hospital, Canada [email_address] www.jmir.org Twitter:eysenbach Gunther Eysenbach MD MPH Gunther Eysenbach MD MPH Thank you! Thank you !

    ×