SlideShare a Scribd company logo
1 of 23
Download to read offline
EDA (Exploratory Data Analysis) of Bahmni (EMR) data
Karrtik Iyer
Mail: @karrtik
Tweets @karrtikiyer
YouTube playlist
Purpose
Explore EMR data collected over a period of time to:
1. Derive insights
2. Observe Trends
3. Establish probable correlations.
4. Help community to get started to explore their EMR data.
Objectives/Agenda
1. Look at patient trend across various regions
2. Top 10 diagnosis reported
3. Pick up top diagnosis to further analyze
a. Male/Female ratio
b. Top regions/villages
c. Age distribution
d. Year wise trend
e. Explore observations/results and chief complaints reported for these patients.
4. Insights from data and challenges
5. Quick peek into other insights which can be derived from this EMR data.
Pre-requisites
1. Basic knowledge of
a. Bahmni/OpenMRS data model and concept dictionary
b. SQL
c. R (RStudio IDE)
2. PC/MAC/Linux machine set up with
a. MySQL Client to connect to the MYSQL server on which Bahmni anonymous DB is set up,
it could be either local or remote server
b. R and RStudio installed
Why R?
1. Open source with great community support.
2. Lot of inbuilt packages for descriptive and predictive analytics which can
be used out of box.
a. Very good mix of packages for querying and plotting the data
3. Easy to learn and use
Let's get going
All hands on exercises are performed on
anonymous data!!!
Part 1
Fundamentals
1. Exploring tables and columns of our interests
2. Using R/RStudio
a. Connect to MYSQL DB
b. Load required R packages
Patients across Regions
1. Number of patients reported across various cities/villages.
2. Percentage of Male/Female Ratio
3. Percentage of patients from each region in top 10 cities/villages
Patient Across Regions
Part 2
Top 10 diagnosis
1. Explore distribution of various diagnoses reported across Male/Females
2. Pick up top 10 diagnosis and look at the male/female ratio
Top Diagnosis - Gastritis
Look at
1. Top 5 regions
a. With Male/Female distribution
2. Age distribution for Male/Female in the top 5 regions.
a. Boxplot
b. Histogram
3. Year wise trend
Top 10 Diagnosis
Gastritis - Deep Dive
Part 3
Explore results for top diagnosis - Gastritis
1. Gather all results for patients with gastritis.
2. Look at important results for female to identify any trends
Top Chronic Diagnosis - Diabetes
1. Gather all the lab results
2. Explore HBA1C results.
a. Lack of consistent data
3. Analyze Hemoglobin levels
a. Outliers
b. Flooring and Capping
c. Check for gender bias in 12 to 18 age group
Exploring Results
Part 4
What’s next?
1. Better understanding of data
2. Data cleaning and preparation
a. City/Village misspelled
b. Outlier detection and replacement strategy
c. Descriptive statistics, measures of central tendency, skewness, hypothesis testing.
3. Feature transformation
a. Extract new features
i. Like Average sugar levels from fasting and postprandial blood sugar levels
ii. Binning of variables such as age to infant, youth, adult, etc..
b. Natural Language processing (NLP)
i. Chief complaints
4. Clustering of patients
References and Links
1. R & RStudio: https://www.rstudio.com/products/rstudio/
2. MySQL:
https://dev.mysql.com/doc/refman/5.6/en/osx-installation-pkg.html
3. RBlogs: https://www.r-bloggers.com/
4. Source Code: https://github.com/karrtikiyer-tw/bahmni-eda
5. YouTube playlist
Thank you!
Please leave your feedback and suggestions via comments.

More Related Content

Recently uploaded

一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
pyhepag
 
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotecAbortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理
cyebo
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
pyhepag
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
DilipVasan
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理
pyhepag
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理
pyhepag
 
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
Amil baba
 

Recently uploaded (20)

一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
 
Easy and simple project file on mp online
Easy and simple project file on mp onlineEasy and simple project file on mp online
Easy and simple project file on mp online
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdf
 
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotecAbortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
Abortion pills in Dammam Saudi Arabia// +966572737505 // buy cytotec
 
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfGenerative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
 
一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理一比一原版麦考瑞大学毕业证成绩单如何办理
一比一原版麦考瑞大学毕业证成绩单如何办理
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdf
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)
 
Machine Learning for Accident Severity Prediction
Machine Learning for Accident Severity PredictionMachine Learning for Accident Severity Prediction
Machine Learning for Accident Severity Prediction
 
How I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonHow I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prison
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
 
The Significance of Transliteration Enhancing
The Significance of Transliteration EnhancingThe Significance of Transliteration Enhancing
The Significance of Transliteration Enhancing
 
一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理一比一原版阿德莱德大学毕业证成绩单如何办理
一比一原版阿德莱德大学毕业证成绩单如何办理
 
社内勉強会資料  Mamba - A new era or ephemeral
社内勉強会資料   Mamba - A new era or ephemeral社内勉強会資料   Mamba - A new era or ephemeral
社内勉強会資料  Mamba - A new era or ephemeral
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理
 
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
 

Featured

Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Saba Software
 

Featured (20)

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 

Exploratory Data Analysis of Bahmni with R

  • 1. EDA (Exploratory Data Analysis) of Bahmni (EMR) data Karrtik Iyer Mail: @karrtik Tweets @karrtikiyer YouTube playlist
  • 2. Purpose Explore EMR data collected over a period of time to: 1. Derive insights 2. Observe Trends 3. Establish probable correlations. 4. Help community to get started to explore their EMR data.
  • 3. Objectives/Agenda 1. Look at patient trend across various regions 2. Top 10 diagnosis reported 3. Pick up top diagnosis to further analyze a. Male/Female ratio b. Top regions/villages c. Age distribution d. Year wise trend e. Explore observations/results and chief complaints reported for these patients. 4. Insights from data and challenges 5. Quick peek into other insights which can be derived from this EMR data.
  • 4. Pre-requisites 1. Basic knowledge of a. Bahmni/OpenMRS data model and concept dictionary b. SQL c. R (RStudio IDE) 2. PC/MAC/Linux machine set up with a. MySQL Client to connect to the MYSQL server on which Bahmni anonymous DB is set up, it could be either local or remote server b. R and RStudio installed
  • 5. Why R? 1. Open source with great community support. 2. Lot of inbuilt packages for descriptive and predictive analytics which can be used out of box. a. Very good mix of packages for querying and plotting the data 3. Easy to learn and use
  • 6. Let's get going All hands on exercises are performed on anonymous data!!!
  • 8. Fundamentals 1. Exploring tables and columns of our interests 2. Using R/RStudio a. Connect to MYSQL DB b. Load required R packages
  • 9. Patients across Regions 1. Number of patients reported across various cities/villages. 2. Percentage of Male/Female Ratio 3. Percentage of patients from each region in top 10 cities/villages
  • 12. Top 10 diagnosis 1. Explore distribution of various diagnoses reported across Male/Females 2. Pick up top 10 diagnosis and look at the male/female ratio
  • 13. Top Diagnosis - Gastritis Look at 1. Top 5 regions a. With Male/Female distribution 2. Age distribution for Male/Female in the top 5 regions. a. Boxplot b. Histogram 3. Year wise trend
  • 17. Explore results for top diagnosis - Gastritis 1. Gather all results for patients with gastritis. 2. Look at important results for female to identify any trends
  • 18. Top Chronic Diagnosis - Diabetes 1. Gather all the lab results 2. Explore HBA1C results. a. Lack of consistent data 3. Analyze Hemoglobin levels a. Outliers b. Flooring and Capping c. Check for gender bias in 12 to 18 age group
  • 21. What’s next? 1. Better understanding of data 2. Data cleaning and preparation a. City/Village misspelled b. Outlier detection and replacement strategy c. Descriptive statistics, measures of central tendency, skewness, hypothesis testing. 3. Feature transformation a. Extract new features i. Like Average sugar levels from fasting and postprandial blood sugar levels ii. Binning of variables such as age to infant, youth, adult, etc.. b. Natural Language processing (NLP) i. Chief complaints 4. Clustering of patients
  • 22. References and Links 1. R & RStudio: https://www.rstudio.com/products/rstudio/ 2. MySQL: https://dev.mysql.com/doc/refman/5.6/en/osx-installation-pkg.html 3. RBlogs: https://www.r-bloggers.com/ 4. Source Code: https://github.com/karrtikiyer-tw/bahmni-eda 5. YouTube playlist
  • 23. Thank you! Please leave your feedback and suggestions via comments.