SlideShare a Scribd company logo
DATA SCIENCE
ECOSYSTEM
M. TAMER ÖZSU NANCY REID RAYMOND NG
U. WATERLOO U. TORONTO UBC
Canadian Data Science Workshop
DATA SCIENCE/BIG DATA IN THE NEWS…
2
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE VOCABULARY
4
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• “Data science, also known as data-driven science, is an
interdisciplinary field of scientific methods, processes,
algorithms and systems to extract knowledge or insights
from data in various forms, either structured or
unstructured, similar to data mining.”
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• “Data science, also known as data-driven science, is an
interdisciplinary field of scientific methods, processes,
algorithms and systems to extract knowledge or insights
from data in various forms, either structured or
unstructured, similar to data mining.”
• “Data science intends to analyze and understand actual
phenomena with ‘data’. In other words, the aim of data science
is to reveal the features or the hidden structure of complicated
natural, human, and social phenomena with data from a
different point of view from the established or traditional theory
and method.”
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• Fourth paradigm
• “… change of all sciences moving from observational, to
theoretical, to computational and now to the 4th Paradigm –
Data-Intensive Scientific Discovery”
6
Canadian Data Science Workshop
WHAT IS IMPORTANT?
Need to solve a real problem using data…
No applications, no data science.
7
Canadian Data Science Workshop
DATA SCIENCE AS A UNIFIER
8
Data
Science
Humanities
Machine/
Statistical
Learning
Application
Domain
Expertise
Visualization
Mathematical
Optimization
Social
Science
Law
Data
Management
Canadian Data Science Workshop
DATA SCIENCE AND BIG DATA
• They are not the “same thing”
• Big data = crude oil
• Big data is about extracting “crude oil”, transporting it in “mega tankers”,
siphoning it through “pipelines”, and storing it in “massive silos”
• Data science is about refining the “crude oil”
Carlos Samohano
Founder, Data Science London
9
Canadian Data Science Workshop
DATA SCIENCE AND ARTIFICIAL INTELLIGENCE
Data
Science
Artificial
Intelligence
ML/DM/
Analytics
10
Canadian Data Science Workshop
DATA SCIENCE AND ARTIFICIAL INTELLIGENCE
Data
Science
Artificial
Intelligence
ML/DM/
Analytics
10
“Data science produces insights.
Machine learning produces predictions”
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Fraud detection
• Investigate fraud patterns in past data
• Early detection is important
• Before damage propagates
• Harder than late detection
• Precision is important
• False positive and false negative are both
bad
• Real-time analytics
11
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Recommender systems
• The ability to offer unique
personalized service
• Increase sales, click-through rates,
conversions, …
• Netflix recommender system valued at
$1B per year
• Amazon recommender system drives a
20-35% lift in sales annually
• Collaborative filtering at scale
12
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Predicting why patients are being
readmitted
• Reduce costs
• Improve population health
• Find the “why” behind specific
populations being readmitted
• Data lakes of multiple data sources
• Investigate ties between readmission and
socioeconomic data points, patient
history, genetics, …
13
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
• Generally refers to using data and
ICT to
• Better plan communities
• Better manage assets
• Reduce costs
• Deploy open data to better engage
with community
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Moneyball
• How to build a baseball team on a very
low budget by relying on data
• Sabermetrics: the statistical analysis of
baseball data to objectively evaluate
performance
• 2002 record of 103-59 was joint best in
MLB
• Team salary budget: $40 million
• Other team: Yankees
• Team salary budget: $120 million
15
Canadian Data Science Workshop
HOLISTIC APPROACH TO DATA SCIENCE
Dissemination &
Visualization
Ethics, Policy & Social Impact
Core
Data
Acquisition
Data
Preservation
16
Modeling &
Analysis
Management of
Big Data
Making Data
Trustable &
Usable
Data Security & Privacy
Application
Application
Application
Application
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
• Visualization for wider
audience
• Visualization for data
exploration
• Open data technologies
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
• Visualization for wider
audience
• Visualization for data
exploration
• Open data technologies
• DM support for
provenance
• Data preparation for big
data management
• Cleaning for data
analysis
• DM for ML
• ML for DM
• Visual analytics
…
17

More Related Content

Similar to Data Science

Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
hktripathy
 
Data mining
Data miningData mining
Data mining
Akanksha Yadav
 
The Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for AnalyticsThe Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for Analytics
SAS Canada
 
Data science unit1
Data science unit1Data science unit1
Data science unit1
varshakumar21
 
Oracle openworld-presentation
Oracle openworld-presentationOracle openworld-presentation
Oracle openworld-presentation
Dr. Neil Brittliff
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptx
AkhirulAminulloh2
 
Data mining techniques unit 1
Data mining techniques  unit 1Data mining techniques  unit 1
Data mining techniques unit 1
malathieswaran29
 
BAS 250 Lecture 1
BAS 250 Lecture 1BAS 250 Lecture 1
BAS 250 Lecture 1
Wake Tech BAS
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
XanGwaps
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3
varshakumar21
 
Cs501 dm intro
Cs501 dm introCs501 dm intro
Cs501 dm intro
Kamal Singh Lodhi
 
Dia sds2015 web version
Dia sds2015 web versionDia sds2015 web version
Dia sds2015 web version
Michael Brodie
 
The Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science ProjectsThe Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science Projects
Gramener
 
Baker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated AudiencesBaker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated Audiences
National Information Standards Organization (NISO)
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big Data
Indu Khemchandani
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
ssuser1a4f0f
 
Keynote: GraphTour Toronto
Keynote: GraphTour TorontoKeynote: GraphTour Toronto
Keynote: GraphTour Toronto
Neo4j
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
wahiba ben abdessalem
 
Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019
Edwin S. Garcia
 
Rethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data HubRethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data Hub
Cloudera, Inc.
 

Similar to Data Science (20)

Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
 
Data mining
Data miningData mining
Data mining
 
The Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for AnalyticsThe Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for Analytics
 
Data science unit1
Data science unit1Data science unit1
Data science unit1
 
Oracle openworld-presentation
Oracle openworld-presentationOracle openworld-presentation
Oracle openworld-presentation
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptx
 
Data mining techniques unit 1
Data mining techniques  unit 1Data mining techniques  unit 1
Data mining techniques unit 1
 
BAS 250 Lecture 1
BAS 250 Lecture 1BAS 250 Lecture 1
BAS 250 Lecture 1
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3
 
Cs501 dm intro
Cs501 dm introCs501 dm intro
Cs501 dm intro
 
Dia sds2015 web version
Dia sds2015 web versionDia sds2015 web version
Dia sds2015 web version
 
The Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science ProjectsThe Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science Projects
 
Baker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated AudiencesBaker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated Audiences
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big Data
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
 
Keynote: GraphTour Toronto
Keynote: GraphTour TorontoKeynote: GraphTour Toronto
Keynote: GraphTour Toronto
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
 
Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019
 
Rethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data HubRethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data Hub
 

Recently uploaded

World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
ak6969907
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
sayalidalavi006
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
History of Stoke Newington
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
Celine George
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
TechSoup
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
Academy of Science of South Africa
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
David Douglas School District
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
heathfieldcps1
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
RitikBhardwaj56
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
Nguyen Thanh Tu Collection
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
Priyankaranawat4
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Excellence Foundation for South Sudan
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 

Recently uploaded (20)

World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 

Data Science

  • 1. DATA SCIENCE ECOSYSTEM M. TAMER ÖZSU NANCY REID RAYMOND NG U. WATERLOO U. TORONTO UBC
  • 2. Canadian Data Science Workshop DATA SCIENCE/BIG DATA IN THE NEWS… 2
  • 3. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 4. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 5. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 6. Canadian Data Science Workshop DATA SCIENCE VOCABULARY 4
  • 7. Canadian Data Science Workshop WHAT IS DATA SCIENCE? 5
  • 8. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • “Data science, also known as data-driven science, is an interdisciplinary field of scientific methods, processes, algorithms and systems to extract knowledge or insights from data in various forms, either structured or unstructured, similar to data mining.” 5
  • 9. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • “Data science, also known as data-driven science, is an interdisciplinary field of scientific methods, processes, algorithms and systems to extract knowledge or insights from data in various forms, either structured or unstructured, similar to data mining.” • “Data science intends to analyze and understand actual phenomena with ‘data’. In other words, the aim of data science is to reveal the features or the hidden structure of complicated natural, human, and social phenomena with data from a different point of view from the established or traditional theory and method.” 5
  • 10. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • Fourth paradigm • “… change of all sciences moving from observational, to theoretical, to computational and now to the 4th Paradigm – Data-Intensive Scientific Discovery” 6
  • 11. Canadian Data Science Workshop WHAT IS IMPORTANT? Need to solve a real problem using data… No applications, no data science. 7
  • 12. Canadian Data Science Workshop DATA SCIENCE AS A UNIFIER 8 Data Science Humanities Machine/ Statistical Learning Application Domain Expertise Visualization Mathematical Optimization Social Science Law Data Management
  • 13. Canadian Data Science Workshop DATA SCIENCE AND BIG DATA • They are not the “same thing” • Big data = crude oil • Big data is about extracting “crude oil”, transporting it in “mega tankers”, siphoning it through “pipelines”, and storing it in “massive silos” • Data science is about refining the “crude oil” Carlos Samohano Founder, Data Science London 9
  • 14. Canadian Data Science Workshop DATA SCIENCE AND ARTIFICIAL INTELLIGENCE Data Science Artificial Intelligence ML/DM/ Analytics 10
  • 15. Canadian Data Science Workshop DATA SCIENCE AND ARTIFICIAL INTELLIGENCE Data Science Artificial Intelligence ML/DM/ Analytics 10 “Data science produces insights. Machine learning produces predictions”
  • 16. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Fraud detection • Investigate fraud patterns in past data • Early detection is important • Before damage propagates • Harder than late detection • Precision is important • False positive and false negative are both bad • Real-time analytics 11
  • 17. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Recommender systems • The ability to offer unique personalized service • Increase sales, click-through rates, conversions, … • Netflix recommender system valued at $1B per year • Amazon recommender system drives a 20-35% lift in sales annually • Collaborative filtering at scale 12
  • 18. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Predicting why patients are being readmitted • Reduce costs • Improve population health • Find the “why” behind specific populations being readmitted • Data lakes of multiple data sources • Investigate ties between readmission and socioeconomic data points, patient history, genetics, … 13
  • 19. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined 14
  • 20. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined 14
  • 21. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined • Generally refers to using data and ICT to • Better plan communities • Better manage assets • Reduce costs • Deploy open data to better engage with community 14
  • 22. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Moneyball • How to build a baseball team on a very low budget by relying on data • Sabermetrics: the statistical analysis of baseball data to objectively evaluate performance • 2002 record of 103-59 was joint best in MLB • Team salary budget: $40 million • Other team: Yankees • Team salary budget: $120 million 15
  • 23. Canadian Data Science Workshop HOLISTIC APPROACH TO DATA SCIENCE Dissemination & Visualization Ethics, Policy & Social Impact Core Data Acquisition Data Preservation 16 Modeling & Analysis Management of Big Data Making Data Trustable & Usable Data Security & Privacy Application Application Application Application
  • 24. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management 17
  • 25. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance 17
  • 26. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms 17
  • 27. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI 17
  • 28. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI • Visualization for wider audience • Visualization for data exploration • Open data technologies 17
  • 29. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI • Visualization for wider audience • Visualization for data exploration • Open data technologies • DM support for provenance • Data preparation for big data management • Cleaning for data analysis • DM for ML • ML for DM • Visual analytics … 17