SlideShare a Scribd company logo
1 of 29
Download to read offline
DATA SCIENCE
ECOSYSTEM
M. TAMER ÖZSU NANCY REID RAYMOND NG
U. WATERLOO U. TORONTO UBC
Canadian Data Science Workshop
DATA SCIENCE/BIG DATA IN THE NEWS…
2
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE EVERYWHERE!...
3
Canadian Data Science Workshop
DATA SCIENCE VOCABULARY
4
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• “Data science, also known as data-driven science, is an
interdisciplinary field of scientific methods, processes,
algorithms and systems to extract knowledge or insights
from data in various forms, either structured or
unstructured, similar to data mining.”
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• “Data science, also known as data-driven science, is an
interdisciplinary field of scientific methods, processes,
algorithms and systems to extract knowledge or insights
from data in various forms, either structured or
unstructured, similar to data mining.”
• “Data science intends to analyze and understand actual
phenomena with ‘data’. In other words, the aim of data science
is to reveal the features or the hidden structure of complicated
natural, human, and social phenomena with data from a
different point of view from the established or traditional theory
and method.”
5
Canadian Data Science Workshop
WHAT IS DATA SCIENCE?
• Fourth paradigm
• “… change of all sciences moving from observational, to
theoretical, to computational and now to the 4th Paradigm –
Data-Intensive Scientific Discovery”
6
Canadian Data Science Workshop
WHAT IS IMPORTANT?
Need to solve a real problem using data…
No applications, no data science.
7
Canadian Data Science Workshop
DATA SCIENCE AS A UNIFIER
8
Data
Science
Humanities
Machine/
Statistical
Learning
Application
Domain
Expertise
Visualization
Mathematical
Optimization
Social
Science
Law
Data
Management
Canadian Data Science Workshop
DATA SCIENCE AND BIG DATA
• They are not the “same thing”
• Big data = crude oil
• Big data is about extracting “crude oil”, transporting it in “mega tankers”,
siphoning it through “pipelines”, and storing it in “massive silos”
• Data science is about refining the “crude oil”
Carlos Samohano
Founder, Data Science London
9
Canadian Data Science Workshop
DATA SCIENCE AND ARTIFICIAL INTELLIGENCE
Data
Science
Artificial
Intelligence
ML/DM/
Analytics
10
Canadian Data Science Workshop
DATA SCIENCE AND ARTIFICIAL INTELLIGENCE
Data
Science
Artificial
Intelligence
ML/DM/
Analytics
10
“Data science produces insights.
Machine learning produces predictions”
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Fraud detection
• Investigate fraud patterns in past data
• Early detection is important
• Before damage propagates
• Harder than late detection
• Precision is important
• False positive and false negative are both
bad
• Real-time analytics
11
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Recommender systems
• The ability to offer unique
personalized service
• Increase sales, click-through rates,
conversions, …
• Netflix recommender system valued at
$1B per year
• Amazon recommender system drives a
20-35% lift in sales annually
• Collaborative filtering at scale
12
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Predicting why patients are being
readmitted
• Reduce costs
• Improve population health
• Find the “why” behind specific
populations being readmitted
• Data lakes of multiple data sources
• Investigate ties between readmission and
socioeconomic data points, patient
history, genetics, …
13
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• “Smart cities”
• Not well-defined
• Generally refers to using data and
ICT to
• Better plan communities
• Better manage assets
• Reduce costs
• Deploy open data to better engage
with community
14
Canadian Data Science Workshop
DATA SCIENCE APPLICATION EXAMPLES
• Moneyball
• How to build a baseball team on a very
low budget by relying on data
• Sabermetrics: the statistical analysis of
baseball data to objectively evaluate
performance
• 2002 record of 103-59 was joint best in
MLB
• Team salary budget: $40 million
• Other team: Yankees
• Team salary budget: $120 million
15
Canadian Data Science Workshop
HOLISTIC APPROACH TO DATA SCIENCE
Dissemination &
Visualization
Ethics, Policy & Social Impact
Core
Data
Acquisition
Data
Preservation
16
Modeling &
Analysis
Management of
Big Data
Making Data
Trustable &
Usable
Data Security & Privacy
Application
Application
Application
Application
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
• Visualization for wider
audience
• Visualization for data
exploration
• Open data technologies
17
Canadian Data Science Workshop
CORE RESEARCH ISSUES & INTERACTIONS
Making Data
Trustable &
Usable
Modelling &
Analysis
Data
Visualization &
Dissemination
Big Data
Management
• Data cleaning
• Sampling
• Data provenance
• Data lakes
• Batch & online access
• Platforms
• Models & methods for data
lakes
• Unsupervised
classification & AI
• Visualization for wider
audience
• Visualization for data
exploration
• Open data technologies
• DM support for
provenance
• Data preparation for big
data management
• Cleaning for data
analysis
• DM for ML
• ML for DM
• Visual analytics
…
17

More Related Content

Similar to Data Science

Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introductionhktripathy
 
The Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for AnalyticsThe Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for AnalyticsSAS Canada
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptxAkhirulAminulloh2
 
Data mining techniques unit 1
Data mining techniques  unit 1Data mining techniques  unit 1
Data mining techniques unit 1malathieswaran29
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptxXanGwaps
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3varshakumar21
 
Dia sds2015 web version
Dia sds2015 web versionDia sds2015 web version
Dia sds2015 web versionMichael Brodie
 
The Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science ProjectsThe Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science ProjectsGramener
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big DataIndu Khemchandani
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxssuser1a4f0f
 
Keynote: GraphTour Toronto
Keynote: GraphTour TorontoKeynote: GraphTour Toronto
Keynote: GraphTour TorontoNeo4j
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxwahiba ben abdessalem
 
Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019Edwin S. Garcia
 
Rethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data HubRethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data HubCloudera, Inc.
 

Similar to Data Science (20)

Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
 
Data mining
Data miningData mining
Data mining
 
The Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for AnalyticsThe Evolution of Data and New Opportunities for Analytics
The Evolution of Data and New Opportunities for Analytics
 
Data science unit1
Data science unit1Data science unit1
Data science unit1
 
Oracle openworld-presentation
Oracle openworld-presentationOracle openworld-presentation
Oracle openworld-presentation
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptx
 
Data mining techniques unit 1
Data mining techniques  unit 1Data mining techniques  unit 1
Data mining techniques unit 1
 
BAS 250 Lecture 1
BAS 250 Lecture 1BAS 250 Lecture 1
BAS 250 Lecture 1
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3
 
Cs501 dm intro
Cs501 dm introCs501 dm intro
Cs501 dm intro
 
Dia sds2015 web version
Dia sds2015 web versionDia sds2015 web version
Dia sds2015 web version
 
The Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science ProjectsThe Most Effective Method For Selecting Data Science Projects
The Most Effective Method For Selecting Data Science Projects
 
Baker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated AudiencesBaker - Evolution of Data Products and Designated Audiences
Baker - Evolution of Data Products and Designated Audiences
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big Data
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
 
Keynote: GraphTour Toronto
Keynote: GraphTour TorontoKeynote: GraphTour Toronto
Keynote: GraphTour Toronto
 
Data_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptxData_Science_Applications_&_Use_Cases.pptx
Data_Science_Applications_&_Use_Cases.pptx
 
Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019Data Mining @ BSU Malolos 2019
Data Mining @ BSU Malolos 2019
 
Rethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data HubRethink Analytics with an Enterprise Data Hub
Rethink Analytics with an Enterprise Data Hub
 

Recently uploaded

POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...M56BOOKSTORE PRODUCT/SERVICE
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
Capitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitolTechU
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxJiesonDelaCerna
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 

Recently uploaded (20)

POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
 
Capitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptx
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 

Data Science

  • 1. DATA SCIENCE ECOSYSTEM M. TAMER ÖZSU NANCY REID RAYMOND NG U. WATERLOO U. TORONTO UBC
  • 2. Canadian Data Science Workshop DATA SCIENCE/BIG DATA IN THE NEWS… 2
  • 3. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 4. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 5. Canadian Data Science Workshop DATA SCIENCE EVERYWHERE!... 3
  • 6. Canadian Data Science Workshop DATA SCIENCE VOCABULARY 4
  • 7. Canadian Data Science Workshop WHAT IS DATA SCIENCE? 5
  • 8. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • “Data science, also known as data-driven science, is an interdisciplinary field of scientific methods, processes, algorithms and systems to extract knowledge or insights from data in various forms, either structured or unstructured, similar to data mining.” 5
  • 9. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • “Data science, also known as data-driven science, is an interdisciplinary field of scientific methods, processes, algorithms and systems to extract knowledge or insights from data in various forms, either structured or unstructured, similar to data mining.” • “Data science intends to analyze and understand actual phenomena with ‘data’. In other words, the aim of data science is to reveal the features or the hidden structure of complicated natural, human, and social phenomena with data from a different point of view from the established or traditional theory and method.” 5
  • 10. Canadian Data Science Workshop WHAT IS DATA SCIENCE? • Fourth paradigm • “… change of all sciences moving from observational, to theoretical, to computational and now to the 4th Paradigm – Data-Intensive Scientific Discovery” 6
  • 11. Canadian Data Science Workshop WHAT IS IMPORTANT? Need to solve a real problem using data… No applications, no data science. 7
  • 12. Canadian Data Science Workshop DATA SCIENCE AS A UNIFIER 8 Data Science Humanities Machine/ Statistical Learning Application Domain Expertise Visualization Mathematical Optimization Social Science Law Data Management
  • 13. Canadian Data Science Workshop DATA SCIENCE AND BIG DATA • They are not the “same thing” • Big data = crude oil • Big data is about extracting “crude oil”, transporting it in “mega tankers”, siphoning it through “pipelines”, and storing it in “massive silos” • Data science is about refining the “crude oil” Carlos Samohano Founder, Data Science London 9
  • 14. Canadian Data Science Workshop DATA SCIENCE AND ARTIFICIAL INTELLIGENCE Data Science Artificial Intelligence ML/DM/ Analytics 10
  • 15. Canadian Data Science Workshop DATA SCIENCE AND ARTIFICIAL INTELLIGENCE Data Science Artificial Intelligence ML/DM/ Analytics 10 “Data science produces insights. Machine learning produces predictions”
  • 16. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Fraud detection • Investigate fraud patterns in past data • Early detection is important • Before damage propagates • Harder than late detection • Precision is important • False positive and false negative are both bad • Real-time analytics 11
  • 17. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Recommender systems • The ability to offer unique personalized service • Increase sales, click-through rates, conversions, … • Netflix recommender system valued at $1B per year • Amazon recommender system drives a 20-35% lift in sales annually • Collaborative filtering at scale 12
  • 18. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Predicting why patients are being readmitted • Reduce costs • Improve population health • Find the “why” behind specific populations being readmitted • Data lakes of multiple data sources • Investigate ties between readmission and socioeconomic data points, patient history, genetics, … 13
  • 19. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined 14
  • 20. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined 14
  • 21. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • “Smart cities” • Not well-defined • Generally refers to using data and ICT to • Better plan communities • Better manage assets • Reduce costs • Deploy open data to better engage with community 14
  • 22. Canadian Data Science Workshop DATA SCIENCE APPLICATION EXAMPLES • Moneyball • How to build a baseball team on a very low budget by relying on data • Sabermetrics: the statistical analysis of baseball data to objectively evaluate performance • 2002 record of 103-59 was joint best in MLB • Team salary budget: $40 million • Other team: Yankees • Team salary budget: $120 million 15
  • 23. Canadian Data Science Workshop HOLISTIC APPROACH TO DATA SCIENCE Dissemination & Visualization Ethics, Policy & Social Impact Core Data Acquisition Data Preservation 16 Modeling & Analysis Management of Big Data Making Data Trustable & Usable Data Security & Privacy Application Application Application Application
  • 24. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management 17
  • 25. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance 17
  • 26. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms 17
  • 27. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI 17
  • 28. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI • Visualization for wider audience • Visualization for data exploration • Open data technologies 17
  • 29. Canadian Data Science Workshop CORE RESEARCH ISSUES & INTERACTIONS Making Data Trustable & Usable Modelling & Analysis Data Visualization & Dissemination Big Data Management • Data cleaning • Sampling • Data provenance • Data lakes • Batch & online access • Platforms • Models & methods for data lakes • Unsupervised classification & AI • Visualization for wider audience • Visualization for data exploration • Open data technologies • DM support for provenance • Data preparation for big data management • Cleaning for data analysis • DM for ML • ML for DM • Visual analytics … 17