SlideShare a Scribd company logo
CS3352 -Foundations of Data
Science
Introduction to Data Science
Dr.V.Anusuya
Associate Professor/IT
Ramco Institute of Technology
Rajapalayam
Introduction
• Data Science is the area of study which involves extracting
insights from vast amounts of data using various scientific
methods, algorithms and processes.
• Data Science is useful to discover hidden patterns from the
voluminous raw data.
• Data Science is because of the evolution of mathematical
statistics, data analysis, and big data.
Contd.,
• Ingredients = Data
• When a chef is starting out with a new dish.
• After the chef has determined what type of dish he would like to
make, he goes to the fridge to gather ingredients. If he doesn’t
have the necessary ingredients, he takes a trip to the store to
collect them.
• As data scientists, our data points are our ingredients. We may
have some on hand, but we still might have to collect more
through web scraping, SQL queries, etc.
Big Data
• Data Science focuses on processing the huge
volume of heterogeneous data known as big
data.
• Big data refers to the data sets that are large
and complex in nature and difficult to process
using traditional data processing application
software.
Contd.,
• The characteristics of big data are often referred
to as the three Vs:
• Volume—How much data is there?
• Variety—How diverse are different types of
data?
• Velocity—At what speed is new data generated?
• Veracity-How accurate is the data?.
• These four properties make big data different
from the data found in traditional data
management tools.
Contd.,
• The four V’s of data make the data
capturing,cleaning,preprocessing,storing,search
ing,sharing,transferring and visualization
processes a complex task.
• Specialization techniques are required to extract
the insights from this huge volume of data.
• The main things that set a data scientist apart
from a statistician are the ability to work with
big data and experience in machine learning,
computing, and algorithm building.
Big data
• Tools- Hadoop, Pig, Spark, R, Python, and Java.
• Python is a great language for data science
because it has many data science libraries
available, and it’s widely supported by
specialized software.
Contd.,
• Data Science is an interdisciplinary field that
allows to extract knowledge from structured
or unstructured data.
• Translate business problem and Research
project into practical solution.
Benefits and uses of data science
• Data science and big data are used almost everywhere
in both commercial and noncommercial Settings.
• Commercial companies in almost every industry use
data science and big data to gain insights into their
customers, processes, staff, completion, and products.
• Many companies use data science to offer customers a
better user experience, as well as to cross-sell, up-sell,
and personalize their offerings.
Benefits and uses of data science
• Governmental organizations are also aware of data’s value. Many
governmental organizations not only rely on internal data scientists to
discover valuable information, but also share their data with the
public.
• Nongovernmental organizations (NGOs) use it to raise money and
defend their causes.
• Universities use data science in their research but also to enhance the
study experience of their students. The rise of massive open online
courses (MOOC) produces a lot of data, which allows universities to
study how this type of learning can complement traditional classes.
Facets of data
• In data science and big data we’ll come across
many different types of data, and each of them
tends to require different tools and techniques. The
main categories of data are these:
• Structured
• Unstructured
• Natural language
• Machine-generated
• Graph-based
• Audio, video, and images
• Streaming
Structured Data
•Structured data is data that depends on a
data model and resides in a fixed field within
a record.
•To store structured data in tables within
databases or Excel files.
•SQL, or Structured Query Language, is the
preferred way to manage and query data
that resides in databases.
•Hierarchical data such as a family tree.
Example
Unstructured Data
• Unstructured data is data that isn’t easy to fit
into a data model because the content is
context-specific or varying.
• Example of unstructured data is your regular
email.
• Although email contains structured elements
such as the sender, title, and body text.
• The thousands of different languages and
dialects out there further complicate this.
Example
Natural language
• Natural language is a special type of unstructured data; it’s challenging to
process because it requires knowledge of specific data science techniques
and linguistics.
• The natural language processing community has had success in entity
recognition, Speech recognition, summarization, text completion, and
sentiment analysis, but models trained in one domain don’t generalize well to
other domains.
• Even state-of-the-art techniques aren’t able to decipher the meaning of every
piece of text.
• Example: personal voice Assistant, siri, Alexa recognize patterns in speech,
provide a useful response.
• Example: Email Filters- Primary, Social ,Promotions
Machine-generated data
• Machine-generated data is information that’s
automatically created by a computer, process,
application, or other machine without human
intervention.
• Machine-generated data is becoming a major
data resource and will continue to do so.
• The analysis of machine data relies on highly
scalable tools, due to its high volume and
speed. Examples of machine data are web
server logs, call detail records, network event
logs, and telemetry.
Introduction to Data Science.pptx
Graph-based or Networked Data
• A graph is a mathematical structure to model
pair-wise relationships between objects.
• Graph or network data is, in short, data that
focuses on the relationship or adjacency of
objects.
• The graph structures use nodes, edges, and
properties to represent and store graphical data.
Contd.,
• Graph-based data is a natural way to represent
social networks, and its structure allows you to
calculate specific metrics such as the influence
of a person and the shortest path between two
people.
• Example
• LinkedIn-business colleagues, Twitter-
follower list.
• Facebook-connecting edges here to show
friends.
Graph based structure
Specialized query languages such as SPARQL
Audio, image, and video
• Audio, image, and video are data types that
pose specific challenges to a data scientist.
• Tasks that are trivial for humans, such as
recognizing objects in pictures, to be challenging
for computers.
• MLBAM (Major League Baseball Advanced
Media) announced in 2014 that they’ll increase
video capture to approximately 7 TB per game
for the purpose of live, in-game analytics.
Contd.,
• Recently a company called DeepMind
succeeded at creating an algorithm that’s
capable of learning how to play video games.
• This algorithm takes the video screen as input
and learns to interpret everything via a
complex of deep learning.
Streaming Data
• The data flows into the system when an event
happens instead of being loaded into a data
store in a batch.
• Examples are the “What’s trending” on
Twitter, live sporting or music events, and the
stock market.

More Related Content

What's hot

Region based segmentation
Region based segmentationRegion based segmentation
Region based segmentation
ramya marichamy
 
Data Science
Data ScienceData Science
Data Science
Prakhyath Rai
 
Data Mining: an Introduction
Data Mining: an IntroductionData Mining: an Introduction
Data Mining: an Introduction
Ali Abbasi
 
Data Integration and Transformation in Data mining
Data Integration and Transformation in Data miningData Integration and Transformation in Data mining
Data Integration and Transformation in Data mining
kavitha muneeshwaran
 
Region based segmentation
Region based segmentationRegion based segmentation
Region based segmentation
Inamul Hossain Imran
 
Polygons - Computer Graphics - Notes
Polygons - Computer Graphics - NotesPolygons - Computer Graphics - Notes
Polygons - Computer Graphics - Notes
Omprakash Chauhan
 
Feature scaling
Feature scalingFeature scaling
Feature scaling
Gautam Kumar
 
Image Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain FiltersImage Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain Filters
Karthika Ramachandran
 
Data preprocessing
Data preprocessingData preprocessing
Data preprocessing
ankur bhalla
 
Image segmentation
Image segmentation Image segmentation
Ann
Ann Ann
Ann
vini89
 
Regularization in deep learning
Regularization in deep learningRegularization in deep learning
Regularization in deep learning
Kien Le
 
Neural Networks: Radial Bases Functions (RBF)
Neural Networks: Radial Bases Functions (RBF)Neural Networks: Radial Bases Functions (RBF)
Neural Networks: Radial Bases Functions (RBF)
Mostafa G. M. Mostafa
 
Presentation machine learning
Presentation machine learningPresentation machine learning
Presentation machine learning
rajab ssemwogerere
 
Pattern recognition UNIT 5
Pattern recognition UNIT 5Pattern recognition UNIT 5
Pattern recognition UNIT 5
SURBHI SAROHA
 
Overview of the graphics system
Overview of the graphics systemOverview of the graphics system
Overview of the graphics system
Kamal Acharya
 
Data Mining: Data Preprocessing
Data Mining: Data PreprocessingData Mining: Data Preprocessing
Data Mining: Data Preprocessing
Lakshmi Sarvani Videla
 
Clustering
ClusteringClustering
Clustering
ClusteringClustering
Clustering
M Rizwan Aqeel
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3
varshakumar21
 

What's hot (20)

Region based segmentation
Region based segmentationRegion based segmentation
Region based segmentation
 
Data Science
Data ScienceData Science
Data Science
 
Data Mining: an Introduction
Data Mining: an IntroductionData Mining: an Introduction
Data Mining: an Introduction
 
Data Integration and Transformation in Data mining
Data Integration and Transformation in Data miningData Integration and Transformation in Data mining
Data Integration and Transformation in Data mining
 
Region based segmentation
Region based segmentationRegion based segmentation
Region based segmentation
 
Polygons - Computer Graphics - Notes
Polygons - Computer Graphics - NotesPolygons - Computer Graphics - Notes
Polygons - Computer Graphics - Notes
 
Feature scaling
Feature scalingFeature scaling
Feature scaling
 
Image Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain FiltersImage Enhancement using Frequency Domain Filters
Image Enhancement using Frequency Domain Filters
 
Data preprocessing
Data preprocessingData preprocessing
Data preprocessing
 
Image segmentation
Image segmentation Image segmentation
Image segmentation
 
Ann
Ann Ann
Ann
 
Regularization in deep learning
Regularization in deep learningRegularization in deep learning
Regularization in deep learning
 
Neural Networks: Radial Bases Functions (RBF)
Neural Networks: Radial Bases Functions (RBF)Neural Networks: Radial Bases Functions (RBF)
Neural Networks: Radial Bases Functions (RBF)
 
Presentation machine learning
Presentation machine learningPresentation machine learning
Presentation machine learning
 
Pattern recognition UNIT 5
Pattern recognition UNIT 5Pattern recognition UNIT 5
Pattern recognition UNIT 5
 
Overview of the graphics system
Overview of the graphics systemOverview of the graphics system
Overview of the graphics system
 
Data Mining: Data Preprocessing
Data Mining: Data PreprocessingData Mining: Data Preprocessing
Data Mining: Data Preprocessing
 
Clustering
ClusteringClustering
Clustering
 
Clustering
ClusteringClustering
Clustering
 
Data science.chapter-1,2,3
Data science.chapter-1,2,3Data science.chapter-1,2,3
Data science.chapter-1,2,3
 

Similar to Introduction to Data Science.pptx

Data science unit1
Data science unit1Data science unit1
Data science unit1
varshakumar21
 
ch2 DS.pptx
ch2 DS.pptxch2 DS.pptx
ch2 DS.pptx
derbew2112
 
Big data ppt
Big data pptBig data ppt
Big data ppt
Deepika ParthaSarathy
 
Digital data
Digital dataDigital data
Digital data
ShivanandaVSeeri
 
Digital Types
Digital TypesDigital Types
Digital Types
ShivanandaVSeeri
 
Big data
Big dataBig data
big data processing.pptx
big data processing.pptxbig data processing.pptx
big data processing.pptx
ssuser96aab9
 
Behind the scenes of data science
Behind the scenes of data scienceBehind the scenes of data science
Behind the scenes of data science
Loïc Lejoly
 
Data Science ppt for the asjdbhsadbmsnc.pptx
Data Science ppt for the asjdbhsadbmsnc.pptxData Science ppt for the asjdbhsadbmsnc.pptx
Data Science ppt for the asjdbhsadbmsnc.pptx
sa3302
 
Data Scientist By: Professor Lili Saghafi
Data Scientist By: Professor Lili SaghafiData Scientist By: Professor Lili Saghafi
Data Scientist By: Professor Lili Saghafi
Professor Lili Saghafi
 
Dw 07032018-dr pl pradhan
Dw 07032018-dr pl pradhanDw 07032018-dr pl pradhan
Dw 07032018-dr pl pradhan
Dr Pradhan PL Pradhan
 
BIg Data Overview
BIg Data OverviewBIg Data Overview
BIg Data Overview
dimantoku
 
semana1.pptx
semana1.pptxsemana1.pptx
semana1.pptx
AidaVivancoLuna1
 
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
Elvis Muyanja
 
01-Introduction.pdf
01-Introduction.pdf01-Introduction.pdf
01-Introduction.pdf
ngVnThng12
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
Umair Shafique
 
Unit-I- Introduction- Traits of Big Data-Final.pptx
Unit-I- Introduction- Traits of Big Data-Final.pptxUnit-I- Introduction- Traits of Big Data-Final.pptx
Unit-I- Introduction- Traits of Big Data-Final.pptx
subhashchandra197
 
Ch~2.pdf
Ch~2.pdfCh~2.pdf
Introduction to Big Data Analytics
Introduction to Big Data AnalyticsIntroduction to Big Data Analytics
Introduction to Big Data Analytics
Utkarsh Sharma
 
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
sureshchandran711
 

Similar to Introduction to Data Science.pptx (20)

Data science unit1
Data science unit1Data science unit1
Data science unit1
 
ch2 DS.pptx
ch2 DS.pptxch2 DS.pptx
ch2 DS.pptx
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Digital data
Digital dataDigital data
Digital data
 
Digital Types
Digital TypesDigital Types
Digital Types
 
Big data
Big dataBig data
Big data
 
big data processing.pptx
big data processing.pptxbig data processing.pptx
big data processing.pptx
 
Behind the scenes of data science
Behind the scenes of data scienceBehind the scenes of data science
Behind the scenes of data science
 
Data Science ppt for the asjdbhsadbmsnc.pptx
Data Science ppt for the asjdbhsadbmsnc.pptxData Science ppt for the asjdbhsadbmsnc.pptx
Data Science ppt for the asjdbhsadbmsnc.pptx
 
Data Scientist By: Professor Lili Saghafi
Data Scientist By: Professor Lili SaghafiData Scientist By: Professor Lili Saghafi
Data Scientist By: Professor Lili Saghafi
 
Dw 07032018-dr pl pradhan
Dw 07032018-dr pl pradhanDw 07032018-dr pl pradhan
Dw 07032018-dr pl pradhan
 
BIg Data Overview
BIg Data OverviewBIg Data Overview
BIg Data Overview
 
semana1.pptx
semana1.pptxsemana1.pptx
semana1.pptx
 
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
DATA SCIENCE IS CATALYZING BUSINESS AND INNOVATION
 
01-Introduction.pdf
01-Introduction.pdf01-Introduction.pdf
01-Introduction.pdf
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
 
Unit-I- Introduction- Traits of Big Data-Final.pptx
Unit-I- Introduction- Traits of Big Data-Final.pptxUnit-I- Introduction- Traits of Big Data-Final.pptx
Unit-I- Introduction- Traits of Big Data-Final.pptx
 
Ch~2.pdf
Ch~2.pdfCh~2.pdf
Ch~2.pdf
 
Introduction to Big Data Analytics
Introduction to Big Data AnalyticsIntroduction to Big Data Analytics
Introduction to Big Data Analytics
 
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
DA DS traning.pptx. Data Science is marking its graph on a high note by expan...
 

More from Anusuya123

Unit-III Correlation and Regression.pptx
Unit-III Correlation and Regression.pptxUnit-III Correlation and Regression.pptx
Unit-III Correlation and Regression.pptx
Anusuya123
 
Types of Data-Introduction.pptx
Types of Data-Introduction.pptxTypes of Data-Introduction.pptx
Types of Data-Introduction.pptx
Anusuya123
 
Basic Statistical Descriptions of Data.pptx
Basic Statistical Descriptions of Data.pptxBasic Statistical Descriptions of Data.pptx
Basic Statistical Descriptions of Data.pptx
Anusuya123
 
Data warehousing.pptx
Data warehousing.pptxData warehousing.pptx
Data warehousing.pptx
Anusuya123
 
Unit 1-Data Science Process Overview.pptx
Unit 1-Data Science Process Overview.pptxUnit 1-Data Science Process Overview.pptx
Unit 1-Data Science Process Overview.pptx
Anusuya123
 
5.2.2. Memory Consistency Models.pptx
5.2.2. Memory Consistency Models.pptx5.2.2. Memory Consistency Models.pptx
5.2.2. Memory Consistency Models.pptx
Anusuya123
 
5.1.3. Chord.pptx
5.1.3. Chord.pptx5.1.3. Chord.pptx
5.1.3. Chord.pptx
Anusuya123
 
3. Descriptive statistics.ppt
3. Descriptive statistics.ppt3. Descriptive statistics.ppt
3. Descriptive statistics.ppt
Anusuya123
 
1. Intro DS.pptx
1. Intro DS.pptx1. Intro DS.pptx
1. Intro DS.pptx
Anusuya123
 
5.Collective bargaining.pptx
5.Collective bargaining.pptx5.Collective bargaining.pptx
5.Collective bargaining.pptx
Anusuya123
 
Runtimeenvironment
RuntimeenvironmentRuntimeenvironment
Runtimeenvironment
Anusuya123
 
Think pair share
Think pair shareThink pair share
Think pair share
Anusuya123
 
Lexical analyzer generator lex
Lexical analyzer generator lexLexical analyzer generator lex
Lexical analyzer generator lex
Anusuya123
 
Operators in Python
Operators in PythonOperators in Python
Operators in Python
Anusuya123
 

More from Anusuya123 (14)

Unit-III Correlation and Regression.pptx
Unit-III Correlation and Regression.pptxUnit-III Correlation and Regression.pptx
Unit-III Correlation and Regression.pptx
 
Types of Data-Introduction.pptx
Types of Data-Introduction.pptxTypes of Data-Introduction.pptx
Types of Data-Introduction.pptx
 
Basic Statistical Descriptions of Data.pptx
Basic Statistical Descriptions of Data.pptxBasic Statistical Descriptions of Data.pptx
Basic Statistical Descriptions of Data.pptx
 
Data warehousing.pptx
Data warehousing.pptxData warehousing.pptx
Data warehousing.pptx
 
Unit 1-Data Science Process Overview.pptx
Unit 1-Data Science Process Overview.pptxUnit 1-Data Science Process Overview.pptx
Unit 1-Data Science Process Overview.pptx
 
5.2.2. Memory Consistency Models.pptx
5.2.2. Memory Consistency Models.pptx5.2.2. Memory Consistency Models.pptx
5.2.2. Memory Consistency Models.pptx
 
5.1.3. Chord.pptx
5.1.3. Chord.pptx5.1.3. Chord.pptx
5.1.3. Chord.pptx
 
3. Descriptive statistics.ppt
3. Descriptive statistics.ppt3. Descriptive statistics.ppt
3. Descriptive statistics.ppt
 
1. Intro DS.pptx
1. Intro DS.pptx1. Intro DS.pptx
1. Intro DS.pptx
 
5.Collective bargaining.pptx
5.Collective bargaining.pptx5.Collective bargaining.pptx
5.Collective bargaining.pptx
 
Runtimeenvironment
RuntimeenvironmentRuntimeenvironment
Runtimeenvironment
 
Think pair share
Think pair shareThink pair share
Think pair share
 
Lexical analyzer generator lex
Lexical analyzer generator lexLexical analyzer generator lex
Lexical analyzer generator lex
 
Operators in Python
Operators in PythonOperators in Python
Operators in Python
 

Recently uploaded

Adv. Digital Signal Processing LAB MANUAL.pdf
Adv. Digital Signal Processing LAB MANUAL.pdfAdv. Digital Signal Processing LAB MANUAL.pdf
Adv. Digital Signal Processing LAB MANUAL.pdf
T.D. Shashikala
 
Python programming Introduction about Python
Python programming Introduction about PythonPython programming Introduction about Python
Python programming Introduction about Python
Senthil Vit
 
Generative-AI-a-boost-for-operations-Presentation.pdf
Generative-AI-a-boost-for-operations-Presentation.pdfGenerative-AI-a-boost-for-operations-Presentation.pdf
Generative-AI-a-boost-for-operations-Presentation.pdf
Aries716858
 
API-1150WB-Cooling Towers.pdf with details
API-1150WB-Cooling Towers.pdf with detailsAPI-1150WB-Cooling Towers.pdf with details
API-1150WB-Cooling Towers.pdf with details
MuhammadUsmanAsghar4
 
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
Jim Mimlitz, P.E.
 
Online airline reservation system project report.pdf
Online airline reservation system project report.pdfOnline airline reservation system project report.pdf
Online airline reservation system project report.pdf
Kamal Acharya
 
The Control of Relative Humidity & Moisture Content in The Air
The Control of Relative Humidity & Moisture Content in The AirThe Control of Relative Humidity & Moisture Content in The Air
The Control of Relative Humidity & Moisture Content in The Air
Ashraf Ismail
 
Time-State Analytics: MinneAnalytics 2024 Talk
Time-State Analytics: MinneAnalytics 2024 TalkTime-State Analytics: MinneAnalytics 2024 Talk
Time-State Analytics: MinneAnalytics 2024 Talk
Evan Chan
 
OSHA LOTO training, LOTO, lock out tag out
OSHA LOTO training, LOTO, lock out tag outOSHA LOTO training, LOTO, lock out tag out
OSHA LOTO training, LOTO, lock out tag out
Ateeb19
 
Chapter 1 Introduction to Software Engineering and Process Models.pdf
Chapter 1 Introduction to Software Engineering and Process Models.pdfChapter 1 Introduction to Software Engineering and Process Models.pdf
Chapter 1 Introduction to Software Engineering and Process Models.pdf
MeghaGupta952452
 
Metrology Book, Bachelors in Mechanical Engineering
Metrology Book, Bachelors in Mechanical EngineeringMetrology Book, Bachelors in Mechanical Engineering
Metrology Book, Bachelors in Mechanical Engineering
leakingvideo
 
Presentation python programming vtu 6th sem
Presentation python programming vtu 6th semPresentation python programming vtu 6th sem
Presentation python programming vtu 6th sem
ssuser8f6b1d1
 
Santa Barbara City College degree offer diploma Transcript
Santa Barbara City College degree offer diploma TranscriptSanta Barbara City College degree offer diploma Transcript
Santa Barbara City College degree offer diploma Transcript
owbetho
 
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
amzhoxvzidbke
 
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagneEAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
idelewebmestre
 
Probability and Statistics by sheldon ross (8th edition).pdf
Probability and Statistics by sheldon ross (8th edition).pdfProbability and Statistics by sheldon ross (8th edition).pdf
Probability and Statistics by sheldon ross (8th edition).pdf
utkarshakusnake
 
Software Engineering and Project Management - Activity Planning
Software Engineering and Project Management - Activity PlanningSoftware Engineering and Project Management - Activity Planning
Software Engineering and Project Management - Activity Planning
Prakhyath Rai
 
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in CityGirls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
rawankhanlove256
 
Introduction And Differences Between File System And Dbms.pptx
Introduction And Differences Between File System And Dbms.pptxIntroduction And Differences Between File System And Dbms.pptx
Introduction And Differences Between File System And Dbms.pptx
SerendipityYoon
 
Red Hat Enterprise Linux Administration 9.0 RH134 pdf
Red Hat Enterprise Linux Administration 9.0 RH134 pdfRed Hat Enterprise Linux Administration 9.0 RH134 pdf
Red Hat Enterprise Linux Administration 9.0 RH134 pdf
mdfkobir
 

Recently uploaded (20)

Adv. Digital Signal Processing LAB MANUAL.pdf
Adv. Digital Signal Processing LAB MANUAL.pdfAdv. Digital Signal Processing LAB MANUAL.pdf
Adv. Digital Signal Processing LAB MANUAL.pdf
 
Python programming Introduction about Python
Python programming Introduction about PythonPython programming Introduction about Python
Python programming Introduction about Python
 
Generative-AI-a-boost-for-operations-Presentation.pdf
Generative-AI-a-boost-for-operations-Presentation.pdfGenerative-AI-a-boost-for-operations-Presentation.pdf
Generative-AI-a-boost-for-operations-Presentation.pdf
 
API-1150WB-Cooling Towers.pdf with details
API-1150WB-Cooling Towers.pdf with detailsAPI-1150WB-Cooling Towers.pdf with details
API-1150WB-Cooling Towers.pdf with details
 
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
SCADAmetrics Instrumentation for Sensus Water Meters - Core and Main Training...
 
Online airline reservation system project report.pdf
Online airline reservation system project report.pdfOnline airline reservation system project report.pdf
Online airline reservation system project report.pdf
 
The Control of Relative Humidity & Moisture Content in The Air
The Control of Relative Humidity & Moisture Content in The AirThe Control of Relative Humidity & Moisture Content in The Air
The Control of Relative Humidity & Moisture Content in The Air
 
Time-State Analytics: MinneAnalytics 2024 Talk
Time-State Analytics: MinneAnalytics 2024 TalkTime-State Analytics: MinneAnalytics 2024 Talk
Time-State Analytics: MinneAnalytics 2024 Talk
 
OSHA LOTO training, LOTO, lock out tag out
OSHA LOTO training, LOTO, lock out tag outOSHA LOTO training, LOTO, lock out tag out
OSHA LOTO training, LOTO, lock out tag out
 
Chapter 1 Introduction to Software Engineering and Process Models.pdf
Chapter 1 Introduction to Software Engineering and Process Models.pdfChapter 1 Introduction to Software Engineering and Process Models.pdf
Chapter 1 Introduction to Software Engineering and Process Models.pdf
 
Metrology Book, Bachelors in Mechanical Engineering
Metrology Book, Bachelors in Mechanical EngineeringMetrology Book, Bachelors in Mechanical Engineering
Metrology Book, Bachelors in Mechanical Engineering
 
Presentation python programming vtu 6th sem
Presentation python programming vtu 6th semPresentation python programming vtu 6th sem
Presentation python programming vtu 6th sem
 
Santa Barbara City College degree offer diploma Transcript
Santa Barbara City College degree offer diploma TranscriptSanta Barbara City College degree offer diploma Transcript
Santa Barbara City College degree offer diploma Transcript
 
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
李易峰祝绪丹做爱视频流出【网芷:ht28.co】可爱学生妹>>>[网趾:ht28.co】]<<<
 
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagneEAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
EAAP2023 : Durabilité et services écosystémiques de l'élevage ovin de montagne
 
Probability and Statistics by sheldon ross (8th edition).pdf
Probability and Statistics by sheldon ross (8th edition).pdfProbability and Statistics by sheldon ross (8th edition).pdf
Probability and Statistics by sheldon ross (8th edition).pdf
 
Software Engineering and Project Management - Activity Planning
Software Engineering and Project Management - Activity PlanningSoftware Engineering and Project Management - Activity Planning
Software Engineering and Project Management - Activity Planning
 
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in CityGirls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
Girls Call Mysore 000XX00000 Provide Best And Top Girl Service And No1 in City
 
Introduction And Differences Between File System And Dbms.pptx
Introduction And Differences Between File System And Dbms.pptxIntroduction And Differences Between File System And Dbms.pptx
Introduction And Differences Between File System And Dbms.pptx
 
Red Hat Enterprise Linux Administration 9.0 RH134 pdf
Red Hat Enterprise Linux Administration 9.0 RH134 pdfRed Hat Enterprise Linux Administration 9.0 RH134 pdf
Red Hat Enterprise Linux Administration 9.0 RH134 pdf
 

Introduction to Data Science.pptx

  • 1. CS3352 -Foundations of Data Science Introduction to Data Science Dr.V.Anusuya Associate Professor/IT Ramco Institute of Technology Rajapalayam
  • 2. Introduction • Data Science is the area of study which involves extracting insights from vast amounts of data using various scientific methods, algorithms and processes. • Data Science is useful to discover hidden patterns from the voluminous raw data. • Data Science is because of the evolution of mathematical statistics, data analysis, and big data.
  • 3. Contd., • Ingredients = Data • When a chef is starting out with a new dish. • After the chef has determined what type of dish he would like to make, he goes to the fridge to gather ingredients. If he doesn’t have the necessary ingredients, he takes a trip to the store to collect them. • As data scientists, our data points are our ingredients. We may have some on hand, but we still might have to collect more through web scraping, SQL queries, etc.
  • 4. Big Data • Data Science focuses on processing the huge volume of heterogeneous data known as big data. • Big data refers to the data sets that are large and complex in nature and difficult to process using traditional data processing application software.
  • 5. Contd., • The characteristics of big data are often referred to as the three Vs: • Volume—How much data is there? • Variety—How diverse are different types of data? • Velocity—At what speed is new data generated? • Veracity-How accurate is the data?. • These four properties make big data different from the data found in traditional data management tools.
  • 6. Contd., • The four V’s of data make the data capturing,cleaning,preprocessing,storing,search ing,sharing,transferring and visualization processes a complex task. • Specialization techniques are required to extract the insights from this huge volume of data. • The main things that set a data scientist apart from a statistician are the ability to work with big data and experience in machine learning, computing, and algorithm building.
  • 7. Big data • Tools- Hadoop, Pig, Spark, R, Python, and Java. • Python is a great language for data science because it has many data science libraries available, and it’s widely supported by specialized software.
  • 8. Contd., • Data Science is an interdisciplinary field that allows to extract knowledge from structured or unstructured data. • Translate business problem and Research project into practical solution.
  • 9. Benefits and uses of data science • Data science and big data are used almost everywhere in both commercial and noncommercial Settings. • Commercial companies in almost every industry use data science and big data to gain insights into their customers, processes, staff, completion, and products. • Many companies use data science to offer customers a better user experience, as well as to cross-sell, up-sell, and personalize their offerings.
  • 10. Benefits and uses of data science • Governmental organizations are also aware of data’s value. Many governmental organizations not only rely on internal data scientists to discover valuable information, but also share their data with the public. • Nongovernmental organizations (NGOs) use it to raise money and defend their causes. • Universities use data science in their research but also to enhance the study experience of their students. The rise of massive open online courses (MOOC) produces a lot of data, which allows universities to study how this type of learning can complement traditional classes.
  • 11. Facets of data • In data science and big data we’ll come across many different types of data, and each of them tends to require different tools and techniques. The main categories of data are these: • Structured • Unstructured • Natural language • Machine-generated • Graph-based • Audio, video, and images • Streaming
  • 12. Structured Data •Structured data is data that depends on a data model and resides in a fixed field within a record. •To store structured data in tables within databases or Excel files. •SQL, or Structured Query Language, is the preferred way to manage and query data that resides in databases. •Hierarchical data such as a family tree.
  • 14. Unstructured Data • Unstructured data is data that isn’t easy to fit into a data model because the content is context-specific or varying. • Example of unstructured data is your regular email. • Although email contains structured elements such as the sender, title, and body text. • The thousands of different languages and dialects out there further complicate this.
  • 16. Natural language • Natural language is a special type of unstructured data; it’s challenging to process because it requires knowledge of specific data science techniques and linguistics. • The natural language processing community has had success in entity recognition, Speech recognition, summarization, text completion, and sentiment analysis, but models trained in one domain don’t generalize well to other domains. • Even state-of-the-art techniques aren’t able to decipher the meaning of every piece of text. • Example: personal voice Assistant, siri, Alexa recognize patterns in speech, provide a useful response. • Example: Email Filters- Primary, Social ,Promotions
  • 17. Machine-generated data • Machine-generated data is information that’s automatically created by a computer, process, application, or other machine without human intervention. • Machine-generated data is becoming a major data resource and will continue to do so. • The analysis of machine data relies on highly scalable tools, due to its high volume and speed. Examples of machine data are web server logs, call detail records, network event logs, and telemetry.
  • 19. Graph-based or Networked Data • A graph is a mathematical structure to model pair-wise relationships between objects. • Graph or network data is, in short, data that focuses on the relationship or adjacency of objects. • The graph structures use nodes, edges, and properties to represent and store graphical data.
  • 20. Contd., • Graph-based data is a natural way to represent social networks, and its structure allows you to calculate specific metrics such as the influence of a person and the shortest path between two people. • Example • LinkedIn-business colleagues, Twitter- follower list. • Facebook-connecting edges here to show friends.
  • 21. Graph based structure Specialized query languages such as SPARQL
  • 22. Audio, image, and video • Audio, image, and video are data types that pose specific challenges to a data scientist. • Tasks that are trivial for humans, such as recognizing objects in pictures, to be challenging for computers. • MLBAM (Major League Baseball Advanced Media) announced in 2014 that they’ll increase video capture to approximately 7 TB per game for the purpose of live, in-game analytics.
  • 23. Contd., • Recently a company called DeepMind succeeded at creating an algorithm that’s capable of learning how to play video games. • This algorithm takes the video screen as input and learns to interpret everything via a complex of deep learning.
  • 24. Streaming Data • The data flows into the system when an event happens instead of being loaded into a data store in a batch. • Examples are the “What’s trending” on Twitter, live sporting or music events, and the stock market.