SlideShare a Scribd company logo
CONTENT
 INTRODUCTION
 WHAT IS BIG DATA ?
 TYPES OF BIG DATA
 ARCHITECTURE OF BIG DATA
 CHARACTERISTICS OF BIG DATA
 BIG DATA – TOOLS
 WHY BIG DATA?
 HOW IS BIG DATA DIFFERENT ?
 WHO’S GENERATING BIG DATA
 THE MODEL HAS CHANGED …
 CHALLENGES OF BIG DATA
 BENEFITS OF BIG DATA
 ADVANTAGES AND DISADVANTAGES OF BIG DATA
 APPLICATIONS OF BIG DATA
 CONCLUSION
INTRODUCTION
 The term “Big Data” was first introduced to the
computing world by Roger Magoulas from O’Reilly
media in 2005.
 Madden define the Big Data as:
"data that’s too big, too fast, or too hard for
existing tools to process”.
 The term is used to refer to data management
technologies which have evolved over time.
WHAT IS BIG DATA ?
 Big Data is a phrase used to
mean a massive volume of
both structured and
unstructured data that is so
large it is difficult to
process using
traditional database and
software techniques.
TYPES OF BIG DATA
ARCHITECTURE
CHACTERISTICS OF BIG DATA
VOLUME
 Volume refers to the quantity of data that is
being manipulated and analysed in order to
obtain a desired result.
 It is the vast amount of data generated every
second that are larger than what the
conventional relational database
infrastructures can cope with.
Exponential increase in
collected/generated data
VELOCITY
 “Velocity” is all about the speed the data.
 Data is begin generated fast and need to
be processed fast.
EXAMPLE:
Healthcare monitoring: sensors monitoring your
activities and body  any abnormal measurements
require immediate reaction
VARIETY
 “Variety” is the third characteristic of
Big
Data. It represents the type of data
that is
stored, analyzed and used. The type of
data
stored and analyzed varies and it can
consist of location coordinates, video
files,
data sent from browsers, simulations
etc.
VALUE
 The fourth “V” is “Value” and is all about
the quality of data that is stored and the
further use of it. Large quantity of data is
being stored from mobile phones call
records to TCP/IP logs.
VERACITY
 “Veracity” is the fifth characteristic of Big
Data and came from the idea that the
possible consistency of data is good
enough for Big Data.
BIG DATA - TOOLS
 HADOOP
-It was specifically built to handle very large data sets. Hadoop is
made up of two main parts: the Hadoop Distributed File System (HDFS)
and MapReduce.
 NoSQL
- NoSQL databases have grown in popularity. These Not Only SQL
databases are not bound by traditional schema models allowing them to
collect unstructured datasets
 MPP
- An MPP database is a database that is optimized to be
processed in parallel for many operations to be performed by many
processing units at a time.
WHY BIG DATA ?
 Growth of Big Data is needed
 Increase of storage capacities
 Increase of processing power
 Availability of data (different data types)
 Every day we create 2.5 quintillion bytes of
data; 90% of the data in the world today has been
created in the last two years alone.
HOW IS BIG DATA DIFFERENT ?
 Automatically generated by a machine
(e.g. Sensor embedded in an engine)
 Typically an entirely new source of data
(e.g. Use of Internet)
 Not designed to be friendly
(e.g. Text streams)
 May not have much values
(e.g. Need to focus on the important part)
WHO’S GENERATING BIG DATA ?
Social media and networks
(all of us are generating data)
Scientific instruments
(collecting all sorts of data)
Mobile devices
(tracking all objects all the time)
Sensor technology and
networks
(measuring all kinds of data)
• The progress and innovation is no longer hindered by the ability to collect data
• But, by the ability to manage, analyze, summarize, visualize, and discover knowledge
from the collected data in a timely manner and in a scalable fashion
THE MODEL HAS CHANGED…
 The Model of Generating/Consuming Data has Changed
Old Model: Few companies are generating data, all others are consuming data
New Model: all of us are generating data, and all of us are consuming
data
CHALLENGES
 The challenges in Big Data can be broadly divided in
to two categories:
 engineering
 semantic
 Engineering challenges include data management
activities such as query, and storage efficiently.
 semantic challenge is determining the meaning of
information from large volumes of unstructured data.
 High volume of processing using a low-power
consumed digital processing architecture.
 Discovery of data-adaptive machine learning
techniques that are able toanalyze data in real-time.
 Design scalable data storages that provide efficient
data mining.
 On the other hand, Patidar, Rane and Jain have
identified a number of key challenges in Big Data
management related to the cloud as follows:
Data security and privacy;
Approximate results;
Data exploration to enable deep analytics;
Enterprise data enrichment with web and social media;
Query optimization; and
Performance isolation for multi-tenancy.
BENEFITS
 Timely
 Accessible
 Holistic
 Trustworthy
 Relevant
 Secure
 Authoritive
 Actionable
ADVANTAGES AND DISADVANTAGES
 ADVANTAGES
+ Big
+ Timely
+ Predictive (sometimes)
+ Cheap
 DISADVANTAGES
- Unknown population representation
- Issues of data quality
- Typically not very multivariate (at the person level)
- Privacy and confidentiality issues
- Difficult to assess accuracy and uncertainty
APPLICATIONS
 Banking and Securities
 Communications, Media and Entertainment
 Healthcare Providers
 Education
 Manufacturing and Natural Resources
 Government
 Insurance
 Information Technology
 Retail
 Retail banking
 Real estate
 Transportation
 Energy and Utilities
CONCLUSION
 Big Data is new and requires investigation and
understanding of both technical and business
requirements.
 Indeed, Big Data is not a stand-alone technology; rather, it
is a combination of the last 50 years of technological
evolution.
 The big advantage of Big Data is its ability to leverage
massive amounts of data without all the complex
programming that was required in the past.
REFERENCE
 https://www.simplilearn.com/big-data-applications-in-
industries-article
 https://en.wikipedia.org/wiki/Big_data
 https://marketingtechblog.com/benefits-of-big-data/
 https://www.import.io/post/all-the-best-big-data-tools-
and-how-to-use-them/
 http://www.smartdatacollective.com/michelenemschoff/
187751/7-important-types-big-data
N. SOWMIYA
VALARMATHI. V
(B.SC [C.S] III YEAR)

More Related Content

What's hot

Integrating Big Data Technologies
Integrating Big Data TechnologiesIntegrating Big Data Technologies
Integrating Big Data TechnologiesDATAVERSITY
 
Big data
Big dataBig data
Big Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation SlidesBig Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation Slides
SlideTeam
 
Team 2 Big Data Presentation
Team 2 Big Data PresentationTeam 2 Big Data Presentation
Team 2 Big Data PresentationMatthew Urdan
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Ramakant Gawande
 
Presentation on Big Data
Presentation on Big DataPresentation on Big Data
Presentation on Big Data
Maruf Abdullah (Rion)
 
Big data
Big dataBig data
Big data
Pooja Shah
 
Big Data and Computer Science Education
Big Data and Computer Science EducationBig Data and Computer Science Education
Big Data and Computer Science Education
James Hendler
 
Big data ppt
Big data pptBig data ppt
Big Data introduction - Café Numérique Bruxelles
Big Data introduction - Café Numérique BruxellesBig Data introduction - Café Numérique Bruxelles
Big Data introduction - Café Numérique Bruxelles
Eric Rodriguez (Hiring in Lex)
 
Our big data
Our big dataOur big data
Our big data
uthrarajan
 
Big Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyBig Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyRohit Dubey
 
Big data analysis using map/reduce
Big data analysis using map/reduceBig data analysis using map/reduce
Big data analysis using map/reduce
RenuSuren
 
big data analytics in mobile cellular network
big data analytics in mobile cellular networkbig data analytics in mobile cellular network
big data analytics in mobile cellular network
shubham patil
 
Big data ppt
Big data pptBig data ppt
Big data ppt
pranay adimalla
 
Big data analytics, research report
Big data analytics, research reportBig data analytics, research report
Big data analytics, research reportJULIO GONZALEZ SANZ
 
Chapter 1 big data
Chapter 1 big dataChapter 1 big data
Chapter 1 big data
Prof .Pragati Khade
 
What is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsWhat is big data ? | Big Data Applications
What is big data ? | Big Data Applications
ShilpaKrishna6
 
Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)
SiamAhmed16
 

What's hot (20)

Integrating Big Data Technologies
Integrating Big Data TechnologiesIntegrating Big Data Technologies
Integrating Big Data Technologies
 
Big data
Big dataBig data
Big data
 
Big Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation SlidesBig Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation Slides
 
Team 2 Big Data Presentation
Team 2 Big Data PresentationTeam 2 Big Data Presentation
Team 2 Big Data Presentation
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
 
Presentation on Big Data
Presentation on Big DataPresentation on Big Data
Presentation on Big Data
 
Big data
Big dataBig data
Big data
 
Big Data and Computer Science Education
Big Data and Computer Science EducationBig Data and Computer Science Education
Big Data and Computer Science Education
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Big Data introduction - Café Numérique Bruxelles
Big Data introduction - Café Numérique BruxellesBig Data introduction - Café Numérique Bruxelles
Big Data introduction - Café Numérique Bruxelles
 
Our big data
Our big dataOur big data
Our big data
 
Big Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyBig Data PPT by Rohit Dubey
Big Data PPT by Rohit Dubey
 
Big data analysis using map/reduce
Big data analysis using map/reduceBig data analysis using map/reduce
Big data analysis using map/reduce
 
big data analytics in mobile cellular network
big data analytics in mobile cellular networkbig data analytics in mobile cellular network
big data analytics in mobile cellular network
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Applications of Big Data
Applications of Big DataApplications of Big Data
Applications of Big Data
 
Big data analytics, research report
Big data analytics, research reportBig data analytics, research report
Big data analytics, research report
 
Chapter 1 big data
Chapter 1 big dataChapter 1 big data
Chapter 1 big data
 
What is big data ? | Big Data Applications
What is big data ? | Big Data ApplicationsWhat is big data ? | Big Data Applications
What is big data ? | Big Data Applications
 
Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)
 

Similar to An Overview of BigData

Big data-ppt
Big data-pptBig data-ppt
Big data-ppt
Nazir Ahmed
 
Big data-ppt-
Big data-ppt-Big data-ppt-
Big data-ppt-
Bhagya Patil
 
big-data-8722-m8RQ3h1.pptx
big-data-8722-m8RQ3h1.pptxbig-data-8722-m8RQ3h1.pptx
big-data-8722-m8RQ3h1.pptx
VaishnavGhadge1
 
Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
Sandip Tipayle Patil
 
UNIT 1 -BIG DATA ANALYTICS Full.pdf
UNIT 1 -BIG DATA ANALYTICS Full.pdfUNIT 1 -BIG DATA ANALYTICS Full.pdf
UNIT 1 -BIG DATA ANALYTICS Full.pdf
vvpadhu
 
Big data
Big dataBig data
Big data
Mahmudul Alam
 
Big data seminor
Big data seminorBig data seminor
Big data seminor
berasrujana
 
BIG DATA & DATA ANALYTICS
BIG  DATA & DATA  ANALYTICSBIG  DATA & DATA  ANALYTICS
BIG DATA & DATA ANALYTICS
NAGARAJAGIDDE
 
Big data
Big dataBig data
Big data
Abhishek Palo
 
Big data
Big dataBig data
Big data
Abhishek Palo
 
Big Data Analysis
Big Data AnalysisBig Data Analysis
Big Data Analysis
IRJET Journal
 
Big-Data-Analytics.8592259.powerpoint.pdf
Big-Data-Analytics.8592259.powerpoint.pdfBig-Data-Analytics.8592259.powerpoint.pdf
Big-Data-Analytics.8592259.powerpoint.pdf
rajsharma159890
 
The Bigger They Are The Harder They Fall
The Bigger They Are The Harder They FallThe Bigger They Are The Harder They Fall
The Bigger They Are The Harder They FallTrillium Software
 
Big Data-Survey
Big Data-SurveyBig Data-Survey
Big Data-Survey
ijeei-iaes
 
Big data Analytics
Big data Analytics Big data Analytics
Big data Analytics
Guduru Lakshmi Kiranmai
 
In memory big data management and processing
In memory big data management and processingIn memory big data management and processing
In memory big data management and processing
Pranav Gontalwar
 
Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperativeTrillium Software
 
Bigdata
BigdataBigdata

Similar to An Overview of BigData (20)

Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
 
Big data-ppt
Big data-pptBig data-ppt
Big data-ppt
 
Big data-ppt-
Big data-ppt-Big data-ppt-
Big data-ppt-
 
big-data-8722-m8RQ3h1.pptx
big-data-8722-m8RQ3h1.pptxbig-data-8722-m8RQ3h1.pptx
big-data-8722-m8RQ3h1.pptx
 
Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
 
UNIT 1 -BIG DATA ANALYTICS Full.pdf
UNIT 1 -BIG DATA ANALYTICS Full.pdfUNIT 1 -BIG DATA ANALYTICS Full.pdf
UNIT 1 -BIG DATA ANALYTICS Full.pdf
 
1
11
1
 
Big data
Big dataBig data
Big data
 
Big data seminor
Big data seminorBig data seminor
Big data seminor
 
BIG DATA & DATA ANALYTICS
BIG  DATA & DATA  ANALYTICSBIG  DATA & DATA  ANALYTICS
BIG DATA & DATA ANALYTICS
 
Big data
Big dataBig data
Big data
 
Big data
Big dataBig data
Big data
 
Big Data Analysis
Big Data AnalysisBig Data Analysis
Big Data Analysis
 
Big-Data-Analytics.8592259.powerpoint.pdf
Big-Data-Analytics.8592259.powerpoint.pdfBig-Data-Analytics.8592259.powerpoint.pdf
Big-Data-Analytics.8592259.powerpoint.pdf
 
The Bigger They Are The Harder They Fall
The Bigger They Are The Harder They FallThe Bigger They Are The Harder They Fall
The Bigger They Are The Harder They Fall
 
Big Data-Survey
Big Data-SurveyBig Data-Survey
Big Data-Survey
 
Big data Analytics
Big data Analytics Big data Analytics
Big data Analytics
 
In memory big data management and processing
In memory big data management and processingIn memory big data management and processing
In memory big data management and processing
 
Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperative
 
Bigdata
BigdataBigdata
Bigdata
 

Recently uploaded

SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
ewymefz
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
ewymefz
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
AbhimanyuSinha9
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
jerlynmaetalle
 
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
Tiktokethiodaily
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
vcaxypu
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
u86oixdj
 
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project PresentationPredicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Boston Institute of Analytics
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
ewymefz
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
ewymefz
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
oz8q3jxlp
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
NABLAS株式会社
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
nscud
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
axoqas
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
ArpitMalhotra16
 

Recently uploaded (20)

SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
一比一原版(UPenn毕业证)宾夕法尼亚大学毕业证成绩单
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
 
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
1.Seydhcuxhxyxhccuuxuxyxyxmisolids 2019.pptx
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
一比一原版(RUG毕业证)格罗宁根大学毕业证成绩单
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
 
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project PresentationPredicting Product Ad Campaign Performance: A Data Analysis Project Presentation
Predicting Product Ad Campaign Performance: A Data Analysis Project Presentation
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
 

An Overview of BigData

  • 1.
  • 2. CONTENT  INTRODUCTION  WHAT IS BIG DATA ?  TYPES OF BIG DATA  ARCHITECTURE OF BIG DATA  CHARACTERISTICS OF BIG DATA  BIG DATA – TOOLS  WHY BIG DATA?  HOW IS BIG DATA DIFFERENT ?  WHO’S GENERATING BIG DATA  THE MODEL HAS CHANGED …  CHALLENGES OF BIG DATA  BENEFITS OF BIG DATA  ADVANTAGES AND DISADVANTAGES OF BIG DATA  APPLICATIONS OF BIG DATA  CONCLUSION
  • 3. INTRODUCTION  The term “Big Data” was first introduced to the computing world by Roger Magoulas from O’Reilly media in 2005.  Madden define the Big Data as: "data that’s too big, too fast, or too hard for existing tools to process”.  The term is used to refer to data management technologies which have evolved over time.
  • 4. WHAT IS BIG DATA ?  Big Data is a phrase used to mean a massive volume of both structured and unstructured data that is so large it is difficult to process using traditional database and software techniques.
  • 8.
  • 9.
  • 10.
  • 11. VOLUME  Volume refers to the quantity of data that is being manipulated and analysed in order to obtain a desired result.  It is the vast amount of data generated every second that are larger than what the conventional relational database infrastructures can cope with. Exponential increase in collected/generated data
  • 12. VELOCITY  “Velocity” is all about the speed the data.  Data is begin generated fast and need to be processed fast. EXAMPLE: Healthcare monitoring: sensors monitoring your activities and body  any abnormal measurements require immediate reaction
  • 13. VARIETY  “Variety” is the third characteristic of Big Data. It represents the type of data that is stored, analyzed and used. The type of data stored and analyzed varies and it can consist of location coordinates, video files, data sent from browsers, simulations etc.
  • 14. VALUE  The fourth “V” is “Value” and is all about the quality of data that is stored and the further use of it. Large quantity of data is being stored from mobile phones call records to TCP/IP logs.
  • 15. VERACITY  “Veracity” is the fifth characteristic of Big Data and came from the idea that the possible consistency of data is good enough for Big Data.
  • 16. BIG DATA - TOOLS  HADOOP -It was specifically built to handle very large data sets. Hadoop is made up of two main parts: the Hadoop Distributed File System (HDFS) and MapReduce.  NoSQL - NoSQL databases have grown in popularity. These Not Only SQL databases are not bound by traditional schema models allowing them to collect unstructured datasets  MPP - An MPP database is a database that is optimized to be processed in parallel for many operations to be performed by many processing units at a time.
  • 17. WHY BIG DATA ?  Growth of Big Data is needed  Increase of storage capacities  Increase of processing power  Availability of data (different data types)  Every day we create 2.5 quintillion bytes of data; 90% of the data in the world today has been created in the last two years alone.
  • 18. HOW IS BIG DATA DIFFERENT ?  Automatically generated by a machine (e.g. Sensor embedded in an engine)  Typically an entirely new source of data (e.g. Use of Internet)  Not designed to be friendly (e.g. Text streams)  May not have much values (e.g. Need to focus on the important part)
  • 19. WHO’S GENERATING BIG DATA ? Social media and networks (all of us are generating data) Scientific instruments (collecting all sorts of data) Mobile devices (tracking all objects all the time) Sensor technology and networks (measuring all kinds of data) • The progress and innovation is no longer hindered by the ability to collect data • But, by the ability to manage, analyze, summarize, visualize, and discover knowledge from the collected data in a timely manner and in a scalable fashion
  • 20. THE MODEL HAS CHANGED…  The Model of Generating/Consuming Data has Changed Old Model: Few companies are generating data, all others are consuming data New Model: all of us are generating data, and all of us are consuming data
  • 21. CHALLENGES  The challenges in Big Data can be broadly divided in to two categories:  engineering  semantic  Engineering challenges include data management activities such as query, and storage efficiently.  semantic challenge is determining the meaning of information from large volumes of unstructured data.
  • 22.  High volume of processing using a low-power consumed digital processing architecture.  Discovery of data-adaptive machine learning techniques that are able toanalyze data in real-time.  Design scalable data storages that provide efficient data mining.  On the other hand, Patidar, Rane and Jain have identified a number of key challenges in Big Data management related to the cloud as follows: Data security and privacy; Approximate results; Data exploration to enable deep analytics; Enterprise data enrichment with web and social media; Query optimization; and Performance isolation for multi-tenancy.
  • 23. BENEFITS  Timely  Accessible  Holistic  Trustworthy  Relevant  Secure  Authoritive  Actionable
  • 24. ADVANTAGES AND DISADVANTAGES  ADVANTAGES + Big + Timely + Predictive (sometimes) + Cheap  DISADVANTAGES - Unknown population representation - Issues of data quality - Typically not very multivariate (at the person level) - Privacy and confidentiality issues - Difficult to assess accuracy and uncertainty
  • 25. APPLICATIONS  Banking and Securities  Communications, Media and Entertainment  Healthcare Providers  Education  Manufacturing and Natural Resources  Government  Insurance  Information Technology  Retail  Retail banking  Real estate  Transportation  Energy and Utilities
  • 26.
  • 27. CONCLUSION  Big Data is new and requires investigation and understanding of both technical and business requirements.  Indeed, Big Data is not a stand-alone technology; rather, it is a combination of the last 50 years of technological evolution.  The big advantage of Big Data is its ability to leverage massive amounts of data without all the complex programming that was required in the past.
  • 28. REFERENCE  https://www.simplilearn.com/big-data-applications-in- industries-article  https://en.wikipedia.org/wiki/Big_data  https://marketingtechblog.com/benefits-of-big-data/  https://www.import.io/post/all-the-best-big-data-tools- and-how-to-use-them/  http://www.smartdatacollective.com/michelenemschoff/ 187751/7-important-types-big-data