SlideShare a Scribd company logo
1 of 43
What is Data
&
Information
?
Introduction to Analytics
And Architecture
Copyright 2021. Genese Cloud Academy
Data Analytics:
● handling data collected by systems
● generate the insights
● improve decision making
○ with facts based on data.
What is Data Analytics?🤔
Copyright 2021. Genese Cloud Academy
Types of Data Analytics
● Descriptive Analytics
● Diagnostic Analytics
● Predictive Analytics
● Prescriptive Analytics
What Are the Types of Data Analytics?🤔
Benefits Of Data Analytics
Credit card Fraud Detection Customer Personalization Security Threats Detection
Real time Alerting User Behaviour
Financial Modeling
Use Cases:
● Social Media
● Ecommerce
● Information Security
● Logistics
● Factory operations
● Internet of Things
What Might be the Use
Cases of Data Analytics?🤔
Challenges(5 V’s)
Data Analytics Tools 🤔🤔 and Use Cases
Amazon Athena
Interactive analysis
Amazon EMR
Big Data Processing
Amazon Elasticsearch
Operational Analytics
Amazon Kinesis
Real-Time Analysis
Amazon RedShift
Data WareHouse
Amazon QuickSight
Dashboards & Visualizations
Amazon Cloud Watch
monitoring & management
Introduction to High
Performance Computing
HPC Workshop
AWS
Copyright 2021. Genese Cloud Academy
High Speed computing:
● implemented in
○ Super Computers for Scientific Research.
Main Area Of Discipline:
● Developing Parallel Processing Algorithm
● Developing Software
shifted from supercomputers to computing Clusters.
Application Areas of HPC
Climate Modeling
Data Analysis
Drug Discovery
Protein Folding
Energy Research
Why Do We need Ever Increasing Performance?
When do you actually need an HPC ?🤔
● Complete time consuming operations in less time
● Complete an operation under a tight schedule
● Perform a high number of operations per second
What is Streaming Data?
Copyright 2021. Genese Cloud Academy
Streaming Data:
● generated continuously by thousands of data sources
Data Stream:
● Continuous
● Ordered
● Changing
● Fast
● huge amount
Traditional DBMS:
Data stored:
● Finite data sets
● Persistent data sets
Streaming data includes a wide variety of data
● log files
● ecommerce purchases,
● in-game player activity,
● information from social networks,
● financial trading floors,
● geospatial services,
● telemetry from connected devices or instrumentation in data centers.
Core Banking
● Improved Scalability
● Met HA and SHA needs
Online Gaming
● Increased reliability
● Accurate and real time data
● Ability to process data at scale
● Faster ramp time
Government Services
● Near real time events and
better data quality
● Increased efficiency
● Produce and store data
● Better privacy
Financial Services
● Enhanced Customer experience
● Improved fraud detection engine
Real-Time Fraud Detection
● Act in real time
● Detect Fraud
● Minimize risk
● Improve customer experience
Real-Time E-Commerce
● OnBoarding New Merchants Faster
● Enabled 360 view of customers
● Enhanced Performance & Monitoring
● Projected saving of Millions of dollars
Do You know About Amazon GO?
Benefits of streaming data
● Improve operational efficiencies
● Reduce infrastructure cost
● Provide faster insights and actions
How To Design Stream Analytics solution?
Challenges in working with streaming data
Streaming data processing requires two layers:
● a storage layer
○ record ordering
○ strong consistency
■ Fast
■ Inexpensive
■ replayable
● Reads
● Writes
● a processing layer.
○ consuming data from the storage layer
○ running computations on that data
○ notifying the storage layer to delete data that is no longer needed.
● Scalability
● data durability
● fault tolerance
Infrastructure to build streaming data applications:
● Amazon Kinesis Data Streams,
● Amazon Kinesis Data Firehose,
● Amazon Managed Streaming for Apache Kafka (Amazon MSK),
● Apache Flume,
● Apache Spark Streaming,
● Apache Storm.
Working with streaming data
on AWS
Amazon Kinesis is a platform for streaming data on AWS
● load and analyze streaming data
● custom streaming data applications
offers three services:
● Amazon Managed Streaming for Apache Kafka
(Amazon MSK).
● Amazon Kinesis Data Firehose,
● Amazon Kinesis Data Streams
run other streaming data platforms
● Apache Flume,
● Apache Spark Streaming, and
● Apache Storm
○ on Amazon EC2
What is Visualization?🤔🤔🤔
any technique for creating images, diagrams, or animations to communicate a message.
Copyright 2021. Genese Cloud Academy
Why is data visualization important?
Data visualization is a:
● Quick & easy way
○ to convey concepts in a universal manner
○ can experiment with different scenarios by making slight adjustments.
● Identify areas that need attention or improvement.
● Clarify which factors influence customer behavior.
● Help you understand which products to place where.
● Predict sales volumes.
Data visualization tools
business intelligence (BI) reporting tool.
set up visualization tools to:
● generate automatic dashboards that track company performance across key performance indicators
(KPIs)
● visually interpret the results.
Kibana Tableau Grafana QuickSight Power BI
What is Big Data?
Copyright 2021. Genese Cloud Academy
BIG DATA:
● collection of data
huge in volume
growing exponentially
with time.
Types Of Big Data
● Structured
● Unstructured
● Semi-structured
Why Learn Big Data?
● Gartner – Big Data is the new Oil.
● IDC – Its market will be growing 7 times faster than the overall IT market.
● IBM – It is not just a technology – it’s a Business Strategy for capitalizing on information resources.
● IBM – Big Data is the biggest buzz word because technology makes it possible to analyze all the
available data.
Characteristics Of Big Data
Your First Big Data
Application on AWS
Word Count example
Copyright 2021. Genese Cloud Academy
Introduction to Big Data using AWS Services

More Related Content

What's hot

Tapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingTapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingSingleStore
 
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Dataconomy Media
 
About Pragmatic Works
About Pragmatic WorksAbout Pragmatic Works
About Pragmatic WorksMILL5
 
Driving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive AnalyticsDriving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive AnalyticsSingleStore
 
Analytics in a Day Ft. Synapse Virtual Workshop
Analytics in a Day Ft. Synapse Virtual WorkshopAnalytics in a Day Ft. Synapse Virtual Workshop
Analytics in a Day Ft. Synapse Virtual WorkshopCCG
 
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...Tyler Wishnoff
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesElasticsearch
 
Disrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging TechnologiesDisrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging TechnologiesDatabricks
 
Why Business Intelligence Should Consider Agile Modern Data Delivery Platform
Why Business Intelligence Should Consider Agile Modern Data Delivery PlatformWhy Business Intelligence Should Consider Agile Modern Data Delivery Platform
Why Business Intelligence Should Consider Agile Modern Data Delivery Platformsyed_javed
 
Master the Multi-Clustered Data Warehouse - Snowflake
Master the Multi-Clustered Data Warehouse - SnowflakeMaster the Multi-Clustered Data Warehouse - Snowflake
Master the Multi-Clustered Data Warehouse - SnowflakeMatillion
 
Scaling Privacy in a Spark Ecosystem
Scaling Privacy in a Spark EcosystemScaling Privacy in a Spark Ecosystem
Scaling Privacy in a Spark EcosystemDatabricks
 
Attributes of a Modern Data Warehouse - Gartner Catalyst
Attributes of a Modern Data Warehouse - Gartner CatalystAttributes of a Modern Data Warehouse - Gartner Catalyst
Attributes of a Modern Data Warehouse - Gartner CatalystJack Mardack
 
Pyramid Analytics vs Sisense
Pyramid Analytics vs SisensePyramid Analytics vs Sisense
Pyramid Analytics vs SisensePyramid Analytics
 
Infrastructure migration to azure cloud
Infrastructure migration to azure cloudInfrastructure migration to azure cloud
Infrastructure migration to azure cloudAlletec
 
Why HR Should Consider Agile Modern Data Delivery Platform
Why HR Should Consider Agile Modern Data Delivery PlatformWhy HR Should Consider Agile Modern Data Delivery Platform
Why HR Should Consider Agile Modern Data Delivery Platformsyed_javed
 
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCE
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCEBig Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCE
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCEMatt Stubbs
 

What's hot (20)

Tapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingTapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile Advertising
 
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
 
About Pragmatic Works
About Pragmatic WorksAbout Pragmatic Works
About Pragmatic Works
 
Analytics in the Cloud
Analytics in the CloudAnalytics in the Cloud
Analytics in the Cloud
 
Driving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive AnalyticsDriving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive Analytics
 
Analytics in a Day Ft. Synapse Virtual Workshop
Analytics in a Day Ft. Synapse Virtual WorkshopAnalytics in a Day Ft. Synapse Virtual Workshop
Analytics in a Day Ft. Synapse Virtual Workshop
 
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...
Hassle-Free Data Lake Governance: Automating Your Analytics with a Semantic L...
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Importance of Big Data Analytics
Importance of Big Data AnalyticsImportance of Big Data Analytics
Importance of Big Data Analytics
 
Disrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging TechnologiesDisrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging Technologies
 
Opportunities derived by AI
Opportunities derived by AIOpportunities derived by AI
Opportunities derived by AI
 
Pyramid vs QlikView
Pyramid vs QlikViewPyramid vs QlikView
Pyramid vs QlikView
 
Why Business Intelligence Should Consider Agile Modern Data Delivery Platform
Why Business Intelligence Should Consider Agile Modern Data Delivery PlatformWhy Business Intelligence Should Consider Agile Modern Data Delivery Platform
Why Business Intelligence Should Consider Agile Modern Data Delivery Platform
 
Master the Multi-Clustered Data Warehouse - Snowflake
Master the Multi-Clustered Data Warehouse - SnowflakeMaster the Multi-Clustered Data Warehouse - Snowflake
Master the Multi-Clustered Data Warehouse - Snowflake
 
Scaling Privacy in a Spark Ecosystem
Scaling Privacy in a Spark EcosystemScaling Privacy in a Spark Ecosystem
Scaling Privacy in a Spark Ecosystem
 
Attributes of a Modern Data Warehouse - Gartner Catalyst
Attributes of a Modern Data Warehouse - Gartner CatalystAttributes of a Modern Data Warehouse - Gartner Catalyst
Attributes of a Modern Data Warehouse - Gartner Catalyst
 
Pyramid Analytics vs Sisense
Pyramid Analytics vs SisensePyramid Analytics vs Sisense
Pyramid Analytics vs Sisense
 
Infrastructure migration to azure cloud
Infrastructure migration to azure cloudInfrastructure migration to azure cloud
Infrastructure migration to azure cloud
 
Why HR Should Consider Agile Modern Data Delivery Platform
Why HR Should Consider Agile Modern Data Delivery PlatformWhy HR Should Consider Agile Modern Data Delivery Platform
Why HR Should Consider Agile Modern Data Delivery Platform
 
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCE
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCEBig Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCE
Big Data LDN 2018: DATABASE FOR THE INSTANT EXPERIENCE
 

Similar to Introduction to Big Data using AWS Services

Integrating Web and Business Data
Integrating Web and Business DataIntegrating Web and Business Data
Integrating Web and Business DataSafe Software
 
Analyzing Real-time Streaming Data with Amazon Kinesis
Analyzing Real-time Streaming Data with Amazon KinesisAnalyzing Real-time Streaming Data with Amazon Kinesis
Analyzing Real-time Streaming Data with Amazon KinesisAmazon Web Services
 
Accelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSAccelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSSri Ambati
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Bas Geerdink
 
Analytics in Your Enterprise
Analytics in Your EnterpriseAnalytics in Your Enterprise
Analytics in Your EnterpriseWSO2
 
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...Lviv Startup Club
 
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward
 
Using Data Science to Build an End-to-End Recommendation System
Using Data Science to Build an End-to-End Recommendation SystemUsing Data Science to Build an End-to-End Recommendation System
Using Data Science to Build an End-to-End Recommendation SystemVMware Tanzu
 
2016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V42016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V4Janani Eshwaran
 
2016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V42016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V4Janani Eshwaran
 
16h00 globant - aws globant-big-data_summit2012
16h00   globant - aws globant-big-data_summit201216h00   globant - aws globant-big-data_summit2012
16h00 globant - aws globant-big-data_summit2012infolive
 
Integrating Web and Business Data
Integrating Web and Business DataIntegrating Web and Business Data
Integrating Web and Business DataSterling Geo
 
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...Amazon Web Services
 
Big Data for Smart City
Big Data for Smart CityBig Data for Smart City
Big Data for Smart CityKoltiva
 
Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise deteo
 
OpenSymmetry - Business Intelligence Maturity
OpenSymmetry - Business Intelligence MaturityOpenSymmetry - Business Intelligence Maturity
OpenSymmetry - Business Intelligence MaturityOpenSymmetry
 
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTXCustomer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTXtsigitnist02
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastDatabricks
 

Similar to Introduction to Big Data using AWS Services (20)

Integrating Web and Business Data
Integrating Web and Business DataIntegrating Web and Business Data
Integrating Web and Business Data
 
Analyzing Real-time Streaming Data with Amazon Kinesis
Analyzing Real-time Streaming Data with Amazon KinesisAnalyzing Real-time Streaming Data with Amazon Kinesis
Analyzing Real-time Streaming Data with Amazon Kinesis
 
Accelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWSAccelerate ML Deployment with H2O Driverless AI on AWS
Accelerate ML Deployment with H2O Driverless AI on AWS
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...
 
Analytics in Your Enterprise
Analytics in Your EnterpriseAnalytics in Your Enterprise
Analytics in Your Enterprise
 
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
Vitalii Bondarenko and Eugene Berko "Cloud AI Platform as an accelerator of e...
 
Taming Big Data With Modern Software Architecture
Taming Big Data  With Modern Software ArchitectureTaming Big Data  With Modern Software Architecture
Taming Big Data With Modern Software Architecture
 
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
Flink Forward Berlin 2017: Bas Geerdink, Martijn Visser - Fast Data at ING - ...
 
Using Data Science to Build an End-to-End Recommendation System
Using Data Science to Build an End-to-End Recommendation SystemUsing Data Science to Build an End-to-End Recommendation System
Using Data Science to Build an End-to-End Recommendation System
 
2016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V42016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V4
 
2016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V42016 DSG Webinar Azure HDInsight 2 V4
2016 DSG Webinar Azure HDInsight 2 V4
 
Globant and Big Data on AWS
Globant and Big Data on AWSGlobant and Big Data on AWS
Globant and Big Data on AWS
 
16h00 globant - aws globant-big-data_summit2012
16h00   globant - aws globant-big-data_summit201216h00   globant - aws globant-big-data_summit2012
16h00 globant - aws globant-big-data_summit2012
 
Integrating Web and Business Data
Integrating Web and Business DataIntegrating Web and Business Data
Integrating Web and Business Data
 
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...
Emerging Prevalence of Data Streaming in Analytics and it's Business Signific...
 
Big Data for Smart City
Big Data for Smart CityBig Data for Smart City
Big Data for Smart City
 
Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise
 
OpenSymmetry - Business Intelligence Maturity
OpenSymmetry - Business Intelligence MaturityOpenSymmetry - Business Intelligence Maturity
OpenSymmetry - Business Intelligence Maturity
 
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTXCustomer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and Fast
 

Recently uploaded

Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxAshokKarra1
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxCarlos105
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxDr.Ibrahim Hassaan
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfSpandanaRallapalli
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 

Recently uploaded (20)

Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptx
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptx
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdf
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 

Introduction to Big Data using AWS Services

  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. Introduction to Analytics And Architecture Copyright 2021. Genese Cloud Academy
  • 8. Data Analytics: ● handling data collected by systems ● generate the insights ● improve decision making ○ with facts based on data. What is Data Analytics?🤔 Copyright 2021. Genese Cloud Academy
  • 9. Types of Data Analytics ● Descriptive Analytics ● Diagnostic Analytics ● Predictive Analytics ● Prescriptive Analytics What Are the Types of Data Analytics?🤔
  • 10. Benefits Of Data Analytics Credit card Fraud Detection Customer Personalization Security Threats Detection Real time Alerting User Behaviour Financial Modeling
  • 11. Use Cases: ● Social Media ● Ecommerce ● Information Security ● Logistics ● Factory operations ● Internet of Things What Might be the Use Cases of Data Analytics?🤔
  • 13. Data Analytics Tools 🤔🤔 and Use Cases Amazon Athena Interactive analysis Amazon EMR Big Data Processing Amazon Elasticsearch Operational Analytics Amazon Kinesis Real-Time Analysis Amazon RedShift Data WareHouse Amazon QuickSight Dashboards & Visualizations Amazon Cloud Watch monitoring & management
  • 14.
  • 15. Introduction to High Performance Computing HPC Workshop AWS
  • 16. Copyright 2021. Genese Cloud Academy
  • 17.
  • 18. High Speed computing: ● implemented in ○ Super Computers for Scientific Research. Main Area Of Discipline: ● Developing Parallel Processing Algorithm ● Developing Software shifted from supercomputers to computing Clusters. Application Areas of HPC
  • 19. Climate Modeling Data Analysis Drug Discovery Protein Folding Energy Research Why Do We need Ever Increasing Performance?
  • 20. When do you actually need an HPC ?🤔 ● Complete time consuming operations in less time ● Complete an operation under a tight schedule ● Perform a high number of operations per second
  • 21. What is Streaming Data? Copyright 2021. Genese Cloud Academy
  • 22. Streaming Data: ● generated continuously by thousands of data sources Data Stream: ● Continuous ● Ordered ● Changing ● Fast ● huge amount Traditional DBMS: Data stored: ● Finite data sets ● Persistent data sets Streaming data includes a wide variety of data ● log files ● ecommerce purchases, ● in-game player activity, ● information from social networks, ● financial trading floors, ● geospatial services, ● telemetry from connected devices or instrumentation in data centers.
  • 23. Core Banking ● Improved Scalability ● Met HA and SHA needs Online Gaming ● Increased reliability ● Accurate and real time data ● Ability to process data at scale ● Faster ramp time
  • 24. Government Services ● Near real time events and better data quality ● Increased efficiency ● Produce and store data ● Better privacy Financial Services ● Enhanced Customer experience ● Improved fraud detection engine
  • 25. Real-Time Fraud Detection ● Act in real time ● Detect Fraud ● Minimize risk ● Improve customer experience Real-Time E-Commerce ● OnBoarding New Merchants Faster ● Enabled 360 view of customers ● Enhanced Performance & Monitoring ● Projected saving of Millions of dollars Do You know About Amazon GO?
  • 26.
  • 27. Benefits of streaming data ● Improve operational efficiencies ● Reduce infrastructure cost ● Provide faster insights and actions
  • 28. How To Design Stream Analytics solution?
  • 29. Challenges in working with streaming data Streaming data processing requires two layers: ● a storage layer ○ record ordering ○ strong consistency ■ Fast ■ Inexpensive ■ replayable ● Reads ● Writes ● a processing layer. ○ consuming data from the storage layer ○ running computations on that data ○ notifying the storage layer to delete data that is no longer needed. ● Scalability ● data durability ● fault tolerance
  • 30. Infrastructure to build streaming data applications: ● Amazon Kinesis Data Streams, ● Amazon Kinesis Data Firehose, ● Amazon Managed Streaming for Apache Kafka (Amazon MSK), ● Apache Flume, ● Apache Spark Streaming, ● Apache Storm.
  • 31.
  • 32. Working with streaming data on AWS Amazon Kinesis is a platform for streaming data on AWS ● load and analyze streaming data ● custom streaming data applications offers three services: ● Amazon Managed Streaming for Apache Kafka (Amazon MSK). ● Amazon Kinesis Data Firehose, ● Amazon Kinesis Data Streams run other streaming data platforms ● Apache Flume, ● Apache Spark Streaming, and ● Apache Storm ○ on Amazon EC2
  • 33. What is Visualization?🤔🤔🤔 any technique for creating images, diagrams, or animations to communicate a message. Copyright 2021. Genese Cloud Academy
  • 34.
  • 35. Why is data visualization important? Data visualization is a: ● Quick & easy way ○ to convey concepts in a universal manner ○ can experiment with different scenarios by making slight adjustments. ● Identify areas that need attention or improvement. ● Clarify which factors influence customer behavior. ● Help you understand which products to place where. ● Predict sales volumes.
  • 36. Data visualization tools business intelligence (BI) reporting tool. set up visualization tools to: ● generate automatic dashboards that track company performance across key performance indicators (KPIs) ● visually interpret the results. Kibana Tableau Grafana QuickSight Power BI
  • 37. What is Big Data? Copyright 2021. Genese Cloud Academy
  • 38. BIG DATA: ● collection of data huge in volume growing exponentially with time. Types Of Big Data ● Structured ● Unstructured ● Semi-structured
  • 39. Why Learn Big Data? ● Gartner – Big Data is the new Oil. ● IDC – Its market will be growing 7 times faster than the overall IT market. ● IBM – It is not just a technology – it’s a Business Strategy for capitalizing on information resources. ● IBM – Big Data is the biggest buzz word because technology makes it possible to analyze all the available data.
  • 41.
  • 42. Your First Big Data Application on AWS Word Count example Copyright 2021. Genese Cloud Academy

Editor's Notes

  1. Data Analytics is Vital to every Business. -helps decision makers (based on analytics and data) -critical tasks (launching New Product,Offering Discounts,marketing New Areas) requires time sensitive decision and experience. Organizations spend millions of dollars on data storage. The problem isn’t finding the data — the problem is failing to do anything with it, AWS
  2. Volume : total amount of data that is coming in and will be ingested into the system. Velocity : speed at which data is flowing in, the challenge consists of processing the data in near real-time and return results as quickly as possible. validating a credit card transaction must instantaneous (near real-time) Variety : Data to be ingested in the system can have different formats,. Veracity : accuracy of incoming data. Value :Decisions makers seek to extract meaningful information and insights from systems to have a competitive edge.
  3. Area of discipline can be divided into small independent parts and can be executed simultaneously by separate processors.
  4. Bank Pubg
  5. Amazon Go LInk to video: https://youtu.be/NrmMk1Myrxc
  6. applying machine learning algorithms, and extract deeper insights from the data. Over time, complex, stream and event processing algorithms, like decaying time windows to find the most recent popular movies, are applied, further enriching the insights.
  7. applying machine learning algorithms, and extract deeper insights from the data. Over time, complex, stream and event processing algorithms, like decaying time windows to find the most recent popular movies, are applied, further enriching the insights.
  8. Drift : The ability to detect and adapt to changes in the distribution of examples is paramount for data stream mining algorithms One pass:a one-pass or single-pass is a streaming algorithm which reads its input exactly once. It does so by processing items in order, without unbounded buffering; it reads a block into an input buffer, processes it, and moves the result into an output buffer for each step in the process. Real-time: Streaming data is data that is continuously generated and delivered rather than processed in batches or micro-batches. ... The terms “real-time” and “stream” converge in “real-time stream processing” to describe streams of real-time data that are gathered and processed as they are generated. Bound data is finite and unchanging data, where everything is known about the set of data. Typically Bound data has a known ending point and is relatively fixed.
  9. applying machine learning algorithms, and extract deeper insights from the data. Over time, complex, stream and event processing algorithms, like decaying time windows to find the most recent popular movies, are applied, further enriching the insights.
  10. deploy and manage your own streaming data solution in the cloud on Amazon EC2.
  11. Because of the way the human brain processes information, using charts or graphs to visualize large amounts of complex data is easier than poring over spreadsheets or reports. Data visualization is a quick, easy way to convey concepts in a universal manner – and can experiment with different scenarios by making slight adjustments.
  12. data with so large size and complexity that none of traditional data management tools can store it or process it efficiently. Big data is also a data but with huge size.