SlideShare a Scribd company logo
1 of 36
Build What’s NEXT
Google Cloud Platform: Data & Analytics
Chris Jang (장혜덕), Head of Cloud Platform, Korea
chrisjang@google.com
Virtualized
Data Centers
Standard virtual kit for
Rent. Still yours to
manage.
2nd
Wave
Colocation
1st
Wave
Your kit, someone
else’s building.
Yours to manage.
Assembly required True On Demand Cloud
Next
Storage Processing Memory Network
Clusters
Distributed Storage, Processing
& Machine Learning
Containers
3rd
Wave
An actual, global
elastic cloud
Invest your energy in
great apps.
Confidential & ProprietaryGoogle Cloud Platform 3
What Makes Google Cloud Platform Different
Google Cloud Platform 4
Foundation
Infrastructure & Operations
Data Services
Application
Runtime Services
Enabling No-Touch Operations
Breakthrough Insights,
Breakthrough Applications
The Gear that Powers Google
Google Cloud Platform 5
Where Google Cloud Platform Really Makes the Difference
True cloud
economics
Make the cloud work for
you, not your vendor.
• Per-minute pricing
• Sustained use discounts
• Custom machine types;
right infrastructure at
right cost
• No up-front fees or lock-
ins
Future-proof
infrastructure
Scale your business
smoothly and
responsibly.
• Live migration
• Private network, owned
fibre
• Carbon-neutral operation
• Deep investments in
open source
Access to
innovation
Unique Data Platform
• Fully managed services
let you focus on insight,
not infrastructure
• Industry-leading
machine learning
Container Revolution
• Decade of innovation at
managing containers at
scale
• Broad industry
partnerships
Google-grade
security
The best security
available, because we
need it.
• Ongoing investment and
innovation in physical
and electronic
countermeasures
• Over 500 security
engineers building
technology.
• Google controls its cloud
stack, from silicon up.
True Cloud Economics
Building what’s next 7
77 edge locations
33 countries
The broadest reaching network
of any Cloud Provider
Google-Grade Networking
Google Cloud Platform 8
Open Innovation
is what we’ve
always been about.
● Open APIs
● Active contribution across many
open source projects
● Deep history of academic
publishing
● Interoperability
Building what’s next 9
Source: google.com/green
Google data centers use half the
energy of typical data centers.
Green is Good
A better cloud
that's better for the
environment.
Green is Good
Google uses
35% renewable energy.
Source: google.com/green
From traditional batch processing to rock-solid event delivery to the nearly
magical abilities of BigQuery, building on Google’s data infrastructure
provides us with a significant advantage where it matters the most.
Nicholas Harteau
VP of Engineering and Infrastructure
”“
Confidential & ProprietaryGoogle Cloud Platform 12
Google’s Mission
Organize the world’s information and make
it universally accessible and useful.“
”
2012 20132002 2004 2006 2008 2010
GFS
MapReduce
BigTable Colossus
Dremel Flume
Megastore
Spanner
Millwheel
PubSub
F1
Google Research Publications referenced are available here: http://research.google.com/pubs/papers.html
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html
2016
Dataflow
TensorFlow
Google’s Innovations In Data Analytics
Storage and Databases Big Data and Analytics Machine Learning
Google Cloud Platform - Data & Analytics Products
BigQuery
Cloud Dataflow
Cloud Dataproc
Cloud Pub/Sub
Cloud Datalab
Cloud Storage
Cloud Datastore
Cloud Bigtable
Cloud SQL
Cloud ML
Cloud Translate API
Cloud Vision API
Cloud Speech API
Common Use Cases For Data & Analytics
“A big data platform”
“A cloud database
for my apps”
“A solution for building
intelligence into my apps”
“A cost-effective
storage solution”
01 Storage
Google Cloud Storage
Big Data
Images
Archives
Backups ● Continuous performance
improvements
● Running at Google scale
○ Several PBs ingested and
downloaded daily
○ Same back-end as Google Drive,
Photos, etc.
● Integrated with leading enterprise
backup and archival products
Archival storage without compromises
Cloud Storage Nearline
Nearline Online Offline
Time to first byte
Storage cost
(GB/Mth)
0.1s 3 s 3 hrs+
$0.01
$0.02
$0.03
0
Google Cloud Storage Partner Ecosystem
02 Databases
How Do Our Customers Store Their Data?
Developer Tools
Google Container Engine
Google App Engine
Google Compute Engine
NoSQLRelational
Cloud SQL
Good for:
Structured and unstructured
files or binary data
Such as:
Images, large media files,
backups
Good for:
App Engine,
mobile/web
Such as:
User profiles,
catalogs
Good for:
Web frameworks,
existing applications
Such as:
User credentials, customer
orders
Good for:
Heavy read &
write, events
Such as:
AdTech,
Financial, IoT
The Right Data Stores for Each Application
Object/File
Cloud
Bigtable
Cloud
Datastore
Cloud Storage
03 Big Data
Big Data Use Cases
Marketing Analytics Mobile Gaming
Analytics
Sensor Data and
IoT
Genomics
Google App
Engine
Google
Analytics
Premium
Cloud
Pub/Sub
BigQuery Storage
(tables)
Cloud Bigtable
(NoSQL)
Cloud Storage
(files)
Cloud Dataflow
BigQuery Analytics
(SQL)
Capture Store Analyze
Cloud
Logs
Batch
Process
Stream
Cloud
Monitoring
Cloud
Dataflow
Use
Data
Scientists
Analysts
Cloud Dataproc
Cloud Datalab
Big Data Lifecycle
Real-time analytics
Real-time
dashboard
Real-time
alerts
Cloud Datalab
04 Machine Learning
Machine Learning: See, Hear and Understand
Machine Learning Use Cases
Structured Data
Classification/ Regression
• Customer Churn Analysis
• Product Diagnostics
• Forecasting
Recommendation
• Content Personalization
• Product X-Sells/Up-sells
Anomaly Detection
• Fraud Detection
• Asset Sensor Diagnostics
• Log Metric Anomalies
Unstructured Data
Image Analytics
• Identify damaged shipments
• Explicit Content Classification
• Identify “styles” in images
Text Analytics
• Call Center log analysis
• Language Identification
• Topic Classification
• Sentiment Analysis
TensorFlow
● Deep Learning technology powering
over 100 Google services
● Generalizable to vision, sound, text,
video and other data
● Runs on CPUs or GPUs, desktop,
server, or mobile computing
platforms
● Available as Apache 2.0 OSS license
Cloud Vision API
To get the most
out of data and secure
competitive advantage.
Empower users to make
better decisions
Transform your organization
into a truly data driven company.
Putting tools into hands of
domain experts.
Apply machine learning
broadly and easily
We make it simple and practical
to incorporate machine learning
models within custom
applications.
We’ve “automated out” the
complexity of building and
maintaining data and
analytics systems.
Spend less on ops and
administration
Easily incorporate context
and real-time data into apps
and architectures
Why Google?
Building what’s next 35
Average age of a
company joining
the S&P 500
1957 2003 2013
75years
25years
10years
Build What’s NEXT
감사합니다!

More Related Content

What's hot

Google Cloud Platform (GCP) At a Glance
Google Cloud Platform (GCP)  At a GlanceGoogle Cloud Platform (GCP)  At a Glance
Google Cloud Platform (GCP) At a GlanceCloud Analogy
 
Introduction to Google Cloud Services / Platforms
Introduction to Google Cloud Services / PlatformsIntroduction to Google Cloud Services / Platforms
Introduction to Google Cloud Services / PlatformsNilanchal
 
#DataUnlimited - Google Big Data Unlimited
#DataUnlimited - Google Big Data Unlimited#DataUnlimited - Google Big Data Unlimited
#DataUnlimited - Google Big Data UnlimitedAudrey Huvet
 
Big Data Best Practices on GCP
Big Data Best Practices on GCPBig Data Best Practices on GCP
Big Data Best Practices on GCPAllCloud
 
Big Data and ML on Google Cloud
Big Data and ML on Google CloudBig Data and ML on Google Cloud
Big Data and ML on Google CloudWlodek Bielski
 
Understanding cloud with Google Cloud Platform
Understanding cloud with Google Cloud PlatformUnderstanding cloud with Google Cloud Platform
Understanding cloud with Google Cloud PlatformDr. Ketan Parmar
 
Birds Eye View on Big Data by STKI
Birds Eye View on Big Data by STKIBirds Eye View on Big Data by STKI
Birds Eye View on Big Data by STKIIdan Tohami
 
Cloud computing overview & Technical intro to Google Cloud
Cloud computing overview & Technical intro to Google CloudCloud computing overview & Technical intro to Google Cloud
Cloud computing overview & Technical intro to Google Cloudwesley chun
 
StackEngine Demo - Docker Austin
StackEngine Demo - Docker AustinStackEngine Demo - Docker Austin
StackEngine Demo - Docker AustinBoyd Hemphill
 
node.js on Google Compute Engine
node.js on Google Compute Enginenode.js on Google Compute Engine
node.js on Google Compute EngineArun Nagarajan
 
An overview of BigQuery
An overview of BigQuery An overview of BigQuery
An overview of BigQuery GirdhareeSaran
 
Critical Breakthroughs and Challenges in Big Data and Analytics
Critical Breakthroughs and Challenges in Big Data and AnalyticsCritical Breakthroughs and Challenges in Big Data and Analytics
Critical Breakthroughs and Challenges in Big Data and AnalyticsData Driven Innovation
 
Big data in action
Big data in actionBig data in action
Big data in actionTu Pham
 
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...Alluxio, Inc.
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud PlatformSujai Prakasam
 
Google Cloud Platform: Prototype ->Production-> Planet scale
Google Cloud Platform: Prototype ->Production-> Planet scaleGoogle Cloud Platform: Prototype ->Production-> Planet scale
Google Cloud Platform: Prototype ->Production-> Planet scaleIdan Tohami
 

What's hot (20)

Google Cloud Platform (GCP) At a Glance
Google Cloud Platform (GCP)  At a GlanceGoogle Cloud Platform (GCP)  At a Glance
Google Cloud Platform (GCP) At a Glance
 
Introduction to Google Cloud Services / Platforms
Introduction to Google Cloud Services / PlatformsIntroduction to Google Cloud Services / Platforms
Introduction to Google Cloud Services / Platforms
 
#DataUnlimited - Google Big Data Unlimited
#DataUnlimited - Google Big Data Unlimited#DataUnlimited - Google Big Data Unlimited
#DataUnlimited - Google Big Data Unlimited
 
Big Data Best Practices on GCP
Big Data Best Practices on GCPBig Data Best Practices on GCP
Big Data Best Practices on GCP
 
Big Data and ML on Google Cloud
Big Data and ML on Google CloudBig Data and ML on Google Cloud
Big Data and ML on Google Cloud
 
A Complete Guide to the Google Cloud Platform
A Complete Guide to the Google Cloud PlatformA Complete Guide to the Google Cloud Platform
A Complete Guide to the Google Cloud Platform
 
Google Cloud Platform Data Storage
Google Cloud Platform Data StorageGoogle Cloud Platform Data Storage
Google Cloud Platform Data Storage
 
TIAD : Automate everything with Google Cloud
TIAD : Automate everything with Google CloudTIAD : Automate everything with Google Cloud
TIAD : Automate everything with Google Cloud
 
Understanding cloud with Google Cloud Platform
Understanding cloud with Google Cloud PlatformUnderstanding cloud with Google Cloud Platform
Understanding cloud with Google Cloud Platform
 
Birds Eye View on Big Data by STKI
Birds Eye View on Big Data by STKIBirds Eye View on Big Data by STKI
Birds Eye View on Big Data by STKI
 
Cloud computing overview & Technical intro to Google Cloud
Cloud computing overview & Technical intro to Google CloudCloud computing overview & Technical intro to Google Cloud
Cloud computing overview & Technical intro to Google Cloud
 
StackEngine Demo - Docker Austin
StackEngine Demo - Docker AustinStackEngine Demo - Docker Austin
StackEngine Demo - Docker Austin
 
Google cloud
Google cloudGoogle cloud
Google cloud
 
node.js on Google Compute Engine
node.js on Google Compute Enginenode.js on Google Compute Engine
node.js on Google Compute Engine
 
An overview of BigQuery
An overview of BigQuery An overview of BigQuery
An overview of BigQuery
 
Critical Breakthroughs and Challenges in Big Data and Analytics
Critical Breakthroughs and Challenges in Big Data and AnalyticsCritical Breakthroughs and Challenges in Big Data and Analytics
Critical Breakthroughs and Challenges in Big Data and Analytics
 
Big data in action
Big data in actionBig data in action
Big data in action
 
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
Integrating Google Cloud Dataproc with Alluxio for faster performance in the ...
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platform
 
Google Cloud Platform: Prototype ->Production-> Planet scale
Google Cloud Platform: Prototype ->Production-> Planet scaleGoogle Cloud Platform: Prototype ->Production-> Planet scale
Google Cloud Platform: Prototype ->Production-> Planet scale
 

Similar to GCP Data & Analytics: Storage, Databases, Big Data, Machine Learning

Eric Andersen Keynote
Eric Andersen KeynoteEric Andersen Keynote
Eric Andersen KeynoteData Con LA
 
Google Cloud Data Platform - Why Google for Data Analysis?
Google Cloud Data Platform - Why Google for Data Analysis?Google Cloud Data Platform - Why Google for Data Analysis?
Google Cloud Data Platform - Why Google for Data Analysis?Andreas Raible
 
Google Cloud Machine Learning
 Google Cloud Machine Learning  Google Cloud Machine Learning
Google Cloud Machine Learning India Quotient
 
GCP On Prem Buyers Guide - White-paper | Qubole
GCP On Prem Buyers Guide - White-paper | Qubole GCP On Prem Buyers Guide - White-paper | Qubole
GCP On Prem Buyers Guide - White-paper | Qubole Vasu S
 
Google not all clouds are created equal - sap sapphire 2014 (1)
Google not all clouds are created equal - sap sapphire 2014 (1)Google not all clouds are created equal - sap sapphire 2014 (1)
Google not all clouds are created equal - sap sapphire 2014 (1)David Torres
 
Big Data Platform and Architecture Recommendation
Big Data Platform and Architecture RecommendationBig Data Platform and Architecture Recommendation
Big Data Platform and Architecture RecommendationSofyan Hadi AHmad
 
Building what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructureBuilding what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructureMediaAgility
 
MongoDB World 2016: Lunch & Learn: Google Cloud for the Enterprise
MongoDB World 2016: Lunch & Learn: Google Cloud for the EnterpriseMongoDB World 2016: Lunch & Learn: Google Cloud for the Enterprise
MongoDB World 2016: Lunch & Learn: Google Cloud for the EnterpriseMongoDB
 
Google Cloud Platform.docx
Google Cloud Platform.docxGoogle Cloud Platform.docx
Google Cloud Platform.docxgcpmastersin
 
Google на конференции Big Data Russia
Google на конференции Big Data RussiaGoogle на конференции Big Data Russia
Google на конференции Big Data Russiarusbase.vc
 
Slides: Success Stories for Data-to-Cloud
Slides: Success Stories for Data-to-CloudSlides: Success Stories for Data-to-Cloud
Slides: Success Stories for Data-to-CloudDATAVERSITY
 
Connecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud PlatformConnecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud PlatformConnectaDigital
 
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc
 
Solving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute finalSolving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute finalAvere Systems
 
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStax
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStaxWebinar | From Zero to 1 Million with Google Cloud Platform and DataStax
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStaxDataStax
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platformdhruv_chaudhari
 
Google Cloud Platform
Google Cloud PlatformGoogle Cloud Platform
Google Cloud PlatformGeneXus
 

Similar to GCP Data & Analytics: Storage, Databases, Big Data, Machine Learning (20)

Eric Andersen Keynote
Eric Andersen KeynoteEric Andersen Keynote
Eric Andersen Keynote
 
Modern Thinking área digital MSKM 21/09/2017
Modern Thinking área digital MSKM 21/09/2017Modern Thinking área digital MSKM 21/09/2017
Modern Thinking área digital MSKM 21/09/2017
 
Google Cloud Data Platform - Why Google for Data Analysis?
Google Cloud Data Platform - Why Google for Data Analysis?Google Cloud Data Platform - Why Google for Data Analysis?
Google Cloud Data Platform - Why Google for Data Analysis?
 
Google Cloud Machine Learning
 Google Cloud Machine Learning  Google Cloud Machine Learning
Google Cloud Machine Learning
 
GCP On Prem Buyers Guide - White-paper | Qubole
GCP On Prem Buyers Guide - White-paper | Qubole GCP On Prem Buyers Guide - White-paper | Qubole
GCP On Prem Buyers Guide - White-paper | Qubole
 
Google not all clouds are created equal - sap sapphire 2014 (1)
Google not all clouds are created equal - sap sapphire 2014 (1)Google not all clouds are created equal - sap sapphire 2014 (1)
Google not all clouds are created equal - sap sapphire 2014 (1)
 
Big Data Platform and Architecture Recommendation
Big Data Platform and Architecture RecommendationBig Data Platform and Architecture Recommendation
Big Data Platform and Architecture Recommendation
 
Building what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructureBuilding what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructure
 
MongoDB World 2016: Lunch & Learn: Google Cloud for the Enterprise
MongoDB World 2016: Lunch & Learn: Google Cloud for the EnterpriseMongoDB World 2016: Lunch & Learn: Google Cloud for the Enterprise
MongoDB World 2016: Lunch & Learn: Google Cloud for the Enterprise
 
Google Cloud Platform.docx
Google Cloud Platform.docxGoogle Cloud Platform.docx
Google Cloud Platform.docx
 
Google на конференции Big Data Russia
Google на конференции Big Data RussiaGoogle на конференции Big Data Russia
Google на конференции Big Data Russia
 
Slides: Success Stories for Data-to-Cloud
Slides: Success Stories for Data-to-CloudSlides: Success Stories for Data-to-Cloud
Slides: Success Stories for Data-to-Cloud
 
Data Platform on GCP
Data Platform on GCPData Platform on GCP
Data Platform on GCP
 
Connecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud PlatformConnecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud Platform
 
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...
 
Solving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute finalSolving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute final
 
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStax
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStaxWebinar | From Zero to 1 Million with Google Cloud Platform and DataStax
Webinar | From Zero to 1 Million with Google Cloud Platform and DataStax
 
JAM23-24_ppt.pptx
JAM23-24_ppt.pptxJAM23-24_ppt.pptx
JAM23-24_ppt.pptx
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platform
 
Google Cloud Platform
Google Cloud PlatformGoogle Cloud Platform
Google Cloud Platform
 

More from Chris Jang

GCP Gaming 2016 Seoul, Korea Build Game Server in 20min
GCP Gaming 2016 Seoul, Korea Build Game Server in 20minGCP Gaming 2016 Seoul, Korea Build Game Server in 20min
GCP Gaming 2016 Seoul, Korea Build Game Server in 20minChris Jang
 
GCP Gaming 2016 Seoul, Korea Firebase
GCP Gaming 2016 Seoul, Korea FirebaseGCP Gaming 2016 Seoul, Korea Firebase
GCP Gaming 2016 Seoul, Korea FirebaseChris Jang
 
GCP Gaming 2016 Seoul, Korea Gaming Analytics
GCP Gaming 2016 Seoul, Korea Gaming AnalyticsGCP Gaming 2016 Seoul, Korea Gaming Analytics
GCP Gaming 2016 Seoul, Korea Gaming AnalyticsChris Jang
 
GCP Gaming Korea 9M Interactive
GCP Gaming Korea 9M InteractiveGCP Gaming Korea 9M Interactive
GCP Gaming Korea 9M InteractiveChris Jang
 
GCP Gaming 2016 Keynote Seoul, Korea
GCP Gaming 2016 Keynote Seoul, KoreaGCP Gaming 2016 Keynote Seoul, Korea
GCP Gaming 2016 Keynote Seoul, KoreaChris Jang
 
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015Chris Jang
 

More from Chris Jang (6)

GCP Gaming 2016 Seoul, Korea Build Game Server in 20min
GCP Gaming 2016 Seoul, Korea Build Game Server in 20minGCP Gaming 2016 Seoul, Korea Build Game Server in 20min
GCP Gaming 2016 Seoul, Korea Build Game Server in 20min
 
GCP Gaming 2016 Seoul, Korea Firebase
GCP Gaming 2016 Seoul, Korea FirebaseGCP Gaming 2016 Seoul, Korea Firebase
GCP Gaming 2016 Seoul, Korea Firebase
 
GCP Gaming 2016 Seoul, Korea Gaming Analytics
GCP Gaming 2016 Seoul, Korea Gaming AnalyticsGCP Gaming 2016 Seoul, Korea Gaming Analytics
GCP Gaming 2016 Seoul, Korea Gaming Analytics
 
GCP Gaming Korea 9M Interactive
GCP Gaming Korea 9M InteractiveGCP Gaming Korea 9M Interactive
GCP Gaming Korea 9M Interactive
 
GCP Gaming 2016 Keynote Seoul, Korea
GCP Gaming 2016 Keynote Seoul, KoreaGCP Gaming 2016 Keynote Seoul, Korea
GCP Gaming 2016 Keynote Seoul, Korea
 
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015
Google Tech Talk with Dr. Eric Brewer in Korea Apr.27.2015
 

Recently uploaded

Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 

Recently uploaded (20)

Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 

GCP Data & Analytics: Storage, Databases, Big Data, Machine Learning

  • 1. Build What’s NEXT Google Cloud Platform: Data & Analytics Chris Jang (장혜덕), Head of Cloud Platform, Korea chrisjang@google.com
  • 2. Virtualized Data Centers Standard virtual kit for Rent. Still yours to manage. 2nd Wave Colocation 1st Wave Your kit, someone else’s building. Yours to manage. Assembly required True On Demand Cloud Next Storage Processing Memory Network Clusters Distributed Storage, Processing & Machine Learning Containers 3rd Wave An actual, global elastic cloud Invest your energy in great apps.
  • 3. Confidential & ProprietaryGoogle Cloud Platform 3 What Makes Google Cloud Platform Different
  • 4. Google Cloud Platform 4 Foundation Infrastructure & Operations Data Services Application Runtime Services Enabling No-Touch Operations Breakthrough Insights, Breakthrough Applications The Gear that Powers Google
  • 5. Google Cloud Platform 5 Where Google Cloud Platform Really Makes the Difference True cloud economics Make the cloud work for you, not your vendor. • Per-minute pricing • Sustained use discounts • Custom machine types; right infrastructure at right cost • No up-front fees or lock- ins Future-proof infrastructure Scale your business smoothly and responsibly. • Live migration • Private network, owned fibre • Carbon-neutral operation • Deep investments in open source Access to innovation Unique Data Platform • Fully managed services let you focus on insight, not infrastructure • Industry-leading machine learning Container Revolution • Decade of innovation at managing containers at scale • Broad industry partnerships Google-grade security The best security available, because we need it. • Ongoing investment and innovation in physical and electronic countermeasures • Over 500 security engineers building technology. • Google controls its cloud stack, from silicon up.
  • 7. Building what’s next 7 77 edge locations 33 countries The broadest reaching network of any Cloud Provider Google-Grade Networking
  • 8. Google Cloud Platform 8 Open Innovation is what we’ve always been about. ● Open APIs ● Active contribution across many open source projects ● Deep history of academic publishing ● Interoperability
  • 9. Building what’s next 9 Source: google.com/green Google data centers use half the energy of typical data centers. Green is Good A better cloud that's better for the environment.
  • 10. Green is Good Google uses 35% renewable energy. Source: google.com/green
  • 11. From traditional batch processing to rock-solid event delivery to the nearly magical abilities of BigQuery, building on Google’s data infrastructure provides us with a significant advantage where it matters the most. Nicholas Harteau VP of Engineering and Infrastructure ”“
  • 12. Confidential & ProprietaryGoogle Cloud Platform 12
  • 13. Google’s Mission Organize the world’s information and make it universally accessible and useful.“ ”
  • 14. 2012 20132002 2004 2006 2008 2010 GFS MapReduce BigTable Colossus Dremel Flume Megastore Spanner Millwheel PubSub F1 Google Research Publications referenced are available here: http://research.google.com/pubs/papers.html The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html 2016 Dataflow TensorFlow Google’s Innovations In Data Analytics
  • 15. Storage and Databases Big Data and Analytics Machine Learning Google Cloud Platform - Data & Analytics Products BigQuery Cloud Dataflow Cloud Dataproc Cloud Pub/Sub Cloud Datalab Cloud Storage Cloud Datastore Cloud Bigtable Cloud SQL Cloud ML Cloud Translate API Cloud Vision API Cloud Speech API
  • 16. Common Use Cases For Data & Analytics “A big data platform” “A cloud database for my apps” “A solution for building intelligence into my apps” “A cost-effective storage solution”
  • 18. Google Cloud Storage Big Data Images Archives Backups ● Continuous performance improvements ● Running at Google scale ○ Several PBs ingested and downloaded daily ○ Same back-end as Google Drive, Photos, etc. ● Integrated with leading enterprise backup and archival products
  • 19. Archival storage without compromises Cloud Storage Nearline Nearline Online Offline Time to first byte Storage cost (GB/Mth) 0.1s 3 s 3 hrs+ $0.01 $0.02 $0.03 0
  • 20. Google Cloud Storage Partner Ecosystem
  • 22. How Do Our Customers Store Their Data? Developer Tools Google Container Engine Google App Engine Google Compute Engine
  • 23. NoSQLRelational Cloud SQL Good for: Structured and unstructured files or binary data Such as: Images, large media files, backups Good for: App Engine, mobile/web Such as: User profiles, catalogs Good for: Web frameworks, existing applications Such as: User credentials, customer orders Good for: Heavy read & write, events Such as: AdTech, Financial, IoT The Right Data Stores for Each Application Object/File Cloud Bigtable Cloud Datastore Cloud Storage
  • 25. Big Data Use Cases Marketing Analytics Mobile Gaming Analytics Sensor Data and IoT Genomics
  • 26. Google App Engine Google Analytics Premium Cloud Pub/Sub BigQuery Storage (tables) Cloud Bigtable (NoSQL) Cloud Storage (files) Cloud Dataflow BigQuery Analytics (SQL) Capture Store Analyze Cloud Logs Batch Process Stream Cloud Monitoring Cloud Dataflow Use Data Scientists Analysts Cloud Dataproc Cloud Datalab Big Data Lifecycle Real-time analytics Real-time dashboard Real-time alerts
  • 27.
  • 30. Machine Learning: See, Hear and Understand
  • 31. Machine Learning Use Cases Structured Data Classification/ Regression • Customer Churn Analysis • Product Diagnostics • Forecasting Recommendation • Content Personalization • Product X-Sells/Up-sells Anomaly Detection • Fraud Detection • Asset Sensor Diagnostics • Log Metric Anomalies Unstructured Data Image Analytics • Identify damaged shipments • Explicit Content Classification • Identify “styles” in images Text Analytics • Call Center log analysis • Language Identification • Topic Classification • Sentiment Analysis
  • 32. TensorFlow ● Deep Learning technology powering over 100 Google services ● Generalizable to vision, sound, text, video and other data ● Runs on CPUs or GPUs, desktop, server, or mobile computing platforms ● Available as Apache 2.0 OSS license
  • 34. To get the most out of data and secure competitive advantage. Empower users to make better decisions Transform your organization into a truly data driven company. Putting tools into hands of domain experts. Apply machine learning broadly and easily We make it simple and practical to incorporate machine learning models within custom applications. We’ve “automated out” the complexity of building and maintaining data and analytics systems. Spend less on ops and administration Easily incorporate context and real-time data into apps and architectures Why Google?
  • 35. Building what’s next 35 Average age of a company joining the S&P 500 1957 2003 2013 75years 25years 10years