Google Cloud Storage is unified object storage for developers and enterprises, from live data serving to data analytics/ML to data archiving.
High performance, internet-scale, immutable BLOB (binary large object) storage
Simple Abstraction Storage buckets, immutable objects with mutable metadata and Globally unique URI identifiers for buckets, objects
Common storage for Google Cloud Platform services
3. Lecture
Overview
Overview of Google Data Storage Overview
Structured or Unstructured
Managed or Unmanaged
GCP Storage Decision Tree
GCP Storage Portfolio
4. GCP Data Storage
• Google Cloud Platform delivers various storage
service offerings which remove much of the
burden of building and managing storage and
infrastructure.
• Like other cloud services, cloud storage will free
you to focus on doing what you do best and
differentiating at the application or service layer.
• Google Cloud Storage has flexible and strategic
pricing.
5. GCP Data
Storage
Requirements
• First is to understand do you need
Structured or Unstructured
• Second, consider the availability
and compliance requirements
• Third, consider costing models
• Fourth, consider performance
requirements (Latency)
• Fifth, determine migration
requirements
6. GCP Data Storage
Structured Data Services
Cloud SQL
Cloud Bigtable
Cloud BigQuery
Cloud Datastore
Cloud Spanner
Unstructured Data Services
Cloud Storage
7. Lets Define
Unstructured
Data
• Data Storage - Unstructured data
• Unstructured data is data that does not have a pre
determined sequence, data model or schema.
• Can be human generated or machine generated
• Examples are Email, documents, social media,
mobile, sensor data, satellite images, etc
• On GCP Cloud Storage is the only service built for
managing and maintaining you Unstructured Data
8. Lets Define Structured Data
• Data Storage - Structured data
• Structured data is data that does
have a pre determined
sequence, data model or
schema. Generally a database
(RDBMS)
• Can be human generated or
machine generated
• Examples are SQL.
9. Lets Define
Semi-
Structured
Data
Data Storage - Semi-
Structured data
Semi-Structured data is data
that contains semantic tags,
but does not conform to the
structure associated with
typical relational databases.
Can be human generated or
machine generated
Examples are XML, JSON and
NoSQL
10. Data Structures
Data Structure
Structured data is comprised of clearly defined data types
whose pattern makes them easily searchable usually in an
RDBMS
Unstructured data – “everything else” – is comprised of
data that is usually not as easily searchable, including
formats like audio, video, and social media postings.
Courtesy of
https://www.datamation.com/big-
data/structured-vs-unstructured-data.html
11. Managed or
Unmanaged Services
• Google Cloud Data Services come
in both managed and unmanaged
services.
• Managed services are for example
Cloud SQL or BigTable in GCP
• Unmanaged services are for
example Cloud Storage in GCP
12. Storage Integration
Storage Integration
Google Cloud Storage is tightly integrated with many of the Google Cloud
Platform products and services. Cloud Storage is often the ingestion point for data being
moved into the cloud, and is frequently the long-term storage location for data