Google Cloud Platform
Big Data Unlimited
Sebastien Agnan, Solution Engineer
sagnan@google.com
Building what’s next 3
Time to Understanding
Typical Big Data
Processing
Programming
Resource
provisioning
Performance
tuning
Monitoring
Reliability
Deployment &
configuration
Handling
growing scale
Utilization
improvements
Building what’s next 4
Time to Understanding
Big Data with Google:
Focus on insight,
not infrastructure.
Programming
StoreCapture Analyze
BigQuery
Big Data at Google
Process
DataflowCloud Storage
DatastoreCloud SQL
Hadoop/SparkKafka
Pub/Sub
Hadoop/Spark
• Publish and Subscription Service
• Simple
• Seamlessly Scalable
• Many-to-many or one-to-one
• Guaranteed Durable Delivery
• Push or Pull
• Secure and Encrypted
PUB / SUB : Real-time and reliable messaging
Building what’s next 7
Lorem Ipsum
Lorem Ipsum
Reliable and Flexible Storage
Performant and economical
Blob, Block, Key Value, SQL and NoSQL
Easy to use : API
High performance : 99.95% SLA and 24x7 phone
support
Strong ecosystem of partners
Data location (US,EU or APAC)
Building what’s next 8
Merges batch and stream processing
Data processing pipelines
Monitoring interface
Significantly lower cost
Google Cloud Dataflow
makes complex data analysis simple
#gcpug | #googlecloud
Google Cloud Dataflow
Optimize
Schedule
GCS GCS
User Code & SDK Monitoring UI
Life of a Pipeline
Building what’s next 10
Scales automatically
No setup or administration
Stream up to 100,000 rows p/sec
Easily integrates with third-party software
Google BigQuery
makes complex data analysis simple
#gcpug | #googlecloud
BigQuery Analytic Service in the Cloud
BigQuery
Analyze ExportImport
How to use BigQuery?
Google
AnalyticsETL tools
Connectors
Google Cloud
BI tools and
Visualization
Google Cloud
Spreadsheets, R,
Hadoop
Building what’s next 12
A more flexible App Engine
Complete Platform-as-a-Service.
Focus on Code. Not infrastructure.
Develop in your favorite language.
Deploy with a click.
Conclusion
StoreCapture Analyze
BigQuery
Big Data at Google - Easy, Inexpensive, and Fast
Process
DataflowCloud Storage
DatastoreCloud SQL
Hadoop/SparkKafka
Pub/Sub
Hadoop/Spark
NEXT PARIS 13 OCtobre
2015
https://goo.gl/wgKqhT
Google confidential │ Do not
distribute
Thank You
#gcpug | #googlecloud
Column Oriented Storage
Record Oriented Storage Column Oriented Storage
Less bandwidth, More compression

#DataUnlimited - Google Big Data Unlimited

  • 1.
    Google Cloud Platform BigData Unlimited Sebastien Agnan, Solution Engineer sagnan@google.com
  • 3.
    Building what’s next3 Time to Understanding Typical Big Data Processing Programming Resource provisioning Performance tuning Monitoring Reliability Deployment & configuration Handling growing scale Utilization improvements
  • 4.
    Building what’s next4 Time to Understanding Big Data with Google: Focus on insight, not infrastructure. Programming
  • 5.
    StoreCapture Analyze BigQuery Big Dataat Google Process DataflowCloud Storage DatastoreCloud SQL Hadoop/SparkKafka Pub/Sub Hadoop/Spark
  • 6.
    • Publish andSubscription Service • Simple • Seamlessly Scalable • Many-to-many or one-to-one • Guaranteed Durable Delivery • Push or Pull • Secure and Encrypted PUB / SUB : Real-time and reliable messaging
  • 7.
    Building what’s next7 Lorem Ipsum Lorem Ipsum Reliable and Flexible Storage Performant and economical Blob, Block, Key Value, SQL and NoSQL Easy to use : API High performance : 99.95% SLA and 24x7 phone support Strong ecosystem of partners Data location (US,EU or APAC)
  • 8.
    Building what’s next8 Merges batch and stream processing Data processing pipelines Monitoring interface Significantly lower cost Google Cloud Dataflow makes complex data analysis simple
  • 9.
    #gcpug | #googlecloud GoogleCloud Dataflow Optimize Schedule GCS GCS User Code & SDK Monitoring UI Life of a Pipeline
  • 10.
    Building what’s next10 Scales automatically No setup or administration Stream up to 100,000 rows p/sec Easily integrates with third-party software Google BigQuery makes complex data analysis simple
  • 11.
    #gcpug | #googlecloud BigQueryAnalytic Service in the Cloud BigQuery Analyze ExportImport How to use BigQuery? Google AnalyticsETL tools Connectors Google Cloud BI tools and Visualization Google Cloud Spreadsheets, R, Hadoop
  • 12.
    Building what’s next12 A more flexible App Engine Complete Platform-as-a-Service. Focus on Code. Not infrastructure. Develop in your favorite language. Deploy with a click.
  • 13.
  • 14.
    StoreCapture Analyze BigQuery Big Dataat Google - Easy, Inexpensive, and Fast Process DataflowCloud Storage DatastoreCloud SQL Hadoop/SparkKafka Pub/Sub Hadoop/Spark
  • 15.
    NEXT PARIS 13OCtobre 2015 https://goo.gl/wgKqhT
  • 16.
    Google confidential │Do not distribute Thank You
  • 17.
    #gcpug | #googlecloud ColumnOriented Storage Record Oriented Storage Column Oriented Storage Less bandwidth, More compression