Introduction to the Google
      Cloud Platform




Mandy Waite, Google Developer Relations
               @tekgrrl
Google Cloud Platform



            Google                      Google
                                                                             Google BigQuery
          App Engine                 Compute Engine                   Interactive analysis of massive datasets at
                                                                      speed

      Scalable application            Virtual machines
       development and
     execution environment                                                  Google Cloud SQL
                                 Run arbitrary workloads at scale      Performant and scalable service for storing
        NoSQL Datastore                                                and accessing data
                                (e.g. Hadoop, scientific computing)
       Auto-scaling Frontends
        Long-lived Backends
           Task Queues
                                                                          Google Cloud Storage

                                                                       MySQL-based, fully managed service
Google App Engine
Opinionated web framework and deployment platform




                            Easy to build
                            Easy to scale
                            Easy to maintain
Get up and running quickly - NO Servers
SDK
  Python, Java, Go runtimes
  Local development server, Eclipse

Google Infrastructure
  Auto-scales

Admin Console
  Easy management
  Logs
And growing: by the numbers

       Google App Engine passed 7.5B+ daily hits




                                                                                                                  2012
                                                   Google                                Google           Cloud SQL
                                                   Storage                             Storage GA         Announce
                                                  Announce                                           Out of
Python Runtime       Java Runtime   Task Queues              High         Backends,
                                                                                                    Preview
                                                  BigQuery Replication   Pull Queues
                                                                                                      SLA        Cloud SQL
                                                  Announce Datastore                                Support      GA

                                                                                                         BigQuery GA
A month in the life of Google App Engine:

         1,000,000 active applications
        2 Trillion datastore operations
half of active world IP addresses touch GAE
Google App Engine Highlights

Fully managed SQL & NoSQL services

Rich APIs and Services:
 Task Queues, Memcache, Search, Users, Cloud Endpoints,
 Socket, Image, Files...

Flexible pricing: free to get started, SLA from $9/mo
Range of support packages: https://cloud.google.com/support/packages
Google App Engine European Data Centers
Compliance and Locality




 Application Hosting in EU
 Data replicated within EU
“ With Google App Engine, we don't need a system
  administrator or anyone dedicated to deploying our
  app, so 99% of our time is working on our
  application.. ”

Ben Kamens, Lead Engineer
Kahn Academy
Google Cloud Endpoints
APIs for Mobile and Web Backends Made Easy
(Experimental)


                 Storage
        (Datastore, SQL, Drive, etc)




                                                        Endpoints
                                       Business Logic



               Web APIs
Search API
(Experimental)



Add Google-like full-text search to
your application
 ● Custom scoring and
   snippeting
 ● GeoSearch
Development Stack
Google Compute Engine
Introducing Google Compute Engine



Compute Faster                    Scale Efficiently                     Save More
Vitrtual machines running on      Rapidly scale to tens of thousands    Benefit from low total cost of
Google environmentally friendly   of cores on infrastructure designed   ownership. Save more with
Infrastructure. Ideal for:        for large-scale computing             Google Compute Engine.
 ● large scale data analysis
 ● Batch processing
 ● Variable size workloads.
Introducing Google Compute Engine


         Compute                          Network                          Storage                          Tooling

Launch Linux Virtual Machines    Connect your VMs together to   Store on persistent disk, local   Control your VMs via REST API
         on demand                  form powerful clusters          disk or Cloud Storage                or command line




                                Adding Virtual Machines to the Google Cloud Platform
Architecture
What's in a VM

Linux VMs
 ● Root access
 ● Debian-based Linux or
   CentOS
 ● Many hardware configurations
    ○ 1, 2, 4, or 8 CPUs
    ○ Up to 52GB of RAM
API Basics

 ●   JSON over HTTP
 ●   Main Resources (Nouns)
      ○   Projects
      ○   Instances
      ○   Networks and Firewalls
      ○   Disks and Snapshots
      ○   Zones
      ○   Actions (Verbs):
 ●   GET, POST (create) and DELETE
      ○   Custom ‘verbs’ for updates
      ○   Auth via OAuth2
Clients and Libraries

 ●   gcutil: command line utility
 ●   Web UI: Built on GAE
 ●   Libraries
 ●   Partners and ecosystem
Flexible Storage Options




      Persistent Disk                Ephemeral Disk           Google Cloud Storage
  Fast, consistent performance       Used to boot VM            Seamless Authentication
  Network Connected, Replicated      Lives and dies with VM     Secure Access
  Snapshots for backup and restore   Encrypted at Rest          EU datacenter option
  Shareable
  Encrypted at Rest
i can haz Compute Engine?
                                    Right now:
                                    ● Limited preview
                                    ● Focused on compute intensive and batch
                                       workloads
                                    ● SLA and support available to commercial
                                       customers
                                    ● Apply: http://cloud.google.com
                                    ● Talk to us! We're happy to discuss your
                                       use case


CC Image courtesy of London looks
Storing Data
Storage Systems at Google
Structured Data: NoSQL + SQL




              Schemaless                      Familiar MySQL

      Queries, Atomic Transactions            Fully Managed

         Best for Internet Scale,      Best for Bounded Scale, highly
        denormalizable DataSets              structured DataSets

      Think Differently ... No Joins           Experimental
Unstructured: Google Cloud Storage
Google BigQuery
Big Data at Google


      72 hours
      100 million gigabytes
      425 million users
BigQuery gives you this power

      Store data with reliability, redundancy and
      consistency
      Go from data to meaning


      At scale ...


      Quickly!
How are developers using it?

     Game and social media analytics

     Infrastructure monitoring


     Advertising campaign optimization


     Sensor data analysis
Regular expressions on 15.7 billion rows...
Upload your Data




                   Google Cloud
                                  BigQuery
                     Storage
Google Spreadsheets via Apps Script
Google Spreadsheets via Apps Script
Libraries

●   Java
●   Python
●   .NET
●   PHP
●   JavaScript
●   Apps Script
●   ... more ...
It's a RESTful API
Wrap Up
cloud.google.com


  Questions?
Thank you!


http://developers.google.com/cloud

Mandy Waite, Warszawa marzec 2013

  • 1.
    Introduction to theGoogle Cloud Platform Mandy Waite, Google Developer Relations @tekgrrl
  • 2.
    Google Cloud Platform Google Google Google BigQuery App Engine Compute Engine Interactive analysis of massive datasets at speed Scalable application Virtual machines development and execution environment Google Cloud SQL Run arbitrary workloads at scale Performant and scalable service for storing NoSQL Datastore and accessing data (e.g. Hadoop, scientific computing) Auto-scaling Frontends Long-lived Backends Task Queues Google Cloud Storage MySQL-based, fully managed service
  • 3.
  • 4.
    Opinionated web frameworkand deployment platform Easy to build Easy to scale Easy to maintain
  • 5.
    Get up andrunning quickly - NO Servers SDK Python, Java, Go runtimes Local development server, Eclipse Google Infrastructure Auto-scales Admin Console Easy management Logs
  • 6.
    And growing: bythe numbers Google App Engine passed 7.5B+ daily hits 2012 Google Google Cloud SQL Storage Storage GA Announce Announce Out of Python Runtime Java Runtime Task Queues High Backends, Preview BigQuery Replication Pull Queues SLA Cloud SQL Announce Datastore Support GA BigQuery GA
  • 7.
    A month inthe life of Google App Engine: 1,000,000 active applications 2 Trillion datastore operations half of active world IP addresses touch GAE
  • 8.
    Google App EngineHighlights Fully managed SQL & NoSQL services Rich APIs and Services: Task Queues, Memcache, Search, Users, Cloud Endpoints, Socket, Image, Files... Flexible pricing: free to get started, SLA from $9/mo Range of support packages: https://cloud.google.com/support/packages
  • 9.
    Google App EngineEuropean Data Centers Compliance and Locality Application Hosting in EU Data replicated within EU
  • 10.
    “ With GoogleApp Engine, we don't need a system administrator or anyone dedicated to deploying our app, so 99% of our time is working on our application.. ” Ben Kamens, Lead Engineer Kahn Academy
  • 13.
    Google Cloud Endpoints APIsfor Mobile and Web Backends Made Easy (Experimental) Storage (Datastore, SQL, Drive, etc) Endpoints Business Logic Web APIs
  • 14.
    Search API (Experimental) Add Google-likefull-text search to your application ● Custom scoring and snippeting ● GeoSearch
  • 15.
  • 16.
  • 17.
    Introducing Google ComputeEngine Compute Faster Scale Efficiently Save More Vitrtual machines running on Rapidly scale to tens of thousands Benefit from low total cost of Google environmentally friendly of cores on infrastructure designed ownership. Save more with Infrastructure. Ideal for: for large-scale computing Google Compute Engine. ● large scale data analysis ● Batch processing ● Variable size workloads.
  • 18.
    Introducing Google ComputeEngine Compute Network Storage Tooling Launch Linux Virtual Machines Connect your VMs together to Store on persistent disk, local Control your VMs via REST API on demand form powerful clusters disk or Cloud Storage or command line Adding Virtual Machines to the Google Cloud Platform
  • 19.
  • 20.
    What's in aVM Linux VMs ● Root access ● Debian-based Linux or CentOS ● Many hardware configurations ○ 1, 2, 4, or 8 CPUs ○ Up to 52GB of RAM
  • 21.
    API Basics ● JSON over HTTP ● Main Resources (Nouns) ○ Projects ○ Instances ○ Networks and Firewalls ○ Disks and Snapshots ○ Zones ○ Actions (Verbs): ● GET, POST (create) and DELETE ○ Custom ‘verbs’ for updates ○ Auth via OAuth2
  • 22.
    Clients and Libraries ● gcutil: command line utility ● Web UI: Built on GAE ● Libraries ● Partners and ecosystem
  • 23.
    Flexible Storage Options Persistent Disk Ephemeral Disk Google Cloud Storage Fast, consistent performance Used to boot VM Seamless Authentication Network Connected, Replicated Lives and dies with VM Secure Access Snapshots for backup and restore Encrypted at Rest EU datacenter option Shareable Encrypted at Rest
  • 24.
    i can hazCompute Engine? Right now: ● Limited preview ● Focused on compute intensive and batch workloads ● SLA and support available to commercial customers ● Apply: http://cloud.google.com ● Talk to us! We're happy to discuss your use case CC Image courtesy of London looks
  • 25.
  • 26.
  • 27.
    Structured Data: NoSQL+ SQL Schemaless Familiar MySQL Queries, Atomic Transactions Fully Managed Best for Internet Scale, Best for Bounded Scale, highly denormalizable DataSets structured DataSets Think Differently ... No Joins Experimental
  • 28.
  • 29.
  • 30.
    Big Data atGoogle 72 hours 100 million gigabytes 425 million users
  • 31.
    BigQuery gives youthis power Store data with reliability, redundancy and consistency Go from data to meaning At scale ... Quickly!
  • 32.
    How are developersusing it? Game and social media analytics Infrastructure monitoring Advertising campaign optimization Sensor data analysis
  • 33.
    Regular expressions on15.7 billion rows...
  • 34.
    Upload your Data Google Cloud BigQuery Storage
  • 35.
  • 36.
  • 37.
    Libraries ● Java ● Python ● .NET ● PHP ● JavaScript ● Apps Script ● ... more ...
  • 38.
  • 39.
  • 40.
  • 41.