Mandy Waite
A Fresh Look at Google's Cloud
mandywaite@google.com
(@tekgrrl)
Building Apps and Services
in the Cloud
Google
App Engine
Google BigQuery
Scalable application
development and
execution environment
NoSQL Datastore
Auto-scaling Frontends
Long-lived Backends
Task Queues
Google
Compute Engine
Virtual machines
Run arbitrary workloads at scale
(e.g. Hadoop, scientific computing)
Google Cloud Platform
Google Cloud Storage
Google Cloud SQL
Interactive analysis of massive datasets at
speed
Performant and scalable service for storing
and accessing data
MySQL-based, fully managed service
Google App Engine
Easy to build
Easy to scale
Easy to maintain
Opinionated framework and deployment
platform
Get up and running quickly - NO Servers
SDK
Python, Java, Go runtimes
Local development server, Eclipse
Google Infrastructure
Auto-scales
Admin Console
Easy management
Logs
Python Runtime Java Runtime Task Queues High
Replication
Datastore
Google
Storage
Announce
BigQuery
Announce
Backends,
Pull Queues
Out of
Preview
SLA
Support
Google
Storage GA
Cloud SQL
Announce
2012
Cloud SQL
GA
BigQuery GA
And growing: by the numbers
Google App Engine passed 7.5B+ daily hits
1,000,000 active applications
2 Trillion datastore operations
half of active world IP addresses touch GAE
A month in the life of Google App Engine:
App Engine Updates and Pricing
Java 7 Support:
InvokeDynamic, try-with-resources, Flexible type creation (diamond
operator)
New features and updates:
Cloud Endpoints (experimental), larger memory options for instances, task
queue async methods, new multithreaded Python Dev Server, Python 2.5
deprecation, Django 1.4.2
Flexible pricing: free to get started, SLA from $9/mo
Range of support packages: https://cloud.google.com/support/packages
Application Hosting in EU
Data replicated within EU
Google App Engine European Data Centers
Compliance and Locality
“ With Google App Engine, we don't need a system
administrator or anyone dedicated to deploying our
app, so 99% of our time is working on our
application.. ”
Ben Kamens, Lead Engineer
Khan Academy
Frontends
Backends
Task Queues
Cron
Compute Network
URL Fetch
XMPP
Channel API
Mail API
Storage
Datastore
Memcache
Namespaces
Blobstore
Cloud SQL
Static content
Services
Images API
App Identity
Users API
MapReduce API
Pipeline API
Prospective Search API
App Engine Services and APIs
Google Cloud Endpoints
Business Logic
APIs for Mobile and Web Backends Made Easy
(Experimental)
Storage
(Datastore, SQL, Drive, etc)
Web APIs
Endpoints
23 Marzo - {codemotion} Laboratorio Google (Alfredo Morresi) - Aula N12
Creare RESTful API Con Google Cloud Endpoints e App Engine #labgoogle
Development Stack
Google Compute Engine
Introducing Google Compute Engine
Adding Virtual Machines to the Google Cloud Platform
Compute
Launch Linux Virtual Machines
on demand
Network
Connect your VMs together to
form powerful clusters
Storage
Store on persistent disk, local
disk or Cloud Storage
Tooling
Control your VMs via REST API
or command line
Architecture
Projects
[Google APIs Console] Project
● Created with APIs Console
● Collection of Compute Engine
Resources
● Team Members
○ Owner, Editor or Viewer
● Billing Information
What's in a VM
Linux VMs
● Root access
● Debian-based Linux or
CentOS
● Many hardware configurations
○ 1, 2, 4, or 8 CPUs
○ Up to 52GB of RAM
API Basics
● JSON over HTTP
● Main Resources (Nouns):
○ Projects
○ Instances
○ Networks and Firewalls
○ Disks and Snapshots
○ Zones
● Actions (Verbs):
○ GET, POST (create) and DELETE
○ Custom ‘verbs’ for updates (PUT/POST)
○ Auth via OAuth2
Clients and Libraries
● gcutil: command line utility
● Web UI: Built on GAE
● Libraries
● Partners and ecosystem
Flexible Storage Options
Persistent Disk
Fast, consistent performance
Network Connected, Replicated
Snapshots for backup and restore
Shareable
Encrypted at Rest
Google Cloud Storage
Seamless Authentication
Secure Access
EU datacenter option
Ephemeral Disk
Used to boot VM
Lives and dies with VM
Encrypted at Rest
Right now:
● Limited preview
● Focused on compute intensive and batch
workloads
● SLA and support available to commercial
customers
● Apply: http://cloud.google.com
● Talk to us! We're happy to discuss your
use case
CC Image courtesy of London looks
i can haz Compute Engine?
Storing Data
Storage Systems at Google
Structured Data: NoSQL + SQL
Schemaless
Queries, Atomic Transactions
Best for Internet Scale,
denormalizable DataSets
Think Differently ... No Joins
Familiar MySQL
Fully Managed
Best for Bounded Scale, highly
structured DataSets
Experimental
Unstructured: Google Cloud Storage
Google BigQuery
Big Data at Google
72 hours
100 million gigabytes
425 million users
BigQuery gives you this power
Store data with reliability, redundancy and
consistency
Go from data to meaning
Quickly!
At scale ...
How are developers using it?
Game and social media analytics
Advertising campaign optimization
Sensor data analysis
Infrastructure monitoring
Regular expressions on 15.7 billion rows...
Google Cloud
Storage
Upload your Data
BigQuery
Google Spreadsheets via Apps Script
Google Spreadsheets via Apps Script
● Java
● Python
● .NET
● PHP
● JavaScript
● Apps Script
● ... more ...
Libraries
It's a RESTful API
Wrap Up
Questions?
cloud.google.com
Thank you!
http://developers.google.com/cloud

A fresh look at Google’s Cloud by Mandy Waite

  • 1.
    Mandy Waite A FreshLook at Google's Cloud mandywaite@google.com (@tekgrrl)
  • 2.
    Building Apps andServices in the Cloud
  • 3.
    Google App Engine Google BigQuery Scalableapplication development and execution environment NoSQL Datastore Auto-scaling Frontends Long-lived Backends Task Queues Google Compute Engine Virtual machines Run arbitrary workloads at scale (e.g. Hadoop, scientific computing) Google Cloud Platform Google Cloud Storage Google Cloud SQL Interactive analysis of massive datasets at speed Performant and scalable service for storing and accessing data MySQL-based, fully managed service
  • 4.
  • 5.
    Easy to build Easyto scale Easy to maintain Opinionated framework and deployment platform
  • 6.
    Get up andrunning quickly - NO Servers SDK Python, Java, Go runtimes Local development server, Eclipse Google Infrastructure Auto-scales Admin Console Easy management Logs
  • 7.
    Python Runtime JavaRuntime Task Queues High Replication Datastore Google Storage Announce BigQuery Announce Backends, Pull Queues Out of Preview SLA Support Google Storage GA Cloud SQL Announce 2012 Cloud SQL GA BigQuery GA And growing: by the numbers Google App Engine passed 7.5B+ daily hits
  • 8.
    1,000,000 active applications 2Trillion datastore operations half of active world IP addresses touch GAE A month in the life of Google App Engine:
  • 9.
    App Engine Updatesand Pricing Java 7 Support: InvokeDynamic, try-with-resources, Flexible type creation (diamond operator) New features and updates: Cloud Endpoints (experimental), larger memory options for instances, task queue async methods, new multithreaded Python Dev Server, Python 2.5 deprecation, Django 1.4.2 Flexible pricing: free to get started, SLA from $9/mo Range of support packages: https://cloud.google.com/support/packages
  • 10.
    Application Hosting inEU Data replicated within EU Google App Engine European Data Centers Compliance and Locality
  • 11.
    “ With GoogleApp Engine, we don't need a system administrator or anyone dedicated to deploying our app, so 99% of our time is working on our application.. ” Ben Kamens, Lead Engineer Khan Academy
  • 13.
    Frontends Backends Task Queues Cron Compute Network URLFetch XMPP Channel API Mail API Storage Datastore Memcache Namespaces Blobstore Cloud SQL Static content Services Images API App Identity Users API MapReduce API Pipeline API Prospective Search API App Engine Services and APIs
  • 14.
    Google Cloud Endpoints BusinessLogic APIs for Mobile and Web Backends Made Easy (Experimental) Storage (Datastore, SQL, Drive, etc) Web APIs Endpoints 23 Marzo - {codemotion} Laboratorio Google (Alfredo Morresi) - Aula N12 Creare RESTful API Con Google Cloud Endpoints e App Engine #labgoogle
  • 15.
  • 16.
  • 17.
    Introducing Google ComputeEngine Adding Virtual Machines to the Google Cloud Platform Compute Launch Linux Virtual Machines on demand Network Connect your VMs together to form powerful clusters Storage Store on persistent disk, local disk or Cloud Storage Tooling Control your VMs via REST API or command line
  • 18.
  • 19.
    Projects [Google APIs Console]Project ● Created with APIs Console ● Collection of Compute Engine Resources ● Team Members ○ Owner, Editor or Viewer ● Billing Information
  • 20.
    What's in aVM Linux VMs ● Root access ● Debian-based Linux or CentOS ● Many hardware configurations ○ 1, 2, 4, or 8 CPUs ○ Up to 52GB of RAM
  • 21.
    API Basics ● JSONover HTTP ● Main Resources (Nouns): ○ Projects ○ Instances ○ Networks and Firewalls ○ Disks and Snapshots ○ Zones ● Actions (Verbs): ○ GET, POST (create) and DELETE ○ Custom ‘verbs’ for updates (PUT/POST) ○ Auth via OAuth2
  • 22.
    Clients and Libraries ●gcutil: command line utility ● Web UI: Built on GAE ● Libraries ● Partners and ecosystem
  • 23.
    Flexible Storage Options PersistentDisk Fast, consistent performance Network Connected, Replicated Snapshots for backup and restore Shareable Encrypted at Rest Google Cloud Storage Seamless Authentication Secure Access EU datacenter option Ephemeral Disk Used to boot VM Lives and dies with VM Encrypted at Rest
  • 24.
    Right now: ● Limitedpreview ● Focused on compute intensive and batch workloads ● SLA and support available to commercial customers ● Apply: http://cloud.google.com ● Talk to us! We're happy to discuss your use case CC Image courtesy of London looks i can haz Compute Engine?
  • 25.
  • 26.
  • 27.
    Structured Data: NoSQL+ SQL Schemaless Queries, Atomic Transactions Best for Internet Scale, denormalizable DataSets Think Differently ... No Joins Familiar MySQL Fully Managed Best for Bounded Scale, highly structured DataSets Experimental
  • 28.
  • 29.
  • 30.
    Big Data atGoogle 72 hours 100 million gigabytes 425 million users
  • 31.
    BigQuery gives youthis power Store data with reliability, redundancy and consistency Go from data to meaning Quickly! At scale ...
  • 32.
    How are developersusing it? Game and social media analytics Advertising campaign optimization Sensor data analysis Infrastructure monitoring
  • 33.
    Regular expressions on15.7 billion rows...
  • 34.
  • 35.
  • 36.
  • 37.
    ● Java ● Python ●.NET ● PHP ● JavaScript ● Apps Script ● ... more ... Libraries
  • 38.
  • 39.
  • 40.
  • 41.