Tel Aviv - Oct 2013
Google Cloud Platform
Google Cloud Overview
+GreenIdo
Developer Advocate, Google
App Engine
Who?
Ido Green
Developer Advocate, Google
plus.google.com/+greenido
● ido-green.appspot.com
● greenido.wordpress.com
● git...
Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates
About Scale
● Google's search index
○ (2012)
● YouTube
○ (2013)
● YouTube... monthly uniques?
○ (2013)
Innovation
Scaling & Innovation
Image courtesy Google/Connie
Zhou
Image courtesy Google
Maps
*AND* security
Cloud industry service levels
PaaS
SaaS
Google Apps Salesforce, SugarCRM, NetSuite
Yahoo!Mail YOUR NEXT APP?
Google Apps S...
Google Cloud Platform service levels
PaaS
SaaS
Google Apps Salesforce, SugarCRM, NetSuite
Yahoo!Mail, Hotmail YOUR NEXT AP...
● Comprehensive, integrated platform
● Extension of Google internal infrastructure
○ Internal services created for us
SHAR...
Google Cloud Platform services
Google worldwide network
"This is what makes Google Google: its
physical network, its thousands of fiber
miles, and those many thousands of servers...
Google Cloud Platform services
Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates
➢ Hardware failure?
➢ Traffic spikes? Scaling?
➢ Patches & upgrades?
➢ Network issues?
➢ License management?
Building a tr...
Why does App Engine exist?
●Easy to build
●Easy to manage
●Easy to scale
● Enabling greater developer productivity!
● Focus on building your app, not...
Python, Java, Go, PHP not enough for you?
Specialized APIs/Services for the Sandbox
Cloud StorageImages
Mail Channel Task Queue
Memcache Datastore URL Fetch
User Se...
Hardware failure, traffic spikes,
scaling, software patches,
upgrades handled by Google...
and yes, we’ll operate it for y...
Administration Console
App Engine - By the Numbers*
● 300,000+ Active developers
● 3,000,000+ Active applications
● Half of world's Internet addr...
App Engine - Larger Numbers*
7,500,000,000+
Hits (per day)
4,500,000,000,000+
Datastore requests
* per month except as oth...
Some App Engine users
● 3.6MM DAUs on FB
● 1.9MM DAUs on MS
● Add Orkut, Bebo,
Hi5, Friendster,
Hyves, Ning…
Long-term scaling...
Short-term scaling...
Images courtesy Gigya
Official blog & live stream apps
hosted on App Engine
On Wedding day...
Blog app served:
● Up to 2k requests per second
● ...
App Engine! -> Cloud Endpoints!
Not all apps have web UI
App Engine as Mobile Backend
● Pulse’s mobile app
○ Android
○ iOS
○ Kindle
● Awards (2011)
○ Apple’s App Store Hall of Fam...
Gaming... share data, mobile or web!
Multimedia scaling...
Google Cloud Endpoints
● APIs for web and mobile backends made easy
● Watch the tutorial & get the code at
cloud.google.co...
Popular App Engine use cases
● Mobile/Tablet
○ App backends
○ Cloud persistence
● Social/Mobile Games
○ Speed, scale
○ API...
“Vendor lock-in”
● What is it?
○ Systems which inherently make
it very difficult or impossible to
migrate (data / logic) t...
● “Must use” Google APIs
○ Not necessarily
● Web app alternatives
○ Java: servlets, JSP
○ Python: Django, web2py,
Tipfy, B...
Pricing
Google
Prediction API
Google
Storage
Pricing
Tier
Monthly
Cost
99.95%
SLA
Paid
Support
Free $0
Paid pay-per-use *
...
● SAS 70, SSAE 16, ISAE 3402, ISO 27001:2005 Certified
● Choose from US- or EU-based service
Security Compliance & Localiz...
● Integration w/Compute Engine, BigQuery, Cloud Datastore
● Java Servlet 3.0 support + Blobstore migration tool
● VM Runti...
Getting Started
Google
Prediction API
Google
Storage
What Where
Product Info cloud.google.com/products
Docs, downloads, et...
Cloud Playground
●Try App Engine in your browser...
cloud-playground.appspot.com
Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates
Connect to Google Cloud Platform
BigQuery
Google Cloud Storage
Google App Engine
Compute
Engine
Cloud SQL
Prediction
???
C...
Google Compute Engine
● Need to go outside App Engine boundaries?
● On-demand VMs (RHEL/CentOS, Debian)
○ 1-8 virtual core...
Compute Engine performance
Source: Scalr/gigaom.com (May 2013)
Real-world Performance Observation
Google Cloud Platform
Google Cloud Storage
● Fast, scalable, highly-available object store (US or EU)
● Strong read-your-w...
Google Cloud Platform
Google Cloud Datastore
● NoSQL database at Google scale
● Low-level interface (access via HTTP/RPC)
...
Google Cloud Platform
Google BigQuery
● Large scale query and analysis cloud service
● Query multi-terabyte datasets in se...
Fusion Tables
● Think: Google Maps + Excel/Sheets on steroids
● Aggregate disparate data in spreadsheet & visualize
● goog...
Course Builder MOOC
Course Builder MOOC
● Open-source MOOC software
○ Easily customizable
○ code.google.com/p/course-builder
● Courses hosted ...
CloudCourse class registration
● App Engine app for course offerings & registration
● http://goo.gl/o8NRSk
Google Apps Script
● script.google.com
● JavaScript baby! outside the browser, in Google’s cloud.
● Browser based IDE
● De...
Apps Script example
Google APIs
● Android
● Chrome
● Google+
● Ads
● Maps
● Drive
● YouTube
● Commerce
● Google TV
● Ido Green - Developer Advocate, Google
○ +GreenIdo
○ @greenido
○ ido-green.appspot.com
● Google Cloud Platform
○ cloud.g...
Ahh! WAIT,
there’s one more
thing...
Cloud Platform Starter Pack
● Developers from affiliated partners can
receive up to $2,000USD of credit towards
cloud usag...
● Ido Green - Developer Advocate, Google
○ +GreenIdo
○ @greenido
○ ido-green.appspot.com
● Google Cloud Platform
○ cloud.g...
Upcoming SlideShare
Loading in...5
×

Google Cloud Platform Update

3,278

Published on

These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,278
On Slideshare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
102
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Google Cloud Platform Update

  1. 1. Tel Aviv - Oct 2013
  2. 2. Google Cloud Platform Google Cloud Overview +GreenIdo Developer Advocate, Google App Engine
  3. 3. Who? Ido Green Developer Advocate, Google plus.google.com/+greenido ● ido-green.appspot.com ● greenido.wordpress.com ● github.com/greenido/
  4. 4. Agenda ●Part I: Background & Motivation ●Part II: Google App Engine ●Part III: Cloud Platform Updates
  5. 5. About Scale ● Google's search index ○ (2012) ● YouTube ○ (2013) ● YouTube... monthly uniques? ○ (2013)
  6. 6. Innovation
  7. 7. Scaling & Innovation Image courtesy Google/Connie Zhou Image courtesy Google Maps *AND* security
  8. 8. Cloud industry service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS
  9. 9. Google Cloud Platform service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail, Hotmail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS
  10. 10. ● Comprehensive, integrated platform ● Extension of Google internal infrastructure ○ Internal services created for us SHARED with YOU ● Google makes improvements to their cloud ○ ...and who gets them first... What is the Google Cloud Platform?
  11. 11. Google Cloud Platform services
  12. 12. Google worldwide network
  13. 13. "This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds." -- S. Levy/Wired (Oct 2012) Our cloud runs our business
  14. 14. Google Cloud Platform services
  15. 15. Agenda ●Part I: Background & Motivation ●Part II: Google App Engine ●Part III: Cloud Platform Updates
  16. 16. ➢ Hardware failure? ➢ Traffic spikes? Scaling? ➢ Patches & upgrades? ➢ Network issues? ➢ License management? Building a traditional web application
  17. 17. Why does App Engine exist?
  18. 18. ●Easy to build ●Easy to manage ●Easy to scale ● Enabling greater developer productivity! ● Focus on building your app, not sys admin ● Let us wear the pagers! ● BUT don't confuse App Engine w/IaaS services! App Engine to the rescue!!
  19. 19. Python, Java, Go, PHP not enough for you?
  20. 20. Specialized APIs/Services for the Sandbox Cloud StorageImages Mail Channel Task Queue Memcache Datastore URL Fetch User Service
  21. 21. Hardware failure, traffic spikes, scaling, software patches, upgrades handled by Google... and yes, we’ll operate it for you! How does it work?
  22. 22. Administration Console
  23. 23. App Engine - By the Numbers* ● 300,000+ Active developers ● 3,000,000+ Active applications ● Half of world's Internet addresses touch an App Engine server (per week) * per month except as otherwise noted
  24. 24. App Engine - Larger Numbers* 7,500,000,000+ Hits (per day) 4,500,000,000,000+ Datastore requests * per month except as otherwise noted
  25. 25. Some App Engine users
  26. 26. ● 3.6MM DAUs on FB ● 1.9MM DAUs on MS ● Add Orkut, Bebo, Hi5, Friendster, Hyves, Ning… Long-term scaling...
  27. 27. Short-term scaling... Images courtesy Gigya
  28. 28. Official blog & live stream apps hosted on App Engine On Wedding day... Blog app served: ● Up to 2k requests per second ● 15 million pageviews ● 5.6 million visitors Live stream app served: ● Up to 32k requests per second ● 37.7 million pageviews ● 13.7 million visitors goo.gl/F1SGc “Royal” scaling
  29. 29. App Engine! -> Cloud Endpoints! Not all apps have web UI
  30. 30. App Engine as Mobile Backend ● Pulse’s mobile app ○ Android ○ iOS ○ Kindle ● Awards (2011) ○ Apple’s App Store Hall of Fame ○ Time Magazine’s Top 50 iOS apps ● 30MM+ users, 10MM+ stories read/day ● Thousands of QPS, 100M daily requests ● Use of App Engine cost-effective ● Get started building your mobile backend: ○ developers.google.com/cloud/samples/mbs
  31. 31. Gaming... share data, mobile or web!
  32. 32. Multimedia scaling...
  33. 33. Google Cloud Endpoints ● APIs for web and mobile backends made easy ● Watch the tutorial & get the code at cloud.google.com/mobilebackendtutorial
  34. 34. Popular App Engine use cases ● Mobile/Tablet ○ App backends ○ Cloud persistence ● Social/Mobile Games ○ Speed, scale ○ API integrations ○ Personals/dating ● Consumer Web Apps ○ Unpredictable traffic ○ Scale ● Apps in Academia ○ Any course where students build web or mobile apps ○ Research projects ○ IT/Operational apps ● Business Apps ○ Enterprise ○ Java runtime ○ Web or Mobile
  35. 35. “Vendor lock-in” ● What is it? ○ Systems which inherently make it very difficult or impossible to migrate (data / logic) to other systems ● Applies to App Engine? ○ Yes & no. ○ Can’t get something for nothing. ○ Goal: take advantage of Google's infrastructure ○ Price: need to write against Google APIs. Make sense? ● Not in Google’s DNA ○ Peter Magnusson post http://goo. gl/X2UyEz
  36. 36. ● “Must use” Google APIs ○ Not necessarily ● Web app alternatives ○ Java: servlets, JSP ○ Python: Django, web2py, Tipfy, Bottle, Pyramid ● Data Storage ○ Cloud SQL (MySQL) ○ Python: Django ORM* ○ Java: JPA/JDO ORMs ● SDKs: open source ● APIs ○ Java: JSR stds, Python: stdlib ● Datastore bulkloader ○ Easily up/download your data ● Open source backend systems ○ Python: AppScale; TyphoonAE ○ Java: CapeDwarf/JBoss - TCK ○ "Private cloud" Fighting lock-in
  37. 37. Pricing Google Prediction API Google Storage Pricing Tier Monthly Cost 99.95% SLA Paid Support Free $0 Paid pay-per-use * Premier $150USD+ * * ● cloud.google.com/pricing ● Please compare - “Apples to Apples”
  38. 38. ● SAS 70, SSAE 16, ISAE 3402, ISO 27001:2005 Certified ● Choose from US- or EU-based service Security Compliance & Localization
  39. 39. ● Integration w/Compute Engine, BigQuery, Cloud Datastore ● Java Servlet 3.0 support + Blobstore migration tool ● VM Runtime App Engine-managed backends via Compute Engine ● developers.google.com/appengine/features/#roadmap_features App Engine Roadmap
  40. 40. Getting Started Google Prediction API Google Storage What Where Product Info cloud.google.com/products Docs, downloads, etc. developers.google.com/appengine Create/manage your apps appengine.google.com Help from experts on anything technical, including App Engine stackoverflow.com Cloud Blog googlecloudplatform.blogspot.com Social google.com/+googlecloudplatform @GoogleCloud ● The docs are great, but what about teaching materials?
  41. 41. Cloud Playground ●Try App Engine in your browser... cloud-playground.appspot.com
  42. 42. Agenda ●Part I: Background & Motivation ●Part II: Google App Engine ●Part III: Cloud Platform Updates
  43. 43. Connect to Google Cloud Platform BigQuery Google Cloud Storage Google App Engine Compute Engine Cloud SQL Prediction ??? Cloud Datastore Translate
  44. 44. Google Compute Engine ● Need to go outside App Engine boundaries? ● On-demand VMs (RHEL/CentOS, Debian) ○ 1-8 virtual cores ○ 1.8-6.5GB RAM/core ○ Private VM network ● 3 storage types ○ Local/scratch: 420GB ○ Persistent disk: 10TB ○ Cloud Storage: unlimited ● 3 interfaces ○ Command-line interface ○ Web-based interface ○ Your code via REST API
  45. 45. Compute Engine performance Source: Scalr/gigaom.com (May 2013) Real-world Performance Observation
  46. 46. Google Cloud Platform Google Cloud Storage ● Fast, scalable, highly-available object store (US or EU) ● Strong read-your-write consistency ● Easy, flexible authentication & sharing (OAuth2, ACLs) ● REST API, App Engine API, Web UI, command-line ● developers.google.com/storage Google Cloud SQL ● MySQL-compatible relational cloud database ● App Engine API or externally via JDBC ● developers.google.com/cloud-sql
  47. 47. Google Cloud Platform Google Cloud Datastore ● NoSQL database at Google scale ● Low-level interface (access via HTTP/RPC) ● Familiar native datastore for App Engine ● developers.google.com/datastore Google Translate ● Translate text into other languages programmatically ● Build multilingual apps with Google translation algorithms ● Familiar RESTful interface ● developers.google.com/translate Cloud Datastore Translate
  48. 48. Google Cloud Platform Google BigQuery ● Large scale query and analysis cloud service ● Query multi-terabyte datasets in seconds ● SQL-like query language ● Based on Google's internal Dremel project ● cloud.google.com/bigquery-tour Google Prediction ● Machine Learning service in the cloud ● Supervised learning ● Train models, get "predictions" ● "Magic?" Possibly. ● developers.google.com/prediction Prediction
  49. 49. Fusion Tables ● Think: Google Maps + Excel/Sheets on steroids ● Aggregate disparate data in spreadsheet & visualize ● google.com/fusiontables
  50. 50. Course Builder MOOC
  51. 51. Course Builder MOOC ● Open-source MOOC software ○ Easily customizable ○ code.google.com/p/course-builder ● Courses hosted on Google App Engine ○ Run your own MOOCs: your code, your control ○ No need to rely on commercial vendor(s) ● More information ○ googleresearch.blogspot.com/2012/09/helping-world-to-teach.html ● Sample course ○ powersearchingwithgoogle.com
  52. 52. CloudCourse class registration ● App Engine app for course offerings & registration ● http://goo.gl/o8NRSk
  53. 53. Google Apps Script ● script.google.com ● JavaScript baby! outside the browser, in Google’s cloud. ● Browser based IDE ● Deeply integrated with Google Apps & services ○ Automate repetitive tasks ○ Manipulate data across multiple tools
  54. 54. Apps Script example
  55. 55. Google APIs ● Android ● Chrome ● Google+ ● Ads ● Maps ● Drive ● YouTube ● Commerce ● Google TV
  56. 56. ● Ido Green - Developer Advocate, Google ○ +GreenIdo ○ @greenido ○ ido-green.appspot.com ● Google Cloud Platform ○ cloud.google.com ○ plus.google.com/+googlecloudplatform Thank you! Q&A Time
  57. 57. Ahh! WAIT, there’s one more thing...
  58. 58. Cloud Platform Starter Pack ● Developers from affiliated partners can receive up to $2,000USD of credit towards cloud usage ○ Up to $1,000 for Google App Engine ○ Up to $1,000 for Google Compute Engine + others ● Apply at cloud.google.com/starterpack and use promo code: gdg-in
  59. 59. ● Ido Green - Developer Advocate, Google ○ +GreenIdo ○ @greenido ○ ido-green.appspot.com ● Google Cloud Platform ○ cloud.google.com ○ plus.google.com/+googlecloudplatform Thank you! Q&A Time
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×