Google Cloud Platform Update

1. Tel Aviv - Oct 2013

2. Google Cloud Platform Google Cloud Overview +GreenIdo Developer Advocate, Google App Engine

3. Who? Ido Green Developer Advocate, Google plus.google.com/+greenido ● ido-green.appspot.com ● greenido.wordpress.com ● github.com/greenido/

4. Agenda ●Part I: Background & Motivation ●Part II: Google App Engine ●Part III: Cloud Platform Updates

5. About Scale ● Google's search index ○ (2012) ● YouTube ○ (2013) ● YouTube... monthly uniques? ○ (2013)

6. Innovation

7. Scaling & Innovation Image courtesy Google/Connie Zhou Image courtesy Google Maps *AND* security

8. Cloud industry service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS

9. Google Cloud Platform service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail, Hotmail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS

10. ● Comprehensive, integrated platform ● Extension of Google internal infrastructure ○ Internal services created for us SHARED with YOU ● Google makes improvements to their cloud ○ ...and who gets them first... What is the Google Cloud Platform?

11. Google Cloud Platform services

12. Google worldwide network

13. "This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds." -- S. Levy/Wired (Oct 2012) Our cloud runs our business

14. Google Cloud Platform services

16. ➢ Hardware failure? ➢ Traffic spikes? Scaling? ➢ Patches & upgrades? ➢ Network issues? ➢ License management? Building a traditional web application

17. Why does App Engine exist?

18. ●Easy to build ●Easy to manage ●Easy to scale ● Enabling greater developer productivity! ● Focus on building your app, not sys admin ● Let us wear the pagers! ● BUT don't confuse App Engine w/IaaS services! App Engine to the rescue!!

19. Python, Java, Go, PHP not enough for you?

20. Specialized APIs/Services for the Sandbox Cloud StorageImages Mail Channel Task Queue Memcache Datastore URL Fetch User Service

21. Hardware failure, traffic spikes, scaling, software patches, upgrades handled by Google... and yes, we’ll operate it for you! How does it work?

22. Administration Console

23. App Engine - By the Numbers* ● 300,000+ Active developers ● 3,000,000+ Active applications ● Half of world's Internet addresses touch an App Engine server (per week) * per month except as otherwise noted

24. App Engine - Larger Numbers* 7,500,000,000+ Hits (per day) 4,500,000,000,000+ Datastore requests * per month except as otherwise noted

25. Some App Engine users

26. ● 3.6MM DAUs on FB ● 1.9MM DAUs on MS ● Add Orkut, Bebo, Hi5, Friendster, Hyves, Ning… Long-term scaling...

27. Short-term scaling... Images courtesy Gigya

28. Official blog & live stream apps hosted on App Engine On Wedding day... Blog app served: ● Up to 2k requests per second ● 15 million pageviews ● 5.6 million visitors Live stream app served: ● Up to 32k requests per second ● 37.7 million pageviews ● 13.7 million visitors goo.gl/F1SGc “Royal” scaling

29. App Engine! -> Cloud Endpoints! Not all apps have web UI

30. App Engine as Mobile Backend ● Pulse’s mobile app ○ Android ○ iOS ○ Kindle ● Awards (2011) ○ Apple’s App Store Hall of Fame ○ Time Magazine’s Top 50 iOS apps ● 30MM+ users, 10MM+ stories read/day ● Thousands of QPS, 100M daily requests ● Use of App Engine cost-effective ● Get started building your mobile backend: ○ developers.google.com/cloud/samples/mbs

31. Gaming... share data, mobile or web!

32. Multimedia scaling...

33. Google Cloud Endpoints ● APIs for web and mobile backends made easy ● Watch the tutorial & get the code at cloud.google.com/mobilebackendtutorial

34. Popular App Engine use cases ● Mobile/Tablet ○ App backends ○ Cloud persistence ● Social/Mobile Games ○ Speed, scale ○ API integrations ○ Personals/dating ● Consumer Web Apps ○ Unpredictable traffic ○ Scale ● Apps in Academia ○ Any course where students build web or mobile apps ○ Research projects ○ IT/Operational apps ● Business Apps ○ Enterprise ○ Java runtime ○ Web or Mobile

35. “Vendor lock-in” ● What is it? ○ Systems which inherently make it very difficult or impossible to migrate (data / logic) to other systems ● Applies to App Engine? ○ Yes & no. ○ Can’t get something for nothing. ○ Goal: take advantage of Google's infrastructure ○ Price: need to write against Google APIs. Make sense? ● Not in Google’s DNA ○ Peter Magnusson post http://goo. gl/X2UyEz

36. ● “Must use” Google APIs ○ Not necessarily ● Web app alternatives ○ Java: servlets, JSP ○ Python: Django, web2py, Tipfy, Bottle, Pyramid ● Data Storage ○ Cloud SQL (MySQL) ○ Python: Django ORM* ○ Java: JPA/JDO ORMs ● SDKs: open source ● APIs ○ Java: JSR stds, Python: stdlib ● Datastore bulkloader ○ Easily up/download your data ● Open source backend systems ○ Python: AppScale; TyphoonAE ○ Java: CapeDwarf/JBoss - TCK ○ "Private cloud" Fighting lock-in

37. Pricing Google Prediction API Google Storage Pricing Tier Monthly Cost 99.95% SLA Paid Support Free $0 Paid pay-per-use * Premier $150USD+ * * ● cloud.google.com/pricing ● Please compare - “Apples to Apples”

38. ● SAS 70, SSAE 16, ISAE 3402, ISO 27001:2005 Certified ● Choose from US- or EU-based service Security Compliance & Localization

39. ● Integration w/Compute Engine, BigQuery, Cloud Datastore ● Java Servlet 3.0 support + Blobstore migration tool ● VM Runtime App Engine-managed backends via Compute Engine ● developers.google.com/appengine/features/#roadmap_features App Engine Roadmap

40. Getting Started Google Prediction API Google Storage What Where Product Info cloud.google.com/products Docs, downloads, etc. developers.google.com/appengine Create/manage your apps appengine.google.com Help from experts on anything technical, including App Engine stackoverflow.com Cloud Blog googlecloudplatform.blogspot.com Social google.com/+googlecloudplatform @GoogleCloud ● The docs are great, but what about teaching materials?

41. Cloud Playground ●Try App Engine in your browser... cloud-playground.appspot.com

43. Connect to Google Cloud Platform BigQuery Google Cloud Storage Google App Engine Compute Engine Cloud SQL Prediction ??? Cloud Datastore Translate

44. Google Compute Engine ● Need to go outside App Engine boundaries? ● On-demand VMs (RHEL/CentOS, Debian) ○ 1-8 virtual cores ○ 1.8-6.5GB RAM/core ○ Private VM network ● 3 storage types ○ Local/scratch: 420GB ○ Persistent disk: 10TB ○ Cloud Storage: unlimited ● 3 interfaces ○ Command-line interface ○ Web-based interface ○ Your code via REST API

45. Compute Engine performance Source: Scalr/gigaom.com (May 2013) Real-world Performance Observation

46. Google Cloud Platform Google Cloud Storage ● Fast, scalable, highly-available object store (US or EU) ● Strong read-your-write consistency ● Easy, flexible authentication & sharing (OAuth2, ACLs) ● REST API, App Engine API, Web UI, command-line ● developers.google.com/storage Google Cloud SQL ● MySQL-compatible relational cloud database ● App Engine API or externally via JDBC ● developers.google.com/cloud-sql

47. Google Cloud Platform Google Cloud Datastore ● NoSQL database at Google scale ● Low-level interface (access via HTTP/RPC) ● Familiar native datastore for App Engine ● developers.google.com/datastore Google Translate ● Translate text into other languages programmatically ● Build multilingual apps with Google translation algorithms ● Familiar RESTful interface ● developers.google.com/translate Cloud Datastore Translate

48. Google Cloud Platform Google BigQuery ● Large scale query and analysis cloud service ● Query multi-terabyte datasets in seconds ● SQL-like query language ● Based on Google's internal Dremel project ● cloud.google.com/bigquery-tour Google Prediction ● Machine Learning service in the cloud ● Supervised learning ● Train models, get "predictions" ● "Magic?" Possibly. ● developers.google.com/prediction Prediction

49. Fusion Tables ● Think: Google Maps + Excel/Sheets on steroids ● Aggregate disparate data in spreadsheet & visualize ● google.com/fusiontables

50. Course Builder MOOC

51. Course Builder MOOC ● Open-source MOOC software ○ Easily customizable ○ code.google.com/p/course-builder ● Courses hosted on Google App Engine ○ Run your own MOOCs: your code, your control ○ No need to rely on commercial vendor(s) ● More information ○ googleresearch.blogspot.com/2012/09/helping-world-to-teach.html ● Sample course ○ powersearchingwithgoogle.com

52. CloudCourse class registration ● App Engine app for course offerings & registration ● http://goo.gl/o8NRSk

53. Google Apps Script ● script.google.com ● JavaScript baby! outside the browser, in Google’s cloud. ● Browser based IDE ● Deeply integrated with Google Apps & services ○ Automate repetitive tasks ○ Manipulate data across multiple tools

54. Apps Script example

55. Google APIs ● Android ● Chrome ● Google+ ● Ads ● Maps ● Drive ● YouTube ● Commerce ● Google TV

56. ● Ido Green - Developer Advocate, Google ○ +GreenIdo ○ @greenido ○ ido-green.appspot.com ● Google Cloud Platform ○ cloud.google.com ○ plus.google.com/+googlecloudplatform Thank you! Q&A Time

57. Ahh! WAIT, there’s one more thing...

58. Cloud Platform Starter Pack ● Developers from affiliated partners can receive up to $2,000USD of credit towards cloud usage ○ Up to $1,000 for Google App Engine ○ Up to $1,000 for Google Compute Engine + others ● Apply at cloud.google.com/starterpack and use promo code: gdg-in

59. ● Ido Green - Developer Advocate, Google ○ +GreenIdo ○ @greenido ○ ido-green.appspot.com ● Google Cloud Platform ○ cloud.google.com ○ plus.google.com/+googlecloudplatform Thank you! Q&A Time