Overview of Google app engine & other services final

1,244 views

Published on

Overview of Google app engine & other services final

Published in: Technology, Business

Overview of Google app engine & other services final

  1. 1. year.mm.dd Meeting Name @ Where
  2. 2. Give us feedback! Fill out this survey! http://goo.gl/6l80dR
  3. 3. CLOUD Google App Engine & Cloud Overview +YOUR NAME TITLE or TEAM COMPANY
  4. 4. GOOGLE CLOUD PLATFORM Google App Engine & Cloud Overview +YOUR NAME TITLE or TEAM COMPANY Translate Prediction Cloud Datastore App Engine
  5. 5. About the Speaker ● Your name, title, affiliation ● Your developer background ● etc. ● Please no advertising here
  6. 6. About You ●Background of your audience, i.e., ○Web/mobile/social/gaming developer/TL, Entrepreneur, QA/test, PM, teacher, manager,... ○Know Java, Python, etc. ●Curious about and/or new to Google tools ●Want to know more about cloud computing
  7. 7. Agenda ●Part I: Background/Motivation ●Part II: All about Google App Engine ●Part III: More Cloud & More ●Part IV: (optional) Hands-on Workshop
  8. 8. About Scale ● Approximate size of Google's search index? ○ (2012) ● How much video uploaded to YouTube every minute (in hours)? ○ (2013) ● Speaking of YouTube... monthly uniques? ○ (2013) ● How many (HTTP) "hits" does App Engine get across all apps every day? ○ Stay tuned... ● Google ever down? 500s?
  9. 9. About innovation
  10. 10. Out-of-this-world scaling & innovation Image courtesy Google/Connie Zhou Image courtesy Google Maps … and security
  11. 11. Cloud industry service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail, Hotmail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS
  12. 12. Google Cloud Platform service levels PaaS SaaS Google Apps Salesforce, SugarCRM, NetSuite Yahoo!Mail, Hotmail YOUR NEXT APP? Google Apps Script force.com Google App Engine Cloud Foundry, OpenShift Windows Azure, Heroku DotCloud, Engine Yard Google BigQuery, Cloud SQL, Cloud Datastore, Translate, Prediction Amazon RDS, DynamoDB; Microsoft SQL (Azure) Database Amazon EC2, S3 Rackspace, Joyent Google Compute Engine, Cloud Storage GoGrid, CloudLayerIaaS
  13. 13. ● Comprehensive, integrated platform ○ Compute, storage, application services ○ Platform & Infrastructure levels of cloud service ● Extension of Google internal infrastructure ○ Internal services created for us SHARED with YOU ○ Access Google services & tools beyond platform ■ Google Apps, Course Builder, Apps Script, etc. ● Google makes improvements to their cloud ○ Users reap these benefits/upgrades ○ Sometimes without any effort at all What is the Google Cloud Platform?
  14. 14. Google Cloud Platform services
  15. 15. Google worldwide network
  16. 16. ● Use what Google uses… ○ Build your software and ○ Run your business in same place... ○ Where Google runs theirs ○ With same scale, performance, security, value… ○ They built for themselves ● Take advantage of Google’s R&D ○ Scalability most difficult & most expensive thing you need to build… why do it?!? "This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds." -- S. Levy/Wired (Oct 2012) Our cloud runs our business
  17. 17. Google Cloud Platform services
  18. 18. Agenda ●Part I: Background/Motivation ●Part II: All about Google App Engine ●Part III: More Cloud & More ●Part IV: (optional) Hands-on Workshop
  19. 19. Hardware failure? Traffic spikes? Scaling? Patches & upgrades? Network issues? License management? Building a traditional web application
  20. 20. Why does App Engine exist?
  21. 21. ●Easy to build ●Easy to manage ●Easy to scale ● Enabling greater developer productivity! ● Focus on building your app, not sys admin ● Let us wear the pagers! ● BUT don't confuse App Engine w/IaaS services! Build and run your web apps on Google’s infrastructure App Engine to the rescue!!
  22. 22. Python, Java, Go, PHP not enough for you?
  23. 23. Specialized APIs/Services for the Sandbox Cloud StorageImages Mail Channel Task Queue Memcache Datastore URL Fetch User Service
  24. 24. Hardware failure, traffic spikes, scaling, software patches, upgrades handled by Google... and yes, we’ll operate it for you! How does it work?
  25. 25. Administration Console
  26. 26. App Engine - By the Numbers* ● 300,000+ Active developers ● 3,000,000+ Active applications ● Half of world's Internet addresses touch an App Engine server (per week) * per month except as otherwise noted
  27. 27. App Engine - Larger Numbers* 7,500,000,000+ Hits (per day) 4,500,000,000,000+ Datastore requests * per month except as otherwise noted
  28. 28. Some App Engine users
  29. 29. ● 3.6MM DAUs on FB ● 1.9MM DAUs on MS ● Add Orkut, Bebo, Hi5, Friendster, Hyves, Ning… Long-term scaling...
  30. 30. Short-term scaling... Images courtesy Gigya
  31. 31. Official blog & live stream apps hosted on App Engine On Wedding day... Blog app served: ● Up to 2k requests per second ● 15 million pageviews ● 5.6 million visitors Live stream app served: ● Up to 32k requests per second ● 37.7 million pageviews ● 13.7 million visitors goo.gl/F1SGc “Royal” scaling
  32. 32. ● Need backend server processing? Want to build your own? ● Go cloud with App Engine! ● No UI needed for app to talk to App Engine, just need HTTP ● Great place for user info e.g., high scores, contacts, levels/badges, etc. ● Better UI: move user data off phone & make universally available Not all apps have web UI
  33. 33. App Engine as Mobile Backend ● Pulse’s mobile app ○ Android ○ iOS ○ Kindle ● Awards (2011) ○ Apple’s App Store Hall of Fame ○ Time Magazine’s Top 50 iOS apps ● 30MM+ users, 10MM+ stories read/day ● Thousands of QPS, 100M daily requests ● Use of App Engine cost-effective ● Get started building your mobile backend: ○ developers.google.com/cloud/samples/mbs
  34. 34. Gaming... share data, mobile or web!
  35. 35. Multimedia scaling...
  36. 36. Google Cloud Endpoints ● APIs for web and mobile backends made easy ● Watch the tutorial & get the code at cloud.google.com/mobilebackendtutorial
  37. 37. Popular App Engine use cases ● Mobile/Tablet ○ App backends ○ Cloud persistence ● Social/Mobile Games ○ Speed, scale ○ API integrations ○ Personals/dating ● Consumer Web Apps ○ Unpredictable traffic ○ Scale ● Apps in Academia ○ Any course where students build web or mobile apps ○ Research projects ○ IT/Operational apps ● Business Apps ○ Enterprise ○ Java runtime ○ Web or Mobile
  38. 38. “Vendor lock-in” ● What is it? ○ Systems which inherently make it very difficult or impossible to migrate (data and/or logic) to other similar/competitive systems ● Applies to App Engine? ○ Yes & no. ○ Can’t get something for nothing. ○ Goal: take advantage of Google's infrastructure ○ Price: need to write against Google APIs. Make sense? ● Not in Google’s DNA ○ http://goo.gl/X2UyEz
  39. 39. ● “Must use” Google APIs ○ Not necessarily ● Web app alternatives ○ Java: servlets, JSP ○ Python: Django, web2py, Tipfy, Bottle, Pyramid ● Data Storage ○ Cloud SQL (MySQL) ○ Python: Django ORM* ○ Java: JPA/JDO ORMs ● SDKs: open source ● APIs ○ Java: JSR stds, Python: stdlib ● Datastore bulkloader ○ Easily up- or download your data ● Open source backend systems ○ Python: AppScale; TyphoonAE ○ Java: CapeDwarf/JBoss - TCK ○ "Private cloud" Fighting lock-in
  40. 40. Pricing Google Prediction API Google Storage Pricing Tier Monthly Cost 99.95% SLA Paid Support Free $0 Paid pay-per-use * Premier $150USD+ * * ● More at cloud.google.com/pricing ● Extra fee/month for special services, i.e., domain SSL
  41. 41. ● SAS 70, SSAE 16, ISAE 3402, ISO 27001:2005 Certified ● Choose from US- or EU-based service Security Compliance & Localization
  42. 42. ● Java Servlet 3.0 support ● Blobstore migration tool ● VM Runtime App Engine-managed backends (via Compute Engine) ● Integration w/Compute Engine, BigQuery, Cloud Datastore ● developers.google.com/appengine/features/#roadmap_features App Engine Roadmap
  43. 43. Getting Started Google Prediction API Google Storage What Where Product Info cloud.google.com/products Docs, downloads, etc. developers.google.com/appengine Create/manage your apps appengine.google.com Help from experts on anything technical, including App Engine stackoverflow.com Cloud Blog googlecloudplatform.blogspot.com Social google.com/+googlecloudplatform @GoogleCloud ● The docs are great, but what about teaching materials?
  44. 44. Open-licensed courseware ●Want to teach App Engine in your course? ●Think you create teaching materials from scratch? ●Think again. developers.google.com/academy
  45. 45. Cloud Playground ●Try App Engine without any downloads! cloud-playground.appspot.com
  46. 46. Agenda ●Part I: Background/Motivation ●Part II: All about Google App Engine ●Part III: More Cloud & More ●Part IV: (optional) Hands-on Workshop
  47. 47. Connect to Google Cloud & other services BigQuery Google Cloud Storage Google App Engine Compute Engine Cloud SQL Prediction ??? Cloud Datastore Translate
  48. 48. Google Compute Engine ● Need to go outside App Engine boundaries? ● On-demand VMs (RHEL, CentOS, Debian, SUSE; FreeBSD) ○ Up to 16 virtual cores & 6.5GB RAM/core ○ Live migration ○ Automatic restart ○ Private VM network ● 3 storage types ○ Local/scratch: 420GB ○ Persistent disk: 10TB ○ Cloud Storage: unlimited ● 3 interfaces ○ Command-line interface ○ Web-based interface ○ Your code via REST API
  49. 49. Compute Engine performance Source: Scalr/gigaom.com (May 2013) Real-world Performance Observation
  50. 50. Google Cloud Platform Google Cloud Storage ● Fast, scalable, highly-available object store (US or EU) ● Strong read-your-write consistency ● Easy, flexible authentication & sharing (OAuth2, ACLs) ● REST API, App Engine API, Web UI, command-line ● developers.google.com/storage Google Cloud SQL ● MySQL-compatible relational cloud database ● App Engine API or externally via JDBC ● developers.google.com/cloud-sql
  51. 51. Google Cloud Platform Google Cloud Datastore ● NoSQL database at Google scale ● Low-level interface (access via HTTP/RPC) ● Familiar native datastore for App Engine ● developers.google.com/datastore Google Translate ● Translate text into other languages programmatically ● Build multilingual apps with Google translation algorithms ● Familiar RESTful interface ● developers.google.com/translate Cloud Datastore Translate
  52. 52. Google Cloud Platform Google BigQuery ● Large scale query and analysis cloud service ● Query multi-terabyte datasets in seconds ● SQL-like query language ● Based on Google's internal Dremel project ● Take a tour at cloud.google.com/bigquery-tour Google Prediction ● Machine Learning service in the cloud ● Supervised learning ● Train models, get "predictions" ● "Magic?" Possibly. ● developers.google.com/prediction Prediction
  53. 53. Fusion Tables ● Think: Google Maps + Excel/Sheets on steroids ● Aggregate disparate data in spreadsheet & visualize ● google.com/fusiontables
  54. 54. Course Builder MOOC
  55. 55. Course Builder MOOC ● Open-source MOOC software ○ Easily customizable ○ code.google.com/p/course-builder ● Courses hosted on Google App Engine ○ Run your own MOOCs: your code, your control ○ No need to rely on commercial vendor(s) ● More information ○ googleresearch.blogspot.com/2012/09/helping-world-to-teach.html ● Sample course ○ powersearchingwithgoogle.com
  56. 56. CloudCourse class registration ● App Engine app for course offerings & registration ● http://goo.gl/o8NRSk
  57. 57. Google Apps Script ● script.google.com ● developers.google.com/apps-script ● JavaScript (outside the browser, in Google’s cloud) ● Browser based IDE (code completion, syntax highlight) ● Deeply integrated with Google Apps & services ○ Automate repetitive tasks ○ Manipulate data across multiple tools ● How does it work? ○ Simple 4-line code example ○ Touches 3 Google products in useful way
  58. 58. Apps Script example
  59. 59. Google APIs ● Android ○ developer.android.com ● Chrome (Chrome extensions, HTML5, Dart, ChromeOS, ChromeBooks) ○ html5rocks.com ● Google+ ○ developers.google.com/+ ● Ads (AdSense, AdWords, AdMob) ○ google.com/ads ● Maps, Earth, KML ○ developers.google.com/maps ● Drive ○ developers.google.com/drive ● YouTube ○ developers.google.com/youtube ● Commerce (Wallet, Checkout, Shopping) ○ developers.google.com/commerce ● Google TV ○ developers.google.com/tv ● Go ○ golang.org
  60. 60. Google Developers Blog googledevelopers.blogspot.com
  61. 61. +Your Name your_email@your_company.com your_title, company @your_twitter your_URL Google Cloud Platform cloud.google.com googlecloudplatform.blogspot.com @googlecloud google.com/+googlecloudplatform Thank you! Q&A
  62. 62. Give us feedback! Fill out this survey! http://goo.gl/6l80dR

×