Google App Engine Overview and Update

Christian Schalk Google Developer Advocate with Wesley ChunGoogle App Engine Overview and UpdateDevFest 2011Singapore/Jakarta

Agenda● Part I: What is App Engine?● Part II: App Engine Product Update ○ Growth and Adoption ○ App Engine successes & use cases ○ App Engine Leaving Preview (BIG DEAL)● Part III: App Engine Recent Features ○ Go, HRD, Backends, Pull Queues, etc.

Why does App Engine exist?

What is App Engine? Build and run your web apps on Google’s infrastructure ● Easy to build ● Easy to maintain ● Easy to scale Focus on building your app, let us wear the pagers!

App Engine Usages ● Mobile/Tablet ● Consumer Web Apps ○ App backends ○ Unpredictable traffic ○ Cloud persistence ○ Scale ● Social/Mobile Games ● Business Web Apps ○ Speed, scale ○ Enterprise ○ API integrations ○ Java runtime

Cloud Development in a Box● Development SDK● Local development tools ○ DevServer ○ Eclipse plugin● Specialized API services● Cloud-based dashboard● Automatic scaling ○ Built-in fault tolerance ○ Automated load balancing● Continuously evolving...

Language Runtime Options GO Java Experimental

Specialized API access to Google Infrastructure

Development Tools for App EngineCloud Application Dashboar dLocal Development Console Google Plugin for Eclipse GoogleAppEngineLauncher (Java) (Python)

App Engine Dashboard

Google Plugin for Eclipse

Demo: Getting started with App Engine Building, testing and deploying a new cloud app in 2 minutes!

App Engine Evolution Through The Years 2008 2009 2010 2011 App Engine Batch write/read Java Task Queues Blobstore Multitenancy Hi-Replication Launch Https DB Import XMPP Appstats Instance Console Datastore Python Status- cron incoming email cursors Always On Channel API Datastore Dashboard Mapper hi-perf imag Files API Memcache 10 min tasks Remote API logs export Prosp Search

App Engine - By the Numbers 100,000+ Active developers per month 300,000+ Active apps per week

App Engine - A Larger Number2,000,000,000+Page views perday

Notable App Engine Customers

Royal Wedding - Scalability Success Official blog & live stream apps hosted on App Engine On Wedding day... Blog app served: ● Up to 2k requests per second ● 15 million pageviews ● 5.6 million visitors Live stream app served: ● Up to 32k requests per second ● 37.7 million pageviews ● 13.7 million visitors http://goo.gl/F1SGc

WebFilings - Enterprise Sucess Enterprise customers: ● Procter & Gamble ● Delta Airlines ● Valero Energy ● Sprint/Nextel ● eBay ● United Airlines ● Dish Network ● ...

Gaming Success on App Engine

What about security? App Engine SAS 70/SSAE 16/ISAE 3402 Certified

App Engine Has Left Preview! ● App Engine is now production! ○ Long-term commitment by Google to App Engine ○ Long-term commitment by App Engine to our users ○ Full Google Product - 3 year deprecation support ● 3 service classes ○ Free ■ Small Apps, Experiments ○ Paid - $9/app/month + usage ■ SLA 99.95% ○ Premium - $500/month + usage ■ Operational Support, SLA, Unlimited Apps www.google.com/enterprise/cloud/appengine/pricing.html

Production Pricing Update● Instance-based charging ○ CPU-hours is replaced by Instance Hours (IH) ■ 1 instance running for 1 hour ○ Similar to instances & tuning in admin console today● APIs ○ No longer charged per CPU-hour ○ Charged per operation● Tuning your app optimization article ○ code.google.com/appengine/articles/managing-resources.html

Go language runtime ● Released SDK for Mac & Linux ○ Windows port in the works ● Uses tweaked Python SDK tools for App Engine ● Announced at Google I/O (May 2011) ● Launched in App Engine (Jul 2011)

High Replication Datastore ● High Replication Datastore (HRD) introduced early 2011 ○ Replacing Master/Slave (M/S) original App Engine datastore as default ○ Uses Paxos algorithm for higher availability ○ Data written to multiple data centers ■ Slightly slower writes, but reads at pace w/ M/S ● Data stored is eventually-consistent ● Delivered ~99.999% uptime since launch!

HRD Now the Default● Very well-received thus far ○ googleappengine.blogspot.com/2011/03/high-replication- datastore-solid-choice.html● Self migration tools now available!

Backends Frontend Configured Backends For transient, "front facing", Web requests... For long/permanent running "backend" jobs

Backends● Long-running servers... no more deadlines... at all!● Fully configurable instances with options: ○ RAM: 128MB to 1GB ○ CPU: 600MHz to 4.8GHz no request deadlines● Can run indefinitely ○ Resident or Dynamic - Public or Private ○ Automatic restarts● Used in conjunction with front-facing Web apps● Easy to configure (backends.yaml, backends.xml)

Pull Queues● Alternative to original "Task Queues" now called "Push Queues"● Whats the difference? ○ Lets you decide when to execute tasks!● Push Queue Details ○ Producers can enqueue tasks ○ Consumer can pull (lease) tasks from queue ○ App Engine app can be producer or consumer ○ Callable via a REST API ■ Can configure ACLs for external access● google.com/events/io/2011/sessions/putting-task-queues-to-work. html

Release 1.5.5● HRD apps ○ Cross Group (XG) transactions ○ Python 2.7 (experimental) ○ Cloud SQL (preview) ○ Full-Text Search (trusted tester) ○ HRD Migration Tool● Higher limits ○ File uploads 10MB → 32MB, URLFetch POST 1MB → 5MB ○ Frontend requests 30s → 60s, URLFetch 10s → 60s ○ Max files 3,000 → 10,000● Other ○ Google Storage File API ○ Admin console number of billed instances

Release 1.6! ● Out of preview! ○ New pricing ○ Scheduler knobs ○ Raised or removed limits ○ Python 2.7 SDK support ○ New query planner ○ Python mapreduce ○ Datastore callbacks for Javahttp://googleappengine.blogspot.com/2011/11/app-engine-160-out-of-preview-release.html

App Engine Roadmap ● Custom domain SSL ● Full text search ● Your next App Engine app!code.google.com/appengine/docs/roadmap.html

Summary● App Engine: Build scalable apps in the cloud ○ Use familiar environments: Java, Python, & now Go ○ Runs on high-performance Google infrastructure● In short history: achieved significant users & traffic ○ 100K+ devs/mo, 300K+ active apps/wk, 2B+ view/day● Build both web and non-UI apps ○ Mobile, game, business, retail, dating, weddings...● Is now production! ○ Formal pricing, SLA, operational support ○ Commitment: Google to GAE, GAE to users

Q&A Wesley Chun profiles.google.com/wescpy @wescpyChristian Schalkprofiles.google.com/cschalk@cschalk

http://gaesaas.wikispaces.asu.edu	83
http://www.gaecupboard.com	15
http://a0.twimg.com	1
http://us-w1.rockmelt.com	1

Google App Engine Overview and Update

by Chris Schalk on Nov 17, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

4 Embeds 100

Statistics

Google App Engine Overview and Update — Presentation Transcript