Living In The Cloud Hosting Data & Apps Using The Google Infrastructure

Hosting Data & Apps Using The Google Infrastructure

Introductions Pamela Fox USC Google MS/BS CS

Pamela Fox

USC

Google

MS/BS CS

Introductions http://www.wordle.net/gallery/wrdl/710650/fkedupmonkey_tags

The Cloud!

Tonight’s Agenda Google Data APIs App Engine

Google Data APIs

Before the Cloud: Web Apps

After the Cloud: Web Apps

Viral Spread Simultaneous Edits = Scaling Nightmare Mo’ Users, Mo’ Problems

Viral Spread

Simultaneous Edits

= Scaling Nightmare

Solution: App Engine

What Is App Engine? Lets you run your web application on top of Google’s infrastructure. Servers Network Datastore Backups Pagers Scalable }

Lets you run your web application on top of Google’s infrastructure.

Servers

Network

Datastore

Backups

Pagers

Why App Engine “ We wear pagers so you don’t have to.” — Guido van Rossum

“ We wear pagers so you don’t have to.”

Simplicity App Engine is designed to be simple. Simple application configuration. No systems administration. No performance tuning. Automatic scaling.

App Engine is designed to be simple.

App Engine Architecture code data

Non-Scalable Architecture code/data

Python

Data Store

Data Store db.GqlQuery(&quot;SELECT * FROM Shout &quot; &quot;WHERE who >= 'b ' AND who < ' c ' &quot; &quot;ORDER BY when DESC&quot;).fetch(100) query = Shout.all() query.order('-date') query.filter('who >=', 'b') query.filter('who <', ‘c') shouts = query.fetch(100)

Memcache

Users @gmail.com @myappsdomain.com

Demo Google App Engine

Google App Engine

Before the Cloud: User Apps

Before the Cloud: User Apps

Users demand ownership of their content. Other sites want to access that content. Damn Needy Users

Users demand ownership of their content.

Other sites want to access that content.

Solution: Google data APIs

How Do You Make Things Accessible? A pplication P rogramming I nterface ( )

APIs An application programming interface (API) is a set of functions, procedures, methods or classes that an operating system , library or service provides to support requests made by computer programs . Source: Wikipedia C/C++ Header File

An application programming interface (API) is a set of functions, procedures, methods or classes that an operating system , library or service provides to support requests made by computer programs .

Source: Wikipedia

APIs RPC || REST * SOAP

RPC || REST

* SOAP

Remote Procedure Calls fooInstance->addNumbers(2, 3); <?xml version=&quot;1.0&quot;?><methodCall> <methodName>Foo.addNumbers</methodName> <params> <param> <value><int>2</int></value> <value><int>3</int></value> </param> </params></methodCall> fooInstance.addNumbers(2, 3); PHP XML (Network) C++

REST [Fielding 2000] Re presentational S tate T ransfer ( )

REST Fundamentals of REST: Application state and functionality is abstracted into discrete resources .

Fundamentals of REST:

REST Fundamentals of REST: Resources are accessible via URLs . /blog/posts/1234

Fundamentals of REST:

REST Fundamentals of REST: Resources share a uniform interface for transferring state . HTTP:// } GET POST PUT DELETE

Fundamentals of REST:

RSS/ATOM Feed { Entries Example ATOM feed.

ATOMPub Feed { Entries

Google data APIs Protocol Feed Query { Entries

The Google Data Protocol REST Google Data Protocol RSS 2.0 Architecture Syndication Updates AtomPub Atom

The Google Data Protocol RSS 2.0 Atom(Pub) Google Data Syndication Format ✓ ✓ ✓ Queries ✓ Updates ✓ ✓ Optimistic Concurrency ✓ Authentication ✓

The Google Data Protocol Over 15 APIs, 1 Protocol Many Uses

Case Study: CalGoo

The Google Data Protocol GET /myFeed 200 OK <?xml version=&quot;1.0&quot;?> <feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <title>Foo</title> <updated>2006-01-23T16:25:00-08:00</updated> <id> http://www.example.com/myFeed </id> <author> <name>Jo March</name> </author> <link href=&quot;/myFeed&quot; rel=&quot;self&quot;/> </feed> Requesting a feed or resource

GET /myFeed

200 OK

<?xml version=&quot;1.0&quot;?>

<feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<title>Foo</title>

<updated>2006-01-23T16:25:00-08:00</updated>

<id> http://www.example.com/myFeed </id>

<author>

<name>Jo March</name>

</author>

<link href=&quot;/myFeed&quot; rel=&quot;self&quot;/>

</feed>

The Google Data Protocol POST /myFeed <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> Creating a new resource

POST /myFeed

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

The Google Data Protocol 201 CREATED <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:26:03-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> Creating a new resource

201 CREATED

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:26:03-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

The Google Data Protocol PUT /myFeed/1/1/ <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:28:05-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my first entry.</content> </entry> Updating an entry

PUT /myFeed/1/1/

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:28:05-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my first entry.</content>

</entry>

The Google Data Protocol 200 OK <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/2/ &quot;/> <updated>2006-01-23T16:28:05-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my first entry.</content> </entry> Updating an entry

200 OK

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/2/ &quot;/>

<updated>2006-01-23T16:28:05-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my first entry.</content>

</entry>

The Google Data Protocol DELETE /myFeed/1/2/ 200 OK Updating an entry

DELETE /myFeed/1/2/

200 OK

Demo Google Data CRUD

Google Data CRUD

The Google Data Protocol GET /myFeed?q=This 200 OK <?xml version=&quot;1.0&quot;?> <feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <title>Foo</title> <updated>2006-01-23T16:26:03-08:00</updated> <id> http://www.example.com/myFeed </id> <link href=&quot;/myFeed&quot; rel=&quot;self&quot;/> <entry> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:26:03-08:00</updated> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> </feed> Searching for a resource

GET /myFeed?q=This

200 OK

<?xml version=&quot;1.0&quot;?>

<feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<title>Foo</title>

<updated>2006-01-23T16:26:03-08:00</updated>

<id> http://www.example.com/myFeed </id>

<link href=&quot;/myFeed&quot; rel=&quot;self&quot;/>

<entry>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:26:03-08:00</updated>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

</feed>

Demo Youtube Searcher

Youtube Searcher

JSON and RSS Other formats are also supported: ?alt=json ?alt=json-in-script ?alt=kml ?alt=rss http://code.google.com/apis/gdata/json.html

Other formats are also supported:

Client Libraries PHP .NET Java JavaScript Objective-C Python + Community Contributed

PHP

Demo Google Data Sample Applications

Google Data Sample Applications

My Secret Motivation For Giving This Talk Google Data APIs ♥ App Engine

Google Data APIs

♥

App Engine

Demo Google Data APIs + App Engine

Google Data APIs + App Engine

Questions?

Questions? Pamela Fox [email_address] @pamelafox More Info http://code.google.com ↶