Living In The Cloud Hosting Data & Apps Using The Google Infrastructure

Hosting Data & Apps Using The Google Infrastructure

Introductions Pamela Fox USC/Google http://www.wordle.net/gallery/wrdl/710650/fkedupmonkey_tags

Pamela Fox USC/Google

The Cloud!

Tonight’s Agenda Google Data APIs App Engine

Google Data APIs

Before the Cloud: Web Apps

After the Cloud: Web Apps

Viral Spread + User Edits = Scaling Nightmare Mo’ Users, Mo’ Problems

Viral Spread + User Edits = Scaling Nightmare

Old Architecture code/data

Old Architecture

Old Architecture

Old Architecture

Solution: App Engine

What Is App Engine? Lets you run your web application on top of Google’s infrastructure. Servers Network Datastore Backups Pagers “ We wear pagers so you don’t have to.” — Guido van Rossum Scalable }

Lets you run your web application on top of Google’s infrastructure.

Servers

Network

Datastore

Backups

Pagers

App Engine Architecture code data

Simple, Automatic Scaling

App Engine Components code data

Python

Data Store

Data Store db.GqlQuery(&quot;SELECT * FROM Shout &quot; &quot;WHERE who >= 'b ' AND who < ' c ' &quot; &quot;ORDER BY when DESC&quot;).fetch(100) query = Shout.all() query.order('-date') query.filter('who >=', 'b') query.filter('who <', ‘c') shouts = query.fetch(100)

Memcache

Users @gmail.com @myappsdomain.com

Demo Google App Engine

Google App Engine

Before the Cloud: User Apps

After the Cloud: User Apps

Users demand ownership of their content. Other sites want to access that content. Damn Needy Users

Users demand ownership of their content.

Other sites want to access that content.

Solution: Google data APIs

How Do You Make Things Accessible? An application programming interface (API) is a set of functions, procedures, methods or classes that an operating system , library or service provides to support requests made by computer programs . Source: Wikipedia A pplication P rogramming I nterface ( )

An application programming interface (API) is a set of functions, procedures, methods or classes that an operating system , library or service provides to support requests made by computer programs .

Source: Wikipedia

APIs RPC || REST * SOAP

RPC || REST

* SOAP

Remote Procedure Calls fooInstance->addNumbers(2, 3); <?xml version=&quot;1.0&quot;?><methodCall> <methodName>Foo.addNumbers</methodName> <params> <param> <value><int>2</int></value> <value><int>3</int></value> </param> </params></methodCall> fooInstance.addNumbers(2, 3); PHP XML (Network) C++

REST [Fielding 2000] Re presentational S tate T ransfer ( )

REST Fundamentals of REST: Application state and functionality is abstracted into discrete resources .

Fundamentals of REST:

REST Fundamentals of REST: Resources are accessible via URLs . /blog/posts/1234

Fundamentals of REST:

REST Fundamentals of REST: Resources share a uniform interface for transferring state . HTTP:// } GET POST PUT DELETE

Fundamentals of REST:

RSS/ATOM Feed { Entries Example RSS feed.

ATOMPub Feed { Entries GET POST PUT DELETE

Google data APIs Protocol Feed Query { Entries GET POST PUT DELETE

The Google Data Protocol REST Google Data Protocol RSS 2.0 Architecture Syndication Updates AtomPub Atom

The Google Data Protocol RSS 2.0 Atom(Pub) Google Data Syndication Format ✓ ✓ ✓ Queries ✓ Updates ✓ ✓ Optimistic Concurrency ✓ Authentication ✓

The Google Data Protocol Over 15 APIs, 1 Protocol Many Uses

Case Study: CalGoo

The Google Data Protocol GET /myFeed 200 OK <?xml version=&quot;1.0&quot;?> <feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <title>Foo</title> <updated>2006-01-23T16:25:00-08:00</updated> <id> http://www.example.com/myFeed </id> <author> <name>Jo March</name> </author> <link href=&quot;/myFeed&quot; rel=&quot;self&quot;/> </feed> Requesting a feed or resource

GET /myFeed

200 OK

<?xml version=&quot;1.0&quot;?>

<feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<title>Foo</title>

<updated>2006-01-23T16:25:00-08:00</updated>

<id> http://www.example.com/myFeed </id>

<author>

<name>Jo March</name>

</author>

<link href=&quot;/myFeed&quot; rel=&quot;self&quot;/>

</feed>

The Google Data Protocol POST /myFeed <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> Creating a new resource

POST /myFeed

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

The Google Data Protocol 201 CREATED <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:26:03-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> Creating a new resource

201 CREATED

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:26:03-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

The Google Data Protocol PUT /myFeed/1/1/ <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:28:05-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my first entry.</content> </entry> Updating an entry

PUT /myFeed/1/1/

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:28:05-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my first entry.</content>

</entry>

The Google Data Protocol 200 OK <?xml version=&quot;1.0&quot;?> <entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/2/ &quot;/> <updated>2006-01-23T16:28:05-08:00</updated> <author> <name>Elizabeth Bennet</name> <email> [email_address] </email> </author> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my first entry.</content> </entry> Updating an entry

200 OK

<?xml version=&quot;1.0&quot;?>

<entry xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/2/ &quot;/>

<updated>2006-01-23T16:28:05-08:00</updated>

<author>

<name>Elizabeth Bennet</name>

<email> [email_address] </email>

</author>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my first entry.</content>

</entry>

The Google Data Protocol DELETE /myFeed/1/2/ 200 OK Updating an entry

DELETE /myFeed/1/2/

200 OK

Demo Google Data CRUD

Google Data CRUD

The Google Data Protocol GET /myFeed?q=This 200 OK <?xml version=&quot;1.0&quot;?> <feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;> <title>Foo</title> <updated>2006-01-23T16:26:03-08:00</updated> <id> http://www.example.com/myFeed </id> <link href=&quot;/myFeed&quot; rel=&quot;self&quot;/> <entry> <id> http://www.example.com/id/1 </id> <link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/> <updated>2006-01-23T16:26:03-08:00</updated> <title type=&quot;text&quot;>Entry 1</title> <content type=&quot;text&quot;>This is my entry</content> </entry> </feed> Searching for a resource

GET /myFeed?q=This

200 OK

<?xml version=&quot;1.0&quot;?>

<feed xmlns=&quot; http://www.w3.org/2005/Atom &quot;>

<title>Foo</title>

<updated>2006-01-23T16:26:03-08:00</updated>

<id> http://www.example.com/myFeed </id>

<link href=&quot;/myFeed&quot; rel=&quot;self&quot;/>

<entry>

<id> http://www.example.com/id/1 </id>

<link rel=&quot;edit&quot; href=&quot; http://example.com/myFeed/1/1/ &quot;/>

<updated>2006-01-23T16:26:03-08:00</updated>

<title type=&quot;text&quot;>Entry 1</title>

<content type=&quot;text&quot;>This is my entry</content>

</entry>

</feed>

Demo Youtube Searcher

Youtube Searcher

JSON and RSS Other formats are also supported: ?alt=json ?alt=json-in-script ?alt=kml ?alt=rss

Other formats are also supported:

Client Libraries PHP .NET Java JavaScript Objective-C Python + Community Contributed

PHP

Demo Google Data Sample Applications

Google Data Sample Applications

My Secret Motivation For Giving This Talk Google Data APIs ♥ App Engine

Google Data APIs

♥

App Engine

Demo Google Data APIs + App Engine

Google Data APIs + App Engine

Conclusion Google Data APIs App Engine Scalable Architecture (AtomPub) APIs

Google Data APIs

Questions? Pamela Fox [email_address] @pamelafox More Info http://code.google.com ↶