Das Web Als Datenbank Mit Yql Und Pipes

Das Web als Datenbank mit YQL und Pipes WebTech 18.11.2009 Dirk Ginader http://ginader.de http://twitter.com/ginader

YQL SELECT * FROM INTERNET

SQL ähnliche Abfrage Sprache für APIs

select {what} from {service} where {condition}

Viele kostenlose Yahoo! APIs automatisch dabei

z.B. Flickr: select * from ﬂickr.photos.search where text="Cat" limit 10

! Die YQL Konsole http://developer.yahoo.com/yql/console/

cbfunc({ "query": { "count": "10", "created": "2009-11-16T02:07:24Z", "lang": "en-US", "updated": "2009-11-16T02:07:24Z", "uri": "http://query.yahooapis.com/v1/yql? q=select+*+from+flickr.photos.search+where+text%3D %22Cat%22+limit+10", "results": { "photo": [ { "farm": "3", "id": "4109367976", "isfamily": "0", "isfriend": "0", "ispublic": "1", "owner": "37422864@N03", "secret": "ee0ef58428", "server": "2703", "title": "cats" }, ... ] } } });

<?xml version="1.0" encoding="UTF-8"?> <query xmlns:yahoo="http://www.yahooapis.com/v1/base.rng" yahoo:count="10" yahoo:created="2009-11-16T02:24:44Z" yahoo:lang="en-US" yahoo:updated="2009-11-16T02:24:44Z" yahoo:uri="http://query.yahooapis.com/v1/yql?q=select+*+from +flickr.photos.search+where+text%3D%22Cat%22+limit+10"> <results> <photo farm="3" id="4109414580" isfamily="0" isfriend="0" ispublic="1" owner="31496263@N00" secret="f3853f8664" server="2685" title="Jiji"/> ... </results> </query>

select * from geo.places where text="san francisco, ca"

select * from social.proﬁle where guid=me

select * from ﬂickr.photos.info where photo_id in (select id from ﬂickr.photos.search where woe_id in (select woeid from geo.places where text='Karlsruhe') ) limit 5;

Flickr (Foto suche, interestingness, places, etc.) Geo (places, placemaker, neighbors, etc.) Social (contacs, proﬁle, read and write!) Maps (map, trafﬁc)

Weather (forecast) Search (termextract, spelling, images, news, etc.) Music (artist, track, video, etc.) Yahoo (url shortener, memcache, etc.)

Die Macht der Community

432 open tables!

Amazon, Answers, bit.ly, delicious, dopplr, facebook, friendfeed, last.fm, google, guardian, iplocation, twitter...

oder auch ganz ohne API

select * from html where url="http://it-republik.de/ konferenzen/webtech09/ sessions/" and xpath='//div[@class="track"]

select * from microformats where url='http:// blog.ginader.de/ impressum.html'

YQL Execute

eigenes Javascript serverseitig bei Yahoo! ausführen

„This is nuts (in a good way).Yahoo!’s intriguing universal SQL-style XML/ JSONP web service interface now supports JavaScript as a kind of stored procedure language, meaning you can use JavaScript and E4X to screen- scrape web pages, then query the results with YQL.“ Simon Willison

cssselect wenn man xpath nicht mag...

use 'http://yqlblog.net/samples/data.html.cssselect.xml' as data.html.cssselect; select * from data.html.cssselect where url="http://webstandards-magazin.de/" and css=".gallery a,a.gallery"

wenn die Seite POST- Daten erwartet

use "http://isithackday.com/hacks/htmlpost/htmlpost.xml?x=33" as htmlpost; select * from htmlpost where url='http://entwickler.com/konferenzen/planer/ create_custom_timetable.php' and postdata="values[11913]=11913&values[11781]=11781&send=1&..." and xpath="//ul[@class='times']/li"

Hackday Projekt wird Hackday Lieblingsspielzeug

graﬁsche Version von YQL

lädt Datenstrukturen fast jeder Art

RSS, Atom, csv, ical, und viele mehr

... und YQL!

Performance!

Alles auf Yahoo! Servern

Caching eingebaut

twitter clients suche, trending topics...

API Kapselung für jede Applikation

kostenlos

sicher mit OAuth

Danke :-) http://ginader.de http://twitter.com/ginader

http://www.webkrauts.de	86
http://coderwall.com	2
resource://brief-content	1
http://feeds2.feedburner.com	1
http://live.aj82.de	1
http://wk7.textformer.com	1

Das Web Als Datenbank Mit Yql Und Pipes

by Dirk Ginader on Nov 23, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

6 Embeds 92

Statistics

Das Web Als Datenbank Mit Yql Und Pipes — Presentation Transcript