Hack Day EU 2011 YQL

YQL and the API hack stack
Jonathan LeBlanc
Principal Software Engineer / Technology Evangelist
Twitter: @jcleblanc

What We’re Going to Cover
YQL Overview
Making Queries and the Console Sandbox
Open Data Tables (a.k.a. Adding New Features into YQL)
Execute (Server-Side JavaScript)
Final Lessons

Overview: Don’t reinvent the wheel!

Overview: The Components of YQL
YQL Service
Web API
YQL Table
USER

Overview: YQLFETCHesdata

Overview: YQL Sets and deletes data

Overview: IS YQL A DATABASE?

Overview:YQL is not a database

YQL Overview
Final Lessons

Making Requests: Fetching data
SELECT myColumn, myTitle
FROM myTable(0, 50)
WHERE myColumn = 'value'
AND myTitle = 'title‘
LIMIT 3 OFFSET 10

MakingRequests: Inserting data
INSERT INTO bitly.shorten (login, apiKey, longUrl)
VALUES ('ME', 'API_KEY', 'http://yahoo.com')

MakingRequests: updating data
UPDATE social.profile.status
SET status="Using YQL UPDATE”
WHERE guid="NJFIDHVPVVISDX7UKED2WHU"

MakingRequests: deleting data
DELETE FROM twittertable
WHERE tweetid="12345"
AND username="twitter_username"
AND password="twitter_password"

MakingRequests: Sub Selects
SELECT * FROM geo.places WHERE textIN (SELECT location FROM social.profile WHERE guid = me)

MakingRequests: The yql console
http://developer.yahoo.com/yql/console

MakingRequests: Flickr URLs
<photofarm="3"
id="5708163920"
isfamily="0"
isfriend="0"
ispublic="1"
owner="31832337@N04"
secret="0075137487"
server="2496"
title="San Francisco"/>

MakingRequests: Flickr URLs
Photo URL
http://farm{$farm}.static.flickr.com/{$server}/{$id}_{$secret}.jpg
Photo Page URL
http://www.flickr.com/photos/{$owner}/{$id}
Photo Owner Profile URL
http://www.flickr.com/photos/{$owner}

Making Requests: url structure
http://query.yahooapis.com/v1/yql?[params]
http://query.yahooapis.com/v1/public/yql?[params]
Params
q= [ YQL QUERY ]
format = [ XML / JSON]
diagnostics = [ true / false ]
debug = [ true / false ]
env= [ .env file URL ]
callback = [ function name ]

Making Requests: Private Data
http://query.yahooapis.com/v1/yql
Uses OAuth 1.0 for authorization
OAuth is complicated – use one of our SDKs athttps://github.com/yahoo

Making Requests: Let’s See It

YQL Overview
Final Lessons

Open Data Tables: Top Level
<?xml version="1.0" encoding="UTF-8"?>
<table xmlns="http://query.yahooapis.com/v1/schema/table.xsd">
<meta></meta>
<bindings></bindings>
</table>

Open Data Tables: Meta Node
<meta></meta>
</table>

Open Data Tables: Meta Node
<meta>
<author>Jonathan LeBlanc</author>
<description>My Table</description>
<documentationURL>www.site.com
</documentationURL>
<sampleQuery>SELECT * FROM {table}
</sampleQuery>
</meta>
</table>

Open Data Tables: Bindings Node
<meta></meta>
</table>

Open Data Tables: Bindings Node
<meta></meta>
<bindings>
<select itemPath="top.child" produces="XML">
<urls>
<urlenv="all">http://www.site.com/{user}</url>
</urls>
<inputs>
<key id="user" type="xs:string" paramType="path"
required="true" />
</inputs>
</select>
</bindings>
</table>

Open Data Tables: Using Your Table
Several Choices:
Upload the XML file to our community Github account.
Upload the XML file to your own site and use the YQL ‘USE’ clause.

Open Data Tables: Community Tables
http://github.com/yql/yql-tables

Open Data Tables: Using The USE Clause
The USE clause
USE 'http://www.mysite.com/my_table.xml'
ASmytable;
SELECT * FROMmytable
WHERE user='john_doe'

YQL Overview
Final Lessons

Execute: Execute Node
<meta></meta>
<bindings>
<urls></urls>
<inputs></inputs>
</select>
</bindings>
</table>

Execute: Execute Node
<meta></meta>
<bindings>
<urls></urls>
<inputs></inputs>
<execute></execute>
</select>
</bindings>
</table>

Execute: Server-Side JavaScript
<execute>
<![CDATA[
//get user specified inputs from YQL query
vararrQueries = inputs['query'];
//create new XML nodes
varelQueries = <queries/>;
//output new node as YQL response
response.object = elQueries;
]]>
</execute>

YQL Overview
Final Lessons

Final Lessons
YQL is a skeleton key for all Yahoo! APIs
Open data tables allow you to create new data feeds out of one or many different raw sources
Execute allows you to manipulate data before it is returned.
Use SDKs when accessing private data that requires OAuth

Final Lessons: Links
All Yahoo! APIs and Services
http://developer.yahoo.com/everything.html
YQL Documentation
http://developer.yahoo.com/yql
YQL Console
http://developer.yahoo.com/yql/console
YQL Github Account (Contribute Tables)
http://github.com/yql/yql-tables

Any questions?
http://www.slideshare.com/jcleblanc/
Jonathan LeBlanc
Twitter: @jcleblanc
E-Mail: jleblanc@yahoo-inc.com

http://www.korben.info	1026
http://korben.info	625
http://www.slideshare.net	126
http://korben.info:81	11
http://lanyrd.com	9
url_unknown	8
http://feeds2.feedburner.com	3
http://twitter.com	3
http://xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx	1
http://paper.li	1

Hack Day EU 2011 YQL

by Jonathan LeBlanc on May 10, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

10 Embeds 1,813

Statistics

Hack Day EU 2011 YQL — Presentation Transcript