Hack Day EU 2011 YQL

2. YQL and the API hack stack Jonathan LeBlanc Principal Software Engineer / Technology Evangelist Twitter: @jcleblanc

3. What We’re Going to Cover YQL Overview Making Queries and the Console Sandbox Open Data Tables (a.k.a. Adding New Features into YQL) Execute (Server-Side JavaScript) Final Lessons

5. Overview: Don’t reinvent the wheel!

6. Overview: The Components of YQL YQL Service Web API YQL Table USER

7. Overview: YQLFETCHesdata

8. Overview: YQL Sets and deletes data

9. Overview: IS YQL A DATABASE?

10. Overview:YQL is not a database

12. Making Requests: Fetching data SELECT myColumn, myTitle FROM myTable(0, 50) WHERE myColumn = 'value' AND myTitle = 'title‘ LIMIT 3 OFFSET 10

13. MakingRequests: Inserting data INSERT INTO bitly.shorten (login, apiKey, longUrl) VALUES ('ME', 'API_KEY', 'http://yahoo.com')

14. MakingRequests: updating data UPDATE social.profile.status SET status="Using YQL UPDATE” WHERE guid="NJFIDHVPVVISDX7UKED2WHU"

15. MakingRequests: deleting data DELETE FROM twittertable WHERE tweetid="12345" AND username="twitter_username" AND password="twitter_password"

16. MakingRequests: Sub Selects SELECT * FROM geo.places WHERE textIN (SELECT location FROM social.profile WHERE guid = me)

17. MakingRequests: The yql console http://developer.yahoo.com/yql/console

18. MakingRequests: Flickr URLs <photofarm="3" id="5708163920" isfamily="0" isfriend="0" ispublic="1" owner="31832337@N04" secret="0075137487" server="2496" title="San Francisco"/>

19. MakingRequests: Flickr URLs Photo URL http://farm{$farm}.static.flickr.com/{$server}/{$id}_{$secret}.jpg Photo Page URL http://www.flickr.com/photos/{$owner}/{$id} Photo Owner Profile URL http://www.flickr.com/photos/{$owner}

20. Making Requests: url structure http://query.yahooapis.com/v1/yql?[params] http://query.yahooapis.com/v1/public/yql?[params] Params <ul><li>q= [ YQL QUERY ]

21. format = [ XML / JSON]

22. diagnostics = [ true / false ]

23. debug = [ true / false ]

24. env= [ .env file URL ]

25. callback = [ function name ]</li></li></ul><li>Making Requests: Private Data http://query.yahooapis.com/v1/yql Uses OAuth 1.0 for authorization OAuth is complicated – use one of our SDKs athttps://github.com/yahoo

26. Making Requests: Let’s See It

28. Open Data Tables: Top Level <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings></bindings> </table>

29. Open Data Tables: Meta Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings></bindings> </table>

30. Open Data Tables: Meta Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta> <author>Jonathan LeBlanc</author> <description>My Table</description> <documentationURL>www.site.com </documentationURL> <sampleQuery>SELECT * FROM {table} </sampleQuery> </meta> <bindings></bindings> </table>

31. Open Data Tables: Bindings Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings></bindings> </table>

32. Open Data Tables: Bindings Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings> <select itemPath="top.child" produces="XML"> <urls> <urlenv="all">http://www.site.com/{user}</url> </urls> <inputs> <key id="user" type="xs:string" paramType="path" required="true" /> </inputs> </select> </bindings> </table>

33. Open Data Tables: Using Your Table Several Choices: Upload the XML file to our community Github account. Upload the XML file to your own site and use the YQL ‘USE’ clause.

34. Open Data Tables: Community Tables http://github.com/yql/yql-tables

35. Open Data Tables: Using The USE Clause The USE clause USE 'http://www.mysite.com/my_table.xml' ASmytable; SELECT * FROMmytable WHERE user='john_doe'

37. Execute: Execute Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings> <select itemPath="top.child" produces="XML"> <urls></urls> <inputs></inputs> </select> </bindings> </table>

38. Execute: Execute Node <?xml version="1.0" encoding="UTF-8"?> <table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"> <meta></meta> <bindings> <select itemPath="top.child" produces="XML"> <urls></urls> <inputs></inputs> <execute></execute> </select> </bindings> </table>

39. Execute: Server-Side JavaScript <execute> <![CDATA[ //get user specified inputs from YQL query vararrQueries = inputs['query']; //create new XML nodes varelQueries = <queries/>; //output new node as YQL response response.object = elQueries; ]]> </execute>

41. Final Lessons YQL is a skeleton key for all Yahoo! APIs Open data tables allow you to create new data feeds out of one or many different raw sources Execute allows you to manipulate data before it is returned. Use SDKs when accessing private data that requires OAuth

42. Final Lessons: Links All Yahoo! APIs and Services http://developer.yahoo.com/everything.html YQL Documentation http://developer.yahoo.com/yql YQL Console http://developer.yahoo.com/yql/console YQL Github Account (Contribute Tables) http://github.com/yql/yql-tables

43. Any questions? http://www.slideshare.com/jcleblanc/ Jonathan LeBlanc Twitter: @jcleblanc E-Mail: jleblanc@yahoo-inc.com