Downloaded 82 times
![select * from html where
url="http://www.slideshare.net/
cheilmann/reasons-to-be-cheerful-
fronteers-2010"
and
xpath="//ol/li/p[contains(.,'http')]"](https://image.slidesharecdn.com/using-yql-sensibly-yuiconf2010-101108152305-phpapp02/75/Using-YQL-Sensibly-YUIConf-2010-56-2048.jpg)
![if(('localStorage' in window) &&
window['localStorage'] !== null){
localStorage.setItem(
'cake',
'much better than cookies'
)
}](https://image.slidesharecdn.com/using-yql-sensibly-yuiconf2010-101108152305-phpapp02/75/Using-YQL-Sensibly-YUIConf-2010-79-2048.jpg)
![if(('localStorage' in window) &&
window['localStorage'] !== null){
var what = localStorage.getItem(
'cake'
)
// what -> 'much better than
cookies'
}](https://image.slidesharecdn.com/using-yql-sensibly-yuiconf2010-101108152305-phpapp02/75/Using-YQL-Sensibly-YUIConf-2010-80-2048.jpg)
![if(('localStorage' in window) &&
window['localStorage'] !== null){
localStorage.setItem(
'cake',
JSON.stringify(
{yummy:‘yes’,candles:5}
)
);
}](https://image.slidesharecdn.com/using-yql-sensibly-yuiconf2010-101108152305-phpapp02/75/Using-YQL-Sensibly-YUIConf-2010-82-2048.jpg)
![if(('localStorage' in window) &&
window['localStorage'] !== null){
var what = JSON.parse(
localStorage.getItem('cake')
);
// what -> Object{...}
// and not [Object object]
}](https://image.slidesharecdn.com/using-yql-sensibly-yuiconf2010-101108152305-phpapp02/75/Using-YQL-Sensibly-YUIConf-2010-83-2048.jpg)
Uploaded byChristian Heilmann
Using YQL Sensibly - YUIConf 2010
The document discusses using Yahoo Query Language (YQL) to efficiently cache, collate, and filter data through various web services and APIs. It proposes examples of building applications, such as calculating distances and translating foreign tweets, while highlighting issues around asynchronous requests and key management. The author encourages leveraging YQL for simplified access to data and better performance through local storage solutions.
More Related Content
Similar to Using YQL Sensibly - YUIConf 2010
Using YQL Sensibly - YUIConf 2010
- 1. Caching, collating andfiltering data Using YQL sensibly
- 2. What is theweb?
- 3. Was ist dasWeb? Data + Interfaces
- 4. Lots of yummy, yummydata.
- 5.
- 6. Companies get their datainto environments they could never reach.
- 7. Developers can build products withoutbuying data or writing code.
- 8. Let’s play withtwo examples.
- 9. Build a systemto calculate the distance between two places on Earth.
- 10. Use a mapservice?
- 11. Raw data andinfo about the places would be better to have.
- 12. Simple Plan: 1. Findthe location of the two places on Earth 2. Calculate the distance.
- 13. Earth Data =Yahoo GeoPlanet
- 14. Yahoo GeoPlanet is adata set that has information about the location of places on Earth. http://developer.yahoo.com/geo/geoplanet/
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 25. A few annoyances 1.Multiple script generation (order? what if one breaks?) 2. Access keys readable in source.
- 26. Building a systemto translate foreign tweets.
- 27. Twitter is multilingual but doesn’ttranslate.
- 28. Google has a translationservice though.
- 29. A simple plan: 1.Investigate Twitter’s search API and Google’s translation API and if needed, get keys. 2. Get the results from Twitter for a certain search. 3. Loop over the results, see which ones are not in English, and then translate them with the Google Translation API.
- 30. Really not that muchdifference in code.
- 31. It also suffersfrom the same issues.
- 32. 1. Asynchronous lookupswith generated script nodes are a pain to get right - what if one breaks? 2. Depending on how many Tweets are not in English, you have to hammer Google’s translation API which slows down your overall app.
- 33. YUI fixes afew of those issues. 1. Using JSONP you can have success and failure events. 2. You can also provide timeouts IO JSON JSON-P JSON-P YQL-Query GET
- 34. Still, it wouldbe nice to have one request, right?
- 35.
- 36.
- 37. YQL http://developer.yahoo.com/yql/console/ select {what}from {where} where {conditions}
- 38.
- 39. select text fromtwitter.search where q=”ft2010” and iso_language_code=”pl”
- 40. select * fromgoogle.translate where q in ( select text from twitter.search where q=”ft2010” and iso_language_code=”pl” ) and target=”en”
- 41. Re-using cool data onthe web?
- 42.
- 45. select * fromcsv where url="http:// spreadsheets.google.com/pub? key=tpWDkIZMZleQaREf493v1Jw&output= csv" and columns="Year,City,Sport,Discipline,Country ,Event, Gender,Type" and Year="1924"
- 46.
- 47. Instead of going crazyfiltering and sorting in JS...
- 48. ...use the YQLserver and then have a very simple JS for displaying.
- 49. Using web services withYQL in JS.
- 50. YQL is aweb service endpoint on its own...
- 51.
- 53.
- 54.
- 56. select * fromhtml where url="http://www.slideshare.net/ cheilmann/reasons-to-be-cheerful- fronteers-2010" and xpath="//ol/li/p[contains(.,'http')]"
- 57.
- 58.
- 59. HTML as JSONis not fun.
- 60. JSON-P-X = HTML asa string in a JSON-P container!
- 61.
- 62. Using YQL re-useof web content is very easy indeed.
- 63. YUI3’s YQL-Query makes iteven better!
- 64.
- 65. Don’t rely on dataarriving - test for it!
- 66.
- 67.
- 68. Using JSON iseasy with libraries.
- 69.
- 70. $.ajax({ url: url, dataType: 'jsonp', jsonp:'callback', jsonpCallback: 'ohyeah' }); function ohyeah(data){ } JSON-P and jQuery:
- 71. Which one touse?
- 72. getJSON() is dangerous with otherpeople’s data.
- 73.
- 74. Cachebreaking is not agood idea.
- 75. Local caching isa good idea.
- 76.
- 77. Would be goodto have a better solution for that.
- 78. localStorage = cookies onsteroids.
- 79. if(('localStorage' in window)&& window['localStorage'] !== null){ localStorage.setItem( 'cake', 'much better than cookies' ) }
- 80. if(('localStorage' in window)&& window['localStorage'] !== null){ var what = localStorage.getItem( 'cake' ) // what -> 'much better than cookies' }
- 81. localStorage only stores Strings- use JSON to work around that.
- 82. if(('localStorage' in window)&& window['localStorage'] !== null){ localStorage.setItem( 'cake', JSON.stringify( {yummy:‘yes’,candles:5} ) ); }
- 83. if(('localStorage' in window)&& window['localStorage'] !== null){ var what = JSON.parse( localStorage.getItem('cake') ); // what -> Object{...} // and not [Object object] }
- 84. Let’s wrap thisup in a function.
- 85. yql - thequery id - storage key name cacheage - how long to cache callback - obvious, isn’t it? https://github.com/codepo8/yql-localcache
- 86.
- 87. Others still work, butload the data every time.
- 88. callback gets an objectwith two properties: data - guess what? type - cached|live|freshcache
- 89. Libraries offer storage fallbacksfor legacy browers via Flash - YUI is of course one of them.
- 90.
- 91. To get yourown API into YQL all you need to do is write an XML schema and put it on GitHub.
- 92.
- 93. YQL allows youto write “executable tables”...
- 94. ...which means you canconvert data with JavaScript that will be executed server-side.
- 95. Our earlier examples asYQL APIs are...
- 96.
- 97.
- 98.
- 100. SELECT * FROM twitter.translateWHERE language="en" and search="warszawa" and amount="20"
- 103.
- 106. SELECT * FROMgeo.distance WHERE place1=”london” and place2="warsaw"
- 108.
- 109.
- 110. Write your schema, putit on the web...
- 111. use “http://awesomeserver.com/ distance.xml” asdistance; SELECT * FROM distance WHERE place1=”london” and place2="warsaw" use USE to use it!
- 112.
- 113. In summary Use YQLinstead of wasting time reading API docs for a simple task Filter data in the service and get the info back in formats you need. Use the fast YQL server instead of doing lots of requests. Write your own JS APIs using execute. Use local storage and don’t break caching. Go and use the web. Go easy on effects.
- 114.