0
YQLPaul Donnelly (@pjdonnelly)YQL Team
When creating an application theheart of the project is the data.
So how do we get data?
So how do we get data?- API’s(flickr, twitter)- Spreadsheets (yahoo finance csv, google docs)- RSS (blogs, news)- HTML pages
Many applications require more thenone source of data from differentproviders.
This can get complicated very quickly.
This can get complicated very quickly.For each web service I need to: Read API docs Figure out REST endpoints Figure ou...
YQL TO THE RESCUE           YQL is an expressive SQL-like           language that lets you           query, filter, and jo...
YQL TO THE RESCUE   Using YQL, accessing the web and   it’s API’s becomes as simple as   SQL:   select {what} from   {serv...
RSS AGGREGATIONselect * from feed where url in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd.com/feed/")
RSS AGGREGATIONselect title,description from feed whereurl in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd...
RSS AGGREGATIONselect title,description from feed whereurl in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd...
SORT AND OTHER METHODSAnything right of the | is performed after all selectoperations are done.Valid methods:• sort• tail ...
HTML SCRAPING (SCRAY-P-I)Pinterest doesn’t (currently) have anAPI for it’s top 50 pins.
HTML SCRAPING (SCRAY-P-I)select * from html where url="http://pinterest.com/popular/" and xpath ="//a[@class=PinImageImgLi...
HTML SCRAPING (SCRAY-P-I)
FLICKRFirst get a Flickr API Key:flickr.com/services/apps/create/apply
FLICKRQuery for pizza:select * from flickr.photos.searchwhere text="pizza" andapi_key="5b7b21a3d44ed659e13410edee783a3b" l...
FLICKRQuery for pizza:
FLICKRQuery for pizza:select source from flickr.photos.sizeswhere photo_id in (select id fromflickr.photos.search wheretex...
FLICKRQuery for pizza:
HOW DO I ACCESS YQLPublic Endpoint:http://query.yahooapis.com/v1/public/yql?q={query}&format={format}
HOW DO I ACCESS YQLFormatsCurrent outputs are XML or JSON orJSON-P
HOW DO I ACCESS YQLYQL Console:developer.yahoo.com/yql/console/
YQL CONSOLE
CONSOLE PARAMETERS - DIAGNOSTICS
CONSOLE PARAMETERS - DEBUG
CONSOLE PARAMETERS – DEBUG CONTD.
CONSOLE TIPS – REST QUERY
CONSOLE TIPS – COMMUNITY TABLES
CONSOLE TIPS – PERMALINK & ALIAS
TABLE EDITOR• Rapid YQL table prototyping    • Create YQL tables    • Create YQL Environment files    • Create YQL Javascr...
TABLE EDITOR – SAMPLE TABLE
YQL IN YAHOO PIPES• http://pipes.yahoo.com• Easy way to create RSS and createcomplex data flows using a visualeditor.• NEW...
YQL IN YAHOO PIPES
RECAP
YQL FORMATS• Accepts JSON, XML, CSV• Outputs XML, JSON, JSONP• Provides data type transformers and mutators• Tidies up dat...
FAST, GLOBALLY AVAILABLE• Deployed across the globe• Both front and back facing caches• Developers can control cache behav...
APP DEVELOPMENT USING YQL• Pick open tables or base YQL tables to buildyour app.• Build new ones for your API if needed• T...
TIPSSearch github.com/yql for table examples:Use: http://developer.yahoo.com/yql/guide/Use: http://christianheilmann.com/t...
THANKSSite: http://developer.yahoo.com/yql/Community:   http://www.yqlblog.net/   http://www.datatables.org/   https://git...
YQL Publicis Hackday
Upcoming SlideShare
Loading in...5
×

YQL Publicis Hackday

1,134

Published on

Published in: Technology
1 Comment
0 Likes
Statistics
Notes
  • Free Download : http://gg.gg/114bb

    Hey Guyz and girls, Today I am gonna show you perfact tool, Remember This video is old, But the download link with hack is brand new. Its very simple to using this tool and here are some instructions in video. Please REDOWNLOAD. Don't Forget to Comment Subscribe & Rate My Video :)

    Virus Scan :- This file has been scanned with avast! Antivirus. -- Status: FILE IS CLEANN.

    Copyright © 2014. All Rights Reserved
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Views
Total Views
1,134
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide
  • Personalized endpoint
  • Transcript of "YQL Publicis Hackday"

    1. 1. YQLPaul Donnelly (@pjdonnelly)YQL Team
    2. 2. When creating an application theheart of the project is the data.
    3. 3. So how do we get data?
    4. 4. So how do we get data?- API’s(flickr, twitter)- Spreadsheets (yahoo finance csv, google docs)- RSS (blogs, news)- HTML pages
    5. 5. Many applications require more thenone source of data from differentproviders.
    6. 6. This can get complicated very quickly.
    7. 7. This can get complicated very quickly.For each web service I need to: Read API docs Figure out REST endpoints Figure out rate limits Figure out syntax
    8. 8. YQL TO THE RESCUE YQL is an expressive SQL-like language that lets you query, filter, and join data across Web services.  SQL = familiar  Not limited to just Yahoo web services, but any web service.  Single access point  Learn the YQL syntax to filter data instead of learning an individual API.
    9. 9. YQL TO THE RESCUE Using YQL, accessing the web and it’s API’s becomes as simple as SQL: select {what} from {service} where {condition}
    10. 10. RSS AGGREGATIONselect * from feed where url in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd.com/feed/")
    11. 11. RSS AGGREGATIONselect title,description from feed whereurl in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd.com/feed/")
    12. 12. RSS AGGREGATIONselect title,description from feed whereurl in("http://feeds.feedburner.com/TechCrunch/","http://allthingsd.com/feed/") |sort(field="pubDate", descending="true”)
    13. 13. SORT AND OTHER METHODSAnything right of the | is performed after all selectoperations are done.Valid methods:• sort• tail (gets the last count items)• truncate (gets the first count items)• reverse• unique (no duplicates)• sanitize (emit safe html, prevents XSS)
    14. 14. HTML SCRAPING (SCRAY-P-I)Pinterest doesn’t (currently) have anAPI for it’s top 50 pins.
    15. 15. HTML SCRAPING (SCRAY-P-I)select * from html where url="http://pinterest.com/popular/" and xpath ="//a[@class=PinImageImgLink]"
    16. 16. HTML SCRAPING (SCRAY-P-I)
    17. 17. FLICKRFirst get a Flickr API Key:flickr.com/services/apps/create/apply
    18. 18. FLICKRQuery for pizza:select * from flickr.photos.searchwhere text="pizza" andapi_key="5b7b21a3d44ed659e13410edee783a3b" limit 10
    19. 19. FLICKRQuery for pizza:
    20. 20. FLICKRQuery for pizza:select source from flickr.photos.sizeswhere photo_id in (select id fromflickr.photos.search wheretext=”pizza" and api_key=“” andsort="relevance") and api_key=“”and label="Medium"
    21. 21. FLICKRQuery for pizza:
    22. 22. HOW DO I ACCESS YQLPublic Endpoint:http://query.yahooapis.com/v1/public/yql?q={query}&format={format}
    23. 23. HOW DO I ACCESS YQLFormatsCurrent outputs are XML or JSON orJSON-P
    24. 24. HOW DO I ACCESS YQLYQL Console:developer.yahoo.com/yql/console/
    25. 25. YQL CONSOLE
    26. 26. CONSOLE PARAMETERS - DIAGNOSTICS
    27. 27. CONSOLE PARAMETERS - DEBUG
    28. 28. CONSOLE PARAMETERS – DEBUG CONTD.
    29. 29. CONSOLE TIPS – REST QUERY
    30. 30. CONSOLE TIPS – COMMUNITY TABLES
    31. 31. CONSOLE TIPS – PERMALINK & ALIAS
    32. 32. TABLE EDITOR• Rapid YQL table prototyping • Create YQL tables • Create YQL Environment files • Create YQL Javascript execute files• Sample templates for all three• Nifty drag & drop support• All the above stored in the Yahoo! Cloud• http://developer.yahoo.com/yql/editor
    33. 33. TABLE EDITOR – SAMPLE TABLE
    34. 34. YQL IN YAHOO PIPES• http://pipes.yahoo.com• Easy way to create RSS and createcomplex data flows using a visualeditor.• NEW!! YQL method • y.pipe(“pipeid”,”<obj params>”)
    35. 35. YQL IN YAHOO PIPES
    36. 36. RECAP
    37. 37. YQL FORMATS• Accepts JSON, XML, CSV• Outputs XML, JSON, JSONP• Provides data type transformers and mutators• Tidies up data sources for you (html table)• Lets you spend more time building your app
    38. 38. FAST, GLOBALLY AVAILABLE• Deployed across the globe• Both front and back facing caches• Developers can control cache behavior • _maxage=<seconds> parameter • _stalewhilerevalidate=<seconds> parameter• Rate limited for external developers • 2000 calls per hour per IP on public endpoint • 20000 on OAuth protected endpoint
    39. 39. APP DEVELOPMENT USING YQL• Pick open tables or base YQL tables to buildyour app.• Build new ones for your API if needed• Test the tables in the YQL console• Use the YUI-YQL module to get data• Or just call the REST query endpoint
    40. 40. TIPSSearch github.com/yql for table examples:Use: http://developer.yahoo.com/yql/guide/Use: http://christianheilmann.com/tag/yql/ forawesome examples and inspiration
    41. 41. THANKSSite: http://developer.yahoo.com/yql/Community: http://www.yqlblog.net/ http://www.datatables.org/ https://github.com/yql/yql-tablesEmail: yql-questions@yahoo-inc.comTwitter: @pjdonnelly
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×