Get me my  Data  ?  Subramanyan Murali Web Developer, hacker, Speaker  Look at various Data sources
Data and hacks
Putting something together in  24 hours  can be a real rush !
Internet is a data exchange medium
Need  innovative  ways to make the data into  information  that is  useful
Any resource on the internet is a  source  of data …
…  that means that there is a lot of data  
Loads and loads of data and data services   !
Data that is complex and in many formats   !
Navigating through all the  complexity  can be hard !#$%&
How to solve the data problem ?
http://pipes.yahoo.com  saves the day!
Graphical interface to  play  with data !
WYSIWYG = pipes
Predefined presentations ! RSS, JSON, Map, badge
Pipes is a visual tool, where is my  command line  ?? 
Put your hands up for YQL !
Common data access language across the web developer.yahoo.com/yql
SQL like syntax Standard and easy to use
select { what } from { service } where { condition } in ( { sub-query } )
Several services can be  chained  using in ()
YQL Console
Lots of Integrations and predefined tables anyone can be part of the interface
Fetching data from a resource has never been simpler   !
http://query.yahooapis.com/v1/ public/yql? q={query} &format={format}
Irrespective of the source, output can be  standardized …
…  thus giving you a solid & consistent data  foundation
Input can be XML, HTML, CSV, micro-formats, Atom feeds, JSON, RSS
Output can be  JSON  or  XML
Mix and match YQL and Pipes ?
Pipes provides you with  processing  capabilities
YQL is another  feed  source
Interlinking YQL and Pipes for  innovation  
Happy Hacking !! Photos @  http://flickr.com/photos/rmsguhan
Upcoming SlideShare
Loading in...5
×

Get me my data !

1,635

Published on

Presentation for IIIT Bangalore Hack U (http://bangalore.yahoo.com/hacku/) on getting data from the Web using YQL and Pipes.yahoo.com

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,635
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Get me my data !

  1. 1. Get me my Data ? Subramanyan Murali Web Developer, hacker, Speaker Look at various Data sources
  2. 2. Data and hacks
  3. 3. Putting something together in 24 hours can be a real rush !
  4. 4. Internet is a data exchange medium
  5. 5. Need innovative ways to make the data into information that is useful
  6. 6. Any resource on the internet is a source of data …
  7. 7. … that means that there is a lot of data 
  8. 8. Loads and loads of data and data services  !
  9. 9. Data that is complex and in many formats  !
  10. 10. Navigating through all the complexity can be hard !#$%&
  11. 11. How to solve the data problem ?
  12. 12. http://pipes.yahoo.com saves the day!
  13. 13. Graphical interface to play with data !
  14. 14. WYSIWYG = pipes
  15. 15. Predefined presentations ! RSS, JSON, Map, badge
  16. 16. Pipes is a visual tool, where is my command line ?? 
  17. 17. Put your hands up for YQL !
  18. 18. Common data access language across the web developer.yahoo.com/yql
  19. 19. SQL like syntax Standard and easy to use
  20. 20. select { what } from { service } where { condition } in ( { sub-query } )
  21. 21. Several services can be chained using in ()
  22. 22. YQL Console
  23. 23. Lots of Integrations and predefined tables anyone can be part of the interface
  24. 24. Fetching data from a resource has never been simpler  !
  25. 25. http://query.yahooapis.com/v1/ public/yql? q={query} &format={format}
  26. 26. Irrespective of the source, output can be standardized …
  27. 27. … thus giving you a solid & consistent data foundation
  28. 28. Input can be XML, HTML, CSV, micro-formats, Atom feeds, JSON, RSS
  29. 29. Output can be JSON or XML
  30. 30. Mix and match YQL and Pipes ?
  31. 31. Pipes provides you with processing capabilities
  32. 32. YQL is another feed source
  33. 33. Interlinking YQL and Pipes for innovation 
  34. 34. Happy Hacking !! Photos @ http://flickr.com/photos/rmsguhan

×