Get me my data !

Get me my Data ? Subramanyan Murali Web Developer, hacker, Speaker Look at various Data sources

Data and hacks

Putting something together in 24 hours can be a real rush !

Internet is a data exchange medium

Need innovative ways to make the data into information that is useful

Any resource on the internet is a source of data …

… that means that there is a lot of data 

Loads and loads of data and data services  !

Data that is complex and in many formats  !

Navigating through all the complexity can be hard !#$%&

How to solve the data problem ?

http://pipes.yahoo.com saves the day!

Graphical interface to play with data !

WYSIWYG = pipes

Predefined presentations ! RSS, JSON, Map, badge

Pipes is a visual tool, where is my command line ?? 

Put your hands up for YQL !

Common data access language across the web developer.yahoo.com/yql

SQL like syntax Standard and easy to use

select { what } from { service } where { condition } in ( { sub-query } )

Several services can be chained using in ()

YQL Console

Lots of Integrations and predefined tables anyone can be part of the interface

Fetching data from a resource has never been simpler  !

http://query.yahooapis.com/v1/ public/yql? q={query} &format={format}

Irrespective of the source, output can be standardized …

… thus giving you a solid & consistent data foundation

Input can be XML, HTML, CSV, micro-formats, Atom feeds, JSON, RSS

Output can be JSON or XML

Mix and match YQL and Pipes ?

Pipes provides you with processing capabilities

YQL is another feed source

Interlinking YQL and Pipes for innovation 

Happy Hacking !! Photos @ http://flickr.com/photos/rmsguhan

by Subramanyan Guhan on Dec 09, 2009