Successfully reported this slideshow.

Data and information

488 views

Published on

Published in: Education, Technology, Business
  • Be the first to comment

  • Be the first to like this

Data and information

  1. 1. Data, Information and tools for both
  2. 2. Who am I and how did I get here? <ul><ul><li>Solutions Architect at Yahoo!7 </li></ul></ul><ul><ul><li>Geo-spatial Platforms, Information Systems </li></ul></ul><ul><ul><li>Lamp stack developer </li></ul></ul><ul><ul><li>Systems engineering </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>@steveathon on twitter </li></ul></ul>
  3. 3. Data, Information and tools for both.
  4. 4. What is data anyway? <ul><ul><li>Raw facts, figures, statistics and elemental data </li></ul></ul><ul><ul><li>Can be meaningless without context </li></ul></ul>Yahoo!7 Proprietary and Confidential
  5. 5. If that’s data, what is information? <ul><ul><li>Information follows the concept of ‘a value greater than the sum of it’s parts’. </li></ul></ul><ul><ul><li>Allows the user to easily ingest the data in a way they are comfortable with </li></ul></ul><ul><ul><li>Delivery is important </li></ul></ul><ul><ul><li>Provides a valuable attribute to the data that allows us to understand it, context. </li></ul></ul><ul><ul><li>Visual, audio, emotional or satirical approach to translation </li></ul></ul>Yahoo!7 Proprietary and Confidential
  6. 6. Example <ul><ul><li>Not so useful, consider the following two pieces of datum S33,46,33 E151,6,148 </li></ul></ul><ul><ul><li>Not typical representation of information of this type </li></ul></ul><ul><ul><li>Causing confusion? </li></ul></ul>Yahoo!7 Proprietary and Confidential
  7. 7. Example <ul><ul><li>What about these two: -33.775927 151.113445 </li></ul></ul><ul><ul><li>Recognition in your brain is already beginning the translation </li></ul></ul>Yahoo!7 Proprietary and Confidential
  8. 8. Example <ul><ul><li>What about these two: -33.775927 151.113445 </li></ul></ul><ul><ul><li>Recognition in your brain is already beginning the translation </li></ul></ul><ul><ul><li>More useful: Macquarie Drive, Macquarie University, North Ryde, New South Wales, Australia, Southern Hemisphere, Earth </li></ul></ul><ul><ul><li>Why is this more useful? We translated the raw data into information that’s easy for you to recognise. </li></ul></ul><ul><ul><li>Another: dd = d+m/60+s/3600 </li></ul></ul>Yahoo!7 Proprietary and Confidential
  9. 9. Types of data <ul><ul><li>Personal, Behavioral, Map, Weather, Fuel, Politicians broken promises, geo spatial, Sporting, crime, usage, historical, meta, house price, statistics, search, unemployment, financial, events </li></ul></ul><ul><ul><li>Some data is useful on it’s own Fuel prices, Crime Statistics, Event Information </li></ul></ul><ul><ul><li>Some data is more useful when it’s combined House prices vs Employment House prices vs Crime Weather vs Accidents Speed Camera Locations vs Accident hot spots </li></ul></ul><ul><ul><li>Some data is useless on it’s own Search data, Financial data </li></ul></ul>Yahoo!7 Proprietary and Confidential
  10. 10. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>Who cares about crime data? </li></ul></ul>Yahoo!7 Proprietary and Confidential
  11. 11. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>Who cares about crime data? </li></ul></ul><ul><ul><li>What if you were buying a house? What would you want to know? </li></ul></ul>Yahoo!7 Proprietary and Confidential
  12. 12. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>Who cares about crime data? </li></ul></ul><ul><ul><li>What if you were buying a house? What would you want to know? </li></ul></ul><ul><ul><li>Agent tells you the crime rate is pretty reasonable for the area. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  13. 13. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>Who cares about crime data? </li></ul></ul><ul><ul><li>What if you were buying a house? What would you want to know? </li></ul></ul><ul><ul><li>Agent tells you the crime rate is pretty reasonable for the area. </li></ul></ul><ul><ul><li>Crime rate in your area is 500% higher than the national average, it just happens to be 20% lower than surrounding suburbs. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  14. 14. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>What about traffic information – congestion, etc. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  15. 15. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>What about traffic information – congestion, etc. </li></ul></ul><ul><ul><li>Valuable to urban planners, governments, etc. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  16. 16. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>How about height maps for suburbs using Lidar. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  17. 17. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>How about height maps for suburbs using Lidar. </li></ul></ul><ul><ul><li>Government uses height maps to audit air conditioning units on major buildings, to issue warnings about outbreaks of communicable diseases (such as Legionnaires) </li></ul></ul>Yahoo!7 Proprietary and Confidential
  18. 18. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>Google Earth, visual instrument used to deliver information to you, the consumer based on all the data they collect. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  19. 19. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>Google Earth, visual instrument used to deliver information to you, the consumer based on all the data they collect. </li></ul></ul><ul><ul><li>Government in US used Google Earth information, to bust people with illegal pools. </li></ul></ul>Yahoo!7 Proprietary and Confidential
  20. 20. Data as a commodity <ul><ul><li>Why is it so valuable? </li></ul></ul><ul><ul><li>Enrichment of existing data </li></ul></ul><ul><ul><li>Comparison, analysis and statistics </li></ul></ul><ul><ul><li>What else? </li></ul></ul><ul><ul><li>Google Earth, visual instrument used to deliver information to you, the consumer based on all the data they collect. </li></ul></ul><ul><ul><li>Government in US used Google Earth information, to bust people with illegal pools. http://news.cnet.com/8301-17852_3-20012396-71.html </li></ul></ul><ul><ul><li>Swiss police used it to bust dope farmers. http://www.independent.co.uk/news/world/europe/swiss-police-bust-dope-farmers-with-google-earth-1520772.html </li></ul></ul>Yahoo!7 Proprietary and Confidential
  21. 21. Making data useful Yahoo!7 Proprietary and Confidential
  22. 22. Being open <ul><ul><li>Owned data </li></ul></ul><ul><ul><li>Source of truth </li></ul></ul><ul><ul><li>Public interest </li></ul></ul><ul><ul><li>General hobbyists </li></ul></ul><ul><ul><li>Get enriched data back </li></ul></ul><ul><ul><li>Change the way you perceive your own data </li></ul></ul>Yahoo!7 Proprietary and Confidential
  23. 23. Data, Hacking and Mashups <ul><ul><li>Hacking isn’t quite what you think it is </li></ul></ul><ul><ul><li>Taking the data or information published by one organisation, making it more useful, changing it’s purpose or direction </li></ul></ul><ul><ul><li>Alter the delivery, same data, same information </li></ul></ul><ul><ul><li>Improve the experience </li></ul></ul><ul><ul><li>Change people’s perception of data </li></ul></ul>Yahoo!7 Proprietary and Confidential
  24. 24. Yahoo! data
  25. 25. Tools <ul><ul><li>Data, YQL </li></ul></ul>Yahoo!7 Proprietary and Confidential
  26. 26. Tools / YQL YQL Query: select * from music.artist.search where keyword=&quot;Madonna“ XML Response: “<Artist catzillaID=&quot;0&quot; flags=&quot;124611&quot; hotzillaID=&quot;1800038606&quot; id=&quot;256352&quot; name=&quot;Madonna&quot; rating=&quot;-1&quot; trackCount=&quot;2428&quot; url=&quot;http://new.music.yahoo.com/madonna/&quot; website=&quot;http://www.madonna.com/&quot;> <ItemInfo> <Relevancy index=&quot;727&quot;/> </ItemInfo> </Artist> “ YQL Query: select * from music.artist.similar where id=&quot;256352“ XML Response: “<Artist catzillaID=&quot;1927421443&quot; flags=&quot;124547&quot; hotzillaID=&quot;1804649855&quot; id=&quot;294026&quot; name=&quot;Anastacia&quot; rating=&quot;-1&quot; trackCount=&quot;714&quot; url=&quot;http://new.music.yahoo.com/anastacia/&quot; website=&quot;http://www.anastacia.com&quot;/> “ Yahoo!7 Proprietary and Confidential
  27. 27. Tools <ul><ul><li>Data, Pipes </li></ul></ul>Yahoo!7 Proprietary and Confidential
  28. 28. Data Sites <ul><ul><li>Facebook (developers.facebook.com) </li></ul></ul><ul><ul><li>Foursquare (foursquare.com/apps) </li></ul></ul><ul><ul><li>Twitter (dev.twitter.com) </li></ul></ul><ul><ul><li>Commonwealth of Australia (data.australia.gov.au) </li></ul></ul><ul><ul><li>New South Wales Govt (data.nsw.gov.au) </li></ul></ul><ul><ul><li>programmableweb.com </li></ul></ul>Yahoo!7 Proprietary and Confidential
  29. 29. Questions <ul><ul><li>Are there any? </li></ul></ul>Yahoo!7 Proprietary and Confidential

×