Data 2.0 - Harnessing New Data Visualization Tools CIL 2008


Published on

What happens when you combine data and Web 2.0?
Mountains of data are piling up in libraries and corporate intranets, but how do we say it visually and make data more useful? Fichter looks at new online tools that enable sharing, analysis, and data visualization to show trends, associations and new insights on your library website that quickly engage, inform, and empower your customers to create their own visualizations. Tools such as Many Eyes go beyond the data visualization and tap into the social dimension encouraging sharing, collaboration, and reuse. Fichter talks about what happens when data goes “social.” From visual dictionaries, textual analysis of works of fiction, to star size and nutritional components of Big Macs, hop on board for this fast-paced look at an amazing set of tools that are at your fingertips.

Published in: Technology, Education

Data 2.0 - Harnessing New Data Visualization Tools CIL 2008

  1. 1. Data Visualizations Darlene Fichter [email_address] April 8, 2008 Computers in Libraries 2008
  2. 2. Photo by Mark Witton , Creative Commons
  3. 3. Outline Data Visualization Library Opportunities Social + Data Tools
  4. 4. Web 1.0 <ul><li>Realm of folks that knew HTML coding </li></ul><ul><li>Creators: “geek” gene </li></ul>
  5. 5. Web 2.0 <ul><li>Everyone can participate </li></ul><ul><ul><li>Don’t need to know HTML </li></ul></ul><ul><ul><ul><li>Blog, wiki, .. </li></ul></ul></ul><ul><li>“Amateur” professionals </li></ul><ul><ul><li>Citizen journalists </li></ul></ul><ul><ul><li>Photographers </li></ul></ul><ul><ul><li>Cartographers </li></ul></ul><ul><ul><li>Question answer services </li></ul></ul>The rise of the amateur statistician.
  6. 6. New Stage: DIY Data <ul><li>< 5 minutes to set up data collection </li></ul><ul><li>< 5 minutes to build on tables to create data visualizatons: </li></ul><ul><ul><li>charts, graphs, maps, tag clouds </li></ul></ul><ul><ul><li>No longer the purvey a select few </li></ul></ul>
  7. 7. Power of Visualization <ul><li>Conveying information visually can open the hearts, minds and eyes </li></ul><ul><li>Understanding </li></ul>
  8. 8. What We Eat http:// -we-eat/ Germany: The Melander family of Bargteheide Food expenditure for one week : 375.39 Euros or $500.07
  9. 9. Bhutan: The Namgay family of Shingkhey Village Food expenditure for one week: 224.93 ngultrum or $5.03
  10. 10. “Tangible” Visualizations
  11. 11. Google My Maps <ul><li>Go to </li></ul><ul><li>Click on My Maps </li></ul><ul><li>Add pushpins plus notes to create a map </li></ul><ul><li>Embed the code in your library site </li></ul><ul><ul><li>Library branches </li></ul></ul><ul><ul><li>Historical buildings </li></ul></ul><ul><ul><li>Locations in stories </li></ul></ul>Easy to use of anyone
  12. 12. Web Site Structure Mapper <ul><li>Blue : links </li></ul><ul><li>Red tables </li></ul><ul><li>Green : div </li></ul><ul><li>Violet : images </li></ul><ul><li>Yellow : forms </li></ul><ul><li>Orange : breaks, paragraphs .. </li></ul><ul><li>Black : the <HTML> tag </li></ul><ul><li>Gray : all other tags </li></ul>
  13. 13. Little Contest Amazon Phoenix Public Library Wired Photo by Pascal Vuylsteker CC Attribution 2.5
  14. 14. Data Visualizations Explosion <ul><li>It’s a visual world </li></ul><ul><ul><li>Notice the growth of the use of rich information graphics and visualizations in newspapers and magazines </li></ul></ul><ul><li>Lots of opportunities and new tools popping up that help display data visually </li></ul>
  15. 15. Population Density of the USA
  16. 16. Newsmap USA Canada Both a mashup and data visualization. Compares news coverage across countries and cultures.
  17. 17. Data “Ecosystem” <ul><li>Open data </li></ul><ul><li>Open set of services & applications (APIs) </li></ul><ul><li>Us (creators, consumers) </li></ul>*API - set of routines for accessing an application or service
  18. 18. <ul><li>Open Content </li></ul>Web Charts, Graphs, Data Visualizations Applications
  19. 19. How “Free” is Data Troy Anderson’s from DataPlace – Google Tech Talk (13:23)
  20. 20. Advantages of “Social” Data <ul><li>Idealistic view </li></ul><ul><li>Cautiously optimistic </li></ul><ul><li>Skeptical </li></ul>
  21. 21. “Idealistic” Slide from: Bricolage: Data at Play Joe Hellerstein, UC Berkeley
  22. 22. Now - Future Slide from: Bricolage: Data at Play Joe Hellerstein, UC Berkeley
  23. 23. Idealistic <ul><li>“ Soon, on, you will be able to come join us in building the machine, or visualize, learn, and analyze our shared history, we hope for the betterment of the human condition. Sincerely, Timepedia's Staff” </li></ul>
  24. 24. Skeptical/Pessimistic <ul><li>Data Authority - garbage in, garbage out </li></ul><ul><ul><li>Deliberate misinformation, spam, errors </li></ul></ul><ul><li>Provenance </li></ul><ul><li>Privacy </li></ul><ul><ul><li>“ Identifying “banned books” readers or by mining Amazon Wishlists and combining information with Yahoo People … </li></ul></ul>
  25. 25. What Happens When <ul><li>You combine the people and data and Web 2.0 tools? </li></ul><ul><li>Less “going with what my gut says” </li></ul><ul><li>“ Workable ” data </li></ul><ul><li>Reproducible results </li></ul><ul><li>Borrow from others </li></ul><ul><li>Level the playing field </li></ul><ul><li>(corporations & communities) </li></ul><ul><li>Disseminate expertise </li></ul>Photo by . eti Creative Commons
  26. 26. Spontaneous Communities <ul><li>Conversations around collections of data </li></ul><ul><li>Example: flickr - High Dynamic Range photo </li></ul><ul><ul><li>HDR is two or more exposures </li></ul></ul><ul><ul><li>Comments, community, practices </li></ul></ul><ul><ul><li>Greater dynamic range of exposures </li></ul></ul>
  27. 27. Photo: The last sunray – Barcelona by Mor ( bcnbits ) licensed under Creative Commons
  28. 28. Look at Some Examples How to put pretty stuff in those drops. Tutorial below: Photo by Steve Took It Creative Commons
  29. 29. DataPlace™ <ul><li>Data and maps </li></ul><ul><li>Assemble your own geographies from neighborhood to nation </li></ul><ul><li>Connect. Discuss. Collaborate. </li></ul><ul><ul><li>Host Important Discussions Online </li></ul></ul><ul><ul><li>Share a Calendar </li></ul></ul><ul><ul><li>Save and Distribute Important Files </li></ul></ul><ul><ul><li>Share Uploaded Datasets </li></ul></ul>
  30. 31. Under the Hood <ul><li>Many activities to create “Free Harmonized Data to the People” </li></ul><ul><li>Take data that doesn’t crawl as well </li></ul><ul><li>Harmonize it </li></ul>
  31. 32. Riddle Troy Anderson’s from DataPlace – Google Tech Talk (34:00)
  32. 33. EveryBlock Civic information — building permits, crimes, … News articles and blog entries Web stuff – Craigslist, Yelp
  33. 34. Timepedia & Chronoscope <ul><li>Stories about our past </li></ul><ul><li>Chronoscope is a visualization platform under development for time series datasets. </li></ul><ul><ul><li>Their goal is create an experience of Google Maps or Google Earth to time series data </li></ul></ul> /chronoscope
  34. 35. TracknGraph <ul><li>Walking Tracker </li></ul><ul><li>Investment Tracker </li></ul><ul><li>Mood Tracker </li></ul><ul><li>Baby Sleep Schedule </li></ul><ul><li>Breastfeeding Tracker </li></ul><ul><li>Weight Tracker </li></ul><ul><li>Child Growth Tracker </li></ul><ul><li>Calorie Counter </li></ul><ul><li>Workout Tracker </li></ul><ul><li>Blood Pressure Monitor </li></ul>
  35. 36. Social Features <ul><li>Share </li></ul><ul><ul><li>Control access </li></ul></ul><ul><ul><li>Group updating </li></ul></ul><ul><ul><li>Publish anywhere </li></ul></ul><ul><li>Create team trackers </li></ul>
  36. 37. Tabular Data Search and Display <ul><li>Find tabular data and chart it </li></ul><ul><li>Upload tables </li></ul><ul><li>Going social end of 2008 </li></ul>Almost 3 million tables & 179 million graphs
  37. 38. Political Contributions by State
  38. 39. Freebase <ul><li>3.38 million topics </li></ul><ul><li>Facts and statistics </li></ul><ul><li>“built by the community and for the community—free for anyone to query, contribute to, built applications on top of, or integrate into their websites” </li></ul><ul><li>Creative Commons “attribution” license </li></ul>
  39. 41. Social Sites for Data Visualization <ul><li>Allows new kind of data analysis </li></ul><ul><li>Caters to the curious and serious, statistician and the citizen </li></ul><ul><li>Important new medium </li></ul>
  40. 42. Social Data Sites Photo by maqroll Slide: Tom Coates, Yahoo!
  41. 43. Social Data Tools Gapminder Swivel Many Eyes
  42. 44. Swivel
  43. 45. Swivel – Tasty Data Goodies Does bowling really burn the most calories?
  44. 46. Data Badge
  45. 47. Many Eyes from IBM Alphaworks
  46. 48. Why is the Sun Called a Dwarf Star?
  47. 49. Love – Analyzing Textual Works
  48. 50. Many Eyes <ul><li>1. View and discuss visualizations </li></ul><ul><li>2. View and discuss data sets </li></ul><ul><li>3. Create visualizations from existing data sets </li></ul><ul><li>If you register, you can also: </li></ul><ul><li>4. Rate data sets and visualizations </li></ul><ul><li>5. Upload your own data </li></ul><ul><li>6. Create and participate in topic hubs </li></ul><ul><li>7. Select items to watch </li></ul><ul><li>8. Track your contributions, watchlist, and topic hubs </li></ul><ul><li>9. See comments that others have written to you </li></ul>
  49. 51. Amazon API -shows relationships between movies, actors, directors ... **mashup and visualization**
  50. 52. Trendalyzer / Gapminder Video of Hans Rosling showing the gapminder software and lively animations of world development trends.
  51. 53. Like to Play with Code illustrator Howard V Brown  Photo: Radio Rover Creative Commons
  52. 54. Google Visualization API <ul><li>Uses the visualization techniques from Gapminder - motion charts </li></ul><ul><li>flashy 3D funnels </li></ul><ul><li>pyramids, pie & donuts </li></ul><ul><li>time series charts (stock prices) </li></ul><ul><li>data gauges </li></ul><ul><li>geographical heat maps </li></ul><ul><li>Gantt charts </li></ul>Supported in Google Docs Spreadsheets & some new Gadgets
  53. 55. Yahoo Charting API http://
  54. 56. More Tools <ul><li>Emprise JavaScript Charts </li></ul><ul><ul><li> </li></ul></ul><ul><li>PHP/SWF Charts </li></ul><ul><ul><li> </li></ul></ul>
  55. 57. Getting Started with Data Visualizations is Easy <ul><li>Step 1 – Get an idea </li></ul><ul><li>Step 2 – Create an account </li></ul><ul><li>Step 3 – Read the fine print about use </li></ul><ul><li>Step 4 – Create it! </li></ul><ul><li>API: Sign up for a developer token </li></ul><ul><ul><li> </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li> </li></ul></ul>
  56. 58. Three Ideas <ul><li>Chart a week </li></ul><ul><ul><li>DataPlace </li></ul></ul><ul><li>Google Maps </li></ul><ul><ul><li>Library, Historical Buildings etc. </li></ul></ul><ul><li>Frappr </li></ul><ul><ul><li>Pushpins to mark places in our town mentioned in fictional works </li></ul></ul>
  57. 59. Frappr Google API Community contributed content Easy to use of anyone
  58. 60. Thank you <ul><li>Darlene Fichter </li></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li> </li></ul></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.