Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Ffctn hackons la-corruption

1,065 views

Published on

  • Be the first to comment

Ffctn hackons la-corruption

  1. 1. ETUDE DE CAS VISUALISER DESDONNÉES OUVERTES Sébastien Pierre, FFunction inc.@Hackons la Corruption., Novembre 2012 www.ffctn.com © FFUNCTION INC, 2011 ffunction inc.
  2. 2. INFOGRAPHIC : SE7EN SUMMITS © FFUNCTION INC, 2011 ffunction inc.
  3. 3. GOOGE DATAVIZ CHALLENGE 2010 (FINALIST) © FFUNCTION INC, 2011 ffunction inc.
  4. 4. NATIONAL GEOGRAPHIC SOCIETYS PROJECTS © FFUNCTION INC, 2011 ffunction inc.
  5. 5. 2008 Canadian FederalTravel & Hospitality Expenses © FFUNCTION INC, 2011 ffunction inc.
  6. 6. SOME THINGS HAVENT CHANGED SINCE 2008➔ SCRAPING DATA in the absence of open-data, journalists will often be in the same context, having to spend time to collect, explore and assess the quality of the data. © FFUNCTION INC, 2011 ffunction inc.
  7. 7. SOME THINGS HAVENT CHANGED SINCE 2008➔ FROM DATA TO STORY Each dataset is a discovery, getting a (compelling) story out of it is still a major challenge. © FFUNCTION INC, 2011 ffunction inc.
  8. 8. THE DATA© FFUNCTION INC, 2011 ffunction inc.
  9. 9. As the result of a federal government directive*, Travel and Hospitality Expenses have been published on the web in Canada since 2004 * Called “proactive disclosure” © FFUNCTION INC, 2011 ffunction inc.
  10. 10. http://www.tbs-sct.gc.ca/pd-dp/gr-rg/index-eng.asp© FFUNCTION INC, 2011 ffunction inc.
  11. 11. Data is (still) not directly accessible, and hosted on each specific ministry website, in a specific format.© FFUNCTION INC, 2011 ffunction inc.
  12. 12. © FFUNCTION INC, 2011 ffunction inc.
  13. 13. ACCURACY PROBLEMSNON-OPEN DATA DATA MAY BE MISSING DATA NOT UP TO DATE © FFUNCTION INC, 2011 ffunction inc.
  14. 14. 22Mb SQL file scraped by citizens(available on Github) © FFUNCTION INC, 2011 ffunction inc.
  15. 15. A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE... © FFUNCTION INC, 2011 ffunction inc.
  16. 16. BUILDING A TOOL TO EXPLORE THE DATA © FFUNCTION INC, 2011 ffunction inc.
  17. 17. Basic analysis of the data © FFUNCTION INC, 2011 ffunction inc.
  18. 18. Thinking about how to represent the data © FFUNCTION INC, 2011 ffunction inc.
  19. 19. Thinking about the flow of interaction © FFUNCTION INC, 2011 ffunction inc.
  20. 20. Importing and visualizing the data © FFUNCTION INC, 2011 ffunction inc.
  21. 21. Mapping out the different types of expenses (travel, hospitality & guidelines) © FFUNCTION INC, 2011 ffunction inc.
  22. 22. Simplifying the representation (expenses vs guidelines, over guidelines is in red) © FFUNCTION INC, 2011 ffunction inc.
  23. 23. Changing the focus (under/over guidelines instead of total spending) © FFUNCTION INC, 2011 ffunction inc.
  24. 24. Adding guides to improve reading the information © FFUNCTION INC, 2011 ffunction inc.
  25. 25. Adding filtering to narrow down to subsets of the data © FFUNCTION INC, 2011 ffunction inc.
  26. 26. Trying alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  27. 27. Trying even more alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  28. 28. THE RESULThttp://ffctn.com/a/expensevisualizer © FFUNCTION INC, 2011 ffunction inc.
  29. 29. © FFUNCTION INC, 2011 ffunction inc.
  30. 30. © FFUNCTION INC, 2011 ffunction inc.
  31. 31. I just found out the 5 top spendingFederal depts, check it out athttp://ur1.ca/a3spt © FFUNCTION INC, 2011 ffunction inc.
  32. 32. © FFUNCTION INC, 2011 ffunction inc.
  33. 33. © FFUNCTION INC, 2011 ffunction inc.
  34. 34. FINDINGS 1© FFUNCTION INC, 2011 ffunction inc.
  35. 35. Cumulative spending TRENDS ONLY BECOME APPARENTWITH THE PROPER MODE OF REPRESENTATION Monthly spending © FFUNCTION INC, 2011 ffunction inc.
  36. 36. PROBLEMS IN THE DATA QUALITY BECOME VISIBLE © FFUNCTION INC, 2011 ffunction inc.
  37. 37. THINGS YOU WOULD EXPECTARE NOT NECESSARILY THERE Spending of ministers for all departments © FFUNCTION INC, 2011 ffunction inc.
  38. 38. DATA TO STORY: CHALLENGES➔ NON-OPEN DATA – Missing or incomplete data: is the problem in the scraper or in the actual data? – At least you now have a tool to assess (and improve) the data quality © FFUNCTION INC, 2011 ffunction inc.
  39. 39. DATA TO STORY: CHALLENGES➔ NOT WHAT I THOUGHT – You might expect something about the data, but the visualization might prove your wrong – You might have been looking for something specific but you cannot see it in the visualization See my “30 min of data visualization” workshop for more on this... © FFUNCTION INC, 2011 ffunction inc.
  40. 40. DATA TO STORY: CHALLENGES➔ DID I TRY HARD ENOUGH? – Theres no secret: youll find something interesting if you explore your data enough. – If everything fails, you can at least get fun facts or controversial examples out of it. © FFUNCTION INC, 2011 ffunction inc.
  41. 41. HOSPITALITY EXPENSES SKYROCKET IN 2008 !! © FFUNCTION INC, 2011 ffunction inc.
  42. 42. INDUSTRY CANADAS BIG SPENDER 2.5x As muchMINISTER DIRECTOR © FFUNCTION INC, 2011 ffunction inc.
  43. 43. WAR IS COSTING CANADA AN ARM AND A LEG! 3 MILLIONS! (over a period of five years) © FFUNCTION INC, 2011 ffunction inc.
  44. 44. THE BEST STORY IS: WE NEED OPEN DATA!THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE! © FFUNCTION INC, 2011 ffunction inc.
  45. 45. TOOLS 1© FFUNCTION INC, 2011 ffunction inc.
  46. 46. GOOGLE REFINE https://github.com/OpenRefine © FFUNCTION INC, 2011 ffunction inc.
  47. 47. DATA WRANGLER http://vis.stanford.edu/wrangler/ © FFUNCTION INC, 2011 ffunction inc.
  48. 48. DATA WRAPPER http://datawrapper.de/ © FFUNCTION INC, 2011 ffunction inc.
  49. 49. MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/ © FFUNCTION INC, 2011 ffunction inc.
  50. 50. R17 http://www.rseventeen.com/ © FFUNCTION INC, 2011 ffunction inc.
  51. 51. THANK YOU!sebastien@ffctn.com / @ffunction WWW.FFCTN.COM © FFUNCTION INC, 2011 ffunction inc.

×