Ffctn hackons la-corruption

991 views

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
991
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
6
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Ffctn hackons la-corruption

  1. 1. ETUDE DE CAS VISUALISER DESDONNÉES OUVERTES Sébastien Pierre, FFunction inc.@Hackons la Corruption., Novembre 2012 www.ffctn.com © FFUNCTION INC, 2011 ffunction inc.
  2. 2. INFOGRAPHIC : SE7EN SUMMITS © FFUNCTION INC, 2011 ffunction inc.
  3. 3. GOOGE DATAVIZ CHALLENGE 2010 (FINALIST) © FFUNCTION INC, 2011 ffunction inc.
  4. 4. NATIONAL GEOGRAPHIC SOCIETYS PROJECTS © FFUNCTION INC, 2011 ffunction inc.
  5. 5. 2008 Canadian FederalTravel & Hospitality Expenses © FFUNCTION INC, 2011 ffunction inc.
  6. 6. SOME THINGS HAVENT CHANGED SINCE 2008➔ SCRAPING DATA in the absence of open-data, journalists will often be in the same context, having to spend time to collect, explore and assess the quality of the data. © FFUNCTION INC, 2011 ffunction inc.
  7. 7. SOME THINGS HAVENT CHANGED SINCE 2008➔ FROM DATA TO STORY Each dataset is a discovery, getting a (compelling) story out of it is still a major challenge. © FFUNCTION INC, 2011 ffunction inc.
  8. 8. THE DATA© FFUNCTION INC, 2011 ffunction inc.
  9. 9. As the result of a federal government directive*, Travel and Hospitality Expenses have been published on the web in Canada since 2004 * Called “proactive disclosure” © FFUNCTION INC, 2011 ffunction inc.
  10. 10. http://www.tbs-sct.gc.ca/pd-dp/gr-rg/index-eng.asp© FFUNCTION INC, 2011 ffunction inc.
  11. 11. Data is (still) not directly accessible, and hosted on each specific ministry website, in a specific format.© FFUNCTION INC, 2011 ffunction inc.
  12. 12. © FFUNCTION INC, 2011 ffunction inc.
  13. 13. ACCURACY PROBLEMSNON-OPEN DATA DATA MAY BE MISSING DATA NOT UP TO DATE © FFUNCTION INC, 2011 ffunction inc.
  14. 14. 22Mb SQL file scraped by citizens(available on Github) © FFUNCTION INC, 2011 ffunction inc.
  15. 15. A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE... © FFUNCTION INC, 2011 ffunction inc.
  16. 16. BUILDING A TOOL TO EXPLORE THE DATA © FFUNCTION INC, 2011 ffunction inc.
  17. 17. Basic analysis of the data © FFUNCTION INC, 2011 ffunction inc.
  18. 18. Thinking about how to represent the data © FFUNCTION INC, 2011 ffunction inc.
  19. 19. Thinking about the flow of interaction © FFUNCTION INC, 2011 ffunction inc.
  20. 20. Importing and visualizing the data © FFUNCTION INC, 2011 ffunction inc.
  21. 21. Mapping out the different types of expenses (travel, hospitality & guidelines) © FFUNCTION INC, 2011 ffunction inc.
  22. 22. Simplifying the representation (expenses vs guidelines, over guidelines is in red) © FFUNCTION INC, 2011 ffunction inc.
  23. 23. Changing the focus (under/over guidelines instead of total spending) © FFUNCTION INC, 2011 ffunction inc.
  24. 24. Adding guides to improve reading the information © FFUNCTION INC, 2011 ffunction inc.
  25. 25. Adding filtering to narrow down to subsets of the data © FFUNCTION INC, 2011 ffunction inc.
  26. 26. Trying alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  27. 27. Trying even more alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  28. 28. THE RESULThttp://ffctn.com/a/expensevisualizer © FFUNCTION INC, 2011 ffunction inc.
  29. 29. © FFUNCTION INC, 2011 ffunction inc.
  30. 30. © FFUNCTION INC, 2011 ffunction inc.
  31. 31. I just found out the 5 top spendingFederal depts, check it out athttp://ur1.ca/a3spt © FFUNCTION INC, 2011 ffunction inc.
  32. 32. © FFUNCTION INC, 2011 ffunction inc.
  33. 33. © FFUNCTION INC, 2011 ffunction inc.
  34. 34. FINDINGS 1© FFUNCTION INC, 2011 ffunction inc.
  35. 35. Cumulative spending TRENDS ONLY BECOME APPARENTWITH THE PROPER MODE OF REPRESENTATION Monthly spending © FFUNCTION INC, 2011 ffunction inc.
  36. 36. PROBLEMS IN THE DATA QUALITY BECOME VISIBLE © FFUNCTION INC, 2011 ffunction inc.
  37. 37. THINGS YOU WOULD EXPECTARE NOT NECESSARILY THERE Spending of ministers for all departments © FFUNCTION INC, 2011 ffunction inc.
  38. 38. DATA TO STORY: CHALLENGES➔ NON-OPEN DATA – Missing or incomplete data: is the problem in the scraper or in the actual data? – At least you now have a tool to assess (and improve) the data quality © FFUNCTION INC, 2011 ffunction inc.
  39. 39. DATA TO STORY: CHALLENGES➔ NOT WHAT I THOUGHT – You might expect something about the data, but the visualization might prove your wrong – You might have been looking for something specific but you cannot see it in the visualization See my “30 min of data visualization” workshop for more on this... © FFUNCTION INC, 2011 ffunction inc.
  40. 40. DATA TO STORY: CHALLENGES➔ DID I TRY HARD ENOUGH? – Theres no secret: youll find something interesting if you explore your data enough. – If everything fails, you can at least get fun facts or controversial examples out of it. © FFUNCTION INC, 2011 ffunction inc.
  41. 41. HOSPITALITY EXPENSES SKYROCKET IN 2008 !! © FFUNCTION INC, 2011 ffunction inc.
  42. 42. INDUSTRY CANADAS BIG SPENDER 2.5x As muchMINISTER DIRECTOR © FFUNCTION INC, 2011 ffunction inc.
  43. 43. WAR IS COSTING CANADA AN ARM AND A LEG! 3 MILLIONS! (over a period of five years) © FFUNCTION INC, 2011 ffunction inc.
  44. 44. THE BEST STORY IS: WE NEED OPEN DATA!THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE! © FFUNCTION INC, 2011 ffunction inc.
  45. 45. TOOLS 1© FFUNCTION INC, 2011 ffunction inc.
  46. 46. GOOGLE REFINE https://github.com/OpenRefine © FFUNCTION INC, 2011 ffunction inc.
  47. 47. DATA WRANGLER http://vis.stanford.edu/wrangler/ © FFUNCTION INC, 2011 ffunction inc.
  48. 48. DATA WRAPPER http://datawrapper.de/ © FFUNCTION INC, 2011 ffunction inc.
  49. 49. MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/ © FFUNCTION INC, 2011 ffunction inc.
  50. 50. R17 http://www.rseventeen.com/ © FFUNCTION INC, 2011 ffunction inc.
  51. 51. THANK YOU!sebastien@ffctn.com / @ffunction WWW.FFCTN.COM © FFUNCTION INC, 2011 ffunction inc.

×