Ffctn hackons la-corruption

  • 631 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
631
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
5
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. ETUDE DE CAS VISUALISER DESDONNÉES OUVERTES Sébastien Pierre, FFunction inc.@Hackons la Corruption., Novembre 2012 www.ffctn.com © FFUNCTION INC, 2011 ffunction inc.
  • 2. INFOGRAPHIC : SE7EN SUMMITS © FFUNCTION INC, 2011 ffunction inc.
  • 3. GOOGE DATAVIZ CHALLENGE 2010 (FINALIST) © FFUNCTION INC, 2011 ffunction inc.
  • 4. NATIONAL GEOGRAPHIC SOCIETYS PROJECTS © FFUNCTION INC, 2011 ffunction inc.
  • 5. 2008 Canadian FederalTravel & Hospitality Expenses © FFUNCTION INC, 2011 ffunction inc.
  • 6. SOME THINGS HAVENT CHANGED SINCE 2008➔ SCRAPING DATA in the absence of open-data, journalists will often be in the same context, having to spend time to collect, explore and assess the quality of the data. © FFUNCTION INC, 2011 ffunction inc.
  • 7. SOME THINGS HAVENT CHANGED SINCE 2008➔ FROM DATA TO STORY Each dataset is a discovery, getting a (compelling) story out of it is still a major challenge. © FFUNCTION INC, 2011 ffunction inc.
  • 8. THE DATA© FFUNCTION INC, 2011 ffunction inc.
  • 9. As the result of a federal government directive*, Travel and Hospitality Expenses have been published on the web in Canada since 2004 * Called “proactive disclosure” © FFUNCTION INC, 2011 ffunction inc.
  • 10. http://www.tbs-sct.gc.ca/pd-dp/gr-rg/index-eng.asp© FFUNCTION INC, 2011 ffunction inc.
  • 11. Data is (still) not directly accessible, and hosted on each specific ministry website, in a specific format.© FFUNCTION INC, 2011 ffunction inc.
  • 12. © FFUNCTION INC, 2011 ffunction inc.
  • 13. ACCURACY PROBLEMSNON-OPEN DATA DATA MAY BE MISSING DATA NOT UP TO DATE © FFUNCTION INC, 2011 ffunction inc.
  • 14. 22Mb SQL file scraped by citizens(available on Github) © FFUNCTION INC, 2011 ffunction inc.
  • 15. A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE... © FFUNCTION INC, 2011 ffunction inc.
  • 16. BUILDING A TOOL TO EXPLORE THE DATA © FFUNCTION INC, 2011 ffunction inc.
  • 17. Basic analysis of the data © FFUNCTION INC, 2011 ffunction inc.
  • 18. Thinking about how to represent the data © FFUNCTION INC, 2011 ffunction inc.
  • 19. Thinking about the flow of interaction © FFUNCTION INC, 2011 ffunction inc.
  • 20. Importing and visualizing the data © FFUNCTION INC, 2011 ffunction inc.
  • 21. Mapping out the different types of expenses (travel, hospitality & guidelines) © FFUNCTION INC, 2011 ffunction inc.
  • 22. Simplifying the representation (expenses vs guidelines, over guidelines is in red) © FFUNCTION INC, 2011 ffunction inc.
  • 23. Changing the focus (under/over guidelines instead of total spending) © FFUNCTION INC, 2011 ffunction inc.
  • 24. Adding guides to improve reading the information © FFUNCTION INC, 2011 ffunction inc.
  • 25. Adding filtering to narrow down to subsets of the data © FFUNCTION INC, 2011 ffunction inc.
  • 26. Trying alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  • 27. Trying even more alternative representations on the data © FFUNCTION INC, 2011 ffunction inc.
  • 28. THE RESULThttp://ffctn.com/a/expensevisualizer © FFUNCTION INC, 2011 ffunction inc.
  • 29. © FFUNCTION INC, 2011 ffunction inc.
  • 30. © FFUNCTION INC, 2011 ffunction inc.
  • 31. I just found out the 5 top spendingFederal depts, check it out athttp://ur1.ca/a3spt © FFUNCTION INC, 2011 ffunction inc.
  • 32. © FFUNCTION INC, 2011 ffunction inc.
  • 33. © FFUNCTION INC, 2011 ffunction inc.
  • 34. FINDINGS 1© FFUNCTION INC, 2011 ffunction inc.
  • 35. Cumulative spending TRENDS ONLY BECOME APPARENTWITH THE PROPER MODE OF REPRESENTATION Monthly spending © FFUNCTION INC, 2011 ffunction inc.
  • 36. PROBLEMS IN THE DATA QUALITY BECOME VISIBLE © FFUNCTION INC, 2011 ffunction inc.
  • 37. THINGS YOU WOULD EXPECTARE NOT NECESSARILY THERE Spending of ministers for all departments © FFUNCTION INC, 2011 ffunction inc.
  • 38. DATA TO STORY: CHALLENGES➔ NON-OPEN DATA – Missing or incomplete data: is the problem in the scraper or in the actual data? – At least you now have a tool to assess (and improve) the data quality © FFUNCTION INC, 2011 ffunction inc.
  • 39. DATA TO STORY: CHALLENGES➔ NOT WHAT I THOUGHT – You might expect something about the data, but the visualization might prove your wrong – You might have been looking for something specific but you cannot see it in the visualization See my “30 min of data visualization” workshop for more on this... © FFUNCTION INC, 2011 ffunction inc.
  • 40. DATA TO STORY: CHALLENGES➔ DID I TRY HARD ENOUGH? – Theres no secret: youll find something interesting if you explore your data enough. – If everything fails, you can at least get fun facts or controversial examples out of it. © FFUNCTION INC, 2011 ffunction inc.
  • 41. HOSPITALITY EXPENSES SKYROCKET IN 2008 !! © FFUNCTION INC, 2011 ffunction inc.
  • 42. INDUSTRY CANADAS BIG SPENDER 2.5x As muchMINISTER DIRECTOR © FFUNCTION INC, 2011 ffunction inc.
  • 43. WAR IS COSTING CANADA AN ARM AND A LEG! 3 MILLIONS! (over a period of five years) © FFUNCTION INC, 2011 ffunction inc.
  • 44. THE BEST STORY IS: WE NEED OPEN DATA!THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE! © FFUNCTION INC, 2011 ffunction inc.
  • 45. TOOLS 1© FFUNCTION INC, 2011 ffunction inc.
  • 46. GOOGLE REFINE https://github.com/OpenRefine © FFUNCTION INC, 2011 ffunction inc.
  • 47. DATA WRANGLER http://vis.stanford.edu/wrangler/ © FFUNCTION INC, 2011 ffunction inc.
  • 48. DATA WRAPPER http://datawrapper.de/ © FFUNCTION INC, 2011 ffunction inc.
  • 49. MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/ © FFUNCTION INC, 2011 ffunction inc.
  • 50. R17 http://www.rseventeen.com/ © FFUNCTION INC, 2011 ffunction inc.
  • 51. THANK YOU!sebastien@ffctn.com / @ffunction WWW.FFCTN.COM © FFUNCTION INC, 2011 ffunction inc.