Ffctn hackons la-corruption

ETUDE DE CAS

VISUALISER DES
DONNÉES OUVERTES

Sébastien Pierre, FFunction inc.
@Hackons la Corruption., Novembre 2012

www.ffctn.com

© FFUNCTION INC, 2011 ffunction
inc.

INFOGRAPHIC : SE7EN SUMMITS

inc.

GOOGE DATAVIZ CHALLENGE 2010 (FINALIST)

inc.

NATIONAL GEOGRAPHIC SOCIETY'S PROJECTS

inc.

2008
Canadian Federal
Travel & Hospitality
Expenses

inc.

SOME THINGS HAVEN'T CHANGED SINCE 2008

➔
SCRAPING DATA
in the absence of open-data, journalists will
often be in the same context, having to spend
time to collect, explore and assess the quality of
the data.

inc.

SOME THINGS HAVEN'T CHANGED SINCE 2008

➔
FROM DATA TO STORY
Each dataset is a discovery, getting a
(compelling) story out of it is still a major
challenge.

inc.

THE DATA

inc.

As the result of a federal government directive*,
Travel and Hospitality Expenses have been
published on the web in Canada since 2004
* Called “proactive disclosure”

inc.

http://www.tbs-sct.gc.ca/pd-dp/gr-rg/index-eng.asp

inc.

Data is (still) not
directly accessible,
and hosted on each
specific ministry
website, in a
specific format.

inc.

inc.

ACCURACY PROBLEMS

NON-OPEN DATA DATA MAY BE MISSING

DATA NOT UP TO DATE

inc.

22Mb SQL file
scraped by citizens
(available on Github)

inc.

A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE...

inc.

BUILDING A TOOL TO EXPLORE THE DATA

inc.

Basic analysis of the data

inc.

Thinking about how to represent the data

inc.

Thinking about the flow of interaction

inc.

Importing and visualizing the data

inc.

Mapping out the different types of expenses (travel, hospitality & guidelines)

inc.

Simplifying the representation (expenses vs guidelines, over guidelines is in red)

inc.

Changing the focus (under/over guidelines instead of total spending)

inc.

Adding guides to improve reading the information

inc.

Adding filtering to narrow down to subsets of the data

inc.

Trying alternative representations on the data

inc.

Trying even more alternative representations on the data

inc.

THE RESULT
http://ffctn.com/a/expensevisualizer

inc.

I just found out the 5 top spending
Federal depts, check it out at
http://ur1.ca/a3spt

inc.

FINDINGS

1

inc.

Cumulative spending

TRENDS ONLY BECOME APPARENT
WITH THE PROPER MODE OF REPRESENTATION

Monthly spending
inc.

PROBLEMS IN THE DATA QUALITY
BECOME VISIBLE

inc.

THINGS YOU WOULD EXPECT
ARE NOT NECESSARILY THERE

Spending of ministers for all departments
inc.

DATA TO STORY: CHALLENGES

➔
NON-OPEN DATA
– Missing or incomplete data: is the problem in the
scraper or in the actual data?
– At least you now have a tool to assess (and improve)
the data quality

inc.


➔
NOT WHAT I THOUGHT
– You might expect something about the data,
but the visualization might prove your wrong
– You might have been looking for something specific
but you cannot see it in the visualization

See my “30 min of data visualization”
workshop for more on this...

inc.


➔
DID I TRY HARD ENOUGH?
– There's no secret: you'll find something interesting if
you explore your data enough.
– If everything fails, you can at least get fun facts or
controversial examples out of it.

inc.

HOSPITALITY EXPENSES SKYROCKET IN 2008 !!

inc.

INDUSTRY CANADA'S BIG SPENDER

2.5x
As much

MINISTER DIRECTOR

inc.

WAR IS COSTING CANADA AN ARM AND A LEG!

3 MILLIONS!
(over a period of five years)

inc.

THE BEST STORY IS:

WE NEED OPEN DATA!

THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE!

inc.

TOOLS

1

inc.

GOOGLE REFINE https://github.com/OpenRefine

inc.

DATA WRANGLER http://vis.stanford.edu/wrangler/

inc.

DATA WRAPPER http://datawrapper.de/

inc.

MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/

inc.

R17 http://www.rseventeen.com/

inc.

THANK
YOU!

sebastien@ffctn.com / @ffunction

WWW.FFCTN.COM

inc.

Ffctn hackons la-corruption

Recommended

Recommended

More Related Content

Similar to Ffctn hackons la-corruption

Similar to Ffctn hackons la-corruption (7)

More from montrealouvert

More from montrealouvert (20)

Ffctn hackons la-corruption