18. âData points are just
words, but when
connected with a squiggly
line they tell a storyâ
Christopher Brown, âMaking Sense of Squiggly Linesâ, 2011, ISBN 978-0-9832593-1-2
Taking this opportunity to explore some of the issues associated with whatever this thing called âdata journalismâ isâŚ
Iâm not a journalist, and donât have any form of journalism training. But I do have an interest in ICT, and from that have an interest in âcommunicationâ.
Letâs start with an easy(?!) question - what is journalism?
One way of answering that question is to list some of the functions, or attributed, associated with it â informing, educating, holding to account, watchdog function, campaigning, contextualising for a particular audience.
Sensemaking seems to me to be an important part of it⌠In part contextualisation, in part identifying the bits that make the difference, the bits that make it important, the bits that make it news that people need to knowâŚ
âŚand often with a particular audience in mind.
Critical judgement.
Second question: what is data? National statistics, sports results, polls, financial figures, health data, school league tables, etc etc.
Is a book data? Or a speech? What if I split a speech up into separate words, count the occurrence of each unique word and then display the result as a âtag cloudâ, or word frequency diagram.
One way of thinking about data is that it is a particular sort of source, or a source that can respond to a particular style of questioning in a particular way.
Another take on this is that many âdata sourcesâ are experts on a particular topic, experts that know a lot of a very particular class of facts.
One way of thinking about data is that it is a particular sort of source, or a source that can respond to a particular style of questioning in a particular way.
Another take on this is that many âdata sourcesâ are experts on a particular topic, experts that know a lot of a very particular class of facts.
So what is data journalism?
If I was to ask you, the members of a school of journalism, âis this or that news article âjournalismââ I imagine one response might, âwellâŚ. Itâs the output of a journalistic process.â
But if I point at a map with some markers on it and ask: âis this map âdata journalismâ, you might answer: yes. Or at least, thatâs what many of the early job ads for data journalists implied.
Sports journalism has sport as the topical contextual frame for some journalistic activity,
Political journalism has politics as the topical contextual frame for some journalistic activity,
Investigative journalism has a particular process as the contextual frame for some journalistic activity, a process that may be applied to particular topic areas.
So for data journalism does âdataâ relate to the topic or the process?
Where we focus on data outputs, then the implication is that the âtopicâ of data is the focus of the framing. But I think we need to reframe to consider the procedural role.
So as a starting point, letâs frame the idea that data journalism is a process related epithet that implies one of the key sources in a journalistic activity is âdataâ.
By focusing on this notion of data journalism as relating to process, we can then start to explore with a little bit more criticality what the practice of data journalism might involve that identifies it as such.
That is, how is practice influenced by the fact that it must engage with âdata as a sourceâ?
The inverted pyramid gives us one way of considering the data journalistic process, or at least identifying some of the steps involved in a data investigation.
But there are many other ways of conceptualising the process â for example, finding stories and telling storiesâŚ
When it comes to finding stories, do we:
want to find stories in a dataset we are provided with, or
use data to help draw out a story lead we have already been tipped off to?
Anscombeâs Quartet is a toy dataset that first appeared in a 1973 paper by statistician Francis Anscombe.
His paper â Graphs in Statistical Analysis â was based around the claim that âgraphs are essential to good statistical analysisâ.
But this is where we start to hit some stumbling blocks.
And a big stumbling block is one that is often denied in higher education, which is the provision of skills, as compared to âhigher level conceptual or academic understandingâ.
There is an old saw that we become better writers through reading more. But how much time do you invest in reading charts?
Really reading them?
I came across this beautifully titled book a few weeks ago - âMaking Sense of Squiggly Linesâ.
The blurb on the back summarises the situation well: âData points are just words, but when connected with a squiggly line they tell a storyâ.
In an ideal world, the process would be simple: have data, get story.
But itâs not that simple.
Itâs more likely that we need to engage with the dataset to try to tease the stories out of it, or facts and relationships from it that we can used to support the claims we make in a narration of some sort of story that is at least supported by the data, or contextualises it in a narrative way that is hopefully âtruthyâ.
One of the ways I like to work with data is to have a conversation with it â asking questions of it and then further questions based on the responses I get.
Sometimes it looks at first as if we have data in a form where we might be able to do something with it â then we realise it needs cleaning and reshaping.
For example, in this case we have percentage signs contaminating numbers, data organised in separate sections â but how do we get a âwell behavedâ view over data from all the wards â and different sorts of data: votes polled per candidate versus the size of the electorate in a particular ward for example.
Walkthrough: http://blog.ouseful.info/2013/05/03/a-wrangling-example-with-openrefine-making-ready-data/
But this is where we start to hit some stumbling blocks.
And a big stumbling block is one that is often denied in higher education, which is the provision of skills, as compared to âhigher level conceptual or academic understandingâ.
Tidying data â or cleaning data â or more colloquially, âwrangling dataâ â refers to the process we need to engage in to turn a dataset we have found into one that is useable.
Many published datasets are horrible.
Really horrible.
They donât work as we might want or expect them to in the applications we tend to have to hand.
Take producing data visualisations, for example: have data, produce visualisation.
No.
Thatâs like saying: have two hours of rambling conversation with source, have 200 word story with strong quotes.
No. Just: no.
It doesnât work like that.
Yes, there are powerful charting tools available BUT they require the data to be clean and tidy and to be in the right shape for the tool. But it typically isnât.
We have to wrangle it.
Now wrangling is a technical job, and arguably a job for technicians â higher apprentices of the journalistic world â not graduate journalists.
But I think out journalists are going to have to learn the equivalent of some machining in the mechanical world.
Just by the by, I didnât draw those block diagrams, I wrote them.
I âwroteâ these charts â you can see how at the top. That code â applied to a suitably shaped version of a dataset known as Anscombeâs Quartet.
The data has been reshaped to 3 column format: a column for the x values, that are plotted on the horizontal x-axes; a column for the y values, that form the vertical y-axes; and a column for the groups, which specify which panel, or facet, each point should be plotted in.
The code defines the construction of those charts. Exactly. There is no magic. At least, no other magic.
One of the first datasets I played with was MPsâ expenses data. Here are a couple of ways I started to chat with it â imagine talking to someone whop knows about *all* the expenses claims put in by every MP over a parliamentary session⌠(The charts were created using an online interactive tool developed by IBM called Many Eyes.)
The bar chart Is ordered, for a particular expenses area, by total amount for each individual MP.
The block histogram shows how many MPs made a total claim in particular expenses area of a particular binned value. (A âbinâ is a range.)
Critical judgement â it applies to data too...
One of the things to mention about mapping data mapping and visualisation techniques is that they often tells us things we already (think we) know; in that sense, they are not news. But they may also tell us things we know in new, visually appealing ways. And by making use of such âconfirmatoryâ visualisations and displays we can build confidence within an audience that they know how to interpret these sorts of representation.
As the audience becomes comfortable reading the charts and making sense of data, when there is something new or surprising in the data, the surprise manifests itself in the reading of the data or chart.
For journalists working with data, developing a sense of familiarity with how to interpret and read data when it is just confirming what you already know helps to refine your senses for spotting things that are odd, noteworthy, or newsworthy.
Taking a little bit of time each day to:
read charts as if they were stories;
look behind the data to find original sources, such as polls or data containing news releases, and then compare the original release with the way it is reported, paying particular attention to the points that are highlighted, and how the data is contextualised;
will help you develop some of the skills you will need if you want to be able to identify, develop and treat some of the stories that your specialist source that is data can provide you with, of only you askâŚ
A scatterplot is another very powerful sort of chart â we can plot two sorts of value against each other to see if there are any groups, or trends.
Some scatterplot tools allow you to size or colour nodes according to further dimensions. Colouring nodes by group (if sensible groups exist) can also help you see whether particular groups are clustered or group together in particular areas of the chart.
Maps can be used to pull out different sorts of relationships â for example, plotting markers in the centre of each MPâs ward coloured by the total value of travel expenses claim in a particular area, we can easily see whether or not an MP is claiming an amount significantly different to MPs in neighbouring wards. In this case â travel expenses â we might expect (at first glance at least) a homophilitic effect â folk a similar distance away from Westminster should presumably make similar sorts of travel claim? At second glance, we might then start to refine our questioning â does ward size (in terms of geographical area) or rurality have an effect? Does an MP travel to and from home more than neighbours (or perhaps claim more in terms of accommodation in London?)
Sometimes we need to provide quite a lot of explanation when it comes to making sense of even a simple data visualisation â âwhat am I supposed to be looking at?â
The other way of using data is to tell stories. But what does that even mean�
The other way of using data is to tell stories. But what does that even mean�
In passing, itâs worth mentioning that one thing statistics does is help provide context.
Is this number a big number in the greater scheme of things? Is this thing likely to happen by chance or is there a meaningful causal relationship between this thing and another thing?
The chart in the corner is a reminder about how surprising probabilities can be. The chart shows the probability (y-axis) that two people share a birthday (the number of people is given on the x-axis). The chart shows that if there are 23 or more people in a room, there is more than a 50/50 chance that two of them will share a birthday (that is, share the same birth day and month, though not necessarily same birth year).
How many people are in the room? If itâs more than 23 â I bet that at least two people share a birthday (at least in terms of day and month).
One of the first datasets I played with was MPsâ expenses data. Here are a couple of ways I started to chat with it â imagine talking to someone whop knows about *all* the expenses claims put in by every MP over a parliamentary session⌠(The charts were created using an online interactive tool developed by IBM called Many Eyes.)
The bar chart Is ordered, for a particular expenses area, by total amount for each individual MP.
The block histogram shows how many MPs made a total claim in particular expenses area of a particular binned value. (A âbinâ is a range.)
The other way of using data is to tell stories. But what does that even mean�