Short talk on The Guardian and open/public data given by Chris Thorpe at the Gov2.0 Expo in Washington on the "Four perspectives of data.gov.uk" panel with Sir Tim Berners-Lee, John Sheridan and Dominic Campbell.
1. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A year of
public data, a
view from
within...
Dr Chris Thorpe
@jaggeree
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
I wanted to tell you about a year in open data as viewed from within The Guardian
2. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
What are we doing in the open data space?
Well in March last year we launched the Open Platform as a beta to developers
And we just lauched it fully last week
It has several parts, one in which developers can take the content of the newspaper as the
raw material for building new businesses
3. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
And other parts, such as the politics API where we make the data we have available free
without limitations on use.
4. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
And people make lovely things out of this data such as this Voter Power Index for the recent
elections which lets you know how much your vote is worth based on marginality and
constituency size
5. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
We also have raw data. Either data our research team sources as part of their work or they
have provided to them.
6. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Which allow our network of developers and visualisers to make important journalistic
visualisations like this one where David McCandless is visually disproving the link the British
National Party always claims between their membership and areas of high ethnicity in the
population.
7. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
We also built a World Government Data store which has an API which allows developers to
search across all the world’s data catalogues
8. HTTP://WWW.FLICKR.COM/PHOTOS/
TOASTKID/
Free our Data
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
We have a history in public data, it’s not a new thing for us, this is Charles Arthur
9. HTTP://WWW.FLICKR.COM/PHOTOS/
TOASTKID/
March 9th 2006
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
he’s campaigned for over four years for the UK’s geographical data to be made freely
available
10. HTTP://WWW.FLICKR.COM/PHOTOS/
PSD/
March 7th 2009
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
and almost three years to the day from his initial article we hosted the first National Hack the
Government day with Rewired State
11. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
For those of you who don’t know, they’re an organisation all about getting developers to
make prototypes which help government to rethink it’s relationship to data and websites,
And they’d love to talk to people who want to do the same thing outside the UK
12. HTTP://WWW.FLICKR.COM/PHOTOS/
PSD/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
About 70 developers came together and made prototypes at the first Rewired State, there
have now been many including one for young people under the age of 16
13. HTTP://WWW.FLICKR.COM/PHOTOS/
NIGELPAINE/
Data driven annecdotes
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Among the things that was made that day was one of the most important things in getting
the UK public data released.
Apart from Sir Tim himself. It kind of helps to have the founder of the web on the team.
14. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Tom Taylor created a KML file from data made available by Paul Clarke, then of Direct Gov.
The Times then made this KML into a map
16. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
The power of it is clear, over 13000 mentions of something that Tom made in well under a
day
17. HTTP://WWW.FLICKR.COM/PHOTOS/
PAUL_CLARKE/
Fast prototypes
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
The other thing that came out of Rewired State were rapid prototypes that Whitehall staff
found useful for beating down defenses about how long things would take.
18. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
For instance I made a faceted API for schools data in under 4 hours from a spreadsheet of
schools data.
19. HTTP://WWW.FLICKR.COM/PHOTOS/
BLACKBELTJONES/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
And as we know, a few months later the UK government launched data.gov.uk
Co-opting with permission Matt Jones’ exceptional image Get Excited and Make Things.
A mantra for the last year and going forward.
20. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
The Cabinet Office asked The Guardian to convene a group of developers from our network
for a few days of hacking and prototype making on the data in the preview to give some more
examples to show the power of what had been released and to get more.
21. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Many things were made, I made something out of schools data.
There’s a pattern here, I have a 3 year old son and many of the government sites about
schools are terrible and not user centric. I’d like to fix that and public data enables that
fixing.
This allows you to see the quality of schools around your location simply and clearly.
23. HTTP://WWW.FLICKR.COM/PHOTOS/
SCRAPLAB/
Data driven artefacts
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
All about services around you, a copy of this paper was given to every cabinet minister and
was influential in getting them to see the value of freeing the geographical data.
25. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
Left Right
Transparency/ Small government
openness
Keeping checks on
“It’s our data” public sector spending
Helping bring level Putting public services
playing field in in private hands
service quality to all
Developing an innovation
Public-private economy with many new
partnerships business owners
Equality in procurement Derive wealth
and tax revenue
Free market economy
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
But there are both left wing and right wing reasons for public data.
And although I’m more left than right, for me personally, the generation of an app economy
and new services built on data are more compelling than the oft touted transparency benefits
26. HTTP://WWW.FLICKR.COM/PHOTOS/
PLAXCOLAB/
Public data is growth media for
an ecosystem to form
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Public data is the nutrient of a whole new eco system and allows new things to happen
27. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
For example at a recent Rewired State a team of us made a brand new board game about
filling the knowledge gap that exists in parents to be
28. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
A game called The Bump Game which includes cards which are about where you live and
provide deep links into government services about the things you don’t know you need to
know yet
29. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
And some of you may have seen the Asborometer, an iPhone app around how many antisocial
banning orders have been issued around you
30. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Or my favourite counter point to it Rupert Reddington’s wonderful Awesomeometer about the
good and cultural things that surround you, made for the Rewired Culture event.
31. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
At the same event, I made an iPad app out of an API I’d made for the Government Art
Collection.
It was made as a straw man to get them to provide creative commonsed high resolution
images of publicly owned art works...
It’s working, they’re now starting to do it and I’ll have to finish the app sometime soon
32. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
This changes things...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
There are things emerging that will change the public participation space we inhabit around
public data.
I’m not mad enough to believe everyone will own an iPad, but I also don’t think they and the
devices that will follow them are for us geeks.
33. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
The people interested in them are not your average Apple fans, they’re older...
iPads are a herald of the era of a simple computer for people who don’t want a computer.
They’re inclusion devices and we need to think of what they’ll do to public service provision.
34. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
And app stores such as the Chrome Web App store announced at Google I/O could be used
as a way of disseminating apps made on public data
35. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
and even providing revenue for their developers
36. HTTP://WWW.FLICKR.COM/PHOTOS/
THOMASHAWK/
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
I’d like to end with an example of where this is beginning to work and that’s BART in San
Francisco and their real time data.
Real time data is the next place for us to work on government to get it released.
It’s key to building user centric apps which have a business model
37. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
Such as all of these iPhone apps, many of them paid ones around BART data.
The evolutionary pressure you see in app stores is often not a race to the bottom on price,
but a race to the top on functionality and useablity...
38. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
as you can see here the top iPhone app for BART, iBartLive costs more than the Simpson’s
game.
39. HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/
We’re only at the dawn of it all...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...
We’re just getting started, but it’s my belief that public data can create new economies,
improve procurement processes and through evolutionary pressure in the marketplace
increase the useability and user centricity of applications that access government services...
We owe it to the consumers of those services to provide an environment where they can get
new and better access to them, mediated by the ingenuity of developers.