HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




 A year of
 public data, a
 view from
 within...
 Dr Chris Thorpe
 @jaggeree

...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


What are we doing in the open data space?

Well in March last year we launc...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And other parts, such as the politics API where we make the data we have av...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And people make lovely things out of this data such as this Voter Power Ind...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


We also have raw data. Either data our research team sources as part of the...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Which allow our network of developers and visualisers to make important jou...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


We also built a World Government Data store which has an API which allows d...
HTTP://WWW.FLICKR.COM/PHOTOS/
TOASTKID/




                                               Free our Data




A YEAR IN PUB...
HTTP://WWW.FLICKR.COM/PHOTOS/
TOASTKID/




                                               March 9th 2006




A YEAR IN PU...
HTTP://WWW.FLICKR.COM/PHOTOS/
PSD/




                                               March 7th 2009




A YEAR IN PUBLIC ...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


For those of you who don’t know, they’re an organisation all about getting ...
HTTP://WWW.FLICKR.COM/PHOTOS/
PSD/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


About 70 developers came together an...
HTTP://WWW.FLICKR.COM/PHOTOS/
NIGELPAINE/




                                  Data driven annecdotes




A YEAR IN PUBLI...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Tom Taylor created a KML file from data made available by Paul Clarke, then ...
HTTP://WWW.FLICKR.COM/PHOTOS/
PAUL_CLARKE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And this powerful example wa...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


The power of it is clear, over 13000 mentions of something that Tom made in...
HTTP://WWW.FLICKR.COM/PHOTOS/
PAUL_CLARKE/




                                               Fast prototypes




A YEAR I...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


For instance I made a faceted API for schools data in under 4 hours from a ...
HTTP://WWW.FLICKR.COM/PHOTOS/
BLACKBELTJONES/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And as we know, a few mon...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


The Cabinet Office asked The Guardian to convene a group of developers from...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Many things were made, I made something out of schools data.

There’s a pat...
HTTP://WWW.FLICKR.COM/PHOTOS/
SCRAPLAB/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Tom Taylor, Dan Catt and Gavin ...
HTTP://WWW.FLICKR.COM/PHOTOS/
SCRAPLAB/




                                          Data driven artefacts




A YEAR IN ...
HTTP://WWW.INFORMATIONISBEAUTIFUL
.NET/LEFTVRIGHT_US.HTML




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


 Then we had ...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




                                                 Left       Right

           ...
HTTP://WWW.FLICKR.COM/PHOTOS/
PLAXCOLAB/




              Public data is growth media for
              an ecosystem to f...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


For example at a recent Rewired...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


A game called The Bump Game whi...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And some of you may have seen the Asborometer, an iPhone app around how man...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Or my favourite counter point t...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


At the same event, I made an iPad app out of an API I’d made for the Govern...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




                                       This changes things...




A YEAR IN PU...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


The people interested in them a...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


And app stores such as the Chro...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


and even providing revenue for their developers
HTTP://WWW.FLICKR.COM/PHOTOS/
THOMASHAWK/




A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


I’d like to end with an examp...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


Such as all of these iPhone apps, many of them paid ones around BART data.
...
A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN...


as you can see here the top iPhone app for BART, iBartLive costs more than ...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




              We’re only at the dawn of it all...




A YEAR IN PUBLIC DATA, A...
HTTP://WWW.FLICKR.COM/PHOTOS/
JAGGEREE/




  Thank you
  Dr Chris Thorpe
  @jaggeree




A YEAR IN PUBLIC DATA, A VIEW FR...
Upcoming SlideShare
Loading in …5
×

A year in public data, a view from within...

4,545 views

Published on

Short talk on The Guardian and open/public data given by Chris Thorpe at the Gov2.0 Expo in Washington on the "Four perspectives of data.gov.uk" panel with Sir Tim Berners-Lee, John Sheridan and Dominic Campbell.

Published in: Technology

A year in public data, a view from within...

  1. 1. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A year of public data, a view from within... Dr Chris Thorpe @jaggeree A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... I wanted to tell you about a year in open data as viewed from within The Guardian
  2. 2. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... What are we doing in the open data space? Well in March last year we launched the Open Platform as a beta to developers And we just lauched it fully last week It has several parts, one in which developers can take the content of the newspaper as the raw material for building new businesses
  3. 3. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And other parts, such as the politics API where we make the data we have available free without limitations on use.
  4. 4. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And people make lovely things out of this data such as this Voter Power Index for the recent elections which lets you know how much your vote is worth based on marginality and constituency size
  5. 5. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... We also have raw data. Either data our research team sources as part of their work or they have provided to them.
  6. 6. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Which allow our network of developers and visualisers to make important journalistic visualisations like this one where David McCandless is visually disproving the link the British National Party always claims between their membership and areas of high ethnicity in the population.
  7. 7. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... We also built a World Government Data store which has an API which allows developers to search across all the world’s data catalogues
  8. 8. HTTP://WWW.FLICKR.COM/PHOTOS/ TOASTKID/ Free our Data A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... We have a history in public data, it’s not a new thing for us, this is Charles Arthur
  9. 9. HTTP://WWW.FLICKR.COM/PHOTOS/ TOASTKID/ March 9th 2006 A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... he’s campaigned for over four years for the UK’s geographical data to be made freely available
  10. 10. HTTP://WWW.FLICKR.COM/PHOTOS/ PSD/ March 7th 2009 A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... and almost three years to the day from his initial article we hosted the first National Hack the Government day with Rewired State
  11. 11. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... For those of you who don’t know, they’re an organisation all about getting developers to make prototypes which help government to rethink it’s relationship to data and websites, And they’d love to talk to people who want to do the same thing outside the UK
  12. 12. HTTP://WWW.FLICKR.COM/PHOTOS/ PSD/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... About 70 developers came together and made prototypes at the first Rewired State, there have now been many including one for young people under the age of 16
  13. 13. HTTP://WWW.FLICKR.COM/PHOTOS/ NIGELPAINE/ Data driven annecdotes A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Among the things that was made that day was one of the most important things in getting the UK public data released. Apart from Sir Tim himself. It kind of helps to have the founder of the web on the team.
  14. 14. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Tom Taylor created a KML file from data made available by Paul Clarke, then of Direct Gov. The Times then made this KML into a map
  15. 15. HTTP://WWW.FLICKR.COM/PHOTOS/ PAUL_CLARKE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And this powerful example was used as part of Sir Tim’s strong persuasive efforts.
  16. 16. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... The power of it is clear, over 13000 mentions of something that Tom made in well under a day
  17. 17. HTTP://WWW.FLICKR.COM/PHOTOS/ PAUL_CLARKE/ Fast prototypes A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... The other thing that came out of Rewired State were rapid prototypes that Whitehall staff found useful for beating down defenses about how long things would take.
  18. 18. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... For instance I made a faceted API for schools data in under 4 hours from a spreadsheet of schools data.
  19. 19. HTTP://WWW.FLICKR.COM/PHOTOS/ BLACKBELTJONES/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And as we know, a few months later the UK government launched data.gov.uk Co-opting with permission Matt Jones’ exceptional image Get Excited and Make Things. A mantra for the last year and going forward.
  20. 20. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... The Cabinet Office asked The Guardian to convene a group of developers from our network for a few days of hacking and prototype making on the data in the preview to give some more examples to show the power of what had been released and to get more.
  21. 21. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Many things were made, I made something out of schools data. There’s a pattern here, I have a 3 year old son and many of the government sites about schools are terrible and not user centric. I’d like to fix that and public data enables that fixing. This allows you to see the quality of schools around your location simply and clearly.
  22. 22. HTTP://WWW.FLICKR.COM/PHOTOS/ SCRAPLAB/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Tom Taylor, Dan Catt and Gavin Bell made the exceptional postcode paper
  23. 23. HTTP://WWW.FLICKR.COM/PHOTOS/ SCRAPLAB/ Data driven artefacts A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... All about services around you, a copy of this paper was given to every cabinet minister and was influential in getting them to see the value of freeing the geographical data.
  24. 24. HTTP://WWW.INFORMATIONISBEAUTIFUL .NET/LEFTVRIGHT_US.HTML A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Then we had a change of government and there were worries that the data may dry up or the project stall.
  25. 25. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ Left Right Transparency/ Small government openness Keeping checks on “It’s our data” public sector spending Helping bring level Putting public services playing field in in private hands service quality to all Developing an innovation Public-private economy with many new partnerships business owners Equality in procurement Derive wealth and tax revenue Free market economy A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... But there are both left wing and right wing reasons for public data. And although I’m more left than right, for me personally, the generation of an app economy and new services built on data are more compelling than the oft touted transparency benefits
  26. 26. HTTP://WWW.FLICKR.COM/PHOTOS/ PLAXCOLAB/ Public data is growth media for an ecosystem to form A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Public data is the nutrient of a whole new eco system and allows new things to happen
  27. 27. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... For example at a recent Rewired State a team of us made a brand new board game about filling the knowledge gap that exists in parents to be
  28. 28. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... A game called The Bump Game which includes cards which are about where you live and provide deep links into government services about the things you don’t know you need to know yet
  29. 29. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And some of you may have seen the Asborometer, an iPhone app around how many antisocial banning orders have been issued around you
  30. 30. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Or my favourite counter point to it Rupert Reddington’s wonderful Awesomeometer about the good and cultural things that surround you, made for the Rewired Culture event.
  31. 31. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... At the same event, I made an iPad app out of an API I’d made for the Government Art Collection. It was made as a straw man to get them to provide creative commonsed high resolution images of publicly owned art works... It’s working, they’re now starting to do it and I’ll have to finish the app sometime soon
  32. 32. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ This changes things... A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... There are things emerging that will change the public participation space we inhabit around public data. I’m not mad enough to believe everyone will own an iPad, but I also don’t think they and the devices that will follow them are for us geeks.
  33. 33. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... The people interested in them are not your average Apple fans, they’re older... iPads are a herald of the era of a simple computer for people who don’t want a computer. They’re inclusion devices and we need to think of what they’ll do to public service provision.
  34. 34. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... And app stores such as the Chrome Web App store announced at Google I/O could be used as a way of disseminating apps made on public data
  35. 35. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... and even providing revenue for their developers
  36. 36. HTTP://WWW.FLICKR.COM/PHOTOS/ THOMASHAWK/ A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... I’d like to end with an example of where this is beginning to work and that’s BART in San Francisco and their real time data. Real time data is the next place for us to work on government to get it released. It’s key to building user centric apps which have a business model
  37. 37. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Such as all of these iPhone apps, many of them paid ones around BART data. The evolutionary pressure you see in app stores is often not a race to the bottom on price, but a race to the top on functionality and useablity...
  38. 38. A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... as you can see here the top iPhone app for BART, iBartLive costs more than the Simpson’s game.
  39. 39. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ We’re only at the dawn of it all... A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... We’re just getting started, but it’s my belief that public data can create new economies, improve procurement processes and through evolutionary pressure in the marketplace increase the useability and user centricity of applications that access government services... We owe it to the consumers of those services to provide an environment where they can get new and better access to them, mediated by the ingenuity of developers.
  40. 40. HTTP://WWW.FLICKR.COM/PHOTOS/ JAGGEREE/ Thank you Dr Chris Thorpe @jaggeree A YEAR IN PUBLIC DATA, A VIEW FROM WITHIN... Thank you

×