Data All the Way Down
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Data All the Way Down

on

  • 3,334 views

Presentation at OKCon 2011 on how to build web applications that provide complex data using a layered architecture.

Presentation at OKCon 2011 on how to build web applications that provide complex data using a layered architecture.

Statistics

Views

Total Views
3,334
Views on SlideShare
3,293
Embed Views
41

Actions

Likes
5
Downloads
25
Comments
0

5 Embeds 41

http://storify.com 33
http://paper.li 4
http://www.slideshare.net 2
http://a0.twimg.com 1
http://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Data All the Way Down Presentation Transcript

  • 1. Data All the Way DownJeni Tennison@JeniThttp://www.jenitennison.com/blog/
  • 2. Data All the Way Down• challenges of complex open data• layered approach to data publishing• essential steps• benefits
  • 3. Complex Datasets• too much for a single spreadsheet• need to navigate • browse through data • look at slices of larger dataset • view summary statistics• need to explain • definitions of terms, provisos & disclaimers
  • 4. User Challenge• complex data sets have range of users • different hardware / platforms • different tasks / goals • different ability / understanding• no one interface satisfies everyone• data owners cannot satisfy everyone• create ecosystem around open data
  • 5. visualisation / data gap end user vs reuser
  • 6. Visualisations• approachable for real people• necessary for stakeholder buy-in• beauty is in whats left out • advertisement or taster of rich datasets • often not possible in official data• leaves questions unanswered • what if we looked at the data in a different way?
  • 7. Raw Data• importable into own data store • often only interested in particular slice • data set may be massive / changing• run whatever analysis you want • requires at least some programming skills • analysis might not be appropriate for the data• documentation probably lacking
  • 8. bridging the gap layered data accessPhoto by Nikita Kravchuk http://www.flickr.com/photos/mi55er/3845619153/
  • 9. Layered Architecture• user interface • navigation and global understanding• API • curated, targeted, programmable access• query • free-form programmable access• raw data
  • 10. legislation.gov.uk lists as Atom feeds
  • 11. legislation.gov.uk content as XML
  • 12. legislation.gov.uk layer other views
  • 13. organograms navigable visualisation
  • 14. organograms JSON data
  • 15. organograms RDF / XML / HTML
  • 16. organograms SPARQL query
  • 17. organograms raw data
  • 18. Key Techniques• resource-driven design (good URIs)• every page built based on API calls• explicit links to API access • for bonus points, link to your transformation code• consistent terminology • clear mapping from UI to API• caching & access control at each level
  • 19. Benefits• fork at any point • dont like the visualisation / API? create your own!• everyone is human • reusers gain understanding from user interface• visualisation benefits the stack • API oriented towards achieving a goal • visual validation of data improves quality
  • 20. Questions?