• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search, and Open Source - By Stephen  Dunn
 

Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search, and Open Source - By Stephen Dunn

on

  • 1,302 views

 

Statistics

Views

Total Views
1,302
Views on SlideShare
1,302
Embed Views
0

Actions

Likes
3
Downloads
22
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

     Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search, and Open Source - By Stephen  Dunn Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search, and Open Source - By Stephen Dunn Presentation Transcript

    • From publisher to platform: How the Guardian embraced the internet using content, search, and Open Source Stephen Dunn, Guardian News and Media stephen.dunn@guardian.co.uk, 25th May, 2011 Twitter: @cuica, @openplatformThursday, 26 May 2011
    • 1 From publisher to platform How the Guardian embraced the Internet using content, search, and Open Source Stephen Dunn, Guardian News and Media 2Thursday, 26 May 2011
    • The publishing era 3Thursday, 26 May 2011
    • We started a long time ago:Thursday, 26 May 2011
    • Keyword page Live blogs Apps Mobile site Twitter updates Swine flu Comment Content partnerships Newspapers Audio Video Open platform APIThursday, 26 May 2011
    • To secure the financial and editorial To secure the financial and editorial independence independence of the Guardian in perpetuity. To promote freedom in thein perpetuity of the Guardian press and liberal journalism globally. To promote freedom in the press and liberal To become the worlds leading liberal voice. journalism globallyThursday, 26 May 2011
    • Open Web Principles 7Thursday, 26 May 2011
    • 2009 8Thursday, 26 May 2011
    • 1. Permanent http://www.flickr.com/photos/fstorr/ • “A cool URI is one that does not change” Tim Berners-Lee 1998 • 1.5 million resources redirected to new scheme 9Thursday, 26 May 2011
    • 2. Addressable ★ Resources are “about” something - ready for the social web. ★ We live in “the age of point-at-things” (Coates 2005) 10Thursday, 26 May 2011
    • 3. Discoverable ★ Multiple routes to content ★ Tagging drives discovery 11Thursday, 26 May 2011
    • 4. Open 12Thursday, 26 May 2011
    • Example: The Hackable Guardian http:// www.guardian.co.uk/.... /technology/internet /rss /technology/all /rss /environment/climatechange +business/globaleconomy/rssThursday, 26 May 2011
    • Results... 14Thursday, 26 May 2011
    • Site traffic growth Final Release Unique Users 30,000,000 26,250,000 First release 22,500,000 Unique Users Pre - project 18,750,000 15,000,000 11,250,000 40M 7,500,000 3,750,000 Sep 2005 Oct 2006 Nov 2007 Dec 2008 15Thursday, 26 May 2011
    • However... 16Thursday, 26 May 2011
    • 1 Billion+ Internet Users! 17Thursday, 26 May 2011
    • 18Thursday, 26 May 2011
    • 19Thursday, 26 May 2011
    • 20Thursday, 26 May 2011
    • ...“How I stopped worrying about my website and learned to love the whole internet.” Matt McAlister 21Thursday, 26 May 2011
    • The Open Strategy OPEN IN OPEN OUT Bring in data and apps Enable partners to from the Internet build applications using Guardian content and services for other platforms 22Thursday, 26 May 2011
    • 23Thursday, 26 May 2011
    • "Our most interesting experiments lie in combining what we know with the experience, opinions and expertise of the people who want to participate rather than passively receive.” 24Thursday, 26 May 2011
    • 25Thursday, 26 May 2011
    • 26Thursday, 26 May 2011
    • 27Thursday, 26 May 2011
    • 28Thursday, 26 May 2011
    • 29Thursday, 26 May 2011
    • 30Thursday, 26 May 2011
    • 31Thursday, 26 May 2011
    • 32Thursday, 26 May 2011
    • 33Thursday, 26 May 2011
    • Jack Shenker “The Guardian alongside Al Jazeera was the one news source that everybody on the streets in Tahrir - not just in Cairo but in surrounding cities and major centers of revolutionary activity - that people were talking about.” 34Thursday, 26 May 2011
    • The Open Strategy OPEN IN OPEN OUT Bring in data and apps Enable partners to from the Internet build applications using Guardian content and services for other platforms 35 22Thursday, 26 May 2011
    • The Open Platform 36Thursday, 26 May 2011
    • The suite of services enabling partners to build applications with the Guardian 37Thursday, 26 May 2011
    • OPEN IN OPEN OUT Bring in data and apps Enable partners to from the Internet build applications using Guardian content and services for other platforms 38 22Thursday, 26 May 2011
    • CONTENT API DATA STORE POLITICS API A service for A directory of Open database selecting and useful data of candidates, collecting curated by voting records, content from Guardian constituencies, the Guardian editors election results, for re-use live data on election dayThursday, 26 May 2011
    • Mutualised news! 40Thursday, 26 May 2011
    • Mutualised news! 41Thursday, 26 May 2011
    • Mutualised news! 42Thursday, 26 May 2011
    • 43Thursday, 26 May 2011
    • 44Thursday, 26 May 2011
    • 45Thursday, 26 May 2011
    • 46Thursday, 26 May 2011
    • DATA STORE A directory of useful data curated by Guardian editorsThursday, 26 May 2011
    • POLITICS API Open database of candidates, voting records, constituencies, election results, live data on election dayThursday, 26 May 2011
    • POLITICS API Open database of candidates, voting records, constituencies, election results, live data on election day 49Thursday, 26 May 2011
    • <OBLIGATORY DOGFOOD SLIDE > 50Thursday, 26 May 2011
    • 51Thursday, 26 May 2011
    • Thursday, 26 May 2011
    • Thursday, 26 May 2011
    • Thursday, 26 May 2011
    • Thursday, 26 May 2011
    • Open for Business 56Thursday, 26 May 2011
    • 3 Tiers of access 3 Revenue models Keyless: Take our headlines. You keep associated revenues. Approved: Take our full article content, but with an advert. Guardian keeps ad revenue, you keep rest-of- page revenue. Bespoke: Take, reformat, augment our content Revenue model to be negotiated. Combination of Media, Fees, Downloads. 57Thursday, 26 May 2011
    • 58Thursday, 26 May 2011
    • What this means Open Out: Developers can now access full content APIs on demand with keys post-approved Platform is positioned as a place to do business So rapid scalability, reliability and performance are now core requirements 59Thursday, 26 May 2011
    • OPEN IN OPEN OUT Bring in data and Allow partners to apps from the build applications internet using Guardian content and services for other platformsThursday, 26 May 2011
    • Simple REST/HTTP MICROAPPS framework allows lightweight development A framework for integrating 3rd party Applications proxied for applications into performance guardian.co.uk Apps generally hosted in the cloud, allows hot deployment into production 61Thursday, 26 May 2011
    • MICROAPPS A framework for integrating 3rd party applications into guardian.co.uk 62Thursday, 26 May 2011
    • • What could I cook?Thursday, 26 May 2011
    • Bringing it together 64Thursday, 26 May 2011
    • 65Thursday, 26 May 2011
    • App showcase 66Thursday, 26 May 2011
    • From publisher to platform Seeking massive growth, but no longer only broadcasting content on the website User/partner engagement & contribution on Journalism data software applications revenue and ads Support developers and partners with data and APIs, need scalability, reliability, speed 67Thursday, 26 May 2011
    • Evolving the architecture 68Thursday, 26 May 2011
    • Web server Web server Web server App server App server App server Memcached (added later) Oracle CMSThursday, 26 May 2011
    • Web server Web server Web server Why RDBMS? App server App server App server 5 years ago, fewer alternatives Memcached Understand operations procedures Can easily recruit DBAs / devs Oracle Developer/ops tools Business critical system: a safe choice CMSThursday, 26 May 2011
    • Scaling traffic Unique Users 30,000,000 26,250,000 22,500,000 Unique Users 18,750,000 15,000,000 11,250,000 7,500,000 3,750,000 Sep 2005 Sep 2006 Sep 2007 Sep 2008 71Thursday, 26 May 2011
    • 72Thursday, 26 May 2011
    • 73Thursday, 26 May 2011
    • 74Thursday, 26 May 2011
    • 75Thursday, 26 May 2011
    • 76Thursday, 26 May 2011
    • 77Thursday, 26 May 2011
    • We chose Solr/Lucene Can perform complex queries, including full-text search We can change the schema with no downtime Most queries are of similar cost Scales very well horizontally “Just worked” in the cloud No strange control processes/engines Developers just loved working with it! 78Thursday, 26 May 2011
    • 79Thursday, 26 May 2011
    • Api Web servers Solr App server Solr Memcached Solr RDBMS Solr Solr Solr CMS Cloud, EC2 80Thursday, 26 May 2011
    • What about Open In? OPEN IN OPEN OUT Bring in data and apps Enable partners to from the Internet build applications using Guardian content and services for other platforms 81 22Thursday, 26 May 2011
    • Apps Web servers Proxy App App server App App Memcached App RDBMS App App CMS external hosting app engine etc 82Thursday, 26 May 2011
    • Core Out In Web servers Solr Proxy App App server App Solr Memcached App Solr App CMS Solr Solr App rdbms Solr Appexternal hosting Cloud, EC2app engine etc 83Thursday, 26 May 2011
    • 84Thursday, 26 May 2011
    • 85Thursday, 26 May 2011