SlideShare a Scribd company logo
legislation.gov.uk
Jeni Tennison
http://www.jenitennison.com/blog/
@JeniT
Work of many
Overview
• UK Legislation
• Goals
• Architecture
• Expert Participation
• Lessons learned
UK Legislation
integration of two sites   OPSI and SLD
many types of legislation   from 1267 to modern day
Data sources
• as-enacted legislation (OPSI)
 • PDFs
 • pre-1988 OCR'd
 • post-1988 SGML/XML data sources

• revised legislation (SLD)
 • February 1991 "base date"
 • different XML format
semi-structured documents   headings, numbered provisions
new legislation   published every working day
versioning   amendments & extents
Goals
Usable
• user experience
 • oriented around personas of real users
 • clear provisos so you know what you're looking at

• reuser experience
 • variety of formats (HTML snippets, XML, RDF, PDF)
 • feeds for access

• integration between the two
Open
• open standards
 • non-proprietary formats

• open source
 • use open source technologies where appropriate
 • open source our code - https://github.com/legislation/legislation

• open licence
 • all available under Open Government Licence
RESTful
• URIs for everything
 • every item of legislation
 • every level within it
 • every version of them
 • every view of them
 • every format of them

• HTTP status codes / content negotiation
• typed link for every transition
Architecture
work
                                 /id/ukpga/1985/67



expression                           303 See Other

    /ukpga/1985/67/scotland                             /ukpga/1985/67/2001-04-01

                                  /ukpga/1985/67



manifestation                   Content-Location
    /ukpga/1985/67/data.xml                             /ukpga/1985/67/data.pdf

                              /ukpga/1985/67/data.htm




       information architecture                      FRBR model
work
                               /id/ukpga/1985/67/section/6



expression                             303 See Other

/ukpga/1985/67/section/6/scotland                    /ukpga/1985/67/section/6/2001-04-01

                                /ukpga/1985/67/section/6



manifestation                       Content-Location
/ukpga/1985/67/section/6/data.xml                       /ukpga/1985/67/section/6/data.pdf

                            /ukpga/1985/67/section/6/data.htm




          same for every fragment                     parts / chapters / sections
tables of contents   access at any level
timelines   access any point in time
custom XML format   crown legislation markup lang.
browsing and searching   views from Atom feeds
single source   multiple views
caching & delivery         CDN


          caching         cache


        static files    web server


   transformation     pipeline engine     XSLT & XSL-FO

storage & queries     XML database        XML & XQuery

          system architecture       native XML
caching & delivery     Akamai


          caching       Squid


        static files    Apache


   transformation      Orbeon           XSLT & XSL-FO

storage & queries     MarkLogic         XML & XQuery

          system architecture     native XML
Expert Participation
Data quality
• data is out of date
 • 100,000 unapplied effects
 • can apply 10,000/year; parliament makes 15,000

• help others help us (and themselves)
 • open source as a model
 • editorial team retains control & ensures quality
  • framing participant tasks
  • reviewing participant work
New requirements
• new types of information
 • effects & research
 • tasks & workflows
 • participants & permissions & messages

• new levels of interactivity
 • read/write platform
 • dynamic, native web interface
lingua franca                  application-native data


 HTML                           JSON
                                          concise
     hard to get wrong


single source format                  web-native data


    XML                            RDF
        flexible                graph model


     other formats are better      for other things
caching & delivery         CDN


          caching         cache


        static files    web server


   transformation     pipeline engine


documents XML database            triplestore     data

              new architecture      XML and RDF data
displays driven by RDF   transformed by XSLT
HTML                 JSON
      URIs
XML                  RDF

 URIs are the keys   weak, flexible links
Lessons learned
User and re-user focus
• integrated API and UIs
 • guarantees relevance
 • help re-users understand information
 • help developers debug

• URIs are key
 • addressability
 • sharability
 • understanding of underlying resource model
Agility
• native XML eases development
 • provides flexible access into documents
 • avoids data model mismatches

• native RDF eases development too!
 • ease of combining information from different sources
 • querying with SPARQL

• schema-free & extensible aids agility
Pitfalls
• performance
 • caching
 • batch processing

• proprietary software
 • rely on non-standard functions & tools
 • partition code
Summary
• complex documents
 • added value from having them on the web

• layered architecture
 • make the most of single-source publishing

• web standards
 • long-term flexibility

• if we can do it with legislation ...
Questions?

More Related Content

What's hot

Steam Learn: An introduction to Redis
Steam Learn: An introduction to RedisSteam Learn: An introduction to Redis
Steam Learn: An introduction to Redis
inovia
 
EKAW - Linked Data Publishing
EKAW - Linked Data PublishingEKAW - Linked Data Publishing
EKAW - Linked Data Publishing
Ruben Taelman
 
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant FormatELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
PretaLLOD
 
Apache Marmotta - Introduction
Apache Marmotta - IntroductionApache Marmotta - Introduction
Apache Marmotta - Introduction
Sebastian Schaffert
 
Clojure - Why does it matter?
Clojure - Why does it matter?Clojure - Why does it matter?
Clojure - Why does it matter?
Falko Riemenschneider
 
Xml databases
Xml databasesXml databases
Xml databases
Srinivasan R
 
DBTG MODEL
DBTG MODELDBTG MODEL
DBTG MODEL
Ramkrishna bhagat
 
Linked Media and Data Using Apache Marmotta
Linked Media and Data Using Apache MarmottaLinked Media and Data Using Apache Marmotta
Linked Media and Data Using Apache Marmotta
Sebastian Schaffert
 
Introduction to LDP in Apache Marmotta
Introduction to LDP in Apache MarmottaIntroduction to LDP in Apache Marmotta
Introduction to LDP in Apache Marmotta
Sergio Fernández
 
DBpedia Viewer - LDOW 2014
DBpedia Viewer - LDOW 2014DBpedia Viewer - LDOW 2014
DBpedia Viewer - LDOW 2014
Dimitris Kontokostas
 
Regal - a Repository for Electronic Documents and Bibliographic Data
Regal - a Repository for Electronic Documents and Bibliographic DataRegal - a Repository for Electronic Documents and Bibliographic Data
Regal - a Repository for Electronic Documents and Bibliographic DataFelix Ostrowski
 
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge BasesLOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
LOD2 Creating Knowledge out of Interlinked Data
 
Linked data tooling XML
Linked data tooling XMLLinked data tooling XML
Linked data tooling XML
FREMEProjectH2020
 
Enabling access to Linked Media with SPARQL-MM
Enabling access to Linked Media with SPARQL-MMEnabling access to Linked Media with SPARQL-MM
Enabling access to Linked Media with SPARQL-MM
Thomas Kurz
 
Linked Media Management with Apache Marmotta
Linked Media Management with Apache MarmottaLinked Media Management with Apache Marmotta
Linked Media Management with Apache Marmotta
Thomas Kurz
 
Change Tracking in Knowledge Organization Systems with skos-history
Change Tracking in Knowledge Organization Systems with skos-historyChange Tracking in Knowledge Organization Systems with skos-history
Change Tracking in Knowledge Organization Systems with skos-history
Joachim Neubert
 
CNU Computer Seminar SQL-ON-HADOOP
CNU Computer Seminar SQL-ON-HADOOPCNU Computer Seminar SQL-ON-HADOOP
CNU Computer Seminar SQL-ON-HADOOPHan-Wool Lee
 
Publishing RDF SKOS with microservices
Publishing RDF SKOS with microservicesPublishing RDF SKOS with microservices
Publishing RDF SKOS with microservices
Bart Hanssens
 
Fedora 4 Deep Dive
Fedora 4 Deep DiveFedora 4 Deep Dive
Fedora 4 Deep Dive
David Wilcox
 
Slides semantic web and Drupal 7 NYCCamp 2012
Slides semantic web and Drupal 7 NYCCamp 2012Slides semantic web and Drupal 7 NYCCamp 2012
Slides semantic web and Drupal 7 NYCCamp 2012scorlosquet
 

What's hot (20)

Steam Learn: An introduction to Redis
Steam Learn: An introduction to RedisSteam Learn: An introduction to Redis
Steam Learn: An introduction to Redis
 
EKAW - Linked Data Publishing
EKAW - Linked Data PublishingEKAW - Linked Data Publishing
EKAW - Linked Data Publishing
 
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant FormatELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
ELSE IF 2019: Porting the xEBR Taxonomy to a Linked Open Data compliant Format
 
Apache Marmotta - Introduction
Apache Marmotta - IntroductionApache Marmotta - Introduction
Apache Marmotta - Introduction
 
Clojure - Why does it matter?
Clojure - Why does it matter?Clojure - Why does it matter?
Clojure - Why does it matter?
 
Xml databases
Xml databasesXml databases
Xml databases
 
DBTG MODEL
DBTG MODELDBTG MODEL
DBTG MODEL
 
Linked Media and Data Using Apache Marmotta
Linked Media and Data Using Apache MarmottaLinked Media and Data Using Apache Marmotta
Linked Media and Data Using Apache Marmotta
 
Introduction to LDP in Apache Marmotta
Introduction to LDP in Apache MarmottaIntroduction to LDP in Apache Marmotta
Introduction to LDP in Apache Marmotta
 
DBpedia Viewer - LDOW 2014
DBpedia Viewer - LDOW 2014DBpedia Viewer - LDOW 2014
DBpedia Viewer - LDOW 2014
 
Regal - a Repository for Electronic Documents and Bibliographic Data
Regal - a Repository for Electronic Documents and Bibliographic DataRegal - a Repository for Electronic Documents and Bibliographic Data
Regal - a Repository for Electronic Documents and Bibliographic Data
 
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge BasesLOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
LOD2 Plenary Vienna 2012: WP2 - Storing and Querying Very Large Knowledge Bases
 
Linked data tooling XML
Linked data tooling XMLLinked data tooling XML
Linked data tooling XML
 
Enabling access to Linked Media with SPARQL-MM
Enabling access to Linked Media with SPARQL-MMEnabling access to Linked Media with SPARQL-MM
Enabling access to Linked Media with SPARQL-MM
 
Linked Media Management with Apache Marmotta
Linked Media Management with Apache MarmottaLinked Media Management with Apache Marmotta
Linked Media Management with Apache Marmotta
 
Change Tracking in Knowledge Organization Systems with skos-history
Change Tracking in Knowledge Organization Systems with skos-historyChange Tracking in Knowledge Organization Systems with skos-history
Change Tracking in Knowledge Organization Systems with skos-history
 
CNU Computer Seminar SQL-ON-HADOOP
CNU Computer Seminar SQL-ON-HADOOPCNU Computer Seminar SQL-ON-HADOOP
CNU Computer Seminar SQL-ON-HADOOP
 
Publishing RDF SKOS with microservices
Publishing RDF SKOS with microservicesPublishing RDF SKOS with microservices
Publishing RDF SKOS with microservices
 
Fedora 4 Deep Dive
Fedora 4 Deep DiveFedora 4 Deep Dive
Fedora 4 Deep Dive
 
Slides semantic web and Drupal 7 NYCCamp 2012
Slides semantic web and Drupal 7 NYCCamp 2012Slides semantic web and Drupal 7 NYCCamp 2012
Slides semantic web and Drupal 7 NYCCamp 2012
 

Viewers also liked

Obras de Antonio Berni
Obras de Antonio Berni Obras de Antonio Berni
Obras de Antonio Berni
Vale Garcia
 
Obras de antonio berni
Obras de antonio berniObras de antonio berni
Obras de antonio bernimolibes
 
Antonio Berni
Antonio BerniAntonio Berni
Antonio Berni
EveCapu
 
Open Data: A New tool for Government
Open Data: A New tool for GovernmentOpen Data: A New tool for Government
Open Data: A New tool for Government
Jeni Tennison
 
BCS Address Day - Open Addresses
BCS Address Day - Open AddressesBCS Address Day - Open Addresses
BCS Address Day - Open Addresses
Jeni Tennison
 
Open Data: Dreams to Reality
Open Data: Dreams to RealityOpen Data: Dreams to Reality
Open Data: Dreams to RealityJeni Tennison
 
How much faith should we have in data? - ODI Friday Lunchtime Lecture
How much faith should we have in data? - ODI Friday Lunchtime LectureHow much faith should we have in data? - ODI Friday Lunchtime Lecture
How much faith should we have in data? - ODI Friday Lunchtime Lecture
Jeni Tennison
 
Commercial value of open data
Commercial value of open dataCommercial value of open data
Commercial value of open dataJeni Tennison
 
Knowledge for Everyone
Knowledge for EveryoneKnowledge for Everyone
Knowledge for Everyone
Jeni Tennison
 
Obras de Lino Enea Spilimbergo
Obras de Lino Enea SpilimbergoObras de Lino Enea Spilimbergo
Obras de Lino Enea SpilimbergoVale Garcia
 
Antonio Berni Escuela 77
Antonio Berni Escuela 77Antonio Berni Escuela 77
Antonio Berni Escuela 77
bancosanluis
 
Antonio berni
Antonio berniAntonio berni
Antonio berni
betigranado
 
My ideal town - iVOX case study
My ideal town - iVOX case studyMy ideal town - iVOX case study
My ideal town - iVOX case study
iVOX
 
Antonio berni
Antonio berniAntonio berni
Antonio berni
susana veron
 
Geddes theory
Geddes theoryGeddes theory
Geddes theory
ishana shaheed
 
102 Planning Theory I
102 Planning Theory I102 Planning Theory I
102 Planning Theory ICoEP
 
Town planning
Town planningTown planning
Town planning
Ar.Muhammad Riyas
 
Rational planning and Sustainability
Rational planning and SustainabilityRational planning and Sustainability
Rational planning and Sustainability
CoEP
 
103 Planning Theory i
103 Planning Theory i103 Planning Theory i
103 Planning Theory i
CoEP
 

Viewers also liked (20)

Obras de Antonio Berni
Obras de Antonio Berni Obras de Antonio Berni
Obras de Antonio Berni
 
Obras de antonio berni
Obras de antonio berniObras de antonio berni
Obras de antonio berni
 
Antonio Berni
Antonio BerniAntonio Berni
Antonio Berni
 
Open Data: A New tool for Government
Open Data: A New tool for GovernmentOpen Data: A New tool for Government
Open Data: A New tool for Government
 
BCS Address Day - Open Addresses
BCS Address Day - Open AddressesBCS Address Day - Open Addresses
BCS Address Day - Open Addresses
 
Open Data: Dreams to Reality
Open Data: Dreams to RealityOpen Data: Dreams to Reality
Open Data: Dreams to Reality
 
How much faith should we have in data? - ODI Friday Lunchtime Lecture
How much faith should we have in data? - ODI Friday Lunchtime LectureHow much faith should we have in data? - ODI Friday Lunchtime Lecture
How much faith should we have in data? - ODI Friday Lunchtime Lecture
 
Commercial value of open data
Commercial value of open dataCommercial value of open data
Commercial value of open data
 
Knowledge for Everyone
Knowledge for EveryoneKnowledge for Everyone
Knowledge for Everyone
 
Obras de Lino Enea Spilimbergo
Obras de Lino Enea SpilimbergoObras de Lino Enea Spilimbergo
Obras de Lino Enea Spilimbergo
 
Antonio berni
Antonio berniAntonio berni
Antonio berni
 
Antonio Berni Escuela 77
Antonio Berni Escuela 77Antonio Berni Escuela 77
Antonio Berni Escuela 77
 
Antonio berni
Antonio berniAntonio berni
Antonio berni
 
My ideal town - iVOX case study
My ideal town - iVOX case studyMy ideal town - iVOX case study
My ideal town - iVOX case study
 
Antonio berni
Antonio berniAntonio berni
Antonio berni
 
Geddes theory
Geddes theoryGeddes theory
Geddes theory
 
102 Planning Theory I
102 Planning Theory I102 Planning Theory I
102 Planning Theory I
 
Town planning
Town planningTown planning
Town planning
 
Rational planning and Sustainability
Rational planning and SustainabilityRational planning and Sustainability
Rational planning and Sustainability
 
103 Planning Theory i
103 Planning Theory i103 Planning Theory i
103 Planning Theory i
 

Similar to Legislation.gov.uk

Data interchange integration, HTML XML Biological XML DTD
Data interchange integration, HTML XML Biological XML DTDData interchange integration, HTML XML Biological XML DTD
Data interchange integration, HTML XML Biological XML DTD
AnushaMahmood
 
How to Find a Needle in the Haystack
How to Find a Needle in the HaystackHow to Find a Needle in the Haystack
How to Find a Needle in the Haystack
Adrian Stevenson
 
Kafka & Hadoop in Rakuten
Kafka & Hadoop in RakutenKafka & Hadoop in Rakuten
Kafka & Hadoop in Rakuten
Rakuten Group, Inc.
 
Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)
Muhammad Shafiq
 
Application of Library Management Software: NewGenLib
Application of Library Management Software: NewGenLibApplication of Library Management Software: NewGenLib
Application of Library Management Software: NewGenLib
David Nzoputa Ofili
 
Nisha talagala keynote_inflow_2016
Nisha talagala keynote_inflow_2016Nisha talagala keynote_inflow_2016
Nisha talagala keynote_inflow_2016
Nisha Talagala
 
The Role of XML in an Information Society with Barry Schaeffer
The Role of XML in an Information Society with Barry SchaefferThe Role of XML in an Information Society with Barry Schaeffer
The Role of XML in an Information Society with Barry Schaeffer
dclsocialmedia
 
Apache Geode Meetup, London
Apache Geode Meetup, LondonApache Geode Meetup, London
Apache Geode Meetup, London
Apache Geode
 
IWMW 1998: Deploying new web technologies
IWMW 1998: Deploying new web technologiesIWMW 1998: Deploying new web technologies
IWMW 1998: Deploying new web technologies
IWMW
 
XML, XML Databases and MPEG-7
XML, XML Databases and MPEG-7XML, XML Databases and MPEG-7
XML, XML Databases and MPEG-7
Deniz Kılınç
 
8023.ppt
8023.ppt8023.ppt
8023.ppt
PoojaTripathi92
 
Apache Geode Meetup, Cork, Ireland at CIT
Apache Geode Meetup, Cork, Ireland at CITApache Geode Meetup, Cork, Ireland at CIT
Apache Geode Meetup, Cork, Ireland at CIT
Apache Geode
 
Introduction to Apache Geode (Cork, Ireland)
Introduction to Apache Geode (Cork, Ireland)Introduction to Apache Geode (Cork, Ireland)
Introduction to Apache Geode (Cork, Ireland)
Anthony Baker
 
Building bridges - Plone Conference 2015 Bucharest
Building bridges   - Plone Conference 2015 BucharestBuilding bridges   - Plone Conference 2015 Bucharest
Building bridges - Plone Conference 2015 Bucharest
Andreas Jung
 
Long and winding road - 2014
Long and winding road  - 2014Long and winding road  - 2014
Long and winding road - 2014
Connor McDonald
 
S. Bartoli & F. Pompermaier – A Semantic Big Data Companion
S. Bartoli & F. Pompermaier – A Semantic Big Data CompanionS. Bartoli & F. Pompermaier – A Semantic Big Data Companion
S. Bartoli & F. Pompermaier – A Semantic Big Data Companion
Flink Forward
 
Web Topics
Web TopicsWeb Topics
Web Topics
Praveen AP
 
Z39.50: Information Retrieval protocol ppt
Z39.50: Information Retrieval protocol pptZ39.50: Information Retrieval protocol ppt
Z39.50: Information Retrieval protocol ppt
SUNILKUMARSINGH
 
Thinking restfully
Thinking restfullyThinking restfully
Thinking restfully
Stelios Gorilas
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
Giorgos Santipantakis
 

Similar to Legislation.gov.uk (20)

Data interchange integration, HTML XML Biological XML DTD
Data interchange integration, HTML XML Biological XML DTDData interchange integration, HTML XML Biological XML DTD
Data interchange integration, HTML XML Biological XML DTD
 
How to Find a Needle in the Haystack
How to Find a Needle in the HaystackHow to Find a Needle in the Haystack
How to Find a Needle in the Haystack
 
Kafka & Hadoop in Rakuten
Kafka & Hadoop in RakutenKafka & Hadoop in Rakuten
Kafka & Hadoop in Rakuten
 
Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)Fyp presentation 2 (SQL Converter)
Fyp presentation 2 (SQL Converter)
 
Application of Library Management Software: NewGenLib
Application of Library Management Software: NewGenLibApplication of Library Management Software: NewGenLib
Application of Library Management Software: NewGenLib
 
Nisha talagala keynote_inflow_2016
Nisha talagala keynote_inflow_2016Nisha talagala keynote_inflow_2016
Nisha talagala keynote_inflow_2016
 
The Role of XML in an Information Society with Barry Schaeffer
The Role of XML in an Information Society with Barry SchaefferThe Role of XML in an Information Society with Barry Schaeffer
The Role of XML in an Information Society with Barry Schaeffer
 
Apache Geode Meetup, London
Apache Geode Meetup, LondonApache Geode Meetup, London
Apache Geode Meetup, London
 
IWMW 1998: Deploying new web technologies
IWMW 1998: Deploying new web technologiesIWMW 1998: Deploying new web technologies
IWMW 1998: Deploying new web technologies
 
XML, XML Databases and MPEG-7
XML, XML Databases and MPEG-7XML, XML Databases and MPEG-7
XML, XML Databases and MPEG-7
 
8023.ppt
8023.ppt8023.ppt
8023.ppt
 
Apache Geode Meetup, Cork, Ireland at CIT
Apache Geode Meetup, Cork, Ireland at CITApache Geode Meetup, Cork, Ireland at CIT
Apache Geode Meetup, Cork, Ireland at CIT
 
Introduction to Apache Geode (Cork, Ireland)
Introduction to Apache Geode (Cork, Ireland)Introduction to Apache Geode (Cork, Ireland)
Introduction to Apache Geode (Cork, Ireland)
 
Building bridges - Plone Conference 2015 Bucharest
Building bridges   - Plone Conference 2015 BucharestBuilding bridges   - Plone Conference 2015 Bucharest
Building bridges - Plone Conference 2015 Bucharest
 
Long and winding road - 2014
Long and winding road  - 2014Long and winding road  - 2014
Long and winding road - 2014
 
S. Bartoli & F. Pompermaier – A Semantic Big Data Companion
S. Bartoli & F. Pompermaier – A Semantic Big Data CompanionS. Bartoli & F. Pompermaier – A Semantic Big Data Companion
S. Bartoli & F. Pompermaier – A Semantic Big Data Companion
 
Web Topics
Web TopicsWeb Topics
Web Topics
 
Z39.50: Information Retrieval protocol ppt
Z39.50: Information Retrieval protocol pptZ39.50: Information Retrieval protocol ppt
Z39.50: Information Retrieval protocol ppt
 
Thinking restfully
Thinking restfullyThinking restfully
Thinking restfully
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
 

More from Jeni Tennison

The challenges of building a strong data infrastructure
The challenges of building a strong data infrastructureThe challenges of building a strong data infrastructure
The challenges of building a strong data infrastructure
Jeni Tennison
 
Why Everyone Needs an Open Data Strategy
Why Everyone Needs an Open Data StrategyWhy Everyone Needs an Open Data Strategy
Why Everyone Needs an Open Data StrategyJeni Tennison
 
Collisions, Chimera and Consonance in Web Content
Collisions, Chimera and Consonance in Web ContentCollisions, Chimera and Consonance in Web Content
Collisions, Chimera and Consonance in Web Content
Jeni Tennison
 
Data All the Way Down
Data All the Way DownData All the Way Down
Data All the Way Down
Jeni Tennison
 
Semantic Web and RDF: Can we reach escape velocity?
Semantic Web and RDF: Can we reach escape velocity?Semantic Web and RDF: Can we reach escape velocity?
Semantic Web and RDF: Can we reach escape velocity?Jeni Tennison
 
How the Web of Data Will be Won
How the Web of Data Will be WonHow the Web of Data Will be Won
How the Web of Data Will be Won
Jeni Tennison
 
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFaOpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
Jeni Tennison
 

More from Jeni Tennison (7)

The challenges of building a strong data infrastructure
The challenges of building a strong data infrastructureThe challenges of building a strong data infrastructure
The challenges of building a strong data infrastructure
 
Why Everyone Needs an Open Data Strategy
Why Everyone Needs an Open Data StrategyWhy Everyone Needs an Open Data Strategy
Why Everyone Needs an Open Data Strategy
 
Collisions, Chimera and Consonance in Web Content
Collisions, Chimera and Consonance in Web ContentCollisions, Chimera and Consonance in Web Content
Collisions, Chimera and Consonance in Web Content
 
Data All the Way Down
Data All the Way DownData All the Way Down
Data All the Way Down
 
Semantic Web and RDF: Can we reach escape velocity?
Semantic Web and RDF: Can we reach escape velocity?Semantic Web and RDF: Can we reach escape velocity?
Semantic Web and RDF: Can we reach escape velocity?
 
How the Web of Data Will be Won
How the Web of Data Will be WonHow the Web of Data Will be Won
How the Web of Data Will be Won
 
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFaOpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
OpenTech 2008: Power of Information - Rewiring the London Gazette with RDFa
 

Recently uploaded

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 

Recently uploaded (20)

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 

Legislation.gov.uk

  • 3. Overview • UK Legislation • Goals • Architecture • Expert Participation • Lessons learned
  • 5. integration of two sites OPSI and SLD
  • 6. many types of legislation from 1267 to modern day
  • 7. Data sources • as-enacted legislation (OPSI) • PDFs • pre-1988 OCR'd • post-1988 SGML/XML data sources • revised legislation (SLD) • February 1991 "base date" • different XML format
  • 8. semi-structured documents headings, numbered provisions
  • 9. new legislation published every working day
  • 10. versioning amendments & extents
  • 11. Goals
  • 12. Usable • user experience • oriented around personas of real users • clear provisos so you know what you're looking at • reuser experience • variety of formats (HTML snippets, XML, RDF, PDF) • feeds for access • integration between the two
  • 13. Open • open standards • non-proprietary formats • open source • use open source technologies where appropriate • open source our code - https://github.com/legislation/legislation • open licence • all available under Open Government Licence
  • 14. RESTful • URIs for everything • every item of legislation • every level within it • every version of them • every view of them • every format of them • HTTP status codes / content negotiation • typed link for every transition
  • 16. work /id/ukpga/1985/67 expression 303 See Other /ukpga/1985/67/scotland /ukpga/1985/67/2001-04-01 /ukpga/1985/67 manifestation Content-Location /ukpga/1985/67/data.xml /ukpga/1985/67/data.pdf /ukpga/1985/67/data.htm information architecture FRBR model
  • 17. work /id/ukpga/1985/67/section/6 expression 303 See Other /ukpga/1985/67/section/6/scotland /ukpga/1985/67/section/6/2001-04-01 /ukpga/1985/67/section/6 manifestation Content-Location /ukpga/1985/67/section/6/data.xml /ukpga/1985/67/section/6/data.pdf /ukpga/1985/67/section/6/data.htm same for every fragment parts / chapters / sections
  • 18. tables of contents access at any level
  • 19. timelines access any point in time
  • 20. custom XML format crown legislation markup lang.
  • 21. browsing and searching views from Atom feeds
  • 22. single source multiple views
  • 23. caching & delivery CDN caching cache static files web server transformation pipeline engine XSLT & XSL-FO storage & queries XML database XML & XQuery system architecture native XML
  • 24. caching & delivery Akamai caching Squid static files Apache transformation Orbeon XSLT & XSL-FO storage & queries MarkLogic XML & XQuery system architecture native XML
  • 26. Data quality • data is out of date • 100,000 unapplied effects • can apply 10,000/year; parliament makes 15,000 • help others help us (and themselves) • open source as a model • editorial team retains control & ensures quality • framing participant tasks • reviewing participant work
  • 27. New requirements • new types of information • effects & research • tasks & workflows • participants & permissions & messages • new levels of interactivity • read/write platform • dynamic, native web interface
  • 28. lingua franca application-native data HTML JSON concise hard to get wrong single source format web-native data XML RDF flexible graph model other formats are better for other things
  • 29. caching & delivery CDN caching cache static files web server transformation pipeline engine documents XML database triplestore data new architecture XML and RDF data
  • 30. displays driven by RDF transformed by XSLT
  • 31. HTML JSON URIs XML RDF URIs are the keys weak, flexible links
  • 33. User and re-user focus • integrated API and UIs • guarantees relevance • help re-users understand information • help developers debug • URIs are key • addressability • sharability • understanding of underlying resource model
  • 34. Agility • native XML eases development • provides flexible access into documents • avoids data model mismatches • native RDF eases development too! • ease of combining information from different sources • querying with SPARQL • schema-free & extensible aids agility
  • 35. Pitfalls • performance • caching • batch processing • proprietary software • rely on non-standard functions & tools • partition code
  • 36. Summary • complex documents • added value from having them on the web • layered architecture • make the most of single-source publishing • web standards • long-term flexibility • if we can do it with legislation ...

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n
  23. \n
  24. \n
  25. \n
  26. \n
  27. \n
  28. Each format has advantages, and so each looks at others advantages jealously:\nHTML's ubiquity\nXML's flexibility and ease of parsing\nRDF's reach to a real-world\nJSON's practicality\n\nOne result is ghettoisation: "you should not exist! you have no point! I am all that's needed!"\nAnother result is self-doubt: "what am I here for? what should I be?"\n
  29. \n
  30. \n
  31. URLs that address structures within formats help those formats to be used together. They can be used for their strengths, without being compromised.\n
  32. \n
  33. \n
  34. \n
  35. \n
  36. \n
  37. \n