Deirdre Lee
CEO, Derilinx
@deirdrelee
@derilinx
www.derilinx.com
Linked Open Statistical Data (LOSD)
Pipeline
ESSnet Linked Open Statistics
6th March 2019, Rome Hackathon
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
ESSNet Introduction
Eoin McCuirc, CSO Ireland
2
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline Introduction
Deirdre Lee, Derilinx
3
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline
A practical and complete LOSD pipeline for the
publishing of Statistical Data on the Semantic Web.
4
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Linked Data
http://5stardata.info/en/
Link your data to others
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOD Cloud
Year No. of Datasets
• 2007 28
• 2008 45
• 2009 95
• 2010 203
• 2011 295
• 2014 570
• 2017 1,163
• 2018 1,231
6
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Publishing Architecture
7
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Recommended LOSD
Publishing Platform
8
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pilots
9
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pilot datasets
• HC55 Census Data - Population data according to
NUTS3, sex and age
• Labour Force Survey (LFS) data
• Survey on Income and Living Conditions (SILC) data
• International Labour Office (ILO) Unemployment
Rate
10
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pilot datasets
• HC55 Census Data - Population data according to
NUTS3, sex and age
• Labour Force Survey (LFS) data
• Survey on Income and Living Conditions (SILC) data
• International Labour Office (ILO) Unemployment
Rate
11
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Training Platform
http://losd.staging.derilinx.com/moodle/
User: rome_hackaton Password: Hackaton-2019
12
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Use-Case 1
NSO Statisticians Publishing LOSD
13
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Use-Case 1
NSO Statisticians Publishing LOSD
14
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline: Data Cataloging
CKAN Frontend
Deirdre Lee, Derilinx
15
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
https://losd-data.staging.derilinx.com
16
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
DEMO
1. CKAN dataset page
2. Publish CSV and JSON-STAT dataset on data hub
3. Convert CSV resource to RDF
4. Convert JSON-STAT resource to RDF
5. Push RDF resource to RDF store
17
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline: LOSD Mapping
Juma
Alan Meehan, ADAPT
18
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
http://losd.staging.derilinx.com:8888/juma-editor/login
19
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
DEMO
1. Juma Login Page mapping Repository
2. Creation of a mapping viewing existing mappings
3. Example mapping for Italian ILO to RDF (data cube)
4. Mapping execution - viewing/downloading RDF
data
20
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Use-Case 2
General Public Users Accessing LOSD
21
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Use-Case 2
General Public Users Accessing LOSD
22
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline: Data Cataloging
CKAN Frontend
Deirdre Lee, Derilinx
23
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
https://losd-data.staging.derilinx.com
24
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
DEMO
1. Browse data on the portal
– Facets
– Keyword search
– Previews
– Metadata
25
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline: Data Visualisation
OLAP Browser & Cube Visualiser
Lukasz Porwol, Insight
26
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
http://losd.staging.derilinx.com:8084/
27
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
OLAP BROWSER DEMO
1. Selecting Datasets
2. Defining Dimensions
3. Using Filters
4. Results Analysis
28
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
29
http://losd.staging.derilinx.com:8083/
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
CUBE VISUALISER DEMO
1. Selecting Datasets
2. Defining Dimensions
3. Defining Filters
4. Visualisation Type Selection
5. Results Preview
30
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Use-Case 3
NSO Collaboration with 3rd Party Partner
for Developing Added-Value Services
31
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
32
Use-Case 3
NSO Collaboration with 3rd Party Partner
for Developing Added-Value Services
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
LOSD Pipeline: Data Access
CKAN API, SPARQL Endpoint, Juma API
Alan Meehan, ADAPT
33
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
http://losd.staging.derilinx.com:8890/sparql
34
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
DEMO
1. Access to data via manual SPARQL query
1. Access to data via SPARQL API
1. Data conversion using the Juma API
35
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
https://losd-dataviz.staging.derilinx.com/
36
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
DEMO
1. Browse viz and graphs that pulls data from virtuoso
using the SPARQL query Alan described previously
37
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66
Assessment Form
https://bit.ly/2C9xS7v
Deirdre Lee
CEO, Derilinx
@deirdrelee
@derilinx
www.derilinx.com
Linked Open Statistical Data (LOSD)
Pipeline
ESSnet Linked Open Statistics
6th March 2019, Rome Hackathon
This project has received funding from the ESSnet LOS
under Grant Agreement No 11101.2017.001-2017.66

Linked Open Statistical Data (LOSD) Pipeline

  • 1.
    Deirdre Lee CEO, Derilinx @deirdrelee @derilinx www.derilinx.com LinkedOpen Statistical Data (LOSD) Pipeline ESSnet Linked Open Statistics 6th March 2019, Rome Hackathon This project has received funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66
  • 2.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 ESSNet Introduction Eoin McCuirc, CSO Ireland 2
  • 3.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline Introduction Deirdre Lee, Derilinx 3
  • 4.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline A practical and complete LOSD pipeline for the publishing of Statistical Data on the Semantic Web. 4
  • 5.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Linked Data http://5stardata.info/en/ Link your data to others
  • 6.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOD Cloud Year No. of Datasets • 2007 28 • 2008 45 • 2009 95 • 2010 203 • 2011 295 • 2014 570 • 2017 1,163 • 2018 1,231 6
  • 7.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Publishing Architecture 7
  • 8.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Recommended LOSD Publishing Platform 8
  • 9.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pilots 9
  • 10.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pilot datasets • HC55 Census Data - Population data according to NUTS3, sex and age • Labour Force Survey (LFS) data • Survey on Income and Living Conditions (SILC) data • International Labour Office (ILO) Unemployment Rate 10
  • 11.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pilot datasets • HC55 Census Data - Population data according to NUTS3, sex and age • Labour Force Survey (LFS) data • Survey on Income and Living Conditions (SILC) data • International Labour Office (ILO) Unemployment Rate 11
  • 12.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Training Platform http://losd.staging.derilinx.com/moodle/ User: rome_hackaton Password: Hackaton-2019 12
  • 13.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Use-Case 1 NSO Statisticians Publishing LOSD 13
  • 14.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Use-Case 1 NSO Statisticians Publishing LOSD 14
  • 15.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline: Data Cataloging CKAN Frontend Deirdre Lee, Derilinx 15
  • 16.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 https://losd-data.staging.derilinx.com 16
  • 17.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 DEMO 1. CKAN dataset page 2. Publish CSV and JSON-STAT dataset on data hub 3. Convert CSV resource to RDF 4. Convert JSON-STAT resource to RDF 5. Push RDF resource to RDF store 17
  • 18.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline: LOSD Mapping Juma Alan Meehan, ADAPT 18
  • 19.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 http://losd.staging.derilinx.com:8888/juma-editor/login 19
  • 20.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 DEMO 1. Juma Login Page mapping Repository 2. Creation of a mapping viewing existing mappings 3. Example mapping for Italian ILO to RDF (data cube) 4. Mapping execution - viewing/downloading RDF data 20
  • 21.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Use-Case 2 General Public Users Accessing LOSD 21
  • 22.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Use-Case 2 General Public Users Accessing LOSD 22
  • 23.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline: Data Cataloging CKAN Frontend Deirdre Lee, Derilinx 23
  • 24.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 https://losd-data.staging.derilinx.com 24
  • 25.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 DEMO 1. Browse data on the portal – Facets – Keyword search – Previews – Metadata 25
  • 26.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline: Data Visualisation OLAP Browser & Cube Visualiser Lukasz Porwol, Insight 26
  • 27.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 http://losd.staging.derilinx.com:8084/ 27
  • 28.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 OLAP BROWSER DEMO 1. Selecting Datasets 2. Defining Dimensions 3. Using Filters 4. Results Analysis 28
  • 29.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 29 http://losd.staging.derilinx.com:8083/
  • 30.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 CUBE VISUALISER DEMO 1. Selecting Datasets 2. Defining Dimensions 3. Defining Filters 4. Visualisation Type Selection 5. Results Preview 30
  • 31.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Use-Case 3 NSO Collaboration with 3rd Party Partner for Developing Added-Value Services 31
  • 32.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 32 Use-Case 3 NSO Collaboration with 3rd Party Partner for Developing Added-Value Services
  • 33.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 LOSD Pipeline: Data Access CKAN API, SPARQL Endpoint, Juma API Alan Meehan, ADAPT 33
  • 34.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 http://losd.staging.derilinx.com:8890/sparql 34
  • 35.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 DEMO 1. Access to data via manual SPARQL query 1. Access to data via SPARQL API 1. Data conversion using the Juma API 35
  • 36.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 https://losd-dataviz.staging.derilinx.com/ 36
  • 37.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 DEMO 1. Browse viz and graphs that pulls data from virtuoso using the SPARQL query Alan described previously 37
  • 38.
    This project hasreceived funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66 Assessment Form https://bit.ly/2C9xS7v
  • 39.
    Deirdre Lee CEO, Derilinx @deirdrelee @derilinx www.derilinx.com LinkedOpen Statistical Data (LOSD) Pipeline ESSnet Linked Open Statistics 6th March 2019, Rome Hackathon This project has received funding from the ESSnet LOS under Grant Agreement No 11101.2017.001-2017.66