SlideShare a Scribd company logo
LDVM implementation
Jiří Helmich, Jakub Klímek
Department of Software Engineering
Faculty of Mathematics and Physics
Charles University
Linked Data
u Tim Berners-Lee: The next web
u http://www.ted.com/talks/tim_berners_lee_on_the_next_web
u “I want you to put your data on the Web!”
u Web of data
u Use HTTP URIs to denote things so that these things can be
dereferenced by people and user agents.
u Provide useful information about the thing when its URI is
dereferenced
(RDF, SPARQL).
u Include links to other related things when publishing data
on the Web.
LDVM IMPLEMENTATION 2
Linked Open Data
LDVM IMPLEMENTATION 3
It’s often very hard to obtain any data, especially governmental. That’s the first star. The second one reminds me of
a way how public contracts were published in my hometown, Liberec – printed, scanned and the image placed into a
PDF file.
So, we have Linked Data…
LDVM IMPLEMENTATION 4
DBPedia is still the center of the Linked Data universe. You can see that the density of links is higher in its
neighbourhood. Anyway, it’s great to see a vast amount of Linked Data! But having it published is not enough…
… even Czech LOD cloud.
u since 2012
u CUNI
u CTU
u VŠE
u 600M triples
u + 600M triples – RUIAN
u OpenLink Virutoso 7
u http://linked.opendata.cz/sparql
LDVM IMPLEMENTATION 5
So, I published a vast amount
of data …
u What about getting something in return?
u Consuming data
u Presenting it in a standard way (charts, maps, …)
u Linked Data
u Integration with other datasets
u reasoning
LDVM IMPLEMENTATION 6
But it’s still hard to tell, whether you can use some dataset or directly combine it with yours. You don’t know, what a
node in LOD represents. You don’t know how to visualize it, how to use it. Even if those dataset are similar and cover
the same topic, they may use different schemas to describe those concepts (e.g. schema.org duplicates some
vocabularies). Reasoning is forgotten, not implemented by many tools.
… but!
u What’s in there?
u How can I use some dataset to enrich mine?
u Is it even compatible with my dataset?
u Can I use some of those to prepare a cool visualization
for my boss?
LDVM IMPLEMENTATION 7
Catalogues - CKAN
u A good way to start
u datahub.io: “finance”
u The Public Finances Databank is a compilation of published
data covering the main aspects of the Government Finances
including receipts, expenditure, borrowing and debt.
u linked.opendata.cz
u Too high-level
LDVM IMPLEMENTATION 8
Reality
LDVM IMPLEMENTATION 9
You start asking SPARQL queries. Top concepts, top queries. That’s the appropriate level, but …
Not very helpful.
LDVM IMPLEMENTATION 10
Visualizations
u Human is a visual being
u Best way how to involve people
u This is not visual:
LDVM IMPLEMENTATION 11
Basic LDVM use-case
u Show me, how I could VISUALIZE my data!
u Could I combine another datasets with mine?
LDVM IMPLEMENTATION 12
http://my.sparql.endpoint/
http://some.named.graph
DEMO
LDVM IMPLEMENTATION 13
https://goo.gl/r5Ln89
Linked Data Visualization
Model
LDVM IMPLEMENTATION 14
LDVM descripton, read e.g. http://events.linkeddata.org/ldow2014/papers/ldow2014_paper_13.pdf
LDVM pipeline
LDVM IMPLEMENTATION 15
RUIAN
OVM.ttl
Towns
extractor
RUIAN geocoder
Google
Maps
This is the pipeline you saw in our first demo. How is it possible that we are able to discover it automatically? Let’s
assume that the fragment ending with RUIAN geocoder was already assembled by our discovery algorithm.
LDVM compatibility check
LDVM IMPLEMENTATION 16
RUIAN geocoder
Google
Maps
[] ruianlink:obec <ex1>;
s:geo [
s:longitude "14.417780" ;
s:latitude "50.084552" .
] .
Output data sample
ASK {
?s s:geo ?g .
?g a s:GeoCoordinates ;
s:latitude ?lat ;
s:longitude ?lng .
}
Input descriptor
We use compatibility checking. Each output has an output data sample, sample RDF data that covers the possible
output as well as possible, being as small as possible. Each input has a set of descriptors, SPARQL ASK queries, that
describes an expected input. If descriptors match data samples, corresponding components are compatible and can be
chained into a visualization pipeline.
LDVM discovery
u Iterative process
u Chaining registered LDVM components
u Starts with pipeline fragments based on available data
sources
LDVM IMPLEMENTATION 17
Towns
extractor
Google
Maps
RUIAN geocoder
RUIAN OVM.ttl
LDVM discovery – before
iteration 1
LDVM IMPLEMENTATION 18
RUIAN OVM.ttl
Towns
extractor
Google
Maps
RUIAN geocoder
Pipeline fragments
Available components
LDVM discovery – iteration 1
LDVM IMPLEMENTATION 19
RUIAN OVM.ttl
Towns
extractor
Google
Maps
RUIAN geocoder
Towns
extractor
Google
Maps
RUIAN geocoder
For every input, every descriptor query is asked against every available datasource. If the datasource answers TRUE,
it’s possible for the component to use that datasource via one of its inputs. Original slides contains animation where
some inputs turn green and some red, based on compatibility checking.
LDVM discovery – after
iteration 1
LDVM IMPLEMENTATION 20
RUIAN OVM.ttl
Towns
extractor
Google
Maps
RUIAN
geocoder
Pipeline fragments
RUIAN RUIAN
RUIAN
geocoder
Fragments created in iteration one. Those ending with visualizers cannot be extended, those are no longer fragments,
those are complete pipelines. No. 2 and 4 are merged into a single fragment, of course. When no fragments are added
during an iteration, discovery terminates.
LDVM discovery – after
iteration 4
LDVM IMPLEMENTATION 21
RUIAN
OVM.ttl
Towns
extractor
RUIAN geocoder
Google
Maps
DEMO
LDVM IMPLEMENTATION 22
https://goo.gl/CEiZpR
LDVM features
LDVM IMPLEMENTATION 23
To display a marker on a map is just one of the visualizer`s features. It is also able to provide facets, display labels
and descriptions. Those features could be described formally by means of LDVM and assigned their own descriptors.
LDVM features
LDVM IMPLEMENTATION 24
?s s:geo ?g .
?g a s:GeoCoordinates ;
s:latitude ?lat ;
s:longitude ?lng .
?s s:geo ?g ;
?p ?o .
?o a skos:Concept
.
?o s:name ?n .
?o s:description ?d .
A dataset must contain some coordinates. If it does not, the maps visualizer is not a good candidate. Therefore that
feature is a mandatory one. Facets are generated using skos:Concept, but that’s an optional feature. The same holds
for labels and descriptions. Based on feature coverage, we will be able to rank both datasets and visualization
pipelines.
LDVM vocabulary
u Define your component or pipeline in RDF
u http://lov.okfn.org/dataset/lov/vocabs/ldvm
u https://github.com/payola/ldvm
LDVM IMPLEMENTATION 25
LDVMi
u http://ldvm.opendata.cz
u https://github.com/payola/LDVMi
LDVM IMPLEMENTATION 26
Running instance of our tool, formerly known as Payola. Currently supporting just our components. Work in progress
;-)
Examples
LDVM IMPLEMENTATION
27
Lates achievements. Note that the filtering is not enough in this case, we’ll have to introduce something more clever.
Examples
LDVM IMPLEMENTATION
28
Backstage: When a LOD guy tries to work with map projections. The black shape should be Slovakia.
Examples
LDVM IMPLEMENTATION
29
Fines issued by Czech Trading Inspection grouped by regions of the Czech Republic. You quickly see which companies
had to pay the biggest fines. No stress…
Advertisement
u http://vysledkykontrol.cz
LDVM IMPLEMENTATION 30
Examples
LDVM IMPLEMENTATION
31
The most advanced visualizer we currently have is the DataCube visualizer. Bosses love charts.
Available components
u Datasources
u Easy to create
u Analyzers
u Just SPARQL queries right now
u Transformers
u Easy to implement, SPARQL queries
u Hard to check compatibility
u Visualizers
u Google Maps, OpenLayers, Treemap, Sunburst, PackLayout,
DataCube
u Do your own!
u Even now, you can implement your own and extend our library.
LDVM IMPLEMENTATION 32
Thank you!
?LDVM IMPLEMENTATION 33

More Related Content

What's hot

R programming
R programmingR programming
R programming
Nandhini G
 
2 it unit-1 start learning r
2 it   unit-1 start learning r2 it   unit-1 start learning r
2 it unit-1 start learning r
Netaji Gandi
 
LSESU a Taste of R Language Workshop
LSESU a Taste of R Language WorkshopLSESU a Taste of R Language Workshop
LSESU a Taste of R Language Workshop
Korkrid Akepanidtaworn
 
The Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
The Statistics of Stairway to Heaven: A Semantic Story About Digital HumanitiesThe Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
The Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
Albert Meroño-Peñuela
 
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-M
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-MExecuting SPARQL Queries over Mapped Document Stores with SparqlMap-M
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-M
Linked Enterprise Date Services
 
R programming
R programmingR programming
R programming
Dr. Vaibhav Kumar
 
Modern PHP RDF toolkits: a comparative study
Modern PHP RDF toolkits: a comparative studyModern PHP RDF toolkits: a comparative study
Modern PHP RDF toolkits: a comparative study
Marius Butuc
 
R tutorial
R tutorialR tutorial
R tutorial
Richard Vidgen
 
SF Python Meetup: TextRank in Python
SF Python Meetup: TextRank in PythonSF Python Meetup: TextRank in Python
SF Python Meetup: TextRank in Python
Paco Nathan
 
How to get started with R programming
How to get started with R programmingHow to get started with R programming
How to get started with R programming
Ramon Salazar
 
swib15 ALIADA
swib15 ALIADAswib15 ALIADA
swib15 ALIADA
aliada project
 
Vocabulary for Linked Data Visualization Model - Dateso 2015
Vocabulary for Linked Data Visualization Model - Dateso 2015Vocabulary for Linked Data Visualization Model - Dateso 2015
Vocabulary for Linked Data Visualization Model - Dateso 2015
Jiří Helmich
 
R language tutorial
R language tutorialR language tutorial
R language tutorial
David Chiu
 
R programming
R programmingR programming
R programming
Shantanu Patil
 
R programming slides
R  programming slidesR  programming slides
R programming slides
Pankaj Saini
 
R Introduction
R IntroductionR Introduction
R Introductionschamber
 

What's hot (16)

R programming
R programmingR programming
R programming
 
2 it unit-1 start learning r
2 it   unit-1 start learning r2 it   unit-1 start learning r
2 it unit-1 start learning r
 
LSESU a Taste of R Language Workshop
LSESU a Taste of R Language WorkshopLSESU a Taste of R Language Workshop
LSESU a Taste of R Language Workshop
 
The Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
The Statistics of Stairway to Heaven: A Semantic Story About Digital HumanitiesThe Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
The Statistics of Stairway to Heaven: A Semantic Story About Digital Humanities
 
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-M
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-MExecuting SPARQL Queries over Mapped Document Stores with SparqlMap-M
Executing SPARQL Queries over Mapped Document Stores with SparqlMap-M
 
R programming
R programmingR programming
R programming
 
Modern PHP RDF toolkits: a comparative study
Modern PHP RDF toolkits: a comparative studyModern PHP RDF toolkits: a comparative study
Modern PHP RDF toolkits: a comparative study
 
R tutorial
R tutorialR tutorial
R tutorial
 
SF Python Meetup: TextRank in Python
SF Python Meetup: TextRank in PythonSF Python Meetup: TextRank in Python
SF Python Meetup: TextRank in Python
 
How to get started with R programming
How to get started with R programmingHow to get started with R programming
How to get started with R programming
 
swib15 ALIADA
swib15 ALIADAswib15 ALIADA
swib15 ALIADA
 
Vocabulary for Linked Data Visualization Model - Dateso 2015
Vocabulary for Linked Data Visualization Model - Dateso 2015Vocabulary for Linked Data Visualization Model - Dateso 2015
Vocabulary for Linked Data Visualization Model - Dateso 2015
 
R language tutorial
R language tutorialR language tutorial
R language tutorial
 
R programming
R programmingR programming
R programming
 
R programming slides
R  programming slidesR  programming slides
R programming slides
 
R Introduction
R IntroductionR Introduction
R Introduction
 

Similar to Linked Data Visualization Model - KEG VŠE

Payola ESWC 2014 demo poster
Payola ESWC 2014 demo posterPayola ESWC 2014 demo poster
Payola ESWC 2014 demo posterJiří Helmich
 
Tomas Knap: UnifiedViews in COMSODE pilot projects
Tomas Knap: UnifiedViews in COMSODE pilot projectsTomas Knap: UnifiedViews in COMSODE pilot projects
Tomas Knap: UnifiedViews in COMSODE pilot projects
Semantic Web Company
 
Standardizing for Open Data
Standardizing for Open DataStandardizing for Open Data
Standardizing for Open Data
Ivan Herman
 
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
Gezim Sejdiu
 
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
tomasknap
 
Linking Big Data to Rich Process Descriptions
Linking Big Data to Rich Process DescriptionsLinking Big Data to Rich Process Descriptions
Linking Big Data to Rich Process Descriptions
Christoph Lange
 
State of the Semantic Web
State of the Semantic WebState of the Semantic Web
State of the Semantic Web
Ivan Herman
 
Building Linked Data Applications
Building Linked Data ApplicationsBuilding Linked Data Applications
Building Linked Data Applications
EUCLID project
 
PDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
PDX Hadoop: Enterprise Data Workflows with Cascading and MesosPDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
PDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
Paco Nathan
 
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
Paco Nathan
 
Linked Data to Improve the OER Experience
Linked Data to Improve the OER ExperienceLinked Data to Improve the OER Experience
Linked Data to Improve the OER Experience
The Open Education Consortium
 
Wed roman tut_open_datapub
Wed roman tut_open_datapubWed roman tut_open_datapub
Wed roman tut_open_datapubeswcsummerschool
 
2011 07 14_fractalperspective
2011 07 14_fractalperspective2011 07 14_fractalperspective
2011 07 14_fractalperspectiveCurran Kelleher
 
Virtuoso -- The Prometheus of RDF
Virtuoso -- The Prometheus of RDFVirtuoso -- The Prometheus of RDF
Virtuoso -- The Prometheus of RDF
OpenLink Software
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
Giorgos Santipantakis
 
LD4KD 2015 - Demos and tools
LD4KD 2015 - Demos and toolsLD4KD 2015 - Demos and tools
LD4KD 2015 - Demos and tools
Vrije Universiteit Amsterdam
 
Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
 Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
Kingsley Uyi Idehen
 
20100614 ISWSA Keynote
20100614 ISWSA Keynote20100614 ISWSA Keynote
20100614 ISWSA Keynote
Axel Polleres
 
The LOD Gateway: Open Source Infrastructure for Linked Data
The LOD Gateway: Open Source Infrastructure for Linked DataThe LOD Gateway: Open Source Infrastructure for Linked Data
The LOD Gateway: Open Source Infrastructure for Linked Data
David Newbury
 

Similar to Linked Data Visualization Model - KEG VŠE (20)

Payola ESWC 2014 demo poster
Payola ESWC 2014 demo posterPayola ESWC 2014 demo poster
Payola ESWC 2014 demo poster
 
Tomas Knap: UnifiedViews in COMSODE pilot projects
Tomas Knap: UnifiedViews in COMSODE pilot projectsTomas Knap: UnifiedViews in COMSODE pilot projects
Tomas Knap: UnifiedViews in COMSODE pilot projects
 
Standardizing for Open Data
Standardizing for Open DataStandardizing for Open Data
Standardizing for Open Data
 
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
The Best of Both Worlds: Unlocking the Power of (big) Knowledge Graphs with S...
 
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
UnifiedViews: Towards ETL Tool for Simple yet Powerful RDF Data Management.
 
Linking Big Data to Rich Process Descriptions
Linking Big Data to Rich Process DescriptionsLinking Big Data to Rich Process Descriptions
Linking Big Data to Rich Process Descriptions
 
State of the Semantic Web
State of the Semantic WebState of the Semantic Web
State of the Semantic Web
 
Building Linked Data Applications
Building Linked Data ApplicationsBuilding Linked Data Applications
Building Linked Data Applications
 
Linked data and voyager
Linked data and voyagerLinked data and voyager
Linked data and voyager
 
PDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
PDX Hadoop: Enterprise Data Workflows with Cascading and MesosPDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
PDX Hadoop: Enterprise Data Workflows with Cascading and Mesos
 
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
July Clojure Users Group Meeting: "Using Cascalog with Palo Alto Open Data"
 
Linked Data to Improve the OER Experience
Linked Data to Improve the OER ExperienceLinked Data to Improve the OER Experience
Linked Data to Improve the OER Experience
 
Wed roman tut_open_datapub
Wed roman tut_open_datapubWed roman tut_open_datapub
Wed roman tut_open_datapub
 
2011 07 14_fractalperspective
2011 07 14_fractalperspective2011 07 14_fractalperspective
2011 07 14_fractalperspective
 
Virtuoso -- The Prometheus of RDF
Virtuoso -- The Prometheus of RDFVirtuoso -- The Prometheus of RDF
Virtuoso -- The Prometheus of RDF
 
RDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival dataRDF-Gen: Generating RDF from streaming and archival data
RDF-Gen: Generating RDF from streaming and archival data
 
LD4KD 2015 - Demos and tools
LD4KD 2015 - Demos and toolsLD4KD 2015 - Demos and tools
LD4KD 2015 - Demos and tools
 
Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
 Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
Virtuoso, The Prometheus of RDF -- Sematics 2014 Conference Keynote
 
20100614 ISWSA Keynote
20100614 ISWSA Keynote20100614 ISWSA Keynote
20100614 ISWSA Keynote
 
The LOD Gateway: Open Source Infrastructure for Linked Data
The LOD Gateway: Open Source Infrastructure for Linked DataThe LOD Gateway: Open Source Infrastructure for Linked Data
The LOD Gateway: Open Source Infrastructure for Linked Data
 

Recently uploaded

Enterprise Software Development with No Code Solutions.pptx
Enterprise Software Development with No Code Solutions.pptxEnterprise Software Development with No Code Solutions.pptx
Enterprise Software Development with No Code Solutions.pptx
QuickwayInfoSystems3
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Deuglo Infosystem Pvt Ltd
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Google
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
Paco van Beckhoven
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
Donna Lenk
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Mind IT Systems
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
Game Development with Unity3D (Game Development lecture 3)
Game Development  with Unity3D (Game Development lecture 3)Game Development  with Unity3D (Game Development lecture 3)
Game Development with Unity3D (Game Development lecture 3)
abdulrafaychaudhry
 
Nidhi Software Price. Fact , Costs, Tips
Nidhi Software Price. Fact , Costs, TipsNidhi Software Price. Fact , Costs, Tips
Nidhi Software Price. Fact , Costs, Tips
vrstrong314
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Globus
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Crescat
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 

Recently uploaded (20)

Enterprise Software Development with No Code Solutions.pptx
Enterprise Software Development with No Code Solutions.pptxEnterprise Software Development with No Code Solutions.pptx
Enterprise Software Development with No Code Solutions.pptx
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
Game Development with Unity3D (Game Development lecture 3)
Game Development  with Unity3D (Game Development lecture 3)Game Development  with Unity3D (Game Development lecture 3)
Game Development with Unity3D (Game Development lecture 3)
 
Nidhi Software Price. Fact , Costs, Tips
Nidhi Software Price. Fact , Costs, TipsNidhi Software Price. Fact , Costs, Tips
Nidhi Software Price. Fact , Costs, Tips
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 

Linked Data Visualization Model - KEG VŠE

  • 1. LDVM implementation Jiří Helmich, Jakub Klímek Department of Software Engineering Faculty of Mathematics and Physics Charles University
  • 2. Linked Data u Tim Berners-Lee: The next web u http://www.ted.com/talks/tim_berners_lee_on_the_next_web u “I want you to put your data on the Web!” u Web of data u Use HTTP URIs to denote things so that these things can be dereferenced by people and user agents. u Provide useful information about the thing when its URI is dereferenced (RDF, SPARQL). u Include links to other related things when publishing data on the Web. LDVM IMPLEMENTATION 2
  • 3. Linked Open Data LDVM IMPLEMENTATION 3 It’s often very hard to obtain any data, especially governmental. That’s the first star. The second one reminds me of a way how public contracts were published in my hometown, Liberec – printed, scanned and the image placed into a PDF file.
  • 4. So, we have Linked Data… LDVM IMPLEMENTATION 4 DBPedia is still the center of the Linked Data universe. You can see that the density of links is higher in its neighbourhood. Anyway, it’s great to see a vast amount of Linked Data! But having it published is not enough…
  • 5. … even Czech LOD cloud. u since 2012 u CUNI u CTU u VŠE u 600M triples u + 600M triples – RUIAN u OpenLink Virutoso 7 u http://linked.opendata.cz/sparql LDVM IMPLEMENTATION 5
  • 6. So, I published a vast amount of data … u What about getting something in return? u Consuming data u Presenting it in a standard way (charts, maps, …) u Linked Data u Integration with other datasets u reasoning LDVM IMPLEMENTATION 6 But it’s still hard to tell, whether you can use some dataset or directly combine it with yours. You don’t know, what a node in LOD represents. You don’t know how to visualize it, how to use it. Even if those dataset are similar and cover the same topic, they may use different schemas to describe those concepts (e.g. schema.org duplicates some vocabularies). Reasoning is forgotten, not implemented by many tools.
  • 7. … but! u What’s in there? u How can I use some dataset to enrich mine? u Is it even compatible with my dataset? u Can I use some of those to prepare a cool visualization for my boss? LDVM IMPLEMENTATION 7
  • 8. Catalogues - CKAN u A good way to start u datahub.io: “finance” u The Public Finances Databank is a compilation of published data covering the main aspects of the Government Finances including receipts, expenditure, borrowing and debt. u linked.opendata.cz u Too high-level LDVM IMPLEMENTATION 8
  • 9. Reality LDVM IMPLEMENTATION 9 You start asking SPARQL queries. Top concepts, top queries. That’s the appropriate level, but …
  • 10. Not very helpful. LDVM IMPLEMENTATION 10
  • 11. Visualizations u Human is a visual being u Best way how to involve people u This is not visual: LDVM IMPLEMENTATION 11
  • 12. Basic LDVM use-case u Show me, how I could VISUALIZE my data! u Could I combine another datasets with mine? LDVM IMPLEMENTATION 12 http://my.sparql.endpoint/ http://some.named.graph
  • 14. Linked Data Visualization Model LDVM IMPLEMENTATION 14 LDVM descripton, read e.g. http://events.linkeddata.org/ldow2014/papers/ldow2014_paper_13.pdf
  • 15. LDVM pipeline LDVM IMPLEMENTATION 15 RUIAN OVM.ttl Towns extractor RUIAN geocoder Google Maps This is the pipeline you saw in our first demo. How is it possible that we are able to discover it automatically? Let’s assume that the fragment ending with RUIAN geocoder was already assembled by our discovery algorithm.
  • 16. LDVM compatibility check LDVM IMPLEMENTATION 16 RUIAN geocoder Google Maps [] ruianlink:obec <ex1>; s:geo [ s:longitude "14.417780" ; s:latitude "50.084552" . ] . Output data sample ASK { ?s s:geo ?g . ?g a s:GeoCoordinates ; s:latitude ?lat ; s:longitude ?lng . } Input descriptor We use compatibility checking. Each output has an output data sample, sample RDF data that covers the possible output as well as possible, being as small as possible. Each input has a set of descriptors, SPARQL ASK queries, that describes an expected input. If descriptors match data samples, corresponding components are compatible and can be chained into a visualization pipeline.
  • 17. LDVM discovery u Iterative process u Chaining registered LDVM components u Starts with pipeline fragments based on available data sources LDVM IMPLEMENTATION 17 Towns extractor Google Maps RUIAN geocoder RUIAN OVM.ttl
  • 18. LDVM discovery – before iteration 1 LDVM IMPLEMENTATION 18 RUIAN OVM.ttl Towns extractor Google Maps RUIAN geocoder Pipeline fragments Available components
  • 19. LDVM discovery – iteration 1 LDVM IMPLEMENTATION 19 RUIAN OVM.ttl Towns extractor Google Maps RUIAN geocoder Towns extractor Google Maps RUIAN geocoder For every input, every descriptor query is asked against every available datasource. If the datasource answers TRUE, it’s possible for the component to use that datasource via one of its inputs. Original slides contains animation where some inputs turn green and some red, based on compatibility checking.
  • 20. LDVM discovery – after iteration 1 LDVM IMPLEMENTATION 20 RUIAN OVM.ttl Towns extractor Google Maps RUIAN geocoder Pipeline fragments RUIAN RUIAN RUIAN geocoder Fragments created in iteration one. Those ending with visualizers cannot be extended, those are no longer fragments, those are complete pipelines. No. 2 and 4 are merged into a single fragment, of course. When no fragments are added during an iteration, discovery terminates.
  • 21. LDVM discovery – after iteration 4 LDVM IMPLEMENTATION 21 RUIAN OVM.ttl Towns extractor RUIAN geocoder Google Maps
  • 23. LDVM features LDVM IMPLEMENTATION 23 To display a marker on a map is just one of the visualizer`s features. It is also able to provide facets, display labels and descriptions. Those features could be described formally by means of LDVM and assigned their own descriptors.
  • 24. LDVM features LDVM IMPLEMENTATION 24 ?s s:geo ?g . ?g a s:GeoCoordinates ; s:latitude ?lat ; s:longitude ?lng . ?s s:geo ?g ; ?p ?o . ?o a skos:Concept . ?o s:name ?n . ?o s:description ?d . A dataset must contain some coordinates. If it does not, the maps visualizer is not a good candidate. Therefore that feature is a mandatory one. Facets are generated using skos:Concept, but that’s an optional feature. The same holds for labels and descriptions. Based on feature coverage, we will be able to rank both datasets and visualization pipelines.
  • 25. LDVM vocabulary u Define your component or pipeline in RDF u http://lov.okfn.org/dataset/lov/vocabs/ldvm u https://github.com/payola/ldvm LDVM IMPLEMENTATION 25
  • 26. LDVMi u http://ldvm.opendata.cz u https://github.com/payola/LDVMi LDVM IMPLEMENTATION 26 Running instance of our tool, formerly known as Payola. Currently supporting just our components. Work in progress ;-)
  • 27. Examples LDVM IMPLEMENTATION 27 Lates achievements. Note that the filtering is not enough in this case, we’ll have to introduce something more clever.
  • 28. Examples LDVM IMPLEMENTATION 28 Backstage: When a LOD guy tries to work with map projections. The black shape should be Slovakia.
  • 29. Examples LDVM IMPLEMENTATION 29 Fines issued by Czech Trading Inspection grouped by regions of the Czech Republic. You quickly see which companies had to pay the biggest fines. No stress…
  • 31. Examples LDVM IMPLEMENTATION 31 The most advanced visualizer we currently have is the DataCube visualizer. Bosses love charts.
  • 32. Available components u Datasources u Easy to create u Analyzers u Just SPARQL queries right now u Transformers u Easy to implement, SPARQL queries u Hard to check compatibility u Visualizers u Google Maps, OpenLayers, Treemap, Sunburst, PackLayout, DataCube u Do your own! u Even now, you can implement your own and extend our library. LDVM IMPLEMENTATION 32