The document discusses publishing data sets as linked data using semantic web technologies. It describes treating a data set as a single resource and providing metadata as linked data to support discovery (Approach 1). It also describes publishing the individual records in a data set as linked data to enable integration, comparison and accessing data as a service (Approach 2). It provides a case study of how the Environment Agency published their bathing water quality data set as linked data using these approaches and vocabularies like the Data Cube vocabulary.
Presentation on the Data Cube vocabulary to support Linked Data publication of statistics and measurement data sets. Given at SemTech 2011, San Francisco.
Linked Data for Federation of OER Data & RepositoriesStefan Dietze
An overview over different alternatives and opportunities of using Linked Data principles and datasets for federated access to distributed OER repositories. The talk was held at the ARIADNE/GLOBE convening (http://ariadne-eu.org/content/open-federations-2013-open-knowledge-sharing-education) at LAK 2013, Leuven, Belgium on 8 April 2013
Data Warehousing and Mining Data from Library and University Systems for Asse...Ray Schwartz
Presentation for course 'Understanding Library Systems and Software Applications' School of Communication and Information, Rutgers University,
New Brunswick, New Jersey, Thursday, October 25, 2012
Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...Laurent Lefort
Canberra Semantic Web Meetup.
Initiatives have been launched to develop semantic vocabularies representing statistical classifications and discovery metadata. Tools are also being created by statistical organizations to support the publication of dimensional data conforming to the Data Cube specification, now in Last Call at W3C.
The meeting will be an opportunity to hear about two semantic Web and Linked Data initiatives for statistical data that are driven by the Australian Government. The Bureau of Meteorlogy and CSIRO have recently released a Linked Data version of the ACORN-SAT historical climate data at http://lab.environment.data.gov.au and the ABS has released the Census data modelled in the Data Cube vocabulary which is part of a challenge the ABS is organising in context of the SemStats Workshop (http://www.datalift.org/en/event/semstats2013/challenge) at the International Semantic Web Conference (ISWC) in Sydney (http://iswc2013.semanticweb.org).
Come along to hear about these two projects, the challenges encountered and the solutions developed.
Using linked data and the semantic web - "powered by INSPIRE" conference pres...Alex Coley
The central commitment of the UK Government to Open Data and Open Data Standards has continued and this has built towards the desire to not only publish data in ways that are open but to do this with data that isin a way that is both useful and structured in a way that is useful. This has necessarily focused on both enabling innovation and improving public sector efficiencies. The UK Government Linked Data Working Group (UKGovLD) was formed as a commitment in the Open Data white paper, and grew from an UK INSPIRE Linked Data Working Group. UKGovLD is here to advise UK Government on the implementation of Linked Data technologies and associated business practices, highlighting areas of best practice and identifying projects that should be prioritised or amended. All to enable collaboration and the delivery of core projects for the benefit of the UK.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
More Related Content
Similar to Using linked data for dataset publication
Presentation on the Data Cube vocabulary to support Linked Data publication of statistics and measurement data sets. Given at SemTech 2011, San Francisco.
Linked Data for Federation of OER Data & RepositoriesStefan Dietze
An overview over different alternatives and opportunities of using Linked Data principles and datasets for federated access to distributed OER repositories. The talk was held at the ARIADNE/GLOBE convening (http://ariadne-eu.org/content/open-federations-2013-open-knowledge-sharing-education) at LAK 2013, Leuven, Belgium on 8 April 2013
Data Warehousing and Mining Data from Library and University Systems for Asse...Ray Schwartz
Presentation for course 'Understanding Library Systems and Software Applications' School of Communication and Information, Rutgers University,
New Brunswick, New Jersey, Thursday, October 25, 2012
Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...Laurent Lefort
Canberra Semantic Web Meetup.
Initiatives have been launched to develop semantic vocabularies representing statistical classifications and discovery metadata. Tools are also being created by statistical organizations to support the publication of dimensional data conforming to the Data Cube specification, now in Last Call at W3C.
The meeting will be an opportunity to hear about two semantic Web and Linked Data initiatives for statistical data that are driven by the Australian Government. The Bureau of Meteorlogy and CSIRO have recently released a Linked Data version of the ACORN-SAT historical climate data at http://lab.environment.data.gov.au and the ABS has released the Census data modelled in the Data Cube vocabulary which is part of a challenge the ABS is organising in context of the SemStats Workshop (http://www.datalift.org/en/event/semstats2013/challenge) at the International Semantic Web Conference (ISWC) in Sydney (http://iswc2013.semanticweb.org).
Come along to hear about these two projects, the challenges encountered and the solutions developed.
Using linked data and the semantic web - "powered by INSPIRE" conference pres...Alex Coley
The central commitment of the UK Government to Open Data and Open Data Standards has continued and this has built towards the desire to not only publish data in ways that are open but to do this with data that isin a way that is both useful and structured in a way that is useful. This has necessarily focused on both enabling innovation and improving public sector efficiencies. The UK Government Linked Data Working Group (UKGovLD) was formed as a commitment in the Open Data white paper, and grew from an UK INSPIRE Linked Data Working Group. UKGovLD is here to advise UK Government on the implementation of Linked Data technologies and associated business practices, highlighting areas of best practice and identifying projects that should be prioritised or amended. All to enable collaboration and the delivery of core projects for the benefit of the UK.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
4. Linked data ...
publishing data on the web ...
... to enable integration, linking and reuse
across silos
5. Linked data
Apply the principles to the web to publication of data
The linked data web:
is a global network of things
each identified by a URI
fetching a URI gives a set of statements in RDF
things connected by typed links
open, anyone can say anything about anything else
Linked data is “data you can click on”
7. Example schools information
http://education.data.gov.uk/id/school/401874 a School
label phase
district “Secondary”
“Cardiff High School”
“Cardiff”
8. Example schools information
http://education.data.gov.uk/id/school/401874 a school:School
phase
label
district school:PhaseOfEducation_Secondary
“Cardiff High School”
http://statistics.data.gov.uk/id/local-authority-district/00PT label “Cardiff”
9. Example schools information
http://education.data.gov.uk/id/school/401874 rdf:type school:School
rdfs:label school:phase
school:district school:PhaseOfEducation_Secondary
“Cardiff High School”
http://statistics.data.gov.uk/id/local-authority-district/00PT rdfs:label “Cardiff”
10. Example schools information
http://education.data.gov.uk/id/school/401874 rdf:type school:School
rdfs:label school:phase
school:district school:PhaseOfEducation_Secondary
“Cardiff High School”
http://statistics.data.gov.uk/id/local-authority-district/00PT label “Cardiff”
http://data.ordnancesurvey.co.uk/id/7000000000025484
admingeo:ward
spatial:extent
admingeo:parish
GML: 310499.4 184176.6 310476.5 ...
11. Example schools information
http://education.data.gov.uk/id/school/401874 rdf:type school:School
rdfs:label school:phase
school:district school:PhaseOfEducation_Secondary
“Cardiff High School”
http://statistics.data.gov.uk/id/local-authority-district/00PT label “Cardiff”
owl:sameAs
http://data.ordnancesurvey.co.uk/id/7000000000025484
admingeo:ward
spatial:extent
admingeo:parish
GML: 310499.4 184176.6 310476.5 ...
12.
13. Role in data set publication
well suited to describing things
schools, companies, animal species, music tracks, tv programmes ...
what about datasets?
environmental measurements, experimental results, statistical analyses ...
14. Approach 1 : Data catalogues
treat the dataset as a single resource, identify with a URI
provide metadata as linked data
descriptive
categorical
technical and structural
Benefits?
separate of metadata from resource & repository
easy aggregation of metadata into catalogues
schema-less enables use-specific annotations and links
use of sharable category schemes and reference data
=> support for discovery
15. Approach 2 : Fine grain publication
publish the data set itself as linked data
entities, terms, individual records in data identified by URIs
data set structure and ontologies linked from data
still include dataset metadata
Benefits?
all benefits of approach 1 to support discovery
self-describing
data slices addressable (trace back, provenance, annotation)
integration across sets - reuse of terms for dimensions, units, values
fine grained access
=> integration, comparison, context, data as a service
16.
17. bathing water quality
what we do...
start of season
15th May Press interest
bathing season
what information 20-22 samples in 22weeks
is relevant to the public
about beaches
30th Sept
annual report
what November
we do
December
18. how linkable data helps
Tenby
Tourist Information Centre
Unit 2 , The Gateway Complex
Tenby. Wales , SA70 7LT
Tel: 01834 842 402
Fax: 01834 845 439
Email: tenby.tic@pembrokeshire.gov.uk
Photo by Skellig2008 (flickr)
19. Publishing the Bathing Water Quality data set
Bathing Sampling Zones Of Assessment
Vocabularies
Waters Points Influence s
e.g. http://location.data.gov.uk/def/ef/SampingPoint
URI Set
Bathing Sampling Zone Of
Reference Data Waters Points Influence
e.g. http://location.data.gov.uk/so/ef/SamplingPoint/bwsp.eaew
Assessme http://environment.data.gov.uk/data/bathing-water-quality
Observation
nt
Datasets
void:subset void:subset
In-season
Annual
Weekly
.../compliance Complianc .../in-season
Assessme
e
nt
20. Data cube vocabulary
collaborative development
sponsored by data.gov.uk
simple, flexible vocabulary
mirrors core information models from:
SDMX (Statistical Data and Metadata eXchange)
DDI (Data Documentation Initiative)
extension to SCOVO vocabulary
image: dullhunk @ flickr
21. Data cube model
A set of observations
indexed by dimensions
describing measures
interpreted according to attributes
(e.g. region)
dimension
measure(s) attributes
• population unit of measure = count
= 32,567 status = preliminary
...
dimension
(e.g. time)
23. Data cube vocabulary
1. Top level
DataSet qb:DataStructureDefinition
qb:component
provenance and metadata qb:sliceKey
structure qb:structure
Observation qb:DataSet qb:SliceKey
measured values, at dimensions qb:slice
qb:sliceStructure
qb:dataset
with attributes qb:Slice
direct link to DataSet qb:subSlice
qb:observation
qb:Observation
dimension values
measure value(s)
attribute values
24. Data cube vocabulary
1. Top level
DataSet qb:DataStructureDefinition
qb:component
provenance and metadata qb:sliceKey
structure qb:structure
Observation qb:DataSet qb:SliceKey
measured values, at dimensions qb:slice
qb:sliceStructure
qb:dataset
with attributes qb:Slice
direct link to DataSet qb:subSlice
Slice qb:observation
qb:Observation
optional grouping by fixing
dimensions dimension values
measure value(s)
attribute values
guide to presentation
allows for abbreviated data
25. Data cube vocabulary
2. Data Structure Definition
explicit definition of cube
qb:DataSet
structure, inline in the data qb:structure
enables qb:DataStructureDefinition
validation qb:component
visualization
discovery qb:ComponentSpecification
abbreviation qb:componentRequired
qb:componentAttachment
qb:order
qb:dimension
qb:measure
qb:attribute
26. Bathing Water Quality cubes
measures
total coliform count, entero virus count, ...
sample classification
dimensions
sampling point
sampling week
sampling year
attributes
abnormal weather
27. Everything has a URI
Selected Lists and
Individual Bathing Waters
Lists and Individual
Assessments
In-Season or Annual
Compliance
Vocabulary Terms
Datasets (and subsets)
Presented as:
HTML, (for people)
JSON, XML, RDF and CSV
(for programs)
28. Data Platform and Applications
Web of Linked Data
http://environment.data.gov.uk/lab/bwq-os.html
29. Outcomes
bathing water quality information available
as both data set and set of web APIs
updated weekly (in season)
third party applications to use and combine the data
seed a web of environmental and location data
reference identifiers can be reused for related information
URI patterns designed to be compatible with INSPIRE
31. Lessons
importance of reference identifiers
developer accessibility
linked data API
publish once, consume many ways
importance of maintenance and QoS expectation
reusable patterns:
reusable vocabularies - Data Cube, org ...
URI patterns
provenance – OMPV and specializations
incremental approach
32. Acknowledgements
Alex Coley (Environment Agency)
for slides 17, 18, and for sponsoring the bathing water quality
data publication
Stuart Williams
developer of the bathing water application and slides 19,27,28
John Sheridan (The National Archive)
for sponsoring the development of data cube
Richard Cyganiak, Jeni Tennison
co-developers of the data cube vocabulary
33. fin.
fin.
image: Christian Haugen @ flickr.com
35. Linked data principles
Use URIs as names for things
Use HTTP URIs so that people can look up those names
When someone looks up a URI, provide useful
information, using the standards (RDF*, SPARQL)
Include links to other URIs, so that they can discover
more things
Pattern of application of semantic
web stack
36. Linked open data cloud: 2007
Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
37. Linked open data cloud: 2009
Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
38. Linked open data cloud: 2010
Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
39. Accessing all this data
link following
HTTP GET, follow links, aggregate relevant statements
query
SPARQL
40. SPARQL
core idea is pattern matching
graph patterns with variables
any subgraph which matches yields row of bindings
ont:districtAdministrative rdfs:label
?school [] “Cardiff”
syntax based on Turtle syntax for RDF
web API endpoints
lots of power
filters sub-queries federated query
optionals property chains update
named graphs aggregation construct
41. Accessing all this data
link following
HTTP GET, follow links, aggregate relevant statements
query
SPARQL
linked data API
RESTful API onto linked data resources
simple query, usable without RDF stack, web dev friendly
easy to layer visualizations and UIs on top
third parties
search engines and aggregators e.g. Sindice, sameAs.org