SlideShare a Scribd company logo
Metadata and Linked Data.
Where is it all going?
By Nicholas Car for the ANZ MDWG, 2018-06-13
LAND & WATER
Supported by:
About me!
Nicholas Car
Senior Experimental Scientist
Environmental Informatics Group
CSIRO Land & Water
Brisbane
• Interested in the totality of Australia’s information
• Formerly at GA
• Now working across agencies, as best I can
• Co-chair of the Aust. Gov. Linked Data WG – linked.data.gov.au
• with Armin here!
Metadata and Linked Data. Where is it all going? | Nicholas Car2 |
Outline
• Profile upgrade opportunities
• Emergent graph
Metadata and Linked Data. Where is it all going? | Nicholas Car3 |
Outline
• Profile upgrade opportunities
• Emergent graph
Metadata and Linked Data. Where is it all going? | Nicholas Car4 |
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community – ANZ
3. Cater for an “emergent graph”
Metadata and Linked Data. Where is it all going? | Nicholas Car5 |
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
• Irina will walk you through GA’s requirements
Metadata and Linked Data. Where is it all going? | Nicholas Car6 |
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
• Irina will walk you through GA’s requirements
Metadata and Linked Data. Where is it all going? | Nicholas Car7 |
e.g. Metadata entity set information (MD_Metadata):
http://pid.geoscience.gov.au/def/schema/ga/ISO19115-1-2014
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community – ANZ
Metadata and Linked Data. Where is it all going? | Nicholas Car8 |
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community – ANZ
• Shared expectations
– Certain fields are expected from all participants
Metadata and Linked Data. Where is it all going? | Nicholas Car9 |
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community – ANZ
• Shared expectations
– Shared codelists
Our community can use a Profile to indicate particular codelists that we
nominate for community use.
• Particular keywords
• Particular catalogue item types
• Particular roles
• Particular agencies
Metadata and Linked Data. Where is it all going? | Nicholas Car10 |
http://pid.geoscience.gov.au/def/
schema/ga/ISO19115-1-2014
Profile upgrade opportunities
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
I will explain…
Metadata and Linked Data. Where is it all going? | Nicholas Car11 |
Outline
• Profile upgrade opportunities
• Emergent graph
Metadata and Linked Data. Where is it all going? | Nicholas Car12 |
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
We are used to this:
Metadata and Linked Data. Where is it all going? | Nicholas Car13 |
Metadata documents Metadata DB
indexation
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
And to some extent this:
Metadata and Linked Data. Where is it all going? | Nicholas Car14 |
Metadata documents Metadata DB
harvesting indexation
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
We want this:
Metadata and Linked Data. Where is it all going? | Nicholas Car15 |
Metadata documents Information graph
?
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
We want this:
Metadata and Linked Data. Where is it all going? | Nicholas Car16 |
Metadata documents Information graph
?
An information graph:
* better represents the way
we understand information
* If done using Linked Data,
can Join information
at any granularity and across
many systems
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
We want this:
Metadata and Linked Data. Where is it all going? | Nicholas Car17 |
Metadata documents Information graph
?
An information graph:
* why?
* The total information
we want is stored in many,
different systems
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
Actually this:
Metadata and Linked Data. Where is it all going? | Nicholas Car18 |
Metadata documents
Emergent graph
1. Tighten up parts of the standard for particular purposes
2. Implement things for an entire community - ANZ
3. Cater for an “emergent graph”
Actually this:
Metadata and Linked Data. Where is it all going? | Nicholas Car19 |
Metadata documents
how ?
Emergent graph - pattern
Metadata and Linked Data. Where is it all going? | Nicholas Car20 |
Research Data Alliance
Emergent graph – how, at GA
Metadata and Linked Data. Where is it all going? | Nicholas Car21 |
(but first why: information in multiple places/systems)
Metadata and Linked Data. Where is it all going? | Nicholas Car22 |
Pattern 12.2
As implemented in test at GA
Emergent graph – how, at GA
Metadata and Linked Data. Where is it all going? | Nicholas Car23 |
http://pid.geoscience.gov.au/def/ont/ga/pdm
GA’s top-level data model relates items within IS19115-1 catalogues and others
Metadata and Linked Data. Where is it all going? | Nicholas Car24 |
Emergent graph – how, at GA
Metadata and Linked Data. Where is it all going? | Nicholas Car25 |
http://pid.geoscience.gov.au/def/schema/ga/ISO19115-3-
2016/codelist/assocTypeCode_codelist.html
Emergent graph – how, at GA
Metadata and Linked Data. Where is it all going? | Nicholas Car26 |
<mri:associatedResource>
<mri:MD_AssociatedResource>
….
</mri:MD_AssociatedResource>
</mri:associatedResource>
<cit:CI_Citation>
…
</cit:CI_Citation>
<mri:associationType>
<mri:DS_AssociationTypeCode codeList="codeListLocation#
DS_AssociationTypeCode" codeListValue="wasDerivedFrom" />
</mri:associationType>
<cit:CI_OnlineResource>
<cit:linkage>
<gco:CharacterString>
http://pid.geoscience.gov.au/dataset/ga/70908
</gco:CharacterString>
</cit:linkage>
…
Dataset 82033 was derived from Dataset 70908 - wasDerivedFrom
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car27 |
http://pid.geoscience.gov.au/def/ont/ga/link
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car28 |
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car29 |
National
Dataset
FSDF
Product
An Org
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car30 |
National
Dataset
FSDF
Product
An Org
wasDerivedFrom
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car31 |
Input
Dataset X
National
Dataset
FSDF
Product
FSDF
Activity
wasDerivedFromwasGeneratedBy
Input
Dataset Y
Input
Dataset Z
used
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car32 |
Input
Dataset X
National
Dataset
FSDF
Product
FSDF
Activity
wasDerivedFromwasGeneratedBy
Input
Dataset Y
Input
Dataset Z
used
An Org
Other
Org
Other,
Other Org
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car33 |
Input
Dataset X
National
Dataset
FSDF
Product
FSDF
Activity
Input
Dataset Y
Input
Dataset Z
Certainty of continuation?
Emergent graph – FSDF
Metadata and Linked Data. Where is it all going? | Nicholas Car34 |
Input
Dataset X
National
Dataset
FSDF
Product
FSDF
Activity
Input
Dataset Y
Input
Dataset Z
Mandate
1
Mandate
2
Mandate
3
X
Emergent graph – Linked Data
• Use URIs to identify everything
• Datasets, Orgs, Mandates
• Elements within datasets
Metadata and Linked Data. Where is it all going? | Nicholas Car35 |
Emergent graph – Linked Data
• Use URIs to identify everything
• Datasets, Orgs, Mandates
• Elements within datasets
• Use the Internet to hop across systems / orgs
• Items in one catalog link to items in another via URIs
Metadata and Linked Data. Where is it all going? | Nicholas Car36 |
Emergent graph – Linked Data
• Use URIs to identify everything
• Datasets, Orgs, Mandates
• Elements within datasets
• Use the Internet to hop across systems / orgs
• Items in one catalog link to items in another via URIs
• Use LD mechanics to get different views of things
• Purse ISO19115-1
• ANZLIC Profile
• Profile X
• PROV
Metadata and Linked Data. Where is it all going? | Nicholas Car37 |
Go forth and
interoperate!
Nicholas Car
Environmental Informatics
Land & Water, Brisbane
nicholas.car@csiro.au
LAND & WATER
Metadata and Linked Data. Where is it all going? | Nicholas Car39 |
Metadata and Linked Data. Where is it all going? | Nicholas Car40 |
Metadata and Linked Data. Where is it all going? | Nicholas Car41 |
Metadata and Linked Data. Where is it all going? | Nicholas Car42 |
Metadata and Linked Data. Where is it all going? | Nicholas Car43 |
Metadata and Linked Data. Where is it all going? | Nicholas Car44 |
Metadata and Linked Data. Where is it all going? | Nicholas Car45 |
<http://test.linked.data.gov.au/org/O-000928> a
auorg#NonCorporateCommonwealthEntity ,
org:Organization ;
rdfs:label "Australian Bureau of Statistics" ;
…
auorg:budgetAppropriations "368919000"^^auorg:AustralianDollars ;
auorg:portfolio <http://test.linked.data.gov.au/portfolio/78921> ;
…
owl:seeAlso <http://www.abs.gov.au> ;
vcard:hasStreetAddress <http://gnafld.net/address/GAACT714857871> ;
…
Metadata and Linked Data. Where is it all going? | Nicholas Car46 |
Metadata and Linked Data. Where is it all going? | Nicholas Car47 |

More Related Content

Similar to Metadata and Linked Data. Where is it all going?

Dive deep into your Data Pools
Dive deep into your Data PoolsDive deep into your Data Pools
Dive deep into your Data Pools
Semantic Web Company
 
Government GraphSummit: Optimizing the Supply Chain
Government GraphSummit: Optimizing the Supply ChainGovernment GraphSummit: Optimizing the Supply Chain
Government GraphSummit: Optimizing the Supply Chain
Neo4j
 
NSDI_ Concepts and Components
NSDI_ Concepts and ComponentsNSDI_ Concepts and Components
NSDI_ Concepts and Components
Jayantha Samarasinghe
 
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
Neo4j
 
Optimizing Your Supply Chain with the Neo4j Graph
Optimizing Your Supply Chain with the Neo4j GraphOptimizing Your Supply Chain with the Neo4j Graph
Optimizing Your Supply Chain with the Neo4j Graph
Neo4j
 
BCS BISSG Business Intelligence - Past, Present and Future
BCS BISSG Business Intelligence - Past, Present and FutureBCS BISSG Business Intelligence - Past, Present and Future
BCS BISSG Business Intelligence - Past, Present and Future
Gary Nuttall MBCS CITP
 
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINALBCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
Gary Nuttall MBCS CITP
 
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark Summit
 
The Ariadne Project
The Ariadne ProjectThe Ariadne Project
The Ariadne Project
ariadnenetwork
 
Clickstream data with spark
Clickstream data with sparkClickstream data with spark
Clickstream data with spark
Marissa Saunders
 
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
Denodo
 
Data Tactics Semantic and Interoperability Summit Feb 12, 2013
Data Tactics Semantic and Interoperability Summit Feb 12, 2013Data Tactics Semantic and Interoperability Summit Feb 12, 2013
Data Tactics Semantic and Interoperability Summit Feb 12, 2013
DataTactics
 
Semantic Web vision and its relevance to Open Digital Data for MGI
Semantic Web vision and its relevance to Open Digital Data for MGISemantic Web vision and its relevance to Open Digital Data for MGI
Semantic Web vision and its relevance to Open Digital Data for MGI
Artificial Intelligence Institute at UofSC
 
DataEd Webinar: Metadata Strategies
DataEd Webinar:  Metadata StrategiesDataEd Webinar:  Metadata Strategies
DataEd Webinar: Metadata Strategies
DATAVERSITY
 
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
Keiichiro Ono
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
XanGwaps
 
Bigdatacooltools
BigdatacooltoolsBigdatacooltools
Bigdatacooltools
suresh sood
 
Go Code Colorado and The Data Liaison
Go Code Colorado and The Data LiaisonGo Code Colorado and The Data Liaison
Go Code Colorado and The Data Liaison
International Map Industry Association
 
Scaling Your Data: Data Democratisation and DataOps
Scaling Your Data: Data Democratisation and DataOpsScaling Your Data: Data Democratisation and DataOps
Scaling Your Data: Data Democratisation and DataOps
Juan Sebastián Urrego Escobar
 
Future se oct15
Future se oct15Future se oct15
Future se oct15
CS, NcState
 

Similar to Metadata and Linked Data. Where is it all going? (20)

Dive deep into your Data Pools
Dive deep into your Data PoolsDive deep into your Data Pools
Dive deep into your Data Pools
 
Government GraphSummit: Optimizing the Supply Chain
Government GraphSummit: Optimizing the Supply ChainGovernment GraphSummit: Optimizing the Supply Chain
Government GraphSummit: Optimizing the Supply Chain
 
NSDI_ Concepts and Components
NSDI_ Concepts and ComponentsNSDI_ Concepts and Components
NSDI_ Concepts and Components
 
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
Optimizing the Supply Chain with Knowledge Graphs, IoT and Digital Twins_Moor...
 
Optimizing Your Supply Chain with the Neo4j Graph
Optimizing Your Supply Chain with the Neo4j GraphOptimizing Your Supply Chain with the Neo4j Graph
Optimizing Your Supply Chain with the Neo4j Graph
 
BCS BISSG Business Intelligence - Past, Present and Future
BCS BISSG Business Intelligence - Past, Present and FutureBCS BISSG Business Intelligence - Past, Present and Future
BCS BISSG Business Intelligence - Past, Present and Future
 
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINALBCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
BCS BISSG - Business Intelligence - Past Present and Future 20150624 FINAL
 
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
 
The Ariadne Project
The Ariadne ProjectThe Ariadne Project
The Ariadne Project
 
Clickstream data with spark
Clickstream data with sparkClickstream data with spark
Clickstream data with spark
 
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
 
Data Tactics Semantic and Interoperability Summit Feb 12, 2013
Data Tactics Semantic and Interoperability Summit Feb 12, 2013Data Tactics Semantic and Interoperability Summit Feb 12, 2013
Data Tactics Semantic and Interoperability Summit Feb 12, 2013
 
Semantic Web vision and its relevance to Open Digital Data for MGI
Semantic Web vision and its relevance to Open Digital Data for MGISemantic Web vision and its relevance to Open Digital Data for MGI
Semantic Web vision and its relevance to Open Digital Data for MGI
 
DataEd Webinar: Metadata Strategies
DataEd Webinar:  Metadata StrategiesDataEd Webinar:  Metadata Strategies
DataEd Webinar: Metadata Strategies
 
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
Workshop: Introduction to Cytoscape at UT-KBRIN Bioinformatics Summit 2014 (4...
 
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx351315535-Module-1-Intro-to-Data-Science-pptx.pptx
351315535-Module-1-Intro-to-Data-Science-pptx.pptx
 
Bigdatacooltools
BigdatacooltoolsBigdatacooltools
Bigdatacooltools
 
Go Code Colorado and The Data Liaison
Go Code Colorado and The Data LiaisonGo Code Colorado and The Data Liaison
Go Code Colorado and The Data Liaison
 
Scaling Your Data: Data Democratisation and DataOps
Scaling Your Data: Data Democratisation and DataOpsScaling Your Data: Data Democratisation and DataOps
Scaling Your Data: Data Democratisation and DataOps
 
Future se oct15
Future se oct15Future se oct15
Future se oct15
 

Recently uploaded

GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 

Recently uploaded (20)

GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 

Metadata and Linked Data. Where is it all going?

  • 1. Metadata and Linked Data. Where is it all going? By Nicholas Car for the ANZ MDWG, 2018-06-13 LAND & WATER Supported by:
  • 2. About me! Nicholas Car Senior Experimental Scientist Environmental Informatics Group CSIRO Land & Water Brisbane • Interested in the totality of Australia’s information • Formerly at GA • Now working across agencies, as best I can • Co-chair of the Aust. Gov. Linked Data WG – linked.data.gov.au • with Armin here! Metadata and Linked Data. Where is it all going? | Nicholas Car2 |
  • 3. Outline • Profile upgrade opportunities • Emergent graph Metadata and Linked Data. Where is it all going? | Nicholas Car3 |
  • 4. Outline • Profile upgrade opportunities • Emergent graph Metadata and Linked Data. Where is it all going? | Nicholas Car4 |
  • 5. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community – ANZ 3. Cater for an “emergent graph” Metadata and Linked Data. Where is it all going? | Nicholas Car5 |
  • 6. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes • Irina will walk you through GA’s requirements Metadata and Linked Data. Where is it all going? | Nicholas Car6 |
  • 7. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes • Irina will walk you through GA’s requirements Metadata and Linked Data. Where is it all going? | Nicholas Car7 | e.g. Metadata entity set information (MD_Metadata): http://pid.geoscience.gov.au/def/schema/ga/ISO19115-1-2014
  • 8. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community – ANZ Metadata and Linked Data. Where is it all going? | Nicholas Car8 |
  • 9. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community – ANZ • Shared expectations – Certain fields are expected from all participants Metadata and Linked Data. Where is it all going? | Nicholas Car9 |
  • 10. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community – ANZ • Shared expectations – Shared codelists Our community can use a Profile to indicate particular codelists that we nominate for community use. • Particular keywords • Particular catalogue item types • Particular roles • Particular agencies Metadata and Linked Data. Where is it all going? | Nicholas Car10 | http://pid.geoscience.gov.au/def/ schema/ga/ISO19115-1-2014
  • 11. Profile upgrade opportunities 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” I will explain… Metadata and Linked Data. Where is it all going? | Nicholas Car11 |
  • 12. Outline • Profile upgrade opportunities • Emergent graph Metadata and Linked Data. Where is it all going? | Nicholas Car12 |
  • 13. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” We are used to this: Metadata and Linked Data. Where is it all going? | Nicholas Car13 | Metadata documents Metadata DB indexation
  • 14. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” And to some extent this: Metadata and Linked Data. Where is it all going? | Nicholas Car14 | Metadata documents Metadata DB harvesting indexation
  • 15. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” We want this: Metadata and Linked Data. Where is it all going? | Nicholas Car15 | Metadata documents Information graph ?
  • 16. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” We want this: Metadata and Linked Data. Where is it all going? | Nicholas Car16 | Metadata documents Information graph ? An information graph: * better represents the way we understand information * If done using Linked Data, can Join information at any granularity and across many systems
  • 17. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” We want this: Metadata and Linked Data. Where is it all going? | Nicholas Car17 | Metadata documents Information graph ? An information graph: * why? * The total information we want is stored in many, different systems
  • 18. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” Actually this: Metadata and Linked Data. Where is it all going? | Nicholas Car18 | Metadata documents
  • 19. Emergent graph 1. Tighten up parts of the standard for particular purposes 2. Implement things for an entire community - ANZ 3. Cater for an “emergent graph” Actually this: Metadata and Linked Data. Where is it all going? | Nicholas Car19 | Metadata documents how ?
  • 20. Emergent graph - pattern Metadata and Linked Data. Where is it all going? | Nicholas Car20 | Research Data Alliance
  • 21. Emergent graph – how, at GA Metadata and Linked Data. Where is it all going? | Nicholas Car21 | (but first why: information in multiple places/systems)
  • 22. Metadata and Linked Data. Where is it all going? | Nicholas Car22 | Pattern 12.2 As implemented in test at GA
  • 23. Emergent graph – how, at GA Metadata and Linked Data. Where is it all going? | Nicholas Car23 | http://pid.geoscience.gov.au/def/ont/ga/pdm GA’s top-level data model relates items within IS19115-1 catalogues and others
  • 24. Metadata and Linked Data. Where is it all going? | Nicholas Car24 |
  • 25. Emergent graph – how, at GA Metadata and Linked Data. Where is it all going? | Nicholas Car25 | http://pid.geoscience.gov.au/def/schema/ga/ISO19115-3- 2016/codelist/assocTypeCode_codelist.html
  • 26. Emergent graph – how, at GA Metadata and Linked Data. Where is it all going? | Nicholas Car26 | <mri:associatedResource> <mri:MD_AssociatedResource> …. </mri:MD_AssociatedResource> </mri:associatedResource> <cit:CI_Citation> … </cit:CI_Citation> <mri:associationType> <mri:DS_AssociationTypeCode codeList="codeListLocation# DS_AssociationTypeCode" codeListValue="wasDerivedFrom" /> </mri:associationType> <cit:CI_OnlineResource> <cit:linkage> <gco:CharacterString> http://pid.geoscience.gov.au/dataset/ga/70908 </gco:CharacterString> </cit:linkage> … Dataset 82033 was derived from Dataset 70908 - wasDerivedFrom
  • 27. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car27 | http://pid.geoscience.gov.au/def/ont/ga/link
  • 28. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car28 |
  • 29. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car29 | National Dataset FSDF Product An Org
  • 30. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car30 | National Dataset FSDF Product An Org wasDerivedFrom
  • 31. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car31 | Input Dataset X National Dataset FSDF Product FSDF Activity wasDerivedFromwasGeneratedBy Input Dataset Y Input Dataset Z used
  • 32. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car32 | Input Dataset X National Dataset FSDF Product FSDF Activity wasDerivedFromwasGeneratedBy Input Dataset Y Input Dataset Z used An Org Other Org Other, Other Org
  • 33. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car33 | Input Dataset X National Dataset FSDF Product FSDF Activity Input Dataset Y Input Dataset Z Certainty of continuation?
  • 34. Emergent graph – FSDF Metadata and Linked Data. Where is it all going? | Nicholas Car34 | Input Dataset X National Dataset FSDF Product FSDF Activity Input Dataset Y Input Dataset Z Mandate 1 Mandate 2 Mandate 3 X
  • 35. Emergent graph – Linked Data • Use URIs to identify everything • Datasets, Orgs, Mandates • Elements within datasets Metadata and Linked Data. Where is it all going? | Nicholas Car35 |
  • 36. Emergent graph – Linked Data • Use URIs to identify everything • Datasets, Orgs, Mandates • Elements within datasets • Use the Internet to hop across systems / orgs • Items in one catalog link to items in another via URIs Metadata and Linked Data. Where is it all going? | Nicholas Car36 |
  • 37. Emergent graph – Linked Data • Use URIs to identify everything • Datasets, Orgs, Mandates • Elements within datasets • Use the Internet to hop across systems / orgs • Items in one catalog link to items in another via URIs • Use LD mechanics to get different views of things • Purse ISO19115-1 • ANZLIC Profile • Profile X • PROV Metadata and Linked Data. Where is it all going? | Nicholas Car37 |
  • 38. Go forth and interoperate! Nicholas Car Environmental Informatics Land & Water, Brisbane nicholas.car@csiro.au LAND & WATER
  • 39. Metadata and Linked Data. Where is it all going? | Nicholas Car39 |
  • 40. Metadata and Linked Data. Where is it all going? | Nicholas Car40 |
  • 41. Metadata and Linked Data. Where is it all going? | Nicholas Car41 |
  • 42. Metadata and Linked Data. Where is it all going? | Nicholas Car42 |
  • 43. Metadata and Linked Data. Where is it all going? | Nicholas Car43 |
  • 44. Metadata and Linked Data. Where is it all going? | Nicholas Car44 |
  • 45. Metadata and Linked Data. Where is it all going? | Nicholas Car45 |
  • 46. <http://test.linked.data.gov.au/org/O-000928> a auorg#NonCorporateCommonwealthEntity , org:Organization ; rdfs:label "Australian Bureau of Statistics" ; … auorg:budgetAppropriations "368919000"^^auorg:AustralianDollars ; auorg:portfolio <http://test.linked.data.gov.au/portfolio/78921> ; … owl:seeAlso <http://www.abs.gov.au> ; vcard:hasStreetAddress <http://gnafld.net/address/GAACT714857871> ; … Metadata and Linked Data. Where is it all going? | Nicholas Car46 |
  • 47. Metadata and Linked Data. Where is it all going? | Nicholas Car47 |