Canberra Semantic Web Meetup.
Initiatives have been launched to develop semantic vocabularies representing statistical classifications and discovery metadata. Tools are also being created by statistical organizations to support the publication of dimensional data conforming to the Data Cube specification, now in Last Call at W3C.
The meeting will be an opportunity to hear about two semantic Web and Linked Data initiatives for statistical data that are driven by the Australian Government. The Bureau of Meteorlogy and CSIRO have recently released a Linked Data version of the ACORN-SAT historical climate data at http://lab.environment.data.gov.au and the ABS has released the Census data modelled in the Data Cube vocabulary which is part of a challenge the ABS is organising in context of the SemStats Workshop (http://www.datalift.org/en/event/semstats2013/challenge) at the International Semantic Web Conference (ISWC) in Sydney (http://iswc2013.semanticweb.org).
Come along to hear about these two projects, the challenges encountered and the solutions developed.
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...Laurent Lefort
Presentation of the SSN XG results at eResearch Australia 2011 https://eresearchau.files.wordpress.com/2012/06/74-semantically-enabling-the-web-of-things-the-w3c-semantic-sensor-network-ontology.pdf
FMI Open Data Interface and Data ModelsRoope Tervo
Description of FMI Open Data Portal services and data models including some WFS basics. The presentation includes also a description of INSPIRE harmonised data models used in the portal.
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...Laurent Lefort
Presentation of the SSN XG results at eResearch Australia 2011 https://eresearchau.files.wordpress.com/2012/06/74-semantically-enabling-the-web-of-things-the-w3c-semantic-sensor-network-ontology.pdf
FMI Open Data Interface and Data ModelsRoope Tervo
Description of FMI Open Data Portal services and data models including some WFS basics. The presentation includes also a description of INSPIRE harmonised data models used in the portal.
The Earth System Grid Federation (ESGF) is a large international collaboration that operates a global infrastructure for management and access of Earth System data. Some of the most valuable data collections served by ESGF include the output of global climate models used for the IPCC reports on climate change (CMIP3, CMIP5 and the upcoming CMIP6), regional climate model output (CORDEX), and observational data from several American and European agencies (Obs4MIPs). This talk will present a brief introduction to ESGF, describe the data access and analysis methods currently available or planned for the future, and conclude with some ideas on how this infrastructure could be used as a testbed for executing distributed analytics on a global scale.
Possibilities of Open Source Code. FMI has a strong open source initiative and many open source software.
Presented at WMO Executive Council (EC-69) Side-Event.
AusCover Earth Observation Services and Data CubesTERN Australia
The presentation provides an overview of earth observation services offered by AusCover Facility of TERN. The presentation was part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond which was held on 9th of March 2016 in University of Queensland.
Eco-informatics: Data services for bringing together and publishing the full ...TERN Australia
The presentation provides an overview of Advanced Ecological Knowledge and Observation System and SHaRED services by the TERN Eco-informatics to publish plot-based ecological data. The presentation was part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond which was held on 9th of March 2016 in University of Queensland.
AusPlots field data collection with AusScribeTERN Australia
The presentation provides an overview of AuScribe, an Android-based ecology field survey App based on AusPLots Rangelands Survey Protocols Manual. The presentation is part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond
Finnish Meteorological Institute is opening its weather data. Slides kept in Aaltoes Insights event describes first insights about open data portal and what is going to be opened.
Application packaging and systematic processing in earth observation exploita...terradue
An overview of Terradue's solutions supporting Earth Observations (EO) Exploitation Platforms across multiple domains.
Presentation done as part of the Open Geospatial Consortium (OGC) Technical Committee ad-hoc meeting for the setup of a new domain working group on EO Exploitation Platforms.
Solar System Processing with LSST: A Status UpdateMario Juric
An update for the LSST Solar System Science Collaboration on the work in progress on data products and software needed to support the Solar System science. Delivered at DPS 2017 meeting.
netCDF-LD - Towards linked data conventions for delivery of environmental dat...Jonathan Yu
This presentation was given at the ISESS'15 conference at Melbourne.
Abstract. netCDF is a well-known and widely used format to exchange array-oriented scientific data such as grids and time-series. We describe a new convention for encoding netCDF based on Linked Data principles called netCDF-LD. netCDF-LD allows metadata elements, given as string values in current netCDF files, to be given as Linked Data objects. netCDF-LD allows precise semantics to be used for elements and expands the type options beyond lists of controlled terms. Using Uniform Resource Identifiers (URIs) for elements allows them to refer to other Linked Data resources for their type and descriptions. This enables improved data discovery through a generic mechanism for element type identification and adds element type expandability to new Linked Data resources as they become available. By following patterns already established for extending existing formats, netCDF-LD applications can take advantage of existing software for processing Linked Data and supporting more effective data discovery and integration across systems.
See http://link.springer.com/chapter/10.1007%2F978-3-319-15994-2_9
The Earth System Grid Federation (ESGF) is a large international collaboration that operates a global infrastructure for management and access of Earth System data. Some of the most valuable data collections served by ESGF include the output of global climate models used for the IPCC reports on climate change (CMIP3, CMIP5 and the upcoming CMIP6), regional climate model output (CORDEX), and observational data from several American and European agencies (Obs4MIPs). This talk will present a brief introduction to ESGF, describe the data access and analysis methods currently available or planned for the future, and conclude with some ideas on how this infrastructure could be used as a testbed for executing distributed analytics on a global scale.
Possibilities of Open Source Code. FMI has a strong open source initiative and many open source software.
Presented at WMO Executive Council (EC-69) Side-Event.
AusCover Earth Observation Services and Data CubesTERN Australia
The presentation provides an overview of earth observation services offered by AusCover Facility of TERN. The presentation was part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond which was held on 9th of March 2016 in University of Queensland.
Eco-informatics: Data services for bringing together and publishing the full ...TERN Australia
The presentation provides an overview of Advanced Ecological Knowledge and Observation System and SHaRED services by the TERN Eco-informatics to publish plot-based ecological data. The presentation was part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond which was held on 9th of March 2016 in University of Queensland.
AusPlots field data collection with AusScribeTERN Australia
The presentation provides an overview of AuScribe, an Android-based ecology field survey App based on AusPLots Rangelands Survey Protocols Manual. The presentation is part of the Workshop on Approaches to Terrestrial Ecosystem Data Management : from collection to synthesis and beyond
Finnish Meteorological Institute is opening its weather data. Slides kept in Aaltoes Insights event describes first insights about open data portal and what is going to be opened.
Application packaging and systematic processing in earth observation exploita...terradue
An overview of Terradue's solutions supporting Earth Observations (EO) Exploitation Platforms across multiple domains.
Presentation done as part of the Open Geospatial Consortium (OGC) Technical Committee ad-hoc meeting for the setup of a new domain working group on EO Exploitation Platforms.
Solar System Processing with LSST: A Status UpdateMario Juric
An update for the LSST Solar System Science Collaboration on the work in progress on data products and software needed to support the Solar System science. Delivered at DPS 2017 meeting.
netCDF-LD - Towards linked data conventions for delivery of environmental dat...Jonathan Yu
This presentation was given at the ISESS'15 conference at Melbourne.
Abstract. netCDF is a well-known and widely used format to exchange array-oriented scientific data such as grids and time-series. We describe a new convention for encoding netCDF based on Linked Data principles called netCDF-LD. netCDF-LD allows metadata elements, given as string values in current netCDF files, to be given as Linked Data objects. netCDF-LD allows precise semantics to be used for elements and expands the type options beyond lists of controlled terms. Using Uniform Resource Identifiers (URIs) for elements allows them to refer to other Linked Data resources for their type and descriptions. This enables improved data discovery through a generic mechanism for element type identification and adds element type expandability to new Linked Data resources as they become available. By following patterns already established for extending existing formats, netCDF-LD applications can take advantage of existing software for processing Linked Data and supporting more effective data discovery and integration across systems.
See http://link.springer.com/chapter/10.1007%2F978-3-319-15994-2_9
Enabling efficient movement of data into & out of a high-performance analysis...Jisc
From Jisc's campus network engineering for data-intensive science workshop on 19 October 2016.
https://www.jisc.ac.uk/events/campus-network-engineering-for-data-intensive-science-workshop-19-oct-2016
Overview of the world of geospatial metadata, and the role of the EDINA service GoGeo in creating, saving, and discovering it. Presented on 19 June 2014 by Tony Mathys in Aberdeen, Scotland.
Evolving Storage and Cyber Infrastructure at the NASA Center for Climate Simu...inside-BigData.com
Ellen Salmon from NASA gave this talk at the 2017 MSST conference. "This talk will describe recent developments at the NASA Center for Climate Simulation, which is funded by NASA’s Science Mission Directorate, and supports the specialized data storage and computational needs of weather, ocean, and climate researchers, as well as astrophysicists, heliophysicists, and planetary scientists. To meet requirements for higher-resolution, higher-fidelity simulations, the NCCS augments its High Performance Computing and storage/retrieval environment. As the petabytes of model and observational data grow, the NCCS is broadening data services offerings and deploying and expanding virtualization resources for high performance analytics."
Watch the video: http://wp.me/p3RLHQ-gPj
Learn more: https://www.nccs.nasa.gov/
and
http://storageconference.us/
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
re3data.org – Registry of Research Data RepositoriesHeinz Pampel
Heinz Pampel | GFZ German Research Centre for Geosciences, LIS
Maxi Kindling | Humboldt-Universität zu Berlin, Berlin School of Library and Information Science Frank Scholze | Karlsruhe Institute of Technology, KIT Library
RDA-Deutschland-Treffen 2015| Potsdam, November 26, 2015
Evolving NASA’s Data and Information Systems for Earth Scienceinside-BigData.com
In this deck from the HPC User Forum, Rahul Ramachandran from NASA presents: Evolving NASA’s Data and Information Systems for Earth Science.
"NASA’s Earth Science Division (ESD) missions help us to understand our planet’s interconnected systems, from a global scale down to minute processes. Working in concert with a satellite network of international partners, ESD can measure precipitation around the world, and it can employ its own constellation of small satellites to look into the eye of a hurricane. ESD technology can track dust storms across continents and mosquito habitats across cities. ESD delivers the technology, expertise and global observations that help us to map the myriad connections between our planet’s vital processes and the effects of ongoing natural and human-caused changes."
Watch the video: https://wp.me/p3RLHQ-k8y
Learn more: https://science.nasa.gov/earth-science
and
http://hpcuserforum.com
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Future manufacturing informatics - typology of manufacturing dataLaurent Lefort
Starting point of manufacturing informatics 2013-2014 survey, presented at joint Sydney-Canberra Semantic web meetup, 21 October 2013 (free event at ISWC 2013).
Presentation made at the Metadata Australia conference, Canberra, May 2010 (also available via metadataaustralia2010.com)
(Light) Introduction to work done in the Semantic Sensor Networks Incubator activity.
Analysis of the commonalities and differences for the adoption of semantic web standards by sensing web and eGov communities of practice.
Description of the work done for the Semantic Markup activity of the Semantic Sensor Networks Incubator activity (at W3C).
Presentation made at the Australian Ontology Workshop, Melbourne, December 2009. The full title of the paper is: "Review of semantic enablement techniques used in geospatial and semantic standards for legacy and opportunistic mashups" (and it is available via crpit.com)
Canberra Semantic Web Meetup, 2 August 2010
The talk objective is to encourage the Meetup members to participate and prepare the Sydney Amped Hack Day (October 16 in Sydney: http://ampedweb.org/ ).
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au
1. Using the Data Cube vocabulary for Publishing Environmental
Linked Data on lab.environment.data.gov.au
Canberra Semantic Web meetup
CSIRO COMPUTATIONAL INFORMATICS
Laurent Lefort, Armin Haller
2. Outline
• ACORN-SAT Dataset
• Building the Data Cube
• Enriching ACORN-SAT Linked Data with Metadata
• Published ACORN-SAT Linked Data
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort2 |
3. The ACORN-SAT dataset
• Released by Aus. Bureau of Meteorology (23 March 2012)
• Available at http://www.bom.gov.au/climate/change/acorn-sat/
• 112 stations in total - 60 from 1910 to 2011
• Homogenised (adjusted) daily temperatures
• Tabular format (1 file per time series/station)
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort3 |
4. “Catalogue websites do not
unlock the full potential of the
collected data and metadata”
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort4 |
Richard Cyganiak,
5. Limitations of ACORN-SAT in Tabular files
• Metadata fields are not documented
• Querying across the catalog is difficult
• Exploring the catalog through different facets
geographical/statistical/tabular is not possible
• Bulk processing of the dataset or parts of it is not possible
• Social annotations are not possible
• Integrating the dataset within other datasets is difficult
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort5 |
6. ACORN-SAT as Linked Data
Linked Data is a shift from publishing data in human readable
HTML documents to machine readable documents.
Linked Data Principles:
1. Use URIs as identifiers for Things
http://sws.geonames.org/2172517
2. Make them actionable
→ http://www.geonames.org/2172517/canberra.html
3. Return information following standards
→ http://sws.geonames.org/2172517/about.rdf
4. Link to other information objects
<rdfs:seeAlso rdf:resource="http://dbpedia.org/resource/Canberra"/>
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort6 |
7. ACORN-SAT as Linked Data
RDF Data Cube: a method to organise linked data in slices
• A vocabulary published by the W3C Government Linked Data (GLD) Working
Group (Working Draft)
• Also the method used to publish statistics data and environmental data in
Europe e.g. for Bathing Water Quality in UK
http://www.epimorphics.com/web/projects/bathing-water-quality
Advantages
• Allows multiple views on the same data (similar to OLAP)
• Generic approach which supports the links to domain-specific definitions
Useable:
• In any browser via Linked Data API (HTML output)
• In JavaScript via Linked Data API (JSON output)
• In R via SPARQL
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort7 |
8. RDF Data Cube 101 - Slices and observations
Dimension d6
Dimension d7
Dimension d1
Dimension d2
Dimension d3
Dimension d4
Dimension d5
Measure m1, m2, …
Attribute a1, a2, …
Cube
Slice
Observation
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort8 |
9. RDF Data Cube 101 – Dataset, Slice, Observation
Cube and Slice
qb:DataSet
qb:slice
qb:Observation
Cube observation
qb:observation
qb:subSlice
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort9 |
qb:Slice
qb:dataSet
void:subset
10. RDF Data Cube 101 – Data Structure Definitions (DSDs)
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort10 |
http://sdmx.org/wp-content/uploads/2012/11/SDMX-Guidelines-for-the-Design-of-Data-
Structure-Definitions.pdf RDF Data Cube model compatible with SDMX
11. 5 basic steps
• 1.Define the prefixes to be used
• 2.Publish your schema
• Define the dimension(s) – used to identify the observations (ex. time, region), what the
observation applies to
• Define the measure(s) – the phenomenon being observed
• Define the attribute(s) - unit of measure
• Define the DSD (attach components)
• 3.Publish your data
• Define the Dataset (attach DSD)
• Define Observations – the actual data
• 4.Include Slices (views) on your data
• Define SliceKey(s) - the fixed dimensions
• Define the DSD (attach SliceKey(s))
• Define the Dataset (attach Slices to be defined)
• Define Slices and Observations
• 5.Select appropriate URIs
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort11 |
12. 1. Prefixes
• PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
• PREFIX rdf: http://www.w3.org/1999/02/22-rdf-syntax-ns#
• PREFIX qb: <http://purl.org/linked-data/cube#>
• PREFIX interval: <http://reference.data.gov.uk/def/intervals/>
• PREFIX gn: <http://www.geonames.org/ontology#>
• PREFIX ssn: <http://purl.oclc.org/NET/ssnx/ssn#>
• PREFIX acorn-sat:
<http://lab.environment.data.gov.au/def/acorn/sat/>
• PREFIX acorn-series:
<http://lab.environment.data.gov.au/def/acorn/time-series/>
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort12 |
13. 2. Define the schema
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort13 |
Dimension
Dimension
Dimension
Measure
Atttribute
Measure
Attribute
Measure
Attribute
Atttribute
Atttribute
Dimension
14. 3. Define the Observations
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort14 |
15. 4. Define the slices
Observation
- MinTemperature
- MaxTemperature
- Rainfall
- Booleans for missing data
Day
(3) Month
(2) Year
(1) ACORN-SAT Series/System (station)
Current Data Cube structure (and URI/API logic)
• Stations/time series
• Year
• Month
• All linking to observations
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort15 |
16. Define the DSD
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort16 |
17. 5. Select appropriate URIs
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort17 |
18. Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort18 |
(extra) Statistics at slice level
To port to DDI-RDF Discovery
19. • Data describing the deployment history
• Available in ACORN-SAT station catalogue (pdf)
• Not available in tabular format distribution
• ACORN-SAT composite stations
– composed of one or several BoM stations
• BoM (Bureau of Meteorology) stations
– composed of one or several station sharing the same codes
• Textual description of significant events
• Data describing the detailed conditions of observations
• Sensors
• Deployment Intervals
… using Semantic Sensor Network (SSN) ontology
• SSN-XG report http://www.w3.org/2005/Incubator/ssn/XGR-ssn/
• SSN Ontology http://purl.oclc.org/NET/ssnx/ssn
Station metadata
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort19 |
20. SSN: deployed systems and observations
Skeleton
Device
Deployment
PlatformSite
System
ssn:System
onPlatform
hasSubsystem
hasDeployment
ssn:DeploymentRelatedProcess
ssn:Deployment
deploymentProcesPart
deployedSystem
ssn:Platform
deployedOnPlatform
attachedSystem
ssn:Device
ssn:Sensor
ssn:SensingDevice
observes
inDeployment
observedBy
ssn:Property
observedProperty
ssn:Observation
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort20 |
21. Example (Darwin)
Time series – Weather stations – Sites – (Sensors)
Darwin Post Office
014016 (1910-1942)
Darwin Airport
014015 (1941-2007 & 2001-now)
2 sites – 1km apart – same code used
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort21 |
22. Deployment phases in Darwin
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort22 |
23. Multiple Views on Data – Mashups
• Display the station locations and their average temperature
readings on a map
• http://lab.environment.data.gov.au/mashup/drilldown
• Select a Date range for climate readings for a given location
• http://lab.environment.data.gov.au/mashup
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort23 |
24. Multiple Views on Data – ELDA Linked Data API
ssn:hasSubSystem
ssn:hasDeployment
ssn:deploymentProcessPartssn:observedBy
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort24 |
25. Multiple Views on Data – SPARQL
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort25 |
26. Multiple Views on Data – SPARQL
PREFIX cube: <http://purl.org/linked-data/cube#>
PREFIX sat: <http://lab.environment.data.gov.au/def/acorn/sat/>
SELECT ?x, MAX(?max) AS ?MaxEver
WHERE { <http://lab.environment.data.gov.au/data/acorn/climate/slice/station/086071>
cube:subSlice ?y .
?y cube:subSlice ?x .
?x sat:month ?z .
?x cube:observation ?obs .
?obs sat:maxTemperature ?max .
FILTER regex(?z, "07")
}
ORDER BY DESC(?max) LIMIT 1
RESULT:
http://lab.environment.data.gov.au/data/acorn/climate/slice/station/086071/year/1975/
month/07 23.3
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort26 |
27. Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort27 |
28. Wrap up
• Experimental version of ACORN-SAT data
• Available at http://lab.environment.data.gov.au/
• Developed for the Australian Bureau of Meteorology (BOM) by CSIRO in cooperation with the Australian
Government Information Management Office (AGIMO)
• Temperature (homogenised) plus Rainfall (not homogenised)
• First version presented at Australian GovHack Day
• Alternative to tabular data
• Last version, uploaded to LOD cloud
• http://thedatahub.org/dataset/acorn-sat
• Linked data (and well managed URIs) to build the bridges between the different agencies
• Current linked data pilot is one agency (BoM) and one server but applies solutions and
schemes already in place in multi-agencies and multi-service providers context (e.g. UK)
• Thanks to AGIMO for helping us to set up http://lab.environment.data.gov.au/
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort28 |
30. Australian Government Linked Data
Working Group (AGLDWG)
• Ad-hoc group established August 2012
– BoM, OSP, CSIRO , AGIMO, DRALGAS, NAA, GA, ABS
• Terms of reference
– Develop technical guidelines and best practice on the use of ‘linked-
data’ by AG agencies
– Inform the development of data.gov.au as a platform for publishing
Commonwealth PSI
– Promote the benefits and encourage adoption of ‘linked-data’ for
publishing Commonwealth PSI
– Where appropriate, undertake specific activities and coordinate
projects in pursuit of these objectives
• Seeking formal endorsement
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort30 |
31. Conclusions
• Approach is applicable to all climate time series
• Opportunities to link to other datasets (Australia, World)
• Geo-features (e.g. GeoNames - done) for weather station sites, districts
• Other climate data e.g. regional and world climate data archives, cyclone
tracks (not yet available as linked data)
• Other environmental data (not yet available as linked data)
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort31 |
32. ISWC 2013
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort32 |
• The 12th International Semantic Web Conference
and the 1st Australasian Semantic Web Conference
21-25 October 2013, Sydney, Australia
• http://iswc2013.semanticweb.org/
• https://twitter.com/iswc2013
• First International Workshop on Semantic Statistics (SemStats 2013)
• SemStats 2013 Challenge
• Call for Papers
• http://datalift.org/en/event/semstats2013/challenge-cfp
• Data
• http://datalift.org/en/event/semstats2013/challenge
Recommended by!
34. Images credits
• Blair Trewin The ACORN-SAT station at Butlers Gorge in central
Tasmania (surfacetemperatures.blogspot.com.au )
• Nathanael Boehm
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort34 |
35. More information
• Laurent Lefort, Josh Bobruk, Armin Haller, Kerry Taylor and
Andrew Woolf A Linked Sensor Data Cube for a 100 Year
Homogenised daily temperature dataset Proc. SSN 2012
Using the Data Cube vocabulary for Publishing Environmental Linked Data on lab.environment.data.gov.au | Laurent Lefort35 |
Editor's Notes
The ACORN-SAT dataset replaces the previously released long term climate time series datasets released by the bureau (eg High Quality dataset)
Working Draft http://www.w3.org/TR/vocab-data-cube/
The tool used for figures is IHMC CMAP Ontology Editor http://www.ihmc.us/groups/coe/