Time series data extraction from NetCDF in TasMaN project

1. Timeseries extraction, visualisation and
exploration
TasMAN, Sense-T, SensorCloud
CCI
Chris Sharman | Research Team Leader
17th March 2014

2. Introduction
• CCI= CSIRO Computational Informatics
• Sensor Networks / Gridded Model projects:
• Tasmanian Marine Analysis Network (TasMAN)
• SouthEsk Hydrological Sensor Network
• Sense-T (www.sense-t.org.au)
• Cross domain sensor networks:
• Coastal/Marine
• Hydrological
• Agriculture
• Aquaculture
Timeseries Servcies | Chris Sharman2 |

3. TasMAN Project
• Use case: Web-based sensor/model data exploration,
visualisation.
• Requirements
• Easy for Web Clients
• Low-latency, web-time
• Linked to WMS
• Data
• Sparse near real-time low-cost marine sensor nodes
• CSIRO SHOC model netCDF curvilinear output
– non-uniform grid
Timeseries Services | Chris Sharman3 |

4. TasMAN – Approach
• Sensor Network timeseries -> bespoke web service (see later)
• Model data -> patched ncWMS
• GetFeatureInfo request with JSON encoding (not standardised)
• Support for vector styles on rotated cell curvilinear grids
Timeseries Services | Chris Sharman4 |
{
longitude: 147.39339269881506,
latitude: -42.95279095077819,
featureInfo:
[
{
layerName: "setas_surf_nrt.temp",
iIndex: 101,
jIndex: 66,
elevation: -0.5,
gridCentreLon: 147.39511108398438,
gridCentreLat: -42.9555549621582,
featureInfo:
{2012-04-11T20:00:00.000Z: "15.368134",
2012-04-11T21:00:00.000Z: "15.308427",
2012-04-11T22:00:00.000Z: "15.210996",
2012-04-11T23:00:00.000Z: "15.168934",
2012-04-12T00:00:00.000Z: "15.173564",...

5. TasMAN – Web Client
• OpenLayers (WMS)
• Spatio-Temporal explorer
• Dataset browser (Simile
Timeline, ncWMS API)
• Time series chart
• Bespoke HTML/JS/Canvas
implementation
– Animated, interactive
– Multiple heterogeneous
timeseries
– Dynamic data loading
– GetFeatureInfo requests
Timeseries Services | Chris Sharman5 |

6. Sense-T and SensorCloud
• Infrastructure for Sense-T research projects
• Point-based timeseries
• Real-time ingestion network
• Sensor Messaging Gateway
• Annotation Service
• SensorCloud API
• THREDDS for Gridded data
Presentation title | Presenter name6 |

7. Data Exchange vs Web Visualisation, Exploration.
• SensorCloud API
• RESTful API
• StarFL meta-data model (OGC Discuss. Paper)
• Focus on simplicity and performance
• Low barrier to entry for developers
• Flexible Aggregation
• OGC SOS
• Designed for data exchange
• Strong governance
• Slow moving
• High Barrier to entry
Timeseries Services | Chris Sharman7 |

8. Presentation title | Presenter name8 |

9. CCI / Autonomous Systems
Chris Sharman
Research Team Leader
t +61 03 6232 5515
e chris.sharman@csiro.au
w www.csiro.au
CCI
Thank you – Questions?