Data Management and Applications at SOCIB

294 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
294
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Data Management and Applications at SOCIB

  1. 1. Data Management and Applications at SOCIB IMDIS 2013 Lucca, Italy David March dmarch@socib.es S. Lora, JP. Beltran, K. Sebastián, S. Gómara and J. Tintoré
  2. 2. OUTLINE • What is SOCIB? • Data Management • Applications • Further works
  3. 3. OUTLINE • What is SOCIB? • Data Management • Applications • Further works
  4. 4. WHAT IS SOCIB • Marine Research Infrastructure located in Balearic Islands • Integrated system in implementation phase (2010-2014) • Nearshore to open sea (NW Mediterranean) • Components: – Distributed multiplatform observing system – Numerical forecasting system – Data Management and visualization system • Provide free open and quality controlled data for science, technology development and response to society needs
  5. 5. WHAT IS SOCIB OBSERVING FACILITIES Research vessel MODELLING FACILITY HF Radar Currents (ROMS) Waves (SWAN) STRATEGIC ISSUES & APPLICATIONS FOR SOCIETY Glider Fixed stations Drifting buoys Beach Monitoring Integrated Coastal Management Marine Spatial Planning
  6. 6. WHAT IS SOCIB DATA SOURCES PARAMETERS DATA TYPES DATA FORMATS
  7. 7. OUTLINE • What is SOCIB? • Data Management • Applications • Further works
  8. 8. DATA MANAGEMENT DATA CENTER FACILITY • Manage all multi-platform SOCIB Data • Allow users to discover, gather, visualize and download • Immerse in the international framework OPEN DATA PRINCIPLES • Discoverable and accessible • Freely available • Interoperable, standardized and quality controlled CHALLENGE • Implement an integrated data management system
  9. 9. DATA MANAGEMENT LIFE CYCLE OF DATA
  10. 10. DATA MANAGEMENT LIFE CYCLE OF DATA
  11. 11. DATA MANAGEMENT DATA PROCESSING DATA PROCESSING STAGES INSTRUMENTATION MANAGEMENT DB • Manages the state of all the instrumentation • PostgreSQL • Managed by web-based application 1. Input data ingestion 2. Data calibration 3. Parameter derivation 4. Merging (existent & new) 5. Quality Control 6. Product generation SOCIB Web based Real-Time Data Monitor Custom software implementations (operational / sporadic running) Java Matlab Python R GIS
  12. 12. DATA MANAGEMENT LIFE CYCLE OF DATA
  13. 13. DATA MANAGEMENT DATA ARCHIVAL netCDF REPOSITORY • CF conventions • GRID / RASTER / MESH / TIME SERIES SPATIAL DATABASE • POINT / LINE / POLYGON
  14. 14. DATA MANAGEMENT LIFE CYCLE OF DATA
  15. 15. DATA MANAGEMENT DATA DISTRIBUTION AND ACCESS THREDDS GEOSERVER • OGC (WMS) , OpenDAP, jWebChart • OGC (WMS, WFS, KML) http://thredds.socib.es/ http://gis.socib.es/geoserver DATA DISCOVERY • API RESTful • JSON/GeoJSON API http://apps.socib.es/DataDiscovery
  16. 16. DATA MANAGEMENT LIFE CYCLE OF DATA
  17. 17. DATA MANAGEMENT DATA CATALOG AND DATA DISCOVERY SOCIB INSTRUMENTATION APP GEONETWORK • Observation platforms, CF conventions • ISO19115, CSW THREDDS • ncISO http://gis.socib.es/geonetwork
  18. 18. DATA MANAGEMENT LIFE CYCLE OF DATA
  19. 19. DATA MANAGEMENT APPLICATIONS AND USERS WEB DEVELOPMENT MAPPING LIBRARIES OpenLayers Mobile Google Maps USERS MULTIPLE DEVICES Desktop / Web GeoExt Researchers and Techinicians General society Policy and decision makers
  20. 20. DATA MANAGEMENT
  21. 21. DATA MANAGEMENT Data Center in numbers 2010 – present DATA PRODUCTION • 184 deployments • 201 instruments • Serving more than 50,000 NetCDF files (3.1 TB) CORPORATE WEBSITE • 248,935 pageviews • 59,128 visitors (4.21 pages/visit) • 3’49” Avg. visit duration
  22. 22. OUTLINE • What is SOCIB? • Data Management • Applications • Further works
  23. 23. APPLICATIONS DAPP – Deployments application http://apps.socib.es/dapp/ TECHNOLOGIES Web application to display information related to trajectories from mobile platforms (e.g., gliders, drifter buoys, ARGO profilers, research vessel) API USERS • Scientists & Researchers • Technicians • Search and Rescue (SAR)
  24. 24. APPLICATIONS LW4NC2 http://thredds.socib.es/lw4nc2 TECHNOLOGIES Web application for multidimensional (grid) data from netCDF files, usually from numerical models or HF radar. USERS • Researchers • Technicians
  25. 25. APPLICATIONS SACOSTA http://gis.socib.es/sacosta TECHNOLOGIES Web-based map viewer for cartographic data such as environmental sensitivity of the coastline USERS • Search and Rescue (SAR) • Policy makers
  26. 26. APPLICATIONS SEABOARD http://seaboard.socib.es TECHNOLOGIES Web tool to disseminate SOCIB real time data to entities that collaborate with the SOCIB Beach Monitoring Facility API USERS • Hotel guest • Beach users
  27. 27. APPLICATIONS FOLLOW THE GLIDER http://followtheglider.com/ TECHNOLOGIES Educational web tool aimed to present the autonomous underwater gliders and gain awareness of their importance for coastal research. API USERS • Students • Teachers • General public
  28. 28. APPLICATIONS BEAMON http://apps.socib.es/beamon TECHNOLOGIES Web tool to display real time data of beach images acquired by the beach monitoring facility. USERS • Researchers • Surfers, anglers • General public
  29. 29. APPLICATIONS SOCIB MOBILE Apps for real-time data from fixed stations (oceanographic buoys, sea level stations and coastal weather stations, etc.) and glider trajectories TECHNOLOGIES API USERS • General public • Researchers • Technicians
  30. 30. APPLICATIONS SOCIB WEBSITE http://www.socib.es/ TECHNOLOGIES Corporate website to provide an overview of the different Facilities. USERS • General public • Researchers
  31. 31. OUTLINE • What is SOCIB? • Data Management • Applications • Further works
  32. 32. FURTHER WORKS MANAGE BIG DATA OBSERVATIONAL DATA MONITORING SERVICES vs DATA DISCOVERY NEW APPLICATIONS
  33. 33. CONCLUSIONS • SOCIB Data Centre is an example of the marine information systems of new ocean observatories and/or marine research infrastructures • Open Data principles in line with the INSPIRE Directive and other important European initiatives such as Emodnet or Copernicus • Response to society needs and provide support to the Integrated Maritime Policy and the Marine Strategy Framework Directive
  34. 34. THANK YOU! GRAZIE! GRACIAS! David March dmarch@socib.es S. Lora K. Sebastián S. Gómara JP. Beltran B. Frontera J. Tintoré Data Centre data.centre@socib.es

×