Integration and Management of Diverse Environmental Data Sets

Integration and Management of Diverse Environmental Data Sets Cameron Kiddle Research Fellow Grid Research Centre University of Calgary

Outline
Data Challenges
GeoChronos (Spectral Libraries)
Spectral Library Demonstration
Cloud Services for Water Management
Cloud Services for Water Management Demonstration
Summit 09 Oct. 14, 2009

Data Challenges - Acquisition
Many different data sources
Different regulations/mechanisms for accessing data
Lack of automation
Finding the right data
Summit 09 Oct. 14, 2009

Data Challenges - Management
Scattered and unorganized data
Inadequate tools for recording/maintaining metadata
Data without metadata is meaningless
Lack of suitable metadata standards
Validation of metadata
Tracking provenance of data
Summit 09 Oct. 14, 2009

Data Challenges – Pre-processing
Raw data typically cannot be directly analyzed
Significant amount of time spent preparing data for analysis
Lack of automation
Summit 09 Oct. 14, 2009

GeoChronos
Partners
CANARIE (NEP-1)
Center for Earth Observation Sciences, University of Alberta
Cybera
Grid Research Centre, University of Calgary
Summit 09 Oct. 14, 2009

GeoChronos
An on-line platform (http://geochronos.org/)
For:
Earth Observation Scientists
Facilitating:
Collaboration between scientists
Application access, management and sharing
Data access, management and sharing
Leveraging:
Web 2.0 and social networking technologies
Cloud computing technologies
Semantic Web technologies
Summit 09 Oct. 14, 2009

GeoChronos
Data Solutions - Spectral Libraries
Store, share and browse spectral data
View spectral plots, metadata, ancillary data and maps
Manage and generate metadata for spectra
Create and share metadata schemas
Technology
iRODS ( http://www.irods.org/ ) for data storage/management
Semantic Web technologies such as RDF (Resource Description Framework) to link/relate data
Next Steps
Generalization of spectral library solution - acquire, store, manage, browse and share other types of data (i.e., satellite, flux, phenology, meteorological, etc.)
Automate data workflows (i.e., mosaic, reproject and subset MODIS data) using cloud-based services
Summit 09 Oct. 14, 2009

Spectral Library - Demonstration Summit 09 Oct. 14, 2009

Spectral Library - Browse Summit 09 Oct. 14, 2009

Spectral Library - Metadata Summit 09 Oct. 14, 2009

Spectral Library - Ancillary Data Summit 09 Oct. 14, 2009

Partners
Alberta Advanced Education and Technology
Alberta WaterSMART
Cybera
Geosensor Web Lab, University of Calgary
Grid Research Centre, University of Calgary
Tesera Systems Inc
Summit 09 Oct. 14, 2009

In preliminary stages of project
Explore use of cloud services to store, manipulate and expose data related to water management
Link and correlate a wide variety of data from a large number of sources
Cloud-based analysis and visualization tools
Investigate integration with existing Alberta WaterPortal (http://www.albertawater.com/)
Summit 09 Oct. 14, 2009

Cloud Services for Water Management - Demonstration Summit 09 Oct. 14, 2009

Data Types and Locations Displayed on Google Earth Summit 09 Oct. 14, 2009

Water Flow Data Shown using Google Visualization API Summit 09 Oct. 14, 2009

Integrating and Visualizing Different Data Sets From Calgary’s Flood in 2005 on Google Earth Summit 09 Oct. 14, 2009

Contact Information Summit 09 Oct. 14, 2009 Cameron Kiddle [email_address] http://pages.cspc.ucalgary.ca/~kiddlec/ http://grid.ucalgary.ca/

Integration and Management of Diverse Environmental Data Sets

by Cameron Kiddle on Oct 14, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

3 Embeds 7

Statistics

Integration and Management of Diverse Environmental Data Sets — Presentation Transcript

http://cameronkiddle.blogspot.com	3
http://www.slideshare.net	2
http://cameronkiddle.blogspot.ca	2