Cyberscience, Software Engineering & Automated Workflows in Geoscience: Perspectivies from EARTHTIME and GeoChron, by Jim Bowring, College of Charleston

•Download as PPTX, PDF•

1 like•522 views

Talk at the EarthCube End-User Domain Workshop for Rock Deformation and Mineral Physics Research. By Jim Bowring, College of Charleston

Automating Workflow from
Raw Data to Repository:
Collaborative Software Engineering

James F. Bowring
Computer Science Department
College of Charleston

EarthCube End-User Domain Workshop
for Rock Deformation & Mineral Physics
Alexandria VA, 13 November 2013

Roadmap
Background

EarthCube
EARTHTIME as Mainstream Science
Software Chasm
CIRDLES as Mainstream Solution Provider
Thoughts

Questions

13 November 2013

Jim Bowring EarthCube Alexandria

2

Background
College of Charleston: Teaching / Research

Software Design / Engineering / Testing
EarthCube: Governance & Software

EARTHTIME: Collaborator
CIRDLES: PI

13 November 2013

Jim Bowring EarthCube Alexandria

3

13 November 2013

Jim Bowring EarthCube Alexandria

Photo courtesy of C. Frank StarmerJuly 2005
4

EarthCube
Structure
&
Tectonic
s

Geodesy
Solar
Terrestria
l

Aeronom
y

Meteorology
Magnetospheric
Physics
PaleoClimate

Solid and
Aqueous
Geochem
-istry

Space
Weather

Climate &
Large
Scale
Dynamic
s

NCAR
Atmospheric
Chemistr
y

EarthCube
CI

Geobiolo
gy &
Geo Ed &
PaleoenWorkforc
tology
e
Geophysi
Training
Cryosphe
cs &
Sediment
re & Ice
Geody-ology &
Dynamic
namics
Stratis
graphy
Critical
Hydrolog
Zone &
y
Soil
Science
Geomorphology

Bioinformati
cs

Physical
Oceanography
Biologica
l
Oceanography

Biology
Ecosyste
ms

Software
&
Modeling

High Perf
Computin
g

Semantic
s&
Ontologi
es

13 November 2013

Igneous
Petrology
& Volcanology

Marine
Geology

Ocean
Drilling &
Engineering

Chemical
Oceanography
Algorith
ms &
Data
Mining

Ocean
Educatio
n

Marine
Geophysi
cs

Jim Bowring EarthCube Alexandria

5

Goal:
calibrate earth history and develop the
geochronological techniques necessary to produce
high precision dates

Requires:
robust software for data reduction, analysis, and
archiving to support both science and education

13 November 2013

Jim Bowring EarthCube Alexandria

6

EARTHTIME
Software Requirements
open-source applications for full real-time
interactive data reduction and uncertainty
propagation
provide extensible plug-n-play models
provide graphical and statistical tools
produce publication-ready artifacts
automatically capture meta-data

produce a standardized & extensible record
for transport to / from archival databases
13 November 2013

Jim Bowring EarthCube Alexandria

7

Software Chasm
Kelly: domain-independent software
engineering solutions serve to isolate
the scientific-computing community
[IEEE Software 2007]

Wilson: treat scientific software with
scientific rigor
[American Scientist 2006]

13 November 2013

Jim Bowring EarthCube Alexandria

8

CIRDLES
Cyber Infrastructure Research and
Development Lab for the Earth Sciences
CIRDLES.org

Collaborative domain-specific software
engineering research to produce tools that
advance science

13 November 2013

Jim Bowring EarthCube Alexandria

9

Collaborative Development Process

13 November 2013

Jim Bowring EarthCube Alexandria

10

Long Tail Solution

13 November 2013

Jim Bowring EarthCube Alexandria

11

Archive with a Click !

13 November 2013

Jim Bowring EarthCube Alexandria

12

Thoughts:
Automating Workflow
from Raw Data to Repository

EarthCube must serve scientists and science
Collaborative Software / CI Engineering

Long-term support for software products
Less tedium, more science
Semantic Web Open World Assumption
13 November 2013

Jim Bowring EarthCube Alexandria

13

Questions ?

13 November 2013

Jim Bowring EarthCube Alexandria

14

The document summarizes an EarthCube community webinar that took place on December 19, 2013. The webinar covered EarthCube updates, the EarthCube test enterprise governance project, and the EarthCube funding solicitation. It provided an agenda for presentations on EarthCube governance, the funding solicitation, and a perspective on EarthCube from the NSF. It also described the goal of EarthCube to create a future state of geosciences cyberinfrastructure and outlined the test enterprise governance project which aims to develop an agile approach to designing an EarthCube system through community engagement.

Portfolio Assembly Workshop: Intro

EarthCube

EarthCube Monthly Community Webinar- Nov. 22, 2013

EarthCube

This webinar features project overviews of all EarthCube Awards (Building Blocks, Research Coordination Networks, Conceptual Designs, and Test Governance), followed by a call for involvement, and a Q&A session. Agenda: EarthCube Awards – Project Overviews 1.. EarthCube Web Services (Building Block) 2. EC3: Earth-Centered Community for Cyberinfrastructure (RCN) 3. GeoSoft (Building Block) 4. Specifying and Implementing ODSIP (Building Block) 5. A Broker Framework for Next Generation Geoscience (BCube) (Building Block) 6. Integrating Discrete and Continuous Data (Building Block) 7. EAGER: Collaborative Research (Building Block) 8. A Cognitive Computer Infrastructure for Geoscience (Building Block) 9. Earth System Bridge (Building Block) 10. CINERGI – Community Inventory of EC Resources for Geoscience Interoperability (BB) 11. Building a Sediment Experimentalist Network (RCN) 12. C4P: Collaboration and Cyberinfrastructure for Paleogeosciences (RCN) 13. Developing a Data-Oriented Human-centric Enterprise for Architecture (CD) 14. Enterprise Architecture for Transformative Research and Collaboration (CD) 15. EC Test Enterprise Governance: An Agile Approach (Test Governance) A Call for Involvement!

EarthCube Stakeholder Alignment Survey Introduction to the Data by Joel Cutch...

EarthCube

EC Portfolio Workshop Introduction

EarthCube

The document summarizes an EarthCube workshop held in February 2014 that sought to gather guidance on developing cyberinfrastructure for geosciences. The workshop goals were to assess needs, visions, opportunities and challenges for building EarthCube and identify how the EarthCube Commons could support the community. The document then outlines plans for an agile approach to EarthCube governance that would engage stakeholders, crowdsource ideas, test concepts, and make recommendations to the National Science Foundation. It provides timelines and functions for the initial governance approach and stakeholder engagement in year one.

Novel Techniques & Connections Between High-Pressure Mineral Physics, Microto...

EarthCube

$Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...$ $Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...$

Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...

EarthCube

Astronauts and Robots 2015: Randall Friedl, JPL

American Astronautical Society

Zachary Labe is a postdoc researcher at NOAA GFDL and Princeton University who studies climate variability and change. His research uses tools like artificial intelligence and climate models to disentangle the signal of climate change from natural weather noise. He conducts field work including Arctic expeditions and uses supercomputers to run complex climate models that generate huge amounts of data.

MSc Geophysics

Emily350847

Developed on the back of a recognised need for qualified Geophysicists within industry, this unique programme is designed to expose students to the theory and practice of modern geophysics, with an emphasis on cutting edge techniques for understanding the structure, dynamics and composition of the Earth from the near surface to the deep interior. The content is broad-based and integrative with a strong focus on the quantitative aspects of geophysical data analysis and interpretation.

Silicon Happy Valley 2016

Corey Cochrane

The presentation discusses the evolution of space-based magnetometers from early fluxgate designs to more advanced solid-state technologies. It provides context on magnetometry and its importance for scientific discovery in fields like heliophysics, planetary science, and earth science. Examples are given of magnetometers used on past and current NASA missions. The presentation then shifts to discussing the speaker's current research developing a new silicon carbide magnetometer for space applications.

Discovery and spectroscopy_of_the_young_jovian_planet_51_eri_b_with_the_gemin...

Sérgio Sacani

Indo além da descoberta e imageamento de um jovem Júpiter, os astrônomos usando o novo instrumento do Observatório Gemini, Planet Imager, o GPI, eles pesquisaram um mundo recém-descoberto com detalhes sem precedentes. O que eles encontraram é um planeta com cerca de duas vezes a massa de Júpiter, e o exoplaneta mais parecido com um planeta do Sistema Solar já imageado diretamente ao redor de outra estrela. O exoplaneta, conhecido como 51 Eridani b, orbita sua estrela hospedeira a uma distância equivalente a 13 vezes a distância da Terra ao Sol (o equivalente a uma distância entre Saturno e Urano no nosso Sistema Solar). O sistema está localizado a cerca de 100 anos-luz de distância. Os dados do Gemini, também forneceram aos cientistas as detecções espectroscópicas de metano já detectadas na atmosfera de um planeta fora do nosso Sistema Solar, adicionando mais similaridades desse exoplaneta com os planetas gigantes do nosso Sistema Solar.

Space Weather: Forecasting, Tracking, and the Effects of Earth Directed Solar...

Emily Schomp

This document provides an overview of space weather phenomena, their effects on Earth, and how they are forecasted and tracked. It describes various solar events like solar flares and coronal mass ejections that can impact Earth. These events are monitored using instruments in space. Models then use data to predict the speed and arrival of solar material. When events hit Earth, they can cause auroras, radiation storms, and issues for technologies. Continuous research improves understanding and forecasting of space weather, which is important as society increasingly relies on technologies affected by these solar events.

Contrasting polar climate change in the past, present, and future

Zachary Labe

Community Webinar: Tune up for AGU

EarthCube

Engagement Team monthly meeting 10.10.2014

EarthCube

The document outlines the agenda and priorities for an EarthCube Demonstration Governance Engagement Team meeting in October 2014. The agenda includes an introduction, announcing a team representative to the Leadership Council, developing internal leadership, reviewing priorities and logistical functions, and discussing future meeting schedules. Key priorities and deliverables for the team are to develop an outreach and communications plan to engage the EarthCube community and stakeholders through compiling science use cases. Housekeeping, meeting leadership, point of contact roles, work management, and collaboration with other groups are listed as important logistical functions for the team.

Sci Committee Meeting Slides 10.06.14

EarthCube

The document summarizes the agenda and priorities for an October meeting of the Science Standing Committee. The agenda includes an introduction, announcing committee representatives, developing internal leadership, and reviewing priorities and logistical functions. The committee's year 1 intended outcome is to support work to complete the year 1 deliverable of developing science use cases. Their priorities are housekeeping tasks like assigning a meeting lead and point of contact for the oversight office.

Funded teams slides 10.10.14

EarthCube

This document summarizes an EarthCube meeting to discuss funded demonstration projects and governance. It outlines the agenda, including introductions from new project teams and a discussion of the role of funded projects. Key points include that the Test Governance project will coordinate the demonstration governance process and report outcomes to NSF. Both the Technology & Architecture Committee and Science Committee outlined initial steps, including forming subcommittees to analyze use cases and gaps. The meeting concluded with a discussion of how funded projects can best work with standing committees through formal work plans, representatives, and regular communication.

Technology and Architecture Committee meeting slides 10.06.14

EarthCube

The October meeting agenda of the EarthCube Technology and Architecture Standing Committee included: 1) Welcome and introductions 2) Announcement of new committee representatives 3) Discussion of the committee's internal leadership structure and responsibilities, including coordinating with other groups, monitoring working groups, and sponsoring new working groups. 4) Review of timelines for upcoming milestones and deliverables and discussion of future meeting schedules.

EarthCube Governance Intro for Solar Terrestrial End-user Workshop

EarthCube

EarthCube Community Webinar: Introduction to Committees and Teams

EarthCube

AHM 2014: The CSDMS Standard Names, Cross-Domain Naming Conventions for Descr...

EarthCube

The document discusses the CSDMS Standard Names, which provide unambiguous naming conventions for describing process models, data sets, and their associated variables. The standard names aim to avoid ambiguity and domain-specific terminology. They support naming quantities, processes, mathematical operations, assumptions, and more. Developing and applying standard names helps different models to automatically match variables and understand each other.

AHM 2014: PolarHub: A Global Hub for Geospatial Service Discovery

EarthCube

AHM 2014: Addressing Data and Heterogeneity, Semantic Building Blocks & CI Pe...

EarthCube

This panel will address data heterogeneity issues in EarthCube from the perspective of semantic building blocks and cyberinfrastructure. The panel, convened by Gary Berg-Cross of SOCoP, will feature co-conveners Pascal Hitzler of Wright State University, Kerstin Lehnert of LDEO, Columbia University, and Peter Wiebe of Woods Hole Oceanographic Institution. Additional panelists will include Scott Peckham of University of Colorado Boulder, Anthony Aufdenkampe of Stroud Water Research Center, Tim Finin of University of Maryland Baltimore County, and Krzysztof Janowicz of University of California Santa Barbara.

AHM 2014: Revisting Governance Model, Preparing for Next Steps

EarthCube

The document lists several potential priorities for EarthCube including developing an emergent architecture, identifying and promoting success stories, providing guidelines for shared services, developing common end user training, benchmarking progress against scientific needs, creating a prototype to demonstrate connectivity and functionality, documenting scientific workflows, and coordinating projects. Additional options mentioned are scoping and articulating a vision, identifying collaborations, documenting use cases, engaging academia in education, improving data management plans and data discovery, establishing light governance led by scientists, tying different design efforts together, determining funding mechanisms, adopting standards, enabling participation from diverse fields, and engaging stakeholders.

AHM 2014: The World of VHub.org ONline Collaboration, Sharing, Data, Models...

EarthCube

AHM 2014: Crawling for EarthCube

EarthCube

AHM 2014: The Flow Simulation Tools on VHub

EarthCube

AHM 2014: Integrated Data Management System for Critical Zone Observatories

EarthCube

Peckham 2014 i_em_ss

EarthCube

The document discusses the CSDMS Standard Names, which are naming conventions developed by the Community Surface Dynamics Modeling System (CSDMS) modeling framework to facilitate automatic coupling of models and data sets from different contributors. The naming conventions follow an object-oriented approach where each standard variable name is composed of an object name and quantity name joined by double underscores. This allows framework software to retrieve numerical values for variables based on their standardized names. The naming conventions were designed according to criteria such as avoiding ambiguity, using widely understood terminology, and supporting mathematical operations and assumptions. They address challenges of automatic semantic mediation when coupling diverse resources that use different naming systems.

Similar to Cyberscience, Software Engineering & Automated Workflows in Geoscience: Perspectivies from EARTHTIME and GeoChron, by Jim Bowring, College of Charleston

Researching and Communicating Our Changing Climate

Zachary Labe

MSc Geophysics

Emily350847

Silicon Happy Valley 2016

Corey Cochrane

Discovery and spectroscopy_of_the_young_jovian_planet_51_eri_b_with_the_gemin...

Sérgio Sacani

Space Weather: Forecasting, Tracking, and the Effects of Earth Directed Solar...

Emily Schomp

Contrasting polar climate change in the past, present, and future

Zachary Labe

Similar to Cyberscience, Software Engineering & Automated Workflows in Geoscience: Perspectivies from EARTHTIME and GeoChron, by Jim Bowring, College of Charleston (6)

Researching and Communicating Our Changing Climate

MSc Geophysics

Silicon Happy Valley 2016

Discovery and spectroscopy_of_the_young_jovian_planet_51_eri_b_with_the_gemin...

Space Weather: Forecasting, Tracking, and the Effects of Earth Directed Solar...

Contrasting polar climate change in the past, present, and future

More from EarthCube

Community Webinar: Tune up for AGU

EarthCube

Engagement Team monthly meeting 10.10.2014

EarthCube

Sci Committee Meeting Slides 10.06.14

EarthCube

Funded teams slides 10.10.14

EarthCube

Technology and Architecture Committee meeting slides 10.06.14

EarthCube

EarthCube Governance Intro for Solar Terrestrial End-user Workshop

EarthCube

EarthCube Community Webinar: Introduction to Committees and Teams

EarthCube

AHM 2014: The CSDMS Standard Names, Cross-Domain Naming Conventions for Descr...

EarthCube

AHM 2014: PolarHub: A Global Hub for Geospatial Service Discovery

EarthCube

AHM 2014: Addressing Data and Heterogeneity, Semantic Building Blocks & CI Pe...

EarthCube

AHM 2014: Revisting Governance Model, Preparing for Next Steps

EarthCube

AHM 2014: The World of VHub.org ONline Collaboration, Sharing, Data, Models...

EarthCube

AHM 2014: Crawling for EarthCube

EarthCube

AHM 2014: The Flow Simulation Tools on VHub

EarthCube

AHM 2014: Integrated Data Management System for Critical Zone Observatories

EarthCube

Peckham 2014 i_em_ss

EarthCube

AHM 2014: BCube Brokering Framework

EarthCube

The document discusses a watershed modeling system called BCube that aims to decrease the effort of watershed initialization by brokering various global geospatial and environmental data required for watershed modeling. BCube allows researchers to focus on scientific research by providing a single access point to the different data formats and sources for elevation, soils, land use, weather, and other data needed to set up and run watershed models. The document provides an overview of the types of data BCube can broker and the workflow where a scientist requests data for a watershed area and BCube returns the available options to choose from.

AHM 2014: EarthCube Architecture Forum Introduction

EarthCube

AHM 2014: A Few Notes on GEOSS Architecture

EarthCube

AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...

EarthCube

More from EarthCube (20)