SlideShare a Scribd company logo
SEEDS Standards Process

Richard Ullman
SEEDS Standards Formulation Team Lead
Richard.E.Ullman@nasa.gov

05 December, 2002

HDF & HDF-EOS Workshop VI

1
SEEDS
• The Strategic Evolution of ESE Data Systems is:
– A strategy for ESE to maximize the science and applications utility
of ESE data.
– A formulation study of best practices in ESE data systems.
– A process for incorporating lessons learned from past and present
ESE data systems into new data system implementations.
– A tool for engaging communities of ESE data providers and users
in the SEEDS strategy.
– NOT a data system development or implementation project or
program - a strategy that applies to implementing organizations.

05 December, 2002

HDF & HDF-EOS Workshop VI

2
SEEDS Formulation Status
• Seven formulation study areas
–
–
–
–
–
–
–

Cost Estimation
Data Lifecycle
Reference Architecture and Reuse
Metrics
Technology Infusion
Standards Processes
Near Term Missions Standards

• Schedule
– SEEDS Formulation team has developed an integrated
Formulation Report and is presently working through GSFC, HQ,
and external review process prior to release.
– Third SEEDS Public Workshop - March 19-21, 2003 Annapolis
05 December, 2002

HDF & HDF-EOS Workshop VI

3
SEEDS Standards Premise
• "An important premise underlying [SEEDS] is that its
various parts should have considerable freedom in the
ways in which they implement their functions and
capabilities. Implementation will not be centrally
developed, nor will the pieces developed be centrally
managed. However, every part of [the ESE network]
should be configured in such a way that data and
information can be readily transferred to any other. This
will be achieved primarily through the adoption of
common interface standards and practices.” [SEEDS preformulation document]
• Standards are what make increased flexibility for SEEDS
participants possible.
05 December, 2002

HDF & HDF-EOS Workshop VI

4
Simplified Data Flow Diagram

Key

Satellite
Instruments

Science or Applications Data
Center

Internal data flow

L0 or spacecraft data

Distribution flow

Ground
Receiving
Station
L0 Processing

Standard Data
Processing

Near Term
Archive

PI-managed, Mission, Theme
Based or Multi-mission Data
Center

U
S
E
R
S

System interchange

Backbone Data Center or Long Term Archive

05 December, 2002

HDF & HDF-EOS Workshop VI

5
SEEDS Standards Process
• Standards Process Study has made recommendations to the
SEEDS formulation
– For approving and developing standards for the ESE network of
data systems and services throughout the SEEDS era.
– Types of standards to be addressed by these processes:
•
•
•
•
•
•
•

Distributed information search protocols (e.g., EOSDIS V0, Z39.50)
Data interface standards (e.g, OGC Web Map Services, DODS)
Data distribution packaging standards (e.g., HDF/HDF-EOS)
Data interchange packaging standards (e.g., HDF/HDF-EOS)
Metadata and documentation standards (e.g., GCMD DIF, ESML)
Service documentation standards (e.g., GCMD SERF)
Service communication protocols (e.g., UDDI, WSDL, SOAP)

05 December, 2002

HDF & HDF-EOS Workshop VI

6
SEEDS Standards Process
• Recommended process should have elements similar to the
IEFT process
• Preference should be given to adoption over development
• Standards should have demonstrated implementation
relevant to ESE.
• Process should be guided by a “Standards Working Group”
– Members to be drawn from NASA ESE funded activities
• Awardees of the REASoN CAN
• Representatives of NASA ESE mission science and project teams
• ESE Applications Office representation

05 December, 2002

HDF & HDF-EOS Workshop VI

7
International
& Interagency
Agreement

HQ Mandate
Science and
Applications

Project
Needs

Vendor
Offerings
Existing
Standards

Adopt or Develop ?

Requirements, needs, constraints come from
various places inside and outside of ESE
•These can be met either by adopting an
already existing specification or by
developing a specification.
•Adopting an existing specification is
preferred to developing a new one.

Adopt

Develop

Candidate
Standards

Revision

Requirements
Revision

Review

Profile

Extend

Existing
Standard

Existing
Standard

Existing
Standard

Testbed/
Spec

Initial
Draft Standards

Choose process
based on
interface
characteristics

Review

Inter-project
Collaboration

RFP/Proposal/
Contract

Approve
Major Revision

Initial
Draft Standards

RFCs

Working
Implementations

Initial
Review
Proposed
Standards

2 Working
Implementations &
Operational experience

Promote to
Draft
Draft
Standards
Declare
Standard
ESE

05 December, 2002
Standards

Significant implementation &
Successful Operational Use

The approval process is based on the IETF process as
documented in RFC2026.
“The goals of the Standards Process are:
•technical excellence;
•prior implementation and testing;
•clear, concise, and easily understood documentation;
•openness and fairness; and
•timeliness.*”

* rfc2026, Section 1.2
HDF & HDF-EOS Workshop- VI

8
Standards Process Status
• SEEDS in FY’03 is in “transition” from formulation.
• Refinement of process recommendations and status of
concurrence by NASA management will be discussed at
next community workshop
– March 19-21 @ “Historic Inns of Annapolis”

• Standards Study Formulation Team is preparing for
initiation of Standards Working Group.
– Group may be initiated shortly after community workshop
– Initial focus will be organizational
– Hope to rapidly begin consideration of “ratifying” standards
already in wide use within ESE (such as HDF)

05 December, 2002

HDF & HDF-EOS Workshop VI

9
SEEDS Near-Term Study Findings
• Requirements for system interchange among ESE
components are different from requirements for
distribution to end-users.
– System interchange packaging standards must focus on interface
standardization, completeness, and correctness of transfer over
“ease of use”.
– The primary requirement for distribution to end-users is “ease of
use”.

• In the near-term, the chief mode of delivering data remains
the transfer of discrete files.
– Data format is the critical component of data packaging.

05 December, 2002

HDF & HDF-EOS Workshop VI

10
SEEDS Near-Term Study Findings
• The use of a general standard is insufficient for
interoperability.
– A common “profile” of the standard is required.
– “profile” is a convention for use of a standard within a user
community.
– “Community-based” standards and profiles of standards, are
preferable

• Evolution of standards for mission science data over the
lifetime of the mission and beyond is inevitable. These
include standards for:
–
–
–
–

Data formats.
Catalog interfaces.
Associated metadata content and format.
Documentation standards

05 December, 2002

HDF & HDF-EOS Workshop VI

11
More SEEDS Information
•

Get reports here:
http://eos.nasa.gov/seeds

05 December, 2002

HDF & HDF-EOS Workshop VI

12

More Related Content

Similar to SEEDS Standards Process

Welcome to HDF Workshop V
Welcome to HDF Workshop VWelcome to HDF Workshop V
Welcome to HDF Workshop V
The HDF-EOS Tools and Information Center
 
Hdg geo discussion
Hdg geo discussionHdg geo discussion
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible FormatsGeneralized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
The HDF-EOS Tools and Information Center
 
Metadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data ProvidersMetadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data Providers
The HDF-EOS Tools and Information Center
 
HDF5 and The HDF Group
HDF5 and The HDF GroupHDF5 and The HDF Group
Aura HDF-EOS File Format Guidelines: Overview and Status
Aura HDF-EOS File Format Guidelines: Overview and StatusAura HDF-EOS File Format Guidelines: Overview and Status
Aura HDF-EOS File Format Guidelines: Overview and Status
The HDF-EOS Tools and Information Center
 
HDF-EOS Workshop II Introduction
HDF-EOS Workshop II IntroductionHDF-EOS Workshop II Introduction
HDF-EOS Workshop II Introduction
The HDF-EOS Tools and Information Center
 
Eidc data centre support
Eidc data centre supportEidc data centre support
Eidc data centre support
Chris Collins
 
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
The HDF-EOS Tools and Information Center
 
2004 Net-centric Systems and Services Interoperability Engineering (NESSIE)
2004 Net-centric Systems and Services  Interoperability Engineering (NESSIE)2004 Net-centric Systems and Services  Interoperability Engineering (NESSIE)
2004 Net-centric Systems and Services Interoperability Engineering (NESSIE)
Bob Marcus
 
Building Cyber-infrastructure at UNC-CH
Building Cyber-infrastructure at UNC-CHBuilding Cyber-infrastructure at UNC-CH
Building Cyber-infrastructure at UNC-CH
Gary Wilhelm
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and Interoperability
Nasr Khashoggi
 
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
BigData_Europe
 
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
The HDF-EOS Tools and Information Center
 
HDF5 for NPOESS Data Products
HDF5 for NPOESS Data ProductsHDF5 for NPOESS Data Products
HDF5 for NPOESS Data Products
The HDF-EOS Tools and Information Center
 
Standard Safeguarding Dataset - overview for CSCDUG.pptx
Standard Safeguarding Dataset - overview for CSCDUG.pptxStandard Safeguarding Dataset - overview for CSCDUG.pptx
Standard Safeguarding Dataset - overview for CSCDUG.pptx
RocioMendez59
 
NASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDISNASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDIS
The HDF-EOS Tools and Information Center
 
Building and Extensible Storage Ecosystem with WOS
Building and Extensible Storage Ecosystem with WOSBuilding and Extensible Storage Ecosystem with WOS
Building and Extensible Storage Ecosystem with WOS
inside-BigData.com
 
Data science.pptx
Data science.pptxData science.pptx
Data science.pptx
HakkinsRaj
 
MEDIN Discovery Metadata Standard
MEDIN Discovery Metadata StandardMEDIN Discovery Metadata Standard

Similar to SEEDS Standards Process (20)

Welcome to HDF Workshop V
Welcome to HDF Workshop VWelcome to HDF Workshop V
Welcome to HDF Workshop V
 
Hdg geo discussion
Hdg geo discussionHdg geo discussion
Hdg geo discussion
 
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible FormatsGeneralized Conversion of HDF-EOS Products to GIS-Compatible Formats
Generalized Conversion of HDF-EOS Products to GIS-Compatible Formats
 
Metadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data ProvidersMetadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data Providers
 
HDF5 and The HDF Group
HDF5 and The HDF GroupHDF5 and The HDF Group
HDF5 and The HDF Group
 
Aura HDF-EOS File Format Guidelines: Overview and Status
Aura HDF-EOS File Format Guidelines: Overview and StatusAura HDF-EOS File Format Guidelines: Overview and Status
Aura HDF-EOS File Format Guidelines: Overview and Status
 
HDF-EOS Workshop II Introduction
HDF-EOS Workshop II IntroductionHDF-EOS Workshop II Introduction
HDF-EOS Workshop II Introduction
 
Eidc data centre support
Eidc data centre supportEidc data centre support
Eidc data centre support
 
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
 
2004 Net-centric Systems and Services Interoperability Engineering (NESSIE)
2004 Net-centric Systems and Services  Interoperability Engineering (NESSIE)2004 Net-centric Systems and Services  Interoperability Engineering (NESSIE)
2004 Net-centric Systems and Services Interoperability Engineering (NESSIE)
 
Building Cyber-infrastructure at UNC-CH
Building Cyber-infrastructure at UNC-CHBuilding Cyber-infrastructure at UNC-CH
Building Cyber-infrastructure at UNC-CH
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and Interoperability
 
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
 
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
Implementation of OGC Web Coverage Service Using HDF5/HDF-EOS5 as the Base Fi...
 
HDF5 for NPOESS Data Products
HDF5 for NPOESS Data ProductsHDF5 for NPOESS Data Products
HDF5 for NPOESS Data Products
 
Standard Safeguarding Dataset - overview for CSCDUG.pptx
Standard Safeguarding Dataset - overview for CSCDUG.pptxStandard Safeguarding Dataset - overview for CSCDUG.pptx
Standard Safeguarding Dataset - overview for CSCDUG.pptx
 
NASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDISNASA HDF and HDF-EOS Status - Use in EOSDIS
NASA HDF and HDF-EOS Status - Use in EOSDIS
 
Building and Extensible Storage Ecosystem with WOS
Building and Extensible Storage Ecosystem with WOSBuilding and Extensible Storage Ecosystem with WOS
Building and Extensible Storage Ecosystem with WOS
 
Data science.pptx
Data science.pptxData science.pptx
Data science.pptx
 
MEDIN Discovery Metadata Standard
MEDIN Discovery Metadata StandardMEDIN Discovery Metadata Standard
MEDIN Discovery Metadata Standard
 

More from The HDF-EOS Tools and Information Center

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
The HDF-EOS Tools and Information Center
 
The State of HDF
The State of HDFThe State of HDF
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
The HDF-EOS Tools and Information Center
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
The HDF-EOS Tools and Information Center
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
The HDF-EOS Tools and Information Center
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
The HDF-EOS Tools and Information Center
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
The HDF-EOS Tools and Information Center
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
The HDF-EOS Tools and Information Center
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
The HDF-EOS Tools and Information Center
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
The HDF-EOS Tools and Information Center
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
The HDF-EOS Tools and Information Center
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
The HDF-EOS Tools and Information Center
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
The HDF-EOS Tools and Information Center
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
The HDF-EOS Tools and Information Center
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
The HDF-EOS Tools and Information Center
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
The HDF-EOS Tools and Information Center
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020

More from The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Recently uploaded

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Neo4j
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Pitangent Analytics & Technology Solutions Pvt. Ltd
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
BibashShahi
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 

Recently uploaded (20)

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 

SEEDS Standards Process

  • 1. SEEDS Standards Process Richard Ullman SEEDS Standards Formulation Team Lead Richard.E.Ullman@nasa.gov 05 December, 2002 HDF & HDF-EOS Workshop VI 1
  • 2. SEEDS • The Strategic Evolution of ESE Data Systems is: – A strategy for ESE to maximize the science and applications utility of ESE data. – A formulation study of best practices in ESE data systems. – A process for incorporating lessons learned from past and present ESE data systems into new data system implementations. – A tool for engaging communities of ESE data providers and users in the SEEDS strategy. – NOT a data system development or implementation project or program - a strategy that applies to implementing organizations. 05 December, 2002 HDF & HDF-EOS Workshop VI 2
  • 3. SEEDS Formulation Status • Seven formulation study areas – – – – – – – Cost Estimation Data Lifecycle Reference Architecture and Reuse Metrics Technology Infusion Standards Processes Near Term Missions Standards • Schedule – SEEDS Formulation team has developed an integrated Formulation Report and is presently working through GSFC, HQ, and external review process prior to release. – Third SEEDS Public Workshop - March 19-21, 2003 Annapolis 05 December, 2002 HDF & HDF-EOS Workshop VI 3
  • 4. SEEDS Standards Premise • "An important premise underlying [SEEDS] is that its various parts should have considerable freedom in the ways in which they implement their functions and capabilities. Implementation will not be centrally developed, nor will the pieces developed be centrally managed. However, every part of [the ESE network] should be configured in such a way that data and information can be readily transferred to any other. This will be achieved primarily through the adoption of common interface standards and practices.” [SEEDS preformulation document] • Standards are what make increased flexibility for SEEDS participants possible. 05 December, 2002 HDF & HDF-EOS Workshop VI 4
  • 5. Simplified Data Flow Diagram Key Satellite Instruments Science or Applications Data Center Internal data flow L0 or spacecraft data Distribution flow Ground Receiving Station L0 Processing Standard Data Processing Near Term Archive PI-managed, Mission, Theme Based or Multi-mission Data Center U S E R S System interchange Backbone Data Center or Long Term Archive 05 December, 2002 HDF & HDF-EOS Workshop VI 5
  • 6. SEEDS Standards Process • Standards Process Study has made recommendations to the SEEDS formulation – For approving and developing standards for the ESE network of data systems and services throughout the SEEDS era. – Types of standards to be addressed by these processes: • • • • • • • Distributed information search protocols (e.g., EOSDIS V0, Z39.50) Data interface standards (e.g, OGC Web Map Services, DODS) Data distribution packaging standards (e.g., HDF/HDF-EOS) Data interchange packaging standards (e.g., HDF/HDF-EOS) Metadata and documentation standards (e.g., GCMD DIF, ESML) Service documentation standards (e.g., GCMD SERF) Service communication protocols (e.g., UDDI, WSDL, SOAP) 05 December, 2002 HDF & HDF-EOS Workshop VI 6
  • 7. SEEDS Standards Process • Recommended process should have elements similar to the IEFT process • Preference should be given to adoption over development • Standards should have demonstrated implementation relevant to ESE. • Process should be guided by a “Standards Working Group” – Members to be drawn from NASA ESE funded activities • Awardees of the REASoN CAN • Representatives of NASA ESE mission science and project teams • ESE Applications Office representation 05 December, 2002 HDF & HDF-EOS Workshop VI 7
  • 8. International & Interagency Agreement HQ Mandate Science and Applications Project Needs Vendor Offerings Existing Standards Adopt or Develop ? Requirements, needs, constraints come from various places inside and outside of ESE •These can be met either by adopting an already existing specification or by developing a specification. •Adopting an existing specification is preferred to developing a new one. Adopt Develop Candidate Standards Revision Requirements Revision Review Profile Extend Existing Standard Existing Standard Existing Standard Testbed/ Spec Initial Draft Standards Choose process based on interface characteristics Review Inter-project Collaboration RFP/Proposal/ Contract Approve Major Revision Initial Draft Standards RFCs Working Implementations Initial Review Proposed Standards 2 Working Implementations & Operational experience Promote to Draft Draft Standards Declare Standard ESE 05 December, 2002 Standards Significant implementation & Successful Operational Use The approval process is based on the IETF process as documented in RFC2026. “The goals of the Standards Process are: •technical excellence; •prior implementation and testing; •clear, concise, and easily understood documentation; •openness and fairness; and •timeliness.*” * rfc2026, Section 1.2 HDF & HDF-EOS Workshop- VI 8
  • 9. Standards Process Status • SEEDS in FY’03 is in “transition” from formulation. • Refinement of process recommendations and status of concurrence by NASA management will be discussed at next community workshop – March 19-21 @ “Historic Inns of Annapolis” • Standards Study Formulation Team is preparing for initiation of Standards Working Group. – Group may be initiated shortly after community workshop – Initial focus will be organizational – Hope to rapidly begin consideration of “ratifying” standards already in wide use within ESE (such as HDF) 05 December, 2002 HDF & HDF-EOS Workshop VI 9
  • 10. SEEDS Near-Term Study Findings • Requirements for system interchange among ESE components are different from requirements for distribution to end-users. – System interchange packaging standards must focus on interface standardization, completeness, and correctness of transfer over “ease of use”. – The primary requirement for distribution to end-users is “ease of use”. • In the near-term, the chief mode of delivering data remains the transfer of discrete files. – Data format is the critical component of data packaging. 05 December, 2002 HDF & HDF-EOS Workshop VI 10
  • 11. SEEDS Near-Term Study Findings • The use of a general standard is insufficient for interoperability. – A common “profile” of the standard is required. – “profile” is a convention for use of a standard within a user community. – “Community-based” standards and profiles of standards, are preferable • Evolution of standards for mission science data over the lifetime of the mission and beyond is inevitable. These include standards for: – – – – Data formats. Catalog interfaces. Associated metadata content and format. Documentation standards 05 December, 2002 HDF & HDF-EOS Workshop VI 11
  • 12. More SEEDS Information • Get reports here: http://eos.nasa.gov/seeds 05 December, 2002 HDF & HDF-EOS Workshop VI 12