The document provides an overview and status update of the Earth Observing System Data and Information System (EOSDIS). It discusses that EOSDIS supports EOS missions by ingesting, processing, archiving, and distributing their data. It notes that the volume of archived data has grown to over 4.9 petabytes containing over 2700 datasets. It also outlines plans to transition to new systems and complete updates to the EOSDIS code by 2009.

1. EOSDIS Status
10/16/2008
Dan Marinelli, Science Systems
Development Office

2. EOSDIS Context
Distributed Active
Archive Centers
(DAACs)
REASoN
ACCESS
Instrument Science
Team Facilities
(SCFs and SIPSs)
Data
Assimilation
Model
Adapted from

3. EOSDIS Mission Profile
1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
ERBS (SAGE II)
10/1984 - 2 years planned mission life
ERS-1
10/1978 - 10 yrs m life
NIMBUS-7 (TOMS I)
Meteor 3 TOMS (TOMS II)
UARS
TOPEX/Poseidon
JERS-1
OrbView-2 (SeaStar)
ERS-2
Earth Probe TOMS (TOMS III)
RadarSat 1
Heritage Missions
3 yrs
ADEOS I (Midori)
TRMM
CERES data only
EOS Missions
Landsat 7
QuikSCAT
KEY
Planned Mission Life
Extended Mission Life
4 yr Data Access Period
(includes 3 yr reprocessing)
3 yr Reprocessing Pd
No Planned EOL
EOS Terra
ADEOS II (Midori II)
3 yrs
Jason-1
ACRIMSAT
Meteor 3M
EOS Aqua
ICESat
EOS Aura
SORCE
1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
file name: EOS missions vs time7.xls

4. Earth Science Data and Information System (ESDIS) Project - GSFC Code 423
•
Objective - Develop and Operate Earth Observing System Data and Information System
(EOSDIS)
–
–
–
•
Organizations: ESDIS Project meets its requirements by funding and managing several
organizations including
–
–
–
•
SDPS - System for ingesting, processing, archiving and distributing data
Data Centers - Science System Operations
EOSDIS Networks - Transportation of mission & science data
SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data
products for delivery to Data Centers
Status
–
–
–
–
–
•
“Large” industrial: Raytheon (EMD)
Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC,
ORNL), Universities (ASF, NSIDC, SEDAC)
Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC),
NCAR
Project Components:
–
–
–
–
•
A production capability for standard science data products from EOS instruments
An “active archive” of Earth science data from EOS and other past and present Earth science missions
A distributed information framework (data centers, system elements, interfaces and data model)
supporting EOS investigators and other users in science, government, industry, education, and policy
EOSDIS has been successfully supporting EOS missions since 1999
Volume of data available from EOS missions continues to grow. Current volume at 4.9 petabytes.
EOSDIS archive contains current as well as legacy Earth science data - more than 2700 datasets
In FY 2007, over 100 million products were distributed to just over 165,000 unique users; approximately
3.0 million distinct users accessed the EOSDIS data centers.
ESDIS Project is working closely with the user community to enhance systems that support and provide
access to data
Web Site: http://eos.nasa.gov/eosdis

5. Monthly Distribution by Products (Sep 2007 - Aug 2008)
ASF
EDC
GSFC
JPL
LaRC
Latis
NSIDC
ORNL
MODAPS
GHRC
SEDAC
Jun-08
Jul-08
20,000
18,000
Product Counts (in 1000's)
16,000
14,000
12,000
10,000
8,000
6,000
4,000
2,000
0
Sep-07
Oct-07
Nov-07
Dec-07
Jan-08
Feb-08
Mar-08
Month
Apr-08
May-08
Aug-08

6. Month
Aug-08
Jul-08
Jun-08
GHRC
May-08
Apr-08
MODAPS
Mar-08
Feb-08
ORNL
Jan-08
Dec-07
NSIDC
Nov-07
Oct-07
Latis
Sep-07
Aug-07
LaRC
Jul-07
Jun-07
JPL
May-07
Apr-07
GSFC
Mar-07
Feb-07
EDC
Jan-07
ASF
Dec-06
Nov-06
Oct-06
Sep-06
Product Counts (in 1000's)
Monthly Distribution by Products (Sep 2006 - Aug 2008)
SEDAC
20,000
18,000
16,000
14,000
12,000
10,000
8,000
6,000
4,000
2,000
0

7. 0
Month
Aug-08
Jul-08
Jun-08
May-08
GHRC
Apr-08
MODAPS
Mar-08
Feb-08
Jan-08
ORNL
Dec-07
NSIDC
Nov-07
Oct-07
Latis
Sep-07
Aug-07
LaRC
Jul-07
Jun-07
JPL
May-07
GSFC
Apr-07
Mar-07
EDC
Feb-07
ASF
Jan-07
Dec-06
Nov-06
Oct-06
Sep-06
Volume (TB)
Monthly Distribution Volume (Sep 2006 - Aug 2008)
SEDAC
250
200
150
100
50

8. Recent Progress
– Transition from EOS Data Gateway (EDG) to ECHO/WIST Underway.
NSIDC, Oak Ridge, and Alaska DAACs have completed transition.
Over 1600 new users currently accessing EOS data via ECHO/WIST.
– Will complete once ECS 7.21 is operational at all sites
• 7.21 was deployed and includes ingest of all data via Data Pool, conversion
to an XML archive for metadata, distribution enhancements

9. Plans for the next year
– ECS Release 7.22: work underway for final delivery planned
under EMD Contract - will include:
• Custom code changes to support transition to disk-based
archive
• Improvements to Bulk Metadata Generation Tool to automate
response to error conditions in interface to ECHO
• Enhanced Checksumming, including validation of integrity of
files in the datapool and archive
• Operating System and Compiler Upgrades (including custom
code changes)
• Code simplification - complete removal of all remnants of
Science Data Server and heritage Storage Management
components (replaced in Release 7.21)

10. EOSDIS Futures
•
Future spending profile reflects reductions being achieved with
evolution
– GES DISC off of ECS; MODAPS performs MODIS processing and
L1/atmospheres archive and distribution
– ASDC DAAC now supports CERES with their ANGe system; ECS to
remain in place through at least 7.22 for other EOS instruments
– ECS evolution development to be complete by March 2009 – has resulted
in greatly reduced physical, SLOC footprint, and thus cost to maintain
•
•
•
ECS contract expires May 2009; ESDIS is putting together RFP for the
follow-on ECS Evolution and Development Contract
THG grant renewed 7/2008 for 3 years
New NASA guideline implies we may not be able to host this workshop
in the future – we’ll keep you posted