This document provides an overview of the Earth Observing System Data and Information System (EOSDIS) including its components, metrics, trends in data access, and plans for the upcoming year. Key points include that EOSDIS is a distributed system consisting of data centers and processing systems that have archived over 4 petabytes of data and distributed over 254 million data products in fiscal year 2009. Popular data products distributed include MODIS and AIRS data. Plans for the upcoming year focus on improving data access and search capabilities.

1. EOSDIS Status
9/29/2010
Dan Marinelli, NASA GSFC
ESDIS Project, Science Systems
Development Office

2. EOSDIS Context
Distributed Active
Archive Centers
(DAACs)
REASoN
ACCESS
Instrument Science
Team Facilities
(SCFs and SIPSs)
Data
Assimilation
Model
Adapted from

3. EOSDIS Data Availability Timeline
1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
ERBS (SAGE II)
10/1984 - 2 years planned mission life
ERS-1
10/1978 - 10 yrs m life
NIMBUS-7 (TOMS I)
Meteor 3 TOMS (TOMS II)
UARS
TOPEX/Poseidon
JERS-1
OrbView-2 (SeaStar)
ERS-2
Earth Probe TOMS (TOMS III)
RadarSat 1
Heritage Missions
EOS Era Missions
ADEOS I early failure
TRMM
Landsat 7
CERES data only
Transition to USGS
QuikSCAT
Terra
KEY
Science Data Available
Planned Mission Life
Extended Mission Life
Active Archive
No Planned EOL
April 2009 NASA Earth
Science Senior Review
ACRIMSAT
Jason-1
Meteor 3M (SAGE III)
GRACE
Aqua
ADEOS II early failure
ICESat
SORCE
Aura
1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

4. Earth Science Data and Information System (ESDIS) Project - GSFC Code 423
•
Objective - Develop and Operate Earth Observing System Data and Information System
(EOSDIS)
–
–
–
•
Organizations: ESDIS Project meets its requirements by funding and managing several
organizations including
–
–
–
•
“Large” industrial: Raytheon (EMD)
Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC,
ORNL), Universities (ASF, NSIDC, SEDAC)
Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC),
NCAR
Project Components:
–
–
–
–
•
A production capability for standard science data products from EOS instruments
An “active archive” of Earth science data from EOS and other past and present Earth science missions
A distributed information framework (data centers, system elements, interfaces and data model)
supporting EOS investigators and other users in science, government, industry, education, and policy
SDPS - System for ingesting, processing, archiving and distributing data
Data Centers - Science System Operations
EOSDIS Networks - Transportation of mission & science data
SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data
products for delivery to Data Centers
Web Site: http://eos.nasa.gov/eosdis

5. EOSDIS Metrics
(Oct. 1, 2008 to Sept. 30, 2009)
Unique Data Sets
Distinct Users of EOSDIS Data and
Services
Web Site Visits
Average Archive Growth
T otal Archive Volume
End User Distribution Products
End User Average Distribution
Volume
> 4,000
> 910K
> 1M
1.8T B/day
4.2 PB
> 254M
6.7 TB/day

6. Trends in data access

7. Volume Distributed - Top 10 Products
FY2008 Top 10 Products Distributed By Volume*
1
2
3
4
5
6
7
8
9
10
Product
MOD021KM
AIRIBRAD
MOD02HKM
MOD13Q1
MOD02QKM
MYD021KM
MYD02QKM
MOD03
MOD09A1
AE_L2A
Description
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km
AIRS/Aqua L1B infrared geolocated radian
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m
MODIS/Terra Level 3 16-Day Vegetation Indices - 250m
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m
MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km
MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 250m
MODIS/Terra L1A Geolocation = 1 km
MODIS/Terra Level 3 8-Day Surface Reflectance - 500m
AMRS-E/Aqua L2A Brightness Temperatures
GBs
124,618.63
111,146.03
102,767.58
93,648.47
86,588.36
82,150.44
60,130.46
49,630.35
46,681.83
45,379.45
Files
2,771,007
2,903,073
722,931
976,410
571,815
2,361,609
364,638
1,937,871
1,287,054
1,050,686
GBs
196,138.51
165,987.99
129,814.39
92,435.13
76,969.07
76,395.48
73,551.47
70,918.78
70,132.05
69,015.68
Files
4,372,203
2,740,625
1,505,551
1,016,617
1,271,568
520,382
5,151,841
776,452
2,799,820
503,350
FY2009 Top 10 Products Distributed By Volume*
1
2
3
4
5
6
7
8
9
10
Product
AIRIBRAD
MOD021KM
MYD021KM
MOD09GA
AE_L2A
MOD02QKM
MOD13Q1
MOD09GQ
MOD03
MOD02HKM
Description
AIRS/Aqua L1B infrared geolocated radian
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km
MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km
MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid
AMRS-E/Aqua L2A Brightness Temperatures
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m
MODIS/Terra Level 3 16-Day Vegetation Indices - 250m
MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid
MODIS/Terra L1A Geolocation = 1 km
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m
FY2009 Annual Report

8. Files Distributed - Top 10 Products
FY2008 Top 10 Products Distributed By # of Files
1
2
3
4
5
6
7
8
9
10
Product
AIRX2RET
MYD04_L2
MOD04_L2
TRMM_3B42
MOD14
AIRIBRAD
MYD14
MOD021KM
PODAAC 167
NSIDC-0032
Description
AIRS/Aqua FINAL Level 2 Products (Without HSB)
MODIS/Aqua Aerosol 5-Min L2 Swath 10km
MODIS/Terra Aerosol 5-Min L2 Swath 10km
TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall
MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km
AIRS/Aqua L1B infrared geolocated radiances
MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km
MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km
Jason-1 Operational Sensor Data Record (OSDR)
DMSP SSM/I Pathfinder Daily EASE-Grid Brightness Temperatures L3
Files
GBs
9,410,738 16,731.67
5,320,157 5,462.87
4,710,287 5,248.00
3,611,579 3,584.12
3,053,976
694.65
2,901,691 111,146.01
2,775,012
653.30
2,771,007 124,618.63
2,496,794 1,073.53
2,485,467 1,808.74
FY2009 Top 10 Products Distributed By # of Files
1
2
3
4
5
6
7
8
9
10
Product
GNSS_DAILY_D
TRMM_3B42
MOD14
MYD14
AIRX2RET
MYD04_L2
GNSS_DAILY_O
GNSS_IGSTROP
MOD13Q1
MOD04_L2
Description
GNSS Daily Compact Observation Data
TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall
MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km
MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km
AIRS/Aqua FINAL Level 2 Products (Without HSB)
MODIS/Aqua Level 2 Aerosol
GNSS Daily Observation Data
GNSS Final Troposphere Zenith Path Delay Product
MODIS/Terra Level 3 16-Day Vegetation Indices - 250m
MODIS/Terra Aerosol 5-MIN L2 Swath 10KM
FY2009 Annual Report
Files
GBs
8,563,521 2,467.65
8,045,425 8,537.75
7,218,381 1,582.00
6,340,602 1,415.80
6,246,276 7,757.08
6,053,135 6,706.02
5,495,849 2,977.94
5,467,986
12.81
5,151,841 73,541.15
5,025,697 5,184.23

9. EOSDIS Metrics Reference
• All kinds of other metrics information about EOSDIS can
be found at:
– http://ems.eos.nasa.gov/reports/index.shtml

10. Recent Progress
– ECS 7.23 is operational at the sites which host ECS (Land
Processes DAAC, Souix Falls, SD, Atmospheric Sciences Data
Center, Langley, VA, and National Snow and Ice Data Center,
Boulder, CO)
• Migration to all disk archive is complete for the ECS systems;
backup is LTO tape, but not used for near-line access
– There were corruption issues that needed to be resolved with a
combination of backups/ reprocessing
– Much of the data was written ‘pre-checksum’ so research
needed to be performed before we felt confident that that data
was ‘ok’, e.g., Level 0 (non HDF) data;
• Focus now is on enhancing data access – EED Contract awarded 4/1 – for sustainment and development
for the EOSDIS which includes ECS Science Data Processing
System and the EOS Clearinghouse (metadata repository)
– Began supporting ICEBridge by working on initial set of data
types; integrating into NSIDC ECS system

11. Plans for the next year
EED
- Hardware end-of-life issues being addressed with technology
refreshes
- ECHO metadata model to be made ISO 19115 compliant – will
help us support new data systems which have ISO 19115 support
required
- Data access enhancements to support conversion services
provided by the data centers which will include subsetting,
reprojection and reformatting on data distributed from the ECS
- Improved search client
- EOSDIS Coherent Web presence
- OpenDAP access to ECS data
- Enhancements to support HDF as an archive format
The HDF Group
• New grant beginning 7/15;