This document proposes a petabyte environmental tape archive and library to address the growing data storage needs of researchers generating huge quantities of data from sources like weather forecasting simulations. It would provide long-term storage for important research data that is currently being deleted in many cases due to limited storage options. The proposed system would use a SpectraLogic tape library and active archive software to provide scalable, reliable storage that researchers can afford, with different storage services depending on the data access needs.

1. Petabyte Environmental Tape Archive and Library
Dr. Steven Pickering
School of Earth & Environment

2. Data Generated/Used
• Weather Forecasting, Atmospheric Composition, Palaeo-Climate,
Satellite Imagery, Palaeontology
• Sources: NOAA, NASA, NCAR, ECMWF, MO (PBs)
• Simulations access these data sources sporadically
• Modern simulations generate huge quantities of data (>1Tb/hr)
• High resolution images/scans

3. Data Storage/Retention
• Grant Funding Bodies: ERC, NERC, EPSRC, Leverhulme
• Data Repositories: BADC, NERC
• Open Access Publications, Limited Storage, Poorly Catalogued
• Important vs. Useful Data
• Currently We Delete 90-95% Of Our Data, To Save Disk Space
• Disks Have A Limited Lifespan (3Yrs)

4. Financial Costs
• Research Grants Have Limited Funding (3Yrs)
• Data Must Be Stored For 10Yrs From Last Access (20Yrs)
• Long-Term Storage Is Costly. E.g. Arkivum
• Centralized Services Offer Poor Access And Value For Money
• Asset vs. Running Costs (10% Hardware, 20% Software)
• Disk vs. Tape, Lifespan, Reliability, Environmental Impact

5. Available Products
• A Storage Solution For Active Research Data, That Can Grow
• Limited Funding (£140k)
• Detailed Comparison Of Deep Storage Vendors
• Quantity, Quality, Reliability, Redundancy, Flexibility
• Environmental Impact, Modular, Expandability, Upgradable
• Extra Features

6. Financial Model
• A Service That Researchers Can Afford (£100/Tb) (£250/LTO-6)
• Small Research Facility. E.g. Microscope, Spectrometer
• Only Have To Cover Running Costs
• 10 Year Lifespan, Long-Term Storage
• Annual Maintenance, 6-8 Year Major Upgrade, 50% Role
• £35k = Selling 140 Tapes

7. Hardware/Software
• SpectraLogic T950 Tape Library, Verde Disk
• QStar Active Archive Software, Disk And Tape Storage
• Website:
• User Registration, Buying Tapes, Messages
• Monitoring Temperature, Current, Voltage, Fan Speed, Robotics
• Monitor Disk Usage, User Quotas

8. Storage Services
• Data Access/Type Determines Service Required
• Near Online Data, Large Cache (1 or 2 copies)
• Deep Online Data, Small Cache (1 or 2 copies)
• Remote Offline Data, Small Cache (2 copies)

9. User Access
• Looks Like Another File System But It Isn’t Necessarily Disk
• Users Must Realize There Can Be Delays In Loading Data
• Accessible Via Linux And Windows With Appropriate Security
• Each Department Has A Central Server For Access To The Service
• Long-Term Storage For Important Research Data
• A System That Can Grow To Meet Our Data Needs