Data grids are an emerging technology that enables the formation of sharable collections from data distributed across multiple storage resources. The integrated Rule Oriented Data System (iRODS) is a data grid developed by the DICE Center at UNC-CH. The iRODS data grid enforces management policies that control properties of the collection. Examples of policies include retention, disposition, distribution, replication, metadata extraction, time-dependent access controls, data processing, data redaction, and integrity checking. Policies can be defined that automate administrative functions (file migration and replication) and that validate assessment criteria (authenticity, integrity, chain of custody). iRODS is used to build data sharing environments, digital libraries, and preservation environments. The iRODS data grid is used at UNC-CH to support the Carolina Digital Repository, the LifeTime Library for the School of Information and Library Science, data grids for the Renaissance Computing Institute (RENCI), collaborations within North Carolina, and both national and international data sharing. At RENCI, the TUCASI data grid supports shared collections between UNC-CH, Duke, and NCSU. The RENCI data grid is federated with ten other data grids including the National Climatic Data Center, the Texas Advanced Computing Center data grid, and the Ocean Observatories Initiative data grid. International applications include the CyberSKA Square Kilometer Array for radio astronomy and the French National Institute for Nuclear Physics and Particle Physics. The collections that are assembled may contain hundreds of millions of files, and petabytes of data. A specific goal is the integration of institutional repositories with the national data infrastructure that is being assembled under the NSF DataNet program. The software is available as an open source distribution from http://irods.diceresearch.org.

1. Policy-Based Data Management Arcot Rajasekar Mike Conway Reagan W. Moore University of North Carolina at Chapel Hill [email_address]

5. Policy-based Data Sharing Client Provider iRODS controlled workflows Provider iRODS controlled workflows Storage Storage Shared Collection Consensus on Policies and Procedures controls the shared data

6. Access distributed data with Web-based Browser or iRODS GUI or Command Line clients. iRODS Data Server Disk, Tape, etc. iRODS Middleware Overview of iRODS Architecture User w/ Client Can Search, Access, Add and Manage Data & Metadata iRODS Metadata Catalog Track information iRODS Rule Engine Track Policies

7. Data Virtualization Storage System Storage Protocol Access Interface Policy Enforcement Points Standard Micro-services Map from the actions requested by the client to multiple policy enforcement points. Map from policy to standard micro-services. Map from micro-services to standard Posix I/O operations. Map standard I/O operations to the protocol supported by the storage system Standard I/O Operations Data Grid

8. iRODS Distributed Data Management

15. LifeTime Library Storage System Storage Protocol Access Interface Policy Enforcement Points Standard Micro-services Multiple clients Policies to automate replication turn on versioning set audit trails enforce strict ACLs replicate metadata Micro-services to create thumbnails extract metadata assign organization Standard I/O Operations Data Grid