Conrad PDES Spring 2006


Published on

Electronic Records Archives Progress Report to Long-Term Data Retention Team at PDES, Inc Spring 2006 Meeting

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Conrad PDES Spring 2006

    1. 1. Program and Research Updates Spring 2006 PDES, Inc. Offsite Mark Conrad Archives Specialist ERA Research Division
    2. 2. <ul><li>Bob’s Not Here! </li></ul><ul><ul><li>NARA’s Representative to PDES </li></ul></ul><ul><ul><li>Specific Questions – [email_address] </li></ul></ul><ul><li>Who am I? </li></ul><ul><ul><li>Archivist on Bob’s Staff </li></ul></ul><ul><ul><li>Continuing Contributor to PDES </li></ul></ul>Caveat Emptor!
    3. 3. Background: NARA’s Mission <ul><li>Enable Citizens to Inspect Records of What the Government has Done </li></ul><ul><li>Enable Officials to Review Their Actions and Help Citizens Hold Them Accountable </li></ul><ul><li>Ensure Continuing Access to Essential Evidence Documenting </li></ul><ul><ul><li>Rights of American Citizens </li></ul></ul><ul><ul><li>Actions of Federal Officials </li></ul></ul><ul><ul><li>The National Experience </li></ul></ul>
    4. 4. Background: NARA’s Mission How Do We Carry It Out? <ul><li>Determine What Evidence is Essential </li></ul><ul><li>Ensure that Evidence is Created </li></ul><ul><li>Make it Easy for Users to Access that Evidence </li></ul><ul><li>Identify Technologies and Partners to: </li></ul><ul><ul><li>Improve Service </li></ul></ul><ul><ul><li>Contain Costs </li></ul></ul>
    5. 5. Background: Federal Records <ul><li>A Federal Record </li></ul><ul><ul><li>Any piece of information, regardless of form or characteristics, made or received by an agency in course of business </li></ul></ul><ul><ul><li>That is, or should be, kept </li></ul></ul><ul><ul><ul><li>As evidence of that activity </li></ul></ul></ul><ul><ul><ul><li>Because it contains valuable data </li></ul></ul></ul><ul><ul><ul><ul><li>44 U.S.C. 3301 </li></ul></ul></ul></ul><ul><li>NARA </li></ul><ul><ul><li>Provides direction, guidance, and assistance to all agencies in managing their records, and </li></ul></ul><ul><ul><li>Preserves records with “enduring” value in the National Archives </li></ul></ul><ul><ul><li>Through lifecycle management of records </li></ul></ul>
    6. 6. Electronic Records NARA’s Challenges <ul><li>Scope The Entire Federal Government </li></ul><ul><li>Variety Different Types of Records </li></ul><ul><li>Complexity Records in Different Formats </li></ul><ul><li>Volume Enormous Amounts of Records </li></ul><ul><li>Obsolescence Constantly Changing Technology </li></ul>
    7. 7. <ul><li>Clinton Administration </li></ul><ul><ul><li>40 million email messages </li></ul></ul><ul><ul><li>State Department </li></ul></ul><ul><ul><li>25 million electronic diplomatic messages </li></ul></ul><ul><li>Department of Defense </li></ul><ul><ul><li>54 million images from electronic official military personnel files annually </li></ul></ul><ul><li>Census Bureau </li></ul><ul><ul><li>600 to 800 million image files (2000 census) </li></ul></ul>Electronic Records Are Arriving!
    8. 8. Anticipated Incoming Permanent Electronic Records Collections within the next 15 years 347 131 35.8 25.8 19.0 14.1 10.6 7.8 5.5 3.6 Projected Accumulated NARA Holdings in petabytes 2022 2018 2014 2013 2012 2011 2010 2009 2008 2007 Year
    9. 9. How NARA Responded The ERA Vision ERA will be a comprehensive, systematic, and dynamic means of preserving and providing continuing access to any type of electronic record free from dependence on any specific hardware or software, created anywhere in the Federal Government.
    10. 10. The ERA System Requirements <ul><li>Persistent </li></ul><ul><ul><li>To be able to manage and access records over time. </li></ul></ul><ul><li>Authentic </li></ul><ul><ul><li>To ensure that record is what it purports to be , and has not been corrupted . </li></ul></ul><ul><li>Scalable </li></ul><ul><ul><li>To grow and adapt to increasing volumes and evolving types of electronic records. </li></ul></ul><ul><ul><li>To serve a variety of user groups . </li></ul></ul>
    11. 11. The ERA System Goals <ul><li>Overcome technological obsolescence in a manner that preserves demonstrably authentic records </li></ul><ul><li>Build a dynamic solution that: </li></ul><ul><ul><li>Accepts that changes will happen </li></ul></ul><ul><ul><li>Incorporates continuing change in IT </li></ul></ul><ul><ul><li>Takes advantage of new technologies </li></ul></ul><ul><ul><li>Maintains and improves performance </li></ul></ul><ul><ul><li>Improves customer service </li></ul></ul>
    12. 12. Ensuring Authenticity <ul><li>The property of a record that it is what it purports to be , and has not been corrupted </li></ul>
    13. 13. <ul><li>For traditional paper records we must: </li></ul><ul><li>Preserve and maintain the medium ( content ) </li></ul><ul><li>Document and maintain a chain of custody </li></ul><ul><li>Maintain the context of the record to other records </li></ul>Ensuring Authenticity
    14. 14. <ul><li>For complex electronic records </li></ul><ul><li>We must preserve the essential properties of the record: </li></ul>Ensuring Authenticity Examples of complex electronic records: Databases, Web sites, GIS, Virtual Reality, Product Models, etc. <ul><ul><li>Content </li></ul></ul><ul><ul><li>Context </li></ul></ul><ul><ul><li>Structure </li></ul></ul><ul><ul><li>Behavior </li></ul></ul>
    15. 15. Strategies that NARA will use <ul><li>Attack the critical preservation issue </li></ul><ul><li>Define Lifecycle requirements </li></ul><ul><li>Find solutions in mainstream technologies </li></ul><ul><li>Keep pace with the next generation national information infrastructure </li></ul><ul><li>Align with overall direction of IT in the U.S. Government </li></ul>
    16. 16. ERA Program Major Milestones <ul><li>First proof-of-concept of research results are delivered and released </li></ul><ul><li>NARA establishes the ERA Program Office </li></ul><ul><li>Research results on preservation of Senate records are delivered </li></ul>1999 2000 2001 <ul><li>Competing contractors deliver ERA prototype design demos </li></ul><ul><li>NARA selects Lockheed Martin Corporation to begin the development of the ERA System. </li></ul>2005 <ul><li>ERA Program is a “Line Item” Appropriation ($36M, P.L. 108-199) </li></ul><ul><li>NARA participates in meetings conducted by the Executive Office of the President’s National Coordination for Federal IT Research Office </li></ul><ul><li>First test of NARA’s Research Prototype Persistent Archive (the “Data Grid”) </li></ul><ul><li>NARA awards two development design contracts to Harris Corporation and Lockheed Martin Corporation </li></ul>2004 <ul><li>The ERA Research Program initiates operation of the Virtual Archives Lab </li></ul>2003 <ul><li>ERA System Requirements are developed </li></ul><ul><li>ERA Research Program supports research at the National Center for Supercomputer Applications (NCSA) </li></ul>2002 <ul><li>The Archivist of the United States tasks Ken Thibodeau with setting up a program to understand the challenges of preserving and accessing Federal Government electronic records </li></ul><ul><li>NARA receives seed money to engage Government and private sector research partners </li></ul>1998
    17. 17. The ERA Program: Where we are now <ul><li>12/ 03 Release of the RFP </li></ul><ul><li>8/3/04 Awarded Two Design Contracts </li></ul><ul><li>9/8/05 NARA Selects a Single Developer 2005 - 2011 Multiple Increments (Inc) w/ Multiple Releases: </li></ul><ul><li>FY07 Initial Operating Capability </li></ul><ul><li>2011 Full Operating Capability </li></ul>Initial Operating Capability FY 2007 12/03 Release of the Request For Proposal (RFP) Contract Awarded NARA Selected Lockheed Martin Corporation Full Operating Capability 2011 Inc 1 8/3/04 Sep 2005 Inc 2 Inc 3 Inc 4 Inc 5 2 years 1 year 1 year 1 year 1 year
    18. 18. Selected Corporate Team <ul><li>8 September 2005 – NARA Selects Lockheed Martin Team to develop Operational ERA System </li></ul><ul><li>Lockheed Martin Corporate team - Bearing Point, Fenestra Technologies, FileTek, EDS, History Associates, Metier, Image Fortress, Science Applications International Corporation, Tessella </li></ul><ul><li>Value of Awarded Contract - $308M </li></ul>
    19. 19. Archivist’s Directive Research 44 U.S.C Section 2904 (Chapter 2 ) <ul><li>The Archivist of the United States is authorized by law to “conduct research with respect to the improvement of records management practices and programs.” </li></ul>
    20. 20. Why ERA Research? <ul><li>Archival Moonshot </li></ul><ul><li>Red-tailed Hawks </li></ul><ul><li>The Wizards </li></ul>
    21. 21. Why ERA Research? The Archival Moonshot <ul><li>Unprecedented Challenges </li></ul><ul><ul><li>Technology Does Not Currently Exist </li></ul></ul><ul><ul><li>Complexity &Volume Will Continue to Grow </li></ul></ul><ul><li>Unprecedented Resources </li></ul><ul><ul><li>Recognized GOVERNMENTAL Challenges </li></ul></ul><ul><ul><li>White House Coordinated Research Activity </li></ul></ul>
    22. 22. Why ERA Research? The Red-Tailed Hawks <ul><li>Identify Potential in New Technologies </li></ul><ul><li>Promote Knowledge & Technology Transfer from Research Projects </li></ul><ul><li>Bring Together Partners with Diverse Domain Expertise </li></ul><ul><li>Leverage Other Research </li></ul>
    23. 23. Why ERA Research? The Wizards <ul><li>Unprecedented Collaborations </li></ul><ul><li>World-Class Expertise in Multiple Domains </li></ul><ul><li>Recognized World-Class Challenges </li></ul>
    24. 24. NARA’s Research Partners National Center for Supercomputing Applications NIST … and many other Federal Agencies and their Records Officers National Science Foundation San Diego Supercomputer Center Global Grid Forum Army Research Laboratory
    25. 25. National Coordination Office for Networking Information Technology Research and Development (NCO/NITRD)
    26. 26. FY 2007 NITRD Supplement to the President's Budget See
    27. 27. FY 2007 NITRD Supplement to the President's Budget: Some Highlights <ul><li>Human-Computer Interaction and Information Management Needs Include: </li></ul><ul><ul><li>Next-generation methods, tools, and technologies to make it possible to access, integrate, analyze, and efficiently manage massive stores of widely distributed, heterogeneous information (e.g., science and engineering research data, Federal records ) </li></ul></ul>
    28. 28. FY 2007 NITRD Supplement to the President's Budget Some Highlights <ul><li>Human-Computer Interaction and Information Management Needs Include: </li></ul><ul><ul><li>Federal information management architecture testbeds: </li></ul></ul><ul><ul><ul><li>To evaluate issues in petascale collections of information governed by differing requirements (e.g., national security, personal privacy) </li></ul></ul></ul><ul><ul><li>Long-term preservation: </li></ul></ul><ul><ul><ul><li>Maintenance of and access to long-lived science and engineering data collections and Federal records </li></ul></ul></ul>
    29. 29. FY 2007 NITRD Supplement to the President's Budget Implications for PDES <ul><li>Explicit Priority for R&D Funding </li></ul><ul><li>Monitor RFPs, RFIs, etc </li></ul><ul><li>ERA Research Will Post to the List any Opportunities We are Made Aware of </li></ul>
    30. 30. ERA Research New Collaboration <ul><li>Department of the Navy </li></ul><ul><ul><li>Engineering Drawings for TWR </li></ul></ul>
    31. 31. Your Contacts in the ERA Program Management Office Bob Chadduck [email_address] Mark Conrad [email_address] ERA Communications (301) 837-0740 [email_address] The ERA Website is