Your SlideShare is downloading. ×
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Luquillo LTER Information Management
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Luquillo LTER Information Management

621

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
621
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Present the progress throughout the past 3 years
    taking into consideration the course of events of the past 20 years
    which have delineated the path that LUQ IM has followed.

    Present what the main challenge to achieve present goals and
    The vision that have emerged as a product of all the processes experienced
    as we have made this progress to achieve our goals.
  • In our history of 20 years as an IM:
    First task was organizing and cataloguing data
    At this time we catalogued in two different catalogues mostly legacy data, specially those from Odum’s time.
    - a pre-LUQ LTER data catalogue that we called LEFDSET
    - an LTER data catalogue that we called LTERDBAS;

    Also at this time we, started and finished developing our first version of metadata standards.

    --BIG FIRST LESSON LEARN: WE NEED TO DOCUMENT OUR DATA

    Around 1993-5 we received the mandate to share data on the internet, so we published our first web site (from 1988 to early 90’s all the telecommunication infrastructure had been by our Pis with the help of Network people). At this time we had part of our LTER data documented with the LUQ documentation standards.

    BIG LESSONS LEARN:
    -DOCUMENTING IS TIME CONSUMING…RESEARHCERS NEED ASSISTANCE TO DO THIS
    -DATA SHOULD BE ACCOMPANIED WITH THE METADATA WHEN PUBLISHED IN THE WEB, OTHERWISE THE CALLS ARE ENDLESS…ASKING FOR VARIABLES ATTRIBUTES, METHODOLOGY, ETC.

    In the decade of synthesis, once again Information Management was included in the general scheme of the LTER program but this time its goals was more explicitly described and the web site became the main scenario for the system. In addition, the network adopted a metadata standard, EML

    LESSONS LAERNED:
    - INVESTIGATORS NEED PRIVATE SPACE TO SHARE DOCUMENT
    - THE LUQ IMS NEEDS TO GO FROM A LOCAL FRAMEWORK TO A WEB-DATA BASED SYSTEM, IN ORDER TO MEET THE DEMANDS OF THE DECADAL PLAN AND ITS CYBERINFRASRUCTURE PLAN DESCRIBED IN IT.
  • Main points here:
    Difference between catalogued and online:
    - Before 2000 : Legacy data catalogued; limited information was extracted from it; LTER data was documented with the developed standards.
    In 2000 : we archived the legacy data and saved the file cabinets that we still keep.

    Between 2000 to 2002:
    - of the 115 catalogued :
    - LTER data sets: 35 were documented and online; 3 where merged into other data sets by the scientist
    - NON LTER – information that could be extracted from the hardcopies was too scarce, previous to LTER scientists not accessible
    Today (2009):
    two already catalogued metadata is being revised by IM: Charlie Hall (David Murphy) (Katherine Smith’ dissertation, Katherine is. Pringle student’s)
    - two CTE data sets, Treatment and Litterfall, are ready and pending for publishing
    -ONE IS PAPER ONLY – SOIL Char of LFDP
    --Of these 127 online: 39 are long term, 1 is from a Costa Rica Project, STREAMS,


  • BEFORE THIS DESCRIPTION OF EML LEVEL

    Establishing the basic elements of the LUQ Information Management System (IMS):
    As we developed the metadata standards we also catalogued the existing data sets.
    Cataloguing means to :
    -File the data; by that time it meant in a file cabinet, now it means in the computer.
    -Enter basic information of the data set in the database:
    +In 1989 we used DBASE III as our RDBMS; we migrated to Paradox in 1992 and
    + it has been used as the official LUQ IM software ever since.
    -The data set assumes as the official ID number, the record number of the row in which its information is entered in this Paradox table. Each record number of the data set will never belong to any other data set; so the official number of each data set is LTERDBAS #n, where n is the number of the Paradox record in which the main information of the data set is entered. Main information includes Identifier, Project title, start and ending dates, list of investigators, and keywords, among other information.

    Metadata forms and guidelines to complete them were made available first as hardcopies in our annual reports and then online, in our web site.

    Many things have to be done at the local level in order to be ready for cyberinfrastrucure and EML. At LUQ we dedicated ourselves to:
    - Manage the data files such that each column of data contained only one data type
    - Convert each data file into a Paradox table
    - Clean and enhance the quality of the metadata such that the general information related to project and the data set is readily available
    - Make sure that all variables are well defined and documented

    ==============
    So with that lessons learned what did we responded:
    First 3 years we dedicated to: Develop Metadata standards 1991: first version of LUQ Documentation (or metadata)

    -1995: We published our first version of a web site with 30 data sets on line; It was then when we decided that no data would be published without metadata

    so we started to enhance our metadata standards which eventually lead us to EML , which in turn help us to enhance the metadata even further

    FOR AT LEAST THE JUNE 2 PRESENTATION: ALL THESE HAVE BEEN EXAMPLES OF COLLABORATION WITH OTHER SITES’ IMS AND SINCE 2003 LNO STAFF!
    ==================
  • Show new web site’s searching capability – pubs by Marsh
    Metadata online forms designed for LUQ by Inigo
    Achieve a true integration of the different “soft” elements of the LUQ IMS: data sets, publications, and people profiles with the use of EML while making them available to public thorugh the Internet
  • Model Web site
  • POINTS:
    From 2003 to 2005:
    --Production of LUQ’s EML Level 3-4 started in 2005
    From 2005 to 2007
    -Two data sets were merged into two others
    -Additions of Level 3 stopped up to until 2008 when ~16 where added
    -Production of LUQ’s EML QC Level 5 started in 2005
    --A
    -a LNO-LUQ Effort
    2006: Visit from Inigo development of scripts
    -collaborative work that served as a model to other sites
  • Show new web site’s searching capability – pubs by Marsh
    Metadata online forms designed for LUQ by Inigo
    Achieve a true integration of the different “soft” elements of the LUQ IMS: data sets, publications, and people profiles with the use of EML while making them available to public thorugh the Internet
  • CyberInfrastructure:
    Describes the new research environments that support:
    advanced data acquisition, data storage, data management, data integration, data mining, data visualization and other computing and information processing services over the Internet.
    In scientific usage, cyberinfrastructure is a technological solution to the problem of:
    efficiently connecting data, computers, and people with the goal of enabling derivation of novel scientific theories and knowledge.

    This new concept of web site:
    EML based – supports Internet data, information, and computing services
    Suports data integration by the use of a vocabulary based infrastructure that links different parts of the information : data sets, publications, and pleople, and research location
    Supports synthesis by providing related information when performing searhces
  • Transcript

    • 1. 2009 Mid–Term Review El Verde Field Station June 4, 2009
    • 2. History Progress Challenge Vision
    • 3. Data Archiving Data Sharing Data Integration 1989 on 1995 on 2001 on Need to team up and publish metadata Organizing, cataloguing; Develop LUQ documentation standards and protocols Need to document Need to have searchable data in the web site Documenting and publishing the data on our first web Decadal Plan and the adoption of the EML standard
    • 4. 0 15 30 35 74 104 117 127 0 7 5 4 On the Web Not Online
    • 5. 2005 on Metadata standards and developed ; data sets catalogued; Data filing protocol established 1989-1991 LUQ EML Level 3 2001-2005 LUQ Web site development 1995 on Bill Michener John Porter Marsh White Inigo San Gil LUQ EML Level 5 QC 1989- on Management of data
    • 6. Dataset Design -PI -Information Manager Data Collection Data Entry Metadata Preparation Quality Control and Assurance Review Data Publication on WWW Revision Revision
    • 7.  ALL DATA SETS ARE CONVERTED TO A RELATIONAL DATABASE MANAGEMENT SYSTEM TABLE  AT A LOCAL LEVEL, THE LUQ IMS HAS THE CAPABILITY OF QUERYING RECORDS OF DATA OUT OF THEIR DATA BASES AND APPENDING OR JOINNING TABLES TOGETHER MANAGING DATA
    • 8. Plans for the LUQ IM Progress  new mechanisms to allow investigators to remotely deposit their data in the LUQ IM system.  Achieved for special groups in a private web site; new web site will provide forms to upload both data and its metadata. 2006 PROPOSAL’S IM GOALS
    • 9. Plans for the LUQ IM Progress  A scroll down Web site map with links to other U.S. LTER sites, and other Best Web Practices features;  Will be available in the new web site; Most of the Best Web practices features implemented in the current web site 2006 PROPOSAL’S IM GOALS
    • 10. Plans for the LUQ IM Progress  Translation of the already existing metadata to EML level 5 standards to allow data as well as its already harvested metadata retrieval by the LTER Network Office’s data warehouse: Metacat  Approximately 87% of the online metadata is in EML, 59% of which is in Level 5 QC 2006 PROPOSAL’S IM GOALS
    • 11. LUQ EML METADATA PACKAGES DEVELOPED 2005 2007 2009 98 75 46 0 21 65 EML L 3-4 EML L5 QC
    • 12. Plans for the LUQ IM Progress  Completion of a database containing GIS referenced list of all LUQ project sites (LUQ GIS database)  Simplified online version is being implemented in the current web site 2006 PROPOSAL’S IM GOALS
    • 13. LTER Web Site Design LTER Web Site Content  LTER Network Identity  LOGO AND ID  link to siteDB  The LTER network domain, luq.ternet.edu,  Navigation  Repeated navigation menu  Hyperlinked section in each main menu page  Data access  Home page link to data set catalog  Signature data sets  Local data sets search: LTER core areas, LUQ Categories  Link to the LNO MetaCat system: owner and by keyword  Prominent link to network-wide databases: ClimDB/HydroDB, SiteDB  Prominent link to EcoTrends NETWORK STANDARDS • Links reach content in few mouse clicks • All recommended links the home page in place: contact information, site bibliography: contact information, Searchable site personnel directory, Searchable site bibliography, searchable citations, progress reports and proposals, news, Network resources, research description, education and outreach
    • 14.  Challenges: -Providing the capability to achieve real integration of information in the INTERNET -Providing a searching mechanism in the web site that will allow users to obtain the data they are looking for plus related data sets and information  Tasks: - - Complete in time the translation of all of our metadata to EML Level 5 and develop the mechanism to automatically produce this level of metadata for new filed data sets - - Produce sets of keywords that will relate all the information in our web site Completing the goals for the LUQ LTER 4

    ×