Object Lessons from a State
Survey to Improve Data Discovery,
Access, and Stewardship
Denise J. Hills, Geological Survey of Alabama
Stephen M. Richard, Arizona Geological Survey
Sponsored by the U.S. Department of Energy under award DE-EE0002850 to the
Arizona Geological Survey acting on behalf of the Association of American State
Geologists

GSA Annual Meeting

29 October 2013
Goal of NGDS
To make large quantities of
geothermal-relevant geoscience
data available to the public by
creating a national, sustainable,
distributed, and interoperable
network of data providers

GSA Annual Meeting

29 October 2013
Role of the GSA
 In association with the State Oil and Gas board,
the Geological Survey of Alabama (GSA) is a
repository of all Oil and Gas well information in
the state, including:
 Geophysical well logs (which may have bottom
hole temperatures (BHT) recorded)
 Cores, cuttings, and other physical samples,
sometimes with descriptions
 Fluid production and injection information

GSA Annual Meeting

29 October 2013
Role of the GSA
 These data may contain information relevant to
geothermal resource development

 This project was the first experience for our

agency to generate large quantities of digitally
preserved data in a standardized format

GSA Annual Meeting

29 October 2013
Roadblock – “Disconnect” Between Data
Creators and Data Scientists
 Early on, standard data science and archival
practices could be confusing for a data
creator/provider, including the terminology

 AZGS provided many useful resources

 Webinars and workshops were conducted that

greatly improved creator/provider’s
understanding of expectations and of the data
science field

GSA Annual Meeting

29 October 2013
Webinar on Metadata

GSA Annual Meeting

29 October 2013
Roadblock – Diverse Users
and Data Creators
 Large project – in theory, one provider per state
– each with different research practices, needs,
and standards

 Content models therefore went through

numerous iterations, trying to capture all
relevant information without unnecessary
duplication

GSA Annual Meeting

29 October 2013
Example of Iterative Process

GSA Annual Meeting

29 October 2013
Roadblock – Data at GSA
 Data discoverability often difficult
 Much of the available information was analog
 Even digital data was not always “machinereadable”

 Lack of standardization and documentation of
data and metadata

 Provenance and quality often poor or unknown

GSA Annual Meeting

29 October 2013
GSA/OGB Well Web Search

GSA Annual Meeting

29 October 2013
GSA/OGB Well Record

GSA Annual Meeting

29 October 2013
GSA/OGB Well Form Access

GSA Annual Meeting

29 October 2013
Example Well Data Forms –
Application to Drill

GSA Annual Meeting

29 October 2013
Example Well Data Forms –
Record of Completion

GSA Annual Meeting

29 October 2013
Example of Digital Headers
Available for Download

GSA Annual Meeting

29 October 2013
Geophysical Well Logs

GSA Annual Meeting

29 October 2013
GSA/OGB Web Core Search

GSA Annual Meeting

29 October 2013
Core Warehouse

GSA Annual Meeting

29 October 2013
Preservation of Core

GSA Annual Meeting

29 October 2013
GSA/OGB Production Search

GSA Annual Meeting

29 October 2013
GSA/OGB Production Record

GSA Annual Meeting

29 October 2013
Alabama Oil and Gas Wells
 Over 18000
permitted wells in
the state (including
offshore wells)

 Over 16000 wells
have information
submitted to NGDS

GSA Annual Meeting

29 October 2013
Alabama Oil and Gas Wells
 More than 13000
wells had logs on
file that might
contain a BHT
measurement

 Over 30000
geophysical well
logs had to be
examined for BHT
measurements

GSA Annual Meeting

29 October 2013
Alabama Oil and Gas Wells
 In all, GSA
submitted more than
11500 BHT
measurements from
more than 6500 oil
and gas wells

GSA Annual Meeting

29 October 2013
Lessons Learned
 Tech-transfer is key to the success of a robust,

usable database – and this needs to be two-way

 Data providers and creators need to be aware of
existing standards, how they are used, and how
they may be modified to best suit their needs if
necessary

GSA Annual Meeting

29 October 2013
Roadblocks Overcome – A
Shift in Mindset at GSA
 In the past, GSA has primarily been data
generator, with little concern about
interoperability

 New process: To think about what all different

users might need with respect to metadata, for
data discovery and access, and for object/data
preservation

GSA Annual Meeting

29 October 2013
Moving Forward
 A new web search database is in development

for the GSA, with a variety of stakeholder needs
addressed

 NGDS Content Models provide a guide for

standardization of GSA metadata beyond NGDS

 While issues of data provenance, quality, and

preservation remain for legacy data, standards
are being discovered, developed, and applied to
any new data (including samples) moving
forward

GSA Annual Meeting

29 October 2013
GSA Annual Meeting

29 October 2013

State Survey Experience with the National Geothermal Database system

  • 1.
    Object Lessons froma State Survey to Improve Data Discovery, Access, and Stewardship Denise J. Hills, Geological Survey of Alabama Stephen M. Richard, Arizona Geological Survey
  • 2.
    Sponsored by theU.S. Department of Energy under award DE-EE0002850 to the Arizona Geological Survey acting on behalf of the Association of American State Geologists GSA Annual Meeting 29 October 2013
  • 3.
    Goal of NGDS Tomake large quantities of geothermal-relevant geoscience data available to the public by creating a national, sustainable, distributed, and interoperable network of data providers GSA Annual Meeting 29 October 2013
  • 4.
    Role of theGSA  In association with the State Oil and Gas board, the Geological Survey of Alabama (GSA) is a repository of all Oil and Gas well information in the state, including:  Geophysical well logs (which may have bottom hole temperatures (BHT) recorded)  Cores, cuttings, and other physical samples, sometimes with descriptions  Fluid production and injection information GSA Annual Meeting 29 October 2013
  • 5.
    Role of theGSA  These data may contain information relevant to geothermal resource development  This project was the first experience for our agency to generate large quantities of digitally preserved data in a standardized format GSA Annual Meeting 29 October 2013
  • 6.
    Roadblock – “Disconnect”Between Data Creators and Data Scientists  Early on, standard data science and archival practices could be confusing for a data creator/provider, including the terminology  AZGS provided many useful resources  Webinars and workshops were conducted that greatly improved creator/provider’s understanding of expectations and of the data science field GSA Annual Meeting 29 October 2013
  • 7.
    Webinar on Metadata GSAAnnual Meeting 29 October 2013
  • 8.
    Roadblock – DiverseUsers and Data Creators  Large project – in theory, one provider per state – each with different research practices, needs, and standards  Content models therefore went through numerous iterations, trying to capture all relevant information without unnecessary duplication GSA Annual Meeting 29 October 2013
  • 9.
    Example of IterativeProcess GSA Annual Meeting 29 October 2013
  • 10.
    Roadblock – Dataat GSA  Data discoverability often difficult  Much of the available information was analog  Even digital data was not always “machinereadable”  Lack of standardization and documentation of data and metadata  Provenance and quality often poor or unknown GSA Annual Meeting 29 October 2013
  • 11.
    GSA/OGB Well WebSearch GSA Annual Meeting 29 October 2013
  • 12.
    GSA/OGB Well Record GSAAnnual Meeting 29 October 2013
  • 13.
    GSA/OGB Well FormAccess GSA Annual Meeting 29 October 2013
  • 14.
    Example Well DataForms – Application to Drill GSA Annual Meeting 29 October 2013
  • 15.
    Example Well DataForms – Record of Completion GSA Annual Meeting 29 October 2013
  • 16.
    Example of DigitalHeaders Available for Download GSA Annual Meeting 29 October 2013
  • 17.
    Geophysical Well Logs GSAAnnual Meeting 29 October 2013
  • 18.
    GSA/OGB Web CoreSearch GSA Annual Meeting 29 October 2013
  • 19.
    Core Warehouse GSA AnnualMeeting 29 October 2013
  • 20.
    Preservation of Core GSAAnnual Meeting 29 October 2013
  • 21.
    GSA/OGB Production Search GSAAnnual Meeting 29 October 2013
  • 22.
    GSA/OGB Production Record GSAAnnual Meeting 29 October 2013
  • 23.
    Alabama Oil andGas Wells  Over 18000 permitted wells in the state (including offshore wells)  Over 16000 wells have information submitted to NGDS GSA Annual Meeting 29 October 2013
  • 24.
    Alabama Oil andGas Wells  More than 13000 wells had logs on file that might contain a BHT measurement  Over 30000 geophysical well logs had to be examined for BHT measurements GSA Annual Meeting 29 October 2013
  • 25.
    Alabama Oil andGas Wells  In all, GSA submitted more than 11500 BHT measurements from more than 6500 oil and gas wells GSA Annual Meeting 29 October 2013
  • 26.
    Lessons Learned  Tech-transferis key to the success of a robust, usable database – and this needs to be two-way  Data providers and creators need to be aware of existing standards, how they are used, and how they may be modified to best suit their needs if necessary GSA Annual Meeting 29 October 2013
  • 27.
    Roadblocks Overcome –A Shift in Mindset at GSA  In the past, GSA has primarily been data generator, with little concern about interoperability  New process: To think about what all different users might need with respect to metadata, for data discovery and access, and for object/data preservation GSA Annual Meeting 29 October 2013
  • 28.
    Moving Forward  Anew web search database is in development for the GSA, with a variety of stakeholder needs addressed  NGDS Content Models provide a guide for standardization of GSA metadata beyond NGDS  While issues of data provenance, quality, and preservation remain for legacy data, standards are being discovered, developed, and applied to any new data (including samples) moving forward GSA Annual Meeting 29 October 2013
  • 29.