SlideShare a Scribd company logo
1 of 14
Parametric versus Conceptual
Uncertainty – Frenchman Flat,
           Nevada

        MODFLOW and More:
    Ground Water and Public Policy

           May 19-21, 2008

           Greg Ruskauff
Acknowledgements


 Work performed by the Stoller-Navarro Joint Venture
  (and its subcontractors) under DOE Contract DE-AC52-
  03NA99205. Project Managers: Bill Wilborn, K.C.
  Thompson


 Many contributors, including: Ian Nienheuser, Nicole
  Denovio, John Ewing, Edward Kwicklis
Introduction

 Underground nuclear testing
  conducted on the Nevada Test Site
  from 1957-1992

 Testing left behind radionuclides in
  the rock

 Underground Testing Area (UGTA)
  Project established to ensure the
  protection of the public and the
  environment
Geologic Setting

 Great Basin area of United
  States

 Complex geology

 Many major features are
  buried

 Drill-hole data sparse,
  difficult to acquire

 Indirect means used to
  establish the character and
  presence of rocks
Frenchman Flat Geologic Model

   Alluvial
   Aquifers

                B
    Volcanic                    B’

    Aquifers
    Aquitards




    Lower
   Carbonate
    Aquifer
Frenchman Flat HFM Uncertainty


    HFM Alternative                              Description
DETA – detachment fault     This alternative is a no detachment fault model.
      alternative

DISP – Displacement fault   This alternative is concerned with the locations and
       alternative          displacement of basin-forming faults.

   CPBA – CP Basin          The CP basin alternative extends the UCCU beneath
      alternative           all of CP basin.

BLFA – Basalt Lava-Flow     The BLFA HSU is modeled as a single continuous
       Aquifer              flow, rather than three separate zones




  Base                                                                         BLFA
Conceptual Model Uncertainty

 Bredehoeft (2005) has suggested that proper conceptual model
  selection is the greatest uncertainty

 Neuman and Weirenga make a similar point (NUREG/CR-6805, 2003)

 Nishikawa (1997) and Harrar et al. (2003) demonstrate the impact of
  alternative conceptual models on predictions

 Beven (1993) laid out the argument for considering multiple alternative
  models and model structures due to the problem of ‘equifinality’ - the
  concept that a unique model with an ‘optimal’ set of parameters is
  inherently unknowable. Instead, he argued for a set of acceptable and
  realistic model representations that are consistent with the data.

 UGTA Project explicitly recognizes and addresses this issue
Uncertainty Components

     Decision

                      Structural
Scenario/Framework    Uncertainty

      Model

Parameter/Knowledge
                      Statistical
    Variability       Uncertainty

Parameter/Knowledge

       Model
                      Structural
 Scenario/Framework
                      Uncertainty

      Decision
Uncertainty Analysis
   Initial idea was “The differences in geologic framework models cause resulting
    differences in unit properties that are at least as large as the uncertainty in the
    properties, and thus the uncertainty is captured.”
    −      Conduct transport parameter uncertainty on a fixed flow field
                                                                               1500

                                                                               1400
   Null space Monte Carlo                                                     1300

   sampling allows calibration                                                1200
                                                                                                                                                                                                                          After Calibration
   constrained parameter                                                      1100




                                          Calibration Objective Function (-)
                                                                                                                                                                                                                          Forward Run Only
   uncertainty to be combined
                                                                               1000

                                                                                900

   with HFM uncertainty                                                        800

                                                                                700


   Using the SVD and a sampled                                                 600

                                                                                500
   parameter project onto space                                                400

   of small eigenvalue (little                                                 300


   influence on solution)                                                      200

                                                                                100

                                                                                 0
                                                                                                  10

                                                                                                       13



                                                                                                                 19

                                                                                                                      22

                                                                                                                           25

                                                                                                                                28

                                                                                                                                     31

                                                                                                                                          34

                                                                                                                                               37




                                                                                                                                                              46

                                                                                                                                                                   49




                                                                                                                                                                                                           73




                                                                                                                                                                                                                            82

                                                                                                                                                                                                                                 85

                                                                                                                                                                                                                                      88

                                                                                                                                                                                                                                           91

                                                                                                                                                                                                                                                94

                                                                                                                                                                                                                                                     97

                                                                                                                                                                                                                                                          10
                                                                                      1

                                                                                          4

                                                                                              7




                                                                                                            16




                                                                                                                                                    40

                                                                                                                                                         43




                                                                                                                                                                        52

                                                                                                                                                                             55

                                                                                                                                                                                  58

                                                                                                                                                                                       61

                                                                                                                                                                                            64

                                                                                                                                                                                                 67

                                                                                                                                                                                                      70



                                                                                                                                                                                                                76

                                                                                                                                                                                                                     79
                                                                                                                                                               Realization


   What is the impact of flow calibration on the prediction of interest?
    −   Does the hard data constrain the prediction?
First-Order Predictions

   Flow through
    test cavity as
    a simple
    prediction
    surrogate
Transport Results

   Computed
    plume
    volume
    exceeding
    SDWA
    radionuclide
    standard as
    metric
Flow Model Calibration
   HFMs have many (more than 100) adjustable parameters

   Frenchman Flat has 26 steady-state head observations, and model boundary
    flows (4) estimated from the regional model

   HFMs have many (more than 100) adjustable parameters

   PEST with singular value decomposition and regularization with a Linux
    cluster able to effectively calibrate and conduct parameter uncertainty
    analysis

   Singular value decomposition of the JtQJ
    matrix in order to define the linear
    combination of base parameters which
    comprises each super parameter –
    dominant eigenvalues and their components
    (eigenvectors) become “super” parameters
     − Idea first proposed by Jacobson (1985)
     − 10 to 15 super parameters
Conclusions
   Discerning (especially before any model analysis) geologic uncertainty
    important to the prediction is difficult in this complex setting
     − Some alternatives have obvious consequences relative to the flow model
        behavior

     − Others have no obvious flow model consequence, but could have
       transport consequences not revealed during flow model analysis

   Approached thoughtlessly, having additional HFMs can add an additional
    burden to a project and impede true understanding

   Uncertainty approach has so far met with regulatory approval, but has a
    significant burden not suitable in its entirely for all applications
Parametric versus Conceptual
Uncertainty – Frenchman Flat,
           Nevada

        MODFLOW and More:
    Ground Water and Public Policy

           May 19-21, 2008

           Greg Ruskauff

More Related Content

Viewers also liked

How World Hunger is Being Solved By the Sweet Potato
How World Hunger is Being Solved By the Sweet PotatoHow World Hunger is Being Solved By the Sweet Potato
How World Hunger is Being Solved By the Sweet PotatoMatt Redington
 
How to get non availability of birth certificate via s2 nri
How to get non availability of birth certificate via s2 nriHow to get non availability of birth certificate via s2 nri
How to get non availability of birth certificate via s2 nriServices 2 NRI
 
Grad - IOSH Membership
Grad - IOSH MembershipGrad - IOSH Membership
Grad - IOSH MembershipSuresh Mondi
 
Building a Pyramid: Symfony Testing Strategies
Building a Pyramid: Symfony Testing StrategiesBuilding a Pyramid: Symfony Testing Strategies
Building a Pyramid: Symfony Testing StrategiesCiaranMcNulty
 
United Arab Emirates لإمارات العربية المتحدة
United Arab Emirates لإمارات العربية المتحدة United Arab Emirates لإمارات العربية المتحدة
United Arab Emirates لإمارات العربية المتحدة Diana Yeghiazaryan
 
IOSH Certificate
IOSH CertificateIOSH Certificate
IOSH CertificateMichael Lim
 
Taller de líquidos y electrólitos mac
Taller de líquidos y electrólitos macTaller de líquidos y electrólitos mac
Taller de líquidos y electrólitos macMarco A. Cedano Ortiz
 
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...A parallel evolutionary algorithm for prioritized pairwise testing of softwar...
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...Javier Ferrer, PhD
 
Elasticsearch, the story so far
Elasticsearch, the story so farElasticsearch, the story so far
Elasticsearch, the story so farJordy Moos
 
TDD with PhpSpec - Lone Star PHP 2016
TDD with PhpSpec - Lone Star PHP 2016TDD with PhpSpec - Lone Star PHP 2016
TDD with PhpSpec - Lone Star PHP 2016CiaranMcNulty
 
Emergency prepardness and Pesponse Training Certificate
Emergency prepardness and Pesponse Training CertificateEmergency prepardness and Pesponse Training Certificate
Emergency prepardness and Pesponse Training CertificateZahidul Alam
 
Líquidos y Electrolitos corporales
Líquidos y Electrolitos corporalesLíquidos y Electrolitos corporales
Líquidos y Electrolitos corporalesfabiola piñero
 

Viewers also liked (18)

How World Hunger is Being Solved By the Sweet Potato
How World Hunger is Being Solved By the Sweet PotatoHow World Hunger is Being Solved By the Sweet Potato
How World Hunger is Being Solved By the Sweet Potato
 
Ewri ruskauff
Ewri ruskauffEwri ruskauff
Ewri ruskauff
 
How to get non availability of birth certificate via s2 nri
How to get non availability of birth certificate via s2 nriHow to get non availability of birth certificate via s2 nri
How to get non availability of birth certificate via s2 nri
 
Model Care96
Model Care96Model Care96
Model Care96
 
Overseas Job Consultant
Overseas Job ConsultantOverseas Job Consultant
Overseas Job Consultant
 
Tijara2
Tijara2Tijara2
Tijara2
 
Grad - IOSH Membership
Grad - IOSH MembershipGrad - IOSH Membership
Grad - IOSH Membership
 
Building a Pyramid: Symfony Testing Strategies
Building a Pyramid: Symfony Testing StrategiesBuilding a Pyramid: Symfony Testing Strategies
Building a Pyramid: Symfony Testing Strategies
 
United Arab Emirates لإمارات العربية المتحدة
United Arab Emirates لإمارات العربية المتحدة United Arab Emirates لإمارات العربية المتحدة
United Arab Emirates لإمارات العربية المتحدة
 
IOSH Certificate
IOSH CertificateIOSH Certificate
IOSH Certificate
 
2011 credentials
2011 credentials2011 credentials
2011 credentials
 
Taller de líquidos y electrólitos mac
Taller de líquidos y electrólitos macTaller de líquidos y electrólitos mac
Taller de líquidos y electrólitos mac
 
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...A parallel evolutionary algorithm for prioritized pairwise testing of softwar...
A parallel evolutionary algorithm for prioritized pairwise testing of softwar...
 
Elasticsearch, the story so far
Elasticsearch, the story so farElasticsearch, the story so far
Elasticsearch, the story so far
 
TDD with PhpSpec - Lone Star PHP 2016
TDD with PhpSpec - Lone Star PHP 2016TDD with PhpSpec - Lone Star PHP 2016
TDD with PhpSpec - Lone Star PHP 2016
 
Qatar ppt
Qatar pptQatar ppt
Qatar ppt
 
Emergency prepardness and Pesponse Training Certificate
Emergency prepardness and Pesponse Training CertificateEmergency prepardness and Pesponse Training Certificate
Emergency prepardness and Pesponse Training Certificate
 
Líquidos y Electrolitos corporales
Líquidos y Electrolitos corporalesLíquidos y Electrolitos corporales
Líquidos y Electrolitos corporales
 

Similar to Igwmc Modeluncert

ARGOMARINE Final Conference - SUSY presentation -
ARGOMARINE Final Conference - SUSY presentation - ARGOMARINE Final Conference - SUSY presentation -
ARGOMARINE Final Conference - SUSY presentation - ARGOMARINE
 
Determination of 2D shallow S wave velocity profile using waveform inversion ...
Determination of 2D shallow S wave velocity profile using waveform inversion ...Determination of 2D shallow S wave velocity profile using waveform inversion ...
Determination of 2D shallow S wave velocity profile using waveform inversion ...Tokugawa Moumouh
 
CSP Training series : solar resource assessment 1/2
CSP Training series : solar resource assessment 1/2CSP Training series : solar resource assessment 1/2
CSP Training series : solar resource assessment 1/2Leonardo ENERGY
 
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGE
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGEEXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGE
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGEMartin Poljanšek
 
Sample size issues on reliability test design
Sample size issues on reliability test designSample size issues on reliability test design
Sample size issues on reliability test designASQ Reliability Division
 
Applications of R in Business contest: 2012
Applications of R in Business contest: 2012Applications of R in Business contest: 2012
Applications of R in Business contest: 2012Revolution Analytics
 
Design of Different Types of Corrugated Board Packages Using Finite Element T...
Design of Different Types of Corrugated Board Packages Using Finite Element T...Design of Different Types of Corrugated Board Packages Using Finite Element T...
Design of Different Types of Corrugated Board Packages Using Finite Element T...SIMULIA
 
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...Bharath Ningaraj
 
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...Jiří Šmída
 
Artificial neural networks for ion beam analysis
Artificial neural networks for ion beam analysisArtificial neural networks for ion beam analysis
Artificial neural networks for ion beam analysisArmando Vieira
 
Univ Of Zagreb Uglesic Prevention Of Flashover
Univ Of Zagreb Uglesic Prevention Of FlashoverUniv Of Zagreb Uglesic Prevention Of Flashover
Univ Of Zagreb Uglesic Prevention Of Flashovercorinne rocherieux
 
3 experimental wideband_characterization_of_a parallel-plate_capacitor
3 experimental wideband_characterization_of_a parallel-plate_capacitor3 experimental wideband_characterization_of_a parallel-plate_capacitor
3 experimental wideband_characterization_of_a parallel-plate_capacitorPiero Belforte
 

Similar to Igwmc Modeluncert (13)

ARGOMARINE Final Conference - SUSY presentation -
ARGOMARINE Final Conference - SUSY presentation - ARGOMARINE Final Conference - SUSY presentation -
ARGOMARINE Final Conference - SUSY presentation -
 
Determination of 2D shallow S wave velocity profile using waveform inversion ...
Determination of 2D shallow S wave velocity profile using waveform inversion ...Determination of 2D shallow S wave velocity profile using waveform inversion ...
Determination of 2D shallow S wave velocity profile using waveform inversion ...
 
CSP Training series : solar resource assessment 1/2
CSP Training series : solar resource assessment 1/2CSP Training series : solar resource assessment 1/2
CSP Training series : solar resource assessment 1/2
 
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGE
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGEEXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGE
EXPERIMENTAL CAMPAIGN ON THE FULL SCALE FRP MOTORWAY BRIDGE
 
Sample size issues on reliability test design
Sample size issues on reliability test designSample size issues on reliability test design
Sample size issues on reliability test design
 
Applications of R in Business contest: 2012
Applications of R in Business contest: 2012Applications of R in Business contest: 2012
Applications of R in Business contest: 2012
 
Gx3113351337
Gx3113351337Gx3113351337
Gx3113351337
 
Design of Different Types of Corrugated Board Packages Using Finite Element T...
Design of Different Types of Corrugated Board Packages Using Finite Element T...Design of Different Types of Corrugated Board Packages Using Finite Element T...
Design of Different Types of Corrugated Board Packages Using Finite Element T...
 
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...
Numerical Investigation of Aerodynamic Performance of H-Rotor Darrieus Wind T...
 
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...
Martin Hanel, Adri Buishand: Assessment of projected changes in seasonal prec...
 
Artificial neural networks for ion beam analysis
Artificial neural networks for ion beam analysisArtificial neural networks for ion beam analysis
Artificial neural networks for ion beam analysis
 
Univ Of Zagreb Uglesic Prevention Of Flashover
Univ Of Zagreb Uglesic Prevention Of FlashoverUniv Of Zagreb Uglesic Prevention Of Flashover
Univ Of Zagreb Uglesic Prevention Of Flashover
 
3 experimental wideband_characterization_of_a parallel-plate_capacitor
3 experimental wideband_characterization_of_a parallel-plate_capacitor3 experimental wideband_characterization_of_a parallel-plate_capacitor
3 experimental wideband_characterization_of_a parallel-plate_capacitor
 

Igwmc Modeluncert

  • 1. Parametric versus Conceptual Uncertainty – Frenchman Flat, Nevada MODFLOW and More: Ground Water and Public Policy May 19-21, 2008 Greg Ruskauff
  • 2. Acknowledgements  Work performed by the Stoller-Navarro Joint Venture (and its subcontractors) under DOE Contract DE-AC52- 03NA99205. Project Managers: Bill Wilborn, K.C. Thompson  Many contributors, including: Ian Nienheuser, Nicole Denovio, John Ewing, Edward Kwicklis
  • 3. Introduction  Underground nuclear testing conducted on the Nevada Test Site from 1957-1992  Testing left behind radionuclides in the rock  Underground Testing Area (UGTA) Project established to ensure the protection of the public and the environment
  • 4. Geologic Setting  Great Basin area of United States  Complex geology  Many major features are buried  Drill-hole data sparse, difficult to acquire  Indirect means used to establish the character and presence of rocks
  • 5. Frenchman Flat Geologic Model Alluvial Aquifers B Volcanic B’ Aquifers Aquitards Lower Carbonate Aquifer
  • 6. Frenchman Flat HFM Uncertainty HFM Alternative Description DETA – detachment fault This alternative is a no detachment fault model. alternative DISP – Displacement fault This alternative is concerned with the locations and alternative displacement of basin-forming faults. CPBA – CP Basin The CP basin alternative extends the UCCU beneath alternative all of CP basin. BLFA – Basalt Lava-Flow The BLFA HSU is modeled as a single continuous Aquifer flow, rather than three separate zones Base BLFA
  • 7. Conceptual Model Uncertainty  Bredehoeft (2005) has suggested that proper conceptual model selection is the greatest uncertainty  Neuman and Weirenga make a similar point (NUREG/CR-6805, 2003)  Nishikawa (1997) and Harrar et al. (2003) demonstrate the impact of alternative conceptual models on predictions  Beven (1993) laid out the argument for considering multiple alternative models and model structures due to the problem of ‘equifinality’ - the concept that a unique model with an ‘optimal’ set of parameters is inherently unknowable. Instead, he argued for a set of acceptable and realistic model representations that are consistent with the data.  UGTA Project explicitly recognizes and addresses this issue
  • 8. Uncertainty Components Decision Structural Scenario/Framework Uncertainty Model Parameter/Knowledge Statistical Variability Uncertainty Parameter/Knowledge Model Structural Scenario/Framework Uncertainty Decision
  • 9. Uncertainty Analysis  Initial idea was “The differences in geologic framework models cause resulting differences in unit properties that are at least as large as the uncertainty in the properties, and thus the uncertainty is captured.” − Conduct transport parameter uncertainty on a fixed flow field 1500 1400  Null space Monte Carlo 1300  sampling allows calibration 1200 After Calibration  constrained parameter 1100 Calibration Objective Function (-) Forward Run Only  uncertainty to be combined 1000 900  with HFM uncertainty 800 700  Using the SVD and a sampled 600 500  parameter project onto space 400  of small eigenvalue (little 300  influence on solution) 200 100 0 10 13 19 22 25 28 31 34 37 46 49 73 82 85 88 91 94 97 10 1 4 7 16 40 43 52 55 58 61 64 67 70 76 79 Realization  What is the impact of flow calibration on the prediction of interest? − Does the hard data constrain the prediction?
  • 10. First-Order Predictions  Flow through test cavity as a simple prediction surrogate
  • 11. Transport Results  Computed plume volume exceeding SDWA radionuclide standard as metric
  • 12. Flow Model Calibration  HFMs have many (more than 100) adjustable parameters  Frenchman Flat has 26 steady-state head observations, and model boundary flows (4) estimated from the regional model  HFMs have many (more than 100) adjustable parameters  PEST with singular value decomposition and regularization with a Linux cluster able to effectively calibrate and conduct parameter uncertainty analysis  Singular value decomposition of the JtQJ matrix in order to define the linear combination of base parameters which comprises each super parameter – dominant eigenvalues and their components (eigenvectors) become “super” parameters − Idea first proposed by Jacobson (1985) − 10 to 15 super parameters
  • 13. Conclusions  Discerning (especially before any model analysis) geologic uncertainty important to the prediction is difficult in this complex setting − Some alternatives have obvious consequences relative to the flow model behavior − Others have no obvious flow model consequence, but could have transport consequences not revealed during flow model analysis  Approached thoughtlessly, having additional HFMs can add an additional burden to a project and impede true understanding  Uncertainty approach has so far met with regulatory approval, but has a significant burden not suitable in its entirely for all applications
  • 14. Parametric versus Conceptual Uncertainty – Frenchman Flat, Nevada MODFLOW and More: Ground Water and Public Policy May 19-21, 2008 Greg Ruskauff