SlideShare a Scribd company logo
1 of 116
Download to read offline
Non-parametric analysis of mass-action models and data




                                      Heather Harrington

                                    Theoretical Systems Biology
                                     Imperial College London



                                            May 8, 2012


    Model checking, multistability, and spatial models      Heather Harrington   1 / 40
Outline and collaborators


(1) Motivation
        Michael Stumpf
        Theoretical Systems Biology, Imperial College London
(2) Model checking using coplanarity
        Kenneth Ho
        Courant Institute of Mathematical Sciences, New York University
        Thomas Thorne
        Theoretical Systems Biology, Imperial College London
(3) Multistationarity via spatial compartmentalization
        Elisenda Feliu
        Institute of Mathematical Sciences, University of Copenhagen
        Carsten Wiuf
        Institute of Mathematical Sciences, University of Copenhagen

(4) Conclusions

     Model checking, multistability, and spatial models   Heather Harrington   2 / 40
Overview: Cell decisions




Cell decisions
Cellular decision-making is necessary for preservation of homeostasis in an
organism, e.g., apoptosis, proliferation, and differentiation.




      Model checking, multistability, and spatial models   Heather Harrington   3 / 40
Overview: Cell decisions




Cell decisions
Cellular decision-making is necessary for preservation of homeostasis in an
organism, e.g., apoptosis, proliferation, and differentiation.


   Mechanisms that regulate these processes are often feedback loops.




      Model checking, multistability, and spatial models   Heather Harrington   3 / 40
Overview: Cell decisions




Cell decisions
Cellular decision-making is necessary for preservation of homeostasis in an
organism, e.g., apoptosis, proliferation, and differentiation.


   Mechanisms that regulate these processes are often feedback loops.
   Feedbacks can affect the behavior of the system (number of
   response states).




      Model checking, multistability, and spatial models   Heather Harrington   3 / 40
Overview: Cell decisions




Cell decisions
Cellular decision-making is necessary for preservation of homeostasis in an
organism, e.g., apoptosis, proliferation, and differentiation.


   Mechanisms that regulate these processes are often feedback loops.
   Feedbacks can affect the behavior of the system (number of
   response states).
   Many models can be constructed to describe the same system.




      Model checking, multistability, and spatial models   Heather Harrington   3 / 40
Theoretical Systems Biology




Aims of the research group:

  Reverse engineering
  Inverse problems
  Bayesian statistics




      Model checking, multistability, and spatial models   Heather Harrington   4 / 40
Statistical Inference


For any model, M(θ), we can infer the parameters in light of data. In
a statistical framework, for example, we use the likelihood

                                          L(θ) = P(D|θ).

Maximizing the likelihood gives us the value of the parameter θ that
maximizes the probability of observing the data D.




     Model checking, multistability, and spatial models    Heather Harrington   5 / 40
Statistical Inference


For any model, M(θ), we can infer the parameters in light of data. In
a statistical framework, for example, we use the likelihood

                                          L(θ) = P(D|θ).

Maximizing the likelihood gives us the value of the parameter θ that
maximizes the probability of observing the data D.
Model Selection
If, however, we have a set of candidate models, M1 , M2 , . . . we have
to employ other criteria to choose which model is best.




     Model checking, multistability, and spatial models    Heather Harrington   5 / 40
Statistical Inference


For any model, M(θ), we can infer the parameters in light of data. In
a statistical framework, for example, we use the likelihood

                                          L(θ) = P(D|θ).

Maximizing the likelihood gives us the value of the parameter θ that
maximizes the probability of observing the data D.
Model Selection
If, however, we have a set of candidate models, M1 , M2 , . . . we have
to employ other criteria to choose which model is best.
The Akaike and Bayesian information criteria, for example, penalize
models that are overly complex.



     Model checking, multistability, and spatial models    Heather Harrington   5 / 40
Bayesian Inference

  In the Bayesian framework, parameter inference centers around
  finding the posterior distribution

                                                         P(D|θ)π(θ)
                                 P(θ|D) =                             ,
                                                         P(D|θ)π(θ)dθ

  where P(D|θ) is the likelihood and π(θ) is called the prior of θ.




    Model checking, multistability, and spatial models           Heather Harrington   6 / 40
Bayesian Inference

  In the Bayesian framework, parameter inference centers around
  finding the posterior distribution

                                                         P(D|θ)π(θ)
                                 P(θ|D) =                             ,
                                                         P(D|θ)π(θ)dθ

  where P(D|θ) is the likelihood and π(θ) is called the prior of θ.
  For model selection, the key quantity is the Evidence (marginal
  likelihood):
                                              P(D|θ)π(θ)dθ,

  which is calculated by integrating the likelihood over the parameter
  space.
  Given a set of models, we prefer the one for which the evidence is
  the highest.
    Model checking, multistability, and spatial models           Heather Harrington   6 / 40
The Problem of Model Selection



  In maximum likelihood estimation (or in optimization approaches
  more generally) model selection needs to be addressed in an ad
  hoc fashion.
  Bayesian approaches integrate out parameter dependencies along
  the way towards model selection.
  In a Bayesian framework, model selection is natural but
  computationally expensive: often prohibitively expensive.




    Model checking, multistability, and spatial models   Heather Harrington   7 / 40
The Problem of Model Selection



  In maximum likelihood estimation (or in optimization approaches
  more generally) model selection needs to be addressed in an ad
  hoc fashion.
  Bayesian approaches integrate out parameter dependencies along
  the way towards model selection.
  In a Bayesian framework, model selection is natural but
  computationally expensive: often prohibitively expensive.
  Can we do better? Can we do parameter-free model selection?




    Model checking, multistability, and spatial models   Heather Harrington   7 / 40
The Problem of Model Selection



  In maximum likelihood estimation (or in optimization approaches
  more generally) model selection needs to be addressed in an ad
  hoc fashion.
  Bayesian approaches integrate out parameter dependencies along
  the way towards model selection.
  In a Bayesian framework, model selection is natural but
  computationally expensive: often prohibitively expensive.
  Can we do better? Can we do parameter-free model selection?
  We will try ...




    Model checking, multistability, and spatial models   Heather Harrington   7 / 40
Background: Model selection using algebraic geometry


Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.




     Model checking, multistability, and spatial models   Heather Harrington   8 / 40
Background: Model selection using algebraic geometry


Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:

   N                   N
                 k
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R
   j=1                j=1




         Model checking, multistability, and spatial models   Heather Harrington   8 / 40
Background: Model selection using algebraic geometry


Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1




         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: Model selection using algebraic geometry


Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1


These equations provide a quantitative description of the model.




         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: Model selection using algebraic geometry

Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1


These equations provide a quantitative description of the model.
In principle, the equations can be used to test the model’s validity by
assessing the degree to which they are satisfied by observed data.




         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: Model selection using algebraic geometry

Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1


These equations provide a quantitative description of the model.
In principle, the equations can be used to test the model’s validity by
assessing the degree to which they are satisfied by observed data.
   However, in practice, the required variables are rarely available.




         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: Model selection using algebraic geometry

Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1


These equations provide a quantitative description of the model.
In principle, the equations can be used to test the model’s validity by
assessing the degree to which they are satisfied by observed data.
   However, in practice, the required variables are rarely available.
   In particular the velocities x = (x1 , . . . , xN ) are difficult to measure, so we
                                ˙     ˙           ˙
   consider only the steady state x = 0.
                                    ˙


         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: Model selection using algebraic geometry

Techniques from algebraic geometry for model discrimination.
Using results from Manrai and Gunawardena (2008) Biophys J.

 Chemical reaction network:                                   Dynamics from mass action kinetics:

   N                   N                                             R                     N
                 k                                                                                s
         sij Xj −i
                 →          sij Xj ,   i = 1, . . . , R       xi =
                                                              ˙            kj sji − sji          xj jk , i = 1, . . . , N
   j=1                j=1                                            j=1                   k=1


These equations provide a quantitative description of the model.
In principle, the equations can be used to test the model’s validity by
assessing the degree to which they are satisfied by observed data.
   However, in practice, the required variables are rarely available.
   In particular the velocities x = (x1 , . . . , xN ) are difficult to measure, so we
                                ˙     ˙           ˙
   consider only the steady state x = 0.
                                    ˙
   We eliminate these variables from the equations if possible.
         Model checking, multistability, and spatial models           Heather Harrington    8 / 40
Background: tools from algebraic geometry




For simple systems, this elimination can be done by hand. But in
general, a more systematic approach is often required.




     Model checking, multistability, and spatial models   Heather Harrington   9 / 40
Background: tools from algebraic geometry




For simple systems, this elimination can be done by hand. But in
general, a more systematic approach is often required.
  Gr¨bner basis nonlinear generalization of Gaussian elimination.
    o




     Model checking, multistability, and spatial models   Heather Harrington   9 / 40
Background: tools from algebraic geometry




For simple systems, this elimination can be done by hand. But in
general, a more systematic approach is often required.
  Gr¨bner basis nonlinear generalization of Gaussian elimination.
    o
  Elimination ideal allows us to perform elimination without having
  to know the numerical values of the parameters a = (k1 , . . . , kR )
  by treating them symbolically.




     Model checking, multistability, and spatial models   Heather Harrington   9 / 40
Background: tools from algebraic geometry




For simple systems, this elimination can be done by hand. But in
general, a more systematic approach is often required.
  Gr¨bner basis nonlinear generalization of Gaussian elimination.
    o
  Elimination ideal allows us to perform elimination without having
  to know the numerical values of the parameters a = (k1 , . . . , kR )
  by treating them symbolically.
  Gr¨bner bases automatically give equations that are fulfilled by any
     o
  steady-state solution and only involve a subset of variables.




     Model checking, multistability, and spatial models   Heather Harrington   9 / 40
Background: variable elimination and invariants


After variable elimination we are left with:
                                     ni             Nobs
                                                             t
             Ii (xobs ; a) =              fij (a)          xkijk ,   i = 1, . . . , Ninv .          (1)
                                    j=1             k=1




     Model checking, multistability, and spatial models              Heather Harrington   10 / 40
Background: variable elimination and invariants


After variable elimination we are left with:
                                     ni             Nobs
                                                             t
             Ii (xobs ; a) =              fij (a)          xkijk ,   i = 1, . . . , Ninv .          (1)
                                    j=1             k=1


  Ii is a polynomial in xobs that vanishes at steady state.




     Model checking, multistability, and spatial models              Heather Harrington   10 / 40
Background: variable elimination and invariants


After variable elimination we are left with:
                                     ni             Nobs
                                                             t
             Ii (xobs ; a) =              fij (a)          xkijk ,   i = 1, . . . , Ninv .          (1)
                                    j=1             k=1


  Ii is a polynomial in xobs that vanishes at steady state.
  We call the Ii steady-state invariants.




     Model checking, multistability, and spatial models              Heather Harrington   10 / 40
Background: variable elimination and invariants


After variable elimination we are left with:
                                     ni             Nobs
                                                             t
             Ii (xobs ; a) =              fij (a)          xkijk ,   i = 1, . . . , Ninv .          (1)
                                    j=1             k=1


  Ii is a polynomial in xobs that vanishes at steady state.
  We call the Ii steady-state invariants.
  Invariants of a model (if they exist) describe relationships between
  observable variables that hold a steady state for any given
  realization of parameter values, regardless of other factors (such as
  initial conditions).



     Model checking, multistability, and spatial models              Heather Harrington   10 / 40
Model Model Model1.1. .Model 22 L 2
                                                                                Model
                                                                      Model 1 Model Model Model
                                                                       1 Model 2 Model 1Model
                                                                                   1                    2

                                                      x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . .
                                                      ˙    ˙ . .˙ ˙ = ˙ ..                                                                    ...
          Assessing coplanarity: overview               .
                                                        .
                                                            x = 1
                                                              . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . .
                                                              ..
                                                               .      ..           .                                                          ...

                                                  xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . .
                                                  ˙    ˙ N .=. ˙ = ˙ N . .
                                                        x
                                                            . ˙N .                                                                            ...




                                   Models
                                Models                                Observed Data DataData Data
                                                                                      Observed
                                                                             Observed Data Data
                                                                             Observed Observed
                                                                                      Observed
                       Calculate elimination ideal
                                                                           Models (Steadymeasurements)
Calculate elimination ideal elimination. .ideal (Steadymeasurements)
                      Calculate                            (Steady state state state measurements)
                                                                            (Steady measurements)
                    Model 1 Model. 2 . . . . Model L (Steady state measurements)
                        Model 1           .                .                 (Steady state state measurements)
                  Calculate elimination ideal                                           ... ...
                  Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . .
                                 . . . . . . . x1 . .. . x11 ˆˆ
                                                   ˆ          ˆ        1 1 . .x1ˆ.
          x1 =˙ 1 = . . . . . .
           ˙ x                                                 x
                                                               ˆ
                       Assess coplanarity ˆ                   ˆ . ˆˆ . .x2 ........ . . . .. .. . . . .
                                                                                 .
                      Assess coplanarity1x2 . . . x.22 . xx2
Assess coplanarity . . . . . .
            . .
                                              x =
                                               ˙               x
                                                               ˆ         2      ˆ
            . .                  ... ... ... ...
                  Assess coplanarity
                                                  ..
                                                    .          ... . . . . .. .. .. ........ . . . .. .. . . . .
                                                               .        ..        .
                  Assess coplanarity              .
          xN =N = . . . . . .
          ˙ x ˙                  . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . .
                                                  ˆ           ˆ m ˆˆ
                                                              x
                                                              ˆ         m      x
                       Reduce number ˙of =           variables  ...          ...        ... ...
                      Reduce number xN variables
Reduce number of variables                    of
                  Reduce number of variables
                       to include only observables
                   observables only observables
                      to include
to include onlyReduce number of variables
                  to include only observablesSteady statestate invariants
         Steady state invariants Data                                 SteadySteady
                                                 Steady state invariants state invariants
                                                             Steady state state invariants
                                                                       Steady invariants
                                                                                    invariants
                            Observed
                  to include only observablesstate invariants
                                             Steady
                     (Steady state measurements) of models
                       Characterize steady states
Characterize steady states of. .models states of models
                      Characterize steady
                                        .
              x1Characterize steady
              ˆ
         Calculate elimination ideal states of models
                  Characterize steady states of elimination ideal
                                    . . . Calculate models
              x2
              ˆ                                                                       1        1
                                                                                                1
                                                                                                          11     1

                .      Transform model variables,
                .     Transform     .model variables, parameters, and data
                                      ..
Transform model variables,
         AssessTransform model variables,
                   coplanarity . . . and data
                       parameters,
             xm parameters, and data
              ˆ Transform model variables,
parameters, and data                         Assess coplanarity
                  parameters, and data
                  parameters, and data

                Steady state invariants
                        Data coplanar                                      Data not coplanar
                                 1

                                                                              1



                                              1


                                                           2
                                                            2
                                                                          Data not coplanar
                             2
                                                  2

                                                  2


                          Data not coplanar                               Model compatible



                       Model compatible                                Model incompatible
                     Data coplanar     2                             Data not coplanar 3

                          Model checking, multistability, and spatial models                                                                        Heather Harrington   11 / 40
                          Model incompatible
Model Model Model1.1. .Model 22 L 2
                                                                                Model
                                                                      Model 1 Model Model Model
                                                                       1 Model 2 Model 1Model
                                                                                   1                    2

                                                      x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . .
                                                      ˙    ˙ . .˙ ˙ = ˙ ..                                                                    ...
          Assessing coplanarity: overview               .
                                                        .
                                                            x = 1
                                                              . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . .
                                                              ..
                                                               .      ..           .                                                          ...

                                                  xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . .
                                                  ˙    ˙ N .=. ˙ = ˙ N . .
                                                        x
                                                            . ˙N .                                                                            ...




                                   Models
                                Models                                Observed Data DataData Data
                                                                                      Observed
                                                                             Observed Data Data
                                                                             Observed Observed
                                                                                      Observed
                       Calculate elimination ideal
                                                                           Models (Steadymeasurements)
Calculate elimination ideal elimination. .ideal (Steadymeasurements)
                      Calculate                            (Steady state state state measurements)
                                                                            (Steady measurements)
                    Model 1 Model. 2 . . . . Model L (Steady state measurements)
                                          .                .                 (Steady state state measurements)
                        Model 1
                  Calculate elimination ideal
                  Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . .
                                 . . . . . . . x1 . .. . x11 ˆˆ
                                                   ˆ          ˆ        1 1 . .x1ˆ.      ... ...                                                     We are interested in how to
          x1 =˙ 1 = . . . . . .
           ˙ x                                                 x
                                                               ˆ
                       Assess coplanarity ˆ                   ˆ . ˆˆ . .x2 ........ . . . .. .. . . . .
                      Assess coplanarity1x2 . . . x.22 . xx2
Assess coplanarity . . . . . .
            . .
            . .
                                              x =
                                               ˙
                                 ... ... ... ...
                  Assess coplanarity                .
                                                               x
                                                               ˆ         2      ˆ.
                                                               ... . . . . .. .. .. ........ . . . .. .. . . . .
                                                               .        ..
                                                                                                                                                    check if models and data are
                  Assess coplanarity              ..
                                                  .
                                                                                  .
          xN =N = . . . . . .
          ˙ x ˙                  . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . .
                       Reduce number ˙of =
                      Reduce number xN variables
                                              of
                                                  ˆ
                                                     variables
                                                              ˆ m ˆˆ
                                                              x
                                                              ˆ
                                                                ...
                                                                        m      x
                                                                             ...        ... ...
                                                                                                                                                    coplanar.
Reduce number of variables
                  Reduce number of variables
                       to include only observables
                   observables only observables
                      to include
to include onlyReduce number of variables
                  to include only observablesSteady statestate invariants
         Steady state invariants Data                                 SteadySteady
                                                 Steady state invariants state invariants
                                                             Steady state state invariants
                                                                       Steady invariants
                                                                                    invariants
                            Observed
                  to include only observablesstate invariants
                                             Steady
                     (Steady state measurements) of models
                       Characterize steady states
Characterize steady states of. .models states of models
                      Characterize steady
                                        .
              x1Characterize steady
              ˆ
         Calculate elimination ideal states of models
                  Characterize steady states of elimination ideal
                                    . . . Calculate models
              x2
              ˆ                                                                       1        1
                                                                                                1
                                                                                                          11     1

                .      Transform model variables,
                .     Transform     .model variables, parameters, and data
                                      ..
Transform model variables,
         AssessTransform model variables,
                   coplanarity . . . and data
                       parameters,
             xm parameters, and data
              ˆ Transform model variables,
parameters, and data                         Assess coplanarity
                  parameters, and data
                  parameters, and data

                Steady state invariants
                        Data coplanar                                      Data not coplanar
                                 1

                                                                              1



                                              1


                                                           2
                                                            2
                                                                          Data not coplanar
                             2
                                                  2

                                                  2


                          Data not coplanar                               Model compatible



                       Model compatible                                Model incompatible
                     Data coplanar     2                             Data not coplanar 3

                          Model checking, multistability, and spatial models                                                                            Heather Harrington   11 / 40
                          Model incompatible
Model Model Model1.1. .Model 22 L 2
                                                                                Model
                                                                      Model 1 Model Model Model
                                                                       1 Model 2 Model 1Model
                                                                                   1                    2

                                                      x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . .
                                                      ˙    ˙ . .˙ ˙ = ˙ ..                                                                    ...
          Assessing coplanarity: overview               .
                                                        .
                                                            x = 1
                                                              . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . .
                                                              ..
                                                               .      ..           .                                                          ...

                                                  xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . .
                                                  ˙    ˙ N .=. ˙ = ˙ N . .
                                                        x
                                                            . ˙N .                                                                            ...




                                   Models
                                Models                                Observed Data DataData Data
                                                                                      Observed
                                                                             Observed Data Data
                                                                             Observed Observed
                                                                                      Observed
                       Calculate elimination ideal
                                                                           Models (Steadymeasurements)
Calculate elimination ideal elimination. .ideal (Steadymeasurements)
                      Calculate                            (Steady state state state measurements)
                                                                            (Steady measurements)
                    Model 1 Model. 2 . . . . Model L (Steady state measurements)
                                          .                .                 (Steady state state measurements)
                        Model 1
                  Calculate elimination ideal
                  Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . .
                                 . . . . . . . x1 . .. . x11 ˆˆ
                                                   ˆ          ˆ        1 1 . .x1ˆ.      ... ...                                                     We are interested in how to
          x1 =˙ 1 = . . . . . .
           ˙ x                                                 x
                                                               ˆ
                       Assess coplanarity ˆ                   ˆ . ˆˆ . .x2 ........ . . . .. .. . . . .
                      Assess coplanarity1x2 . . . x.22 . xx2
Assess coplanarity . . . . . .
            . .
            . .
                                              x =
                                               ˙
                                 ... ... ... ...
                  Assess coplanarity                .
                                                               x
                                                               ˆ         2      ˆ.
                                                               ... . . . . .. .. .. ........ . . . .. .. . . . .
                                                               .        ..
                                                                                                                                                    check if models and data are
                  Assess coplanarity              ..
                                                  .
                                                                                  .
          xN =N = . . . . . .
          ˙ x ˙                  . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . .
                       Reduce number ˙of =
                      Reduce number xN variables
                                              of
                                                  ˆ
                                                     variables
                                                              ˆ m ˆˆ
                                                              x
                                                              ˆ
                                                                ...
                                                                        m      x
                                                                             ...        ... ...
                                                                                                                                                    coplanar.
Reduce number of variables
                  Reduce number of variables
                       to include only observables
                   observables only observables
                      to include
to include onlyReduce number of variables
                  to include only observablesSteady statestate invariants
         Steady state invariants Data
                            Observed                                  SteadySteady
                                                 Steady state invariants state invariants
                                                             Steady state state invariants
                                                                       Steady invariants
                                                                                    invariants
                                                                                                                                                    Assess if the invariants and
                  to include only observablesstate invariants
                                             Steady
                     (Steady state measurements) of models
                       Characterize steady states                                                                                                   data, when transformed, lie on
Characterize steady states of. .models states of models
                      Characterize steady
                                        .
              x1Characterize steady
              ˆ
         Calculate elimination ideal states of models
              x2
              ˆ
                  Characterize steady states of elimination ideal
                                    . . . Calculate models                            1        1
                                                                                                1
                                                                                                          11     1
                                                                                                                                                    a common plane.
                .      Transform model variables,
                .     Transform     .model variables, parameters, and data
                                      ..
Transform model variables,
         AssessTransform model variables,
                   coplanarity . . . and data
                       parameters,
             xm parameters, and data
              ˆ Transform model variables,
parameters, and data                         Assess coplanarity
                  parameters, and data
                  parameters, and data

                Steady state invariants
                        Data coplanar                                      Data not coplanar
                                 1

                                                                              1



                                              1


                                                           2
                                                            2
                                                                          Data not coplanar
                             2
                                                  2

                                                  2


                          Data not coplanar                               Model compatible



                       Model compatible                                Model incompatible
                     Data coplanar     2                             Data not coplanar 3

                          Model checking, multistability, and spatial models                                                                            Heather Harrington   11 / 40
                          Model incompatible
Model Model Model1.1. .Model 22 L 2
                                                                                Model
                                                                      Model 1 Model Model Model
                                                                       1 Model 2 Model 1Model
                                                                                   1                    2

                                                      x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . .
                                                      ˙    ˙ . .˙ ˙ = ˙ ..                                                                    ...
          Assessing coplanarity: overview               .
                                                        .
                                                            x = 1
                                                              . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . .
                                                              ..
                                                               .      ..           .                                                          ...

                                                  xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . .
                                                  ˙    ˙ N .=. ˙ = ˙ N . .
                                                        x
                                                            . ˙N .                                                                            ...




                                   Models
                                Models                                Observed Data DataData Data
                                                                                      Observed
                                                                             Observed Data Data
                                                                             Observed Observed
                                                                                      Observed
                       Calculate elimination ideal
                                                                           Models (Steadymeasurements)
Calculate elimination ideal elimination. .ideal (Steadymeasurements)
                      Calculate                            (Steady state state state measurements)
                                                                            (Steady measurements)
                    Model 1 Model. 2 . . . . Model L (Steady state measurements)
                                          .                .                 (Steady state state measurements)
                        Model 1
                  Calculate elimination ideal
                  Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . .
                                 . . . . . . . x1 . .. . x11 ˆˆ
                                                   ˆ          ˆ        1 1 . .x1ˆ.      ... ...                                                     We are interested in how to
          x1 =˙ 1 = . . . . . .
           ˙ x                                                 x
                                                               ˆ
                       Assess coplanarity ˆ                   ˆ . ˆˆ . .x2 ........ . . . .. .. . . . .
                      Assess coplanarity1x2 . . . x.22 . xx2
Assess coplanarity . . . . . .
            . .
            . .
                                              x =
                                               ˙
                                 ... ... ... ...
                  Assess coplanarity                .
                                                               x
                                                               ˆ         2      ˆ.
                                                               ... . . . . .. .. .. ........ . . . .. .. . . . .
                                                               .        ..
                                                                                                                                                    check if models and data are
                  Assess coplanarity              ..
                                                  .
                                                                                  .
          xN =N = . . . . . .
          ˙ x ˙                  . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . .
                       Reduce number ˙of =
                      Reduce number xN variables
                                              of
                                                  ˆ
                                                     variables
                                                              ˆ m ˆˆ
                                                              x
                                                              ˆ
                                                                ...
                                                                        m      x
                                                                             ...        ... ...
                                                                                                                                                    coplanar.
Reduce number of variables
                  Reduce number of variables
                       to include only observables
                   observables only observables
                      to include
to include onlyReduce number of variables
                  to include only observablesSteady statestate invariants
         Steady state invariants Data
                            Observed                                  SteadySteady
                                                 Steady state invariants state invariants
                                                             Steady state state invariants
                                                                       Steady invariants
                                                                                    invariants
                                                                                                                                                    Assess if the invariants and
                  to include only observablesstate invariants
                                             Steady
                     (Steady state measurements) of models
                       Characterize steady states                                                                                                   data, when transformed, lie on
Characterize steady states of. .models states of models
                      Characterize steady
                                        .
              x1Characterize steady
              ˆ
         Calculate elimination ideal states of models
              x2
              ˆ
                  Characterize steady states of elimination ideal
                                    . . . Calculate models                            1        1
                                                                                                1
                                                                                                          11     1
                                                                                                                                                    a common plane.
                .      Transform model variables,
                .     Transform     .model variables, parameters, and data
                                      ..
Transform model variables,
         AssessTransform model variables,
                   coplanarity . . . and data
                       parameters,
             xm parameters, and data
              ˆ Transform model variables,
parameters, and data                         Assess coplanarity
                                                                                                                                                    In a sense, we are checking the
                  parameters, and data
                  parameters, and data                                                                                                              coplanarity of transformed
                Steady state invariants
                        Data coplanar                                      Data not coplanar                                                        invariants and data.
                                 1

                                                                              1



                                              1


                                                           2
                                                            2
                                                                          Data not coplanar
                             2
                                                  2

                                                  2


                          Data not coplanar                               Model compatible



                       Model compatible                                Model incompatible
                     Data coplanar     2                             Data not coplanar 3

                          Model checking, multistability, and spatial models                                                                            Heather Harrington   11 / 40
                          Model incompatible
Model Model Model1.1. .Model 22 L 2
                                                                                Model
                                                                      Model 1 Model Model Model
                                                                       1 Model 2 Model 1Model
                                                                                   1                    2

                                                      x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . .
                                                      ˙    ˙ . .˙ ˙ = ˙ ..                                                                    ...
          Assessing coplanarity: overview               .
                                                        .
                                                            x = 1
                                                              . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . .
                                                              ..
                                                               .      ..           .                                                          ...

                                                  xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . .
                                                  ˙    ˙ N .=. ˙ = ˙ N . .
                                                        x
                                                            . ˙N .                                                                            ...




                                   Models
                                Models                                Observed Data DataData Data
                                                                                      Observed
                                                                             Observed Data Data
                                                                             Observed Observed
                                                                                      Observed
                       Calculate elimination ideal
                                                                           Models (Steadymeasurements)
Calculate elimination ideal elimination. .ideal (Steadymeasurements)
                      Calculate                            (Steady state state state measurements)
                                                                            (Steady measurements)
                    Model 1 Model. 2 . . . . Model L (Steady state measurements)
                                          .                .                 (Steady state state measurements)
                        Model 1
                  Calculate elimination ideal
                  Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . .
                                 . . . . . . . x1 . .. . x11 ˆˆ
                                                   ˆ          ˆ        1 1 . .x1ˆ.      ... ...                                                     We are interested in how to
          x1 =˙ 1 = . . . . . .
           ˙ x                                                 x
                                                               ˆ
                       Assess coplanarity ˆ                   ˆ . ˆˆ . .x2 ........ . . . .. .. . . . .
                      Assess coplanarity1x2 . . . x.22 . xx2
Assess coplanarity . . . . . .
            . .
            . .
                                              x =
                                               ˙
                                 ... ... ... ...
                  Assess coplanarity                .
                                                               x
                                                               ˆ         2      ˆ.
                                                               ... . . . . .. .. .. ........ . . . .. .. . . . .
                                                               .        ..
                                                                                                                                                    check if models and data are
                  Assess coplanarity              ..
                                                  .
                                                                                  .
          xN =N = . . . . . .
          ˙ x ˙                  . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . .
                       Reduce number ˙of =
                      Reduce number xN variables
                                              of
                                                  ˆ
                                                     variables
                                                              ˆ m ˆˆ
                                                              x
                                                              ˆ
                                                                ...
                                                                        m      x
                                                                             ...        ... ...
                                                                                                                                                    coplanar.
Reduce number of variables
                  Reduce number of variables
                       to include only observables
                   observables only observables
                      to include
to include onlyReduce number of variables
                  to include only observablesSteady statestate invariants
         Steady state invariants Data
                            Observed                                  SteadySteady
                                                 Steady state invariants state invariants
                                                             Steady state state invariants
                                                                       Steady invariants
                                                                                    invariants
                                                                                                                                                    Assess if the invariants and
                  to include only observablesstate invariants
                                             Steady
                     (Steady state measurements) of models
                       Characterize steady states                                                                                                   data, when transformed, lie on
Characterize steady states of. .models states of models
                      Characterize steady
                                        .
              x1Characterize steady
              ˆ
         Calculate elimination ideal states of models
              x2
              ˆ
                  Characterize steady states of elimination ideal
                                    . . . Calculate models                            1        1
                                                                                                1
                                                                                                          11     1
                                                                                                                                                    a common plane.
                .      Transform model variables,
                .     Transform     .model variables, parameters, and data
                                      ..
Transform model variables,
         AssessTransform model variables,
                   coplanarity . . . and data
                       parameters,
             xm parameters, and data
              ˆ Transform model variables,
parameters, and data                         Assess coplanarity
                                                                                                                                                    In a sense, we are checking the
                  parameters, and data
                  parameters, and data                                                                                                              coplanarity of transformed
                Steady state invariants
                        Data coplanar                                      Data not coplanar                                                        invariants and data.
                                 1




                                              1
                                                                              1

                                                                                                                                                    Model rejection can then be
                             2
                                                  2
                                                           2
                                                            2
                                                                          Data not coplanar
                                                                                                                                                    performed by assessing the
                          Data not coplanar
                                                  2


                                                                          Model compatible
                                                                                                                                                    degree to which the transformed
                                                                                                                                                    data deviate from coplanarity.
                       Model compatible                                Model incompatible
                     Data coplanar     2                             Data not coplanar 3

                          Model checking, multistability, and spatial models                                                                            Heather Harrington   11 / 40
                          Model incompatible
Assess coplanarity: question




Data coplanarity
Given a set of steady-state measurements xobs,i for i = 1, . . . , m, and
                                           ˆ
model with steady-state invariants I = {I1 , . . . , INinv }, we need a
procedure for deciding whether it is possible that the invariant is
compatible with the data, i.e.,

                            I (ˆobs,i ; a) = 0,
                               x                          i = 1, . . . , m,                      (2)

for some choice of a.




     Model checking, multistability, and spatial models           Heather Harrington   12 / 40
Assess coplanarity: transform variables and data

Consider an invariant I ∈ I, written in somewhat simplified form as
                                                      n             Nobs
                                                                            t
                              I (xobs ; a) =              fj (a)           xkjk                       (3)
                                                    j=1             k=1

To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as:
                          x
                                                           n
                                       I (ξ; α) =               α i ξi .
                                                          i=1




     Model checking, multistability, and spatial models                Heather Harrington   13 / 40
Assess coplanarity: transform variables and data

Consider an invariant I ∈ I, written in somewhat simplified form as
                                                      n             Nobs
                                                                            t
                              I (xobs ; a) =              fj (a)           xkjk                       (3)
                                                    j=1             k=1

To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as:
                          x
                                                           n
                                       I (ξ; α) =               α i ξi .
                                                          i=1

Let ϕ: xobs → ξ.




     Model checking, multistability, and spatial models                Heather Harrington   13 / 40
Assess coplanarity: transform variables and data

Consider an invariant I ∈ I, written in somewhat simplified form as
                                                      n             Nobs
                                                                            t
                              I (xobs ; a) =              fj (a)           xkjk                       (3)
                                                    j=1             k=1

To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as:
                          x
                                                           n
                                       I (ξ; α) =               α i ξi .
                                                          i=1


                                                             ˆ
   Compatibility implies that the transformed variable ξ = ϕ(ˆobs )x
                                            x
   corresponding to any observation ˆobs with coordinates
    ˆ            ˆ
   (ξ1 , . . . , ξn ), lies on the plane defined by the coefficients α.



     Model checking, multistability, and spatial models                Heather Harrington   13 / 40
Assess coplanarity: transform variables and data

Consider an invariant I ∈ I, written in somewhat simplified form as
                                                      n             Nobs
                                                                            t
                              I (xobs ; a) =              fj (a)           xkjk                       (3)
                                                    j=1             k=1

To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as:
                          x
                                                           n
                                       I (ξ; α) =               α i ξi .
                                                          i=1


                                                                ˆ
   Compatibility implies that the transformed variable ξ = ϕ(ˆobs )   x
                                            x
   corresponding to any observation ˆobs with coordinates
    ˆ            ˆ
   (ξ1 , . . . , ξn ), lies on the plane defined by the coefficients α.
   In other words, compatibility with the data xobs,i implies that the
                                                      ˆ
   corresponding transformed data ξ        ˆi = ϕ(ˆobs,i ) are coplanar.
                                                  x
     Model checking, multistability, and spatial models                Heather Harrington   13 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .




    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .
  Then the data are coplanar if and only if Ξα = 0 for some column
  vector α = 0.




    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .
  Then the data are coplanar if and only if Ξα = 0 for some column
  vector α = 0.
  Such a vector resides in the null space of Ξ, spanned by the right
  singular vectors of Ξ corresponding to zero singular values.




    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .
  Then the data are coplanar if and only if Ξα = 0 for some column
  vector α = 0.
  Such a vector resides in the null space of Ξ, spanned by the right
  singular vectors of Ξ corresponding to zero singular values.
  Thus, assuming that m > n, if the smallest singular value σn of Ξ
  is nonzero, then the data cannot be coplanar.




    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .
  Then the data are coplanar if and only if Ξα = 0 for some column
  vector α = 0.
  Such a vector resides in the null space of Ξ, spanned by the right
  singular vectors of Ξ corresponding to zero singular values.
  Thus, assuming that m > n, if the smallest singular value σn of Ξ
  is nonzero, then the data cannot be coplanar.
  More generally, σn = min α =1 Ξα gives the least squares
  deviation of the data from coplanarity under the scaling constraint
   α = 1.




    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: SVD


                                                       ˆ
  Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i .
  Then the data are coplanar if and only if Ξα = 0 for some column
  vector α = 0.
  Such a vector resides in the null space of Ξ, spanned by the right
  singular vectors of Ξ corresponding to zero singular values.
  Thus, assuming that m > n, if the smallest singular value σn of Ξ
  is nonzero, then the data cannot be coplanar.
  More generally, σn = min α =1 Ξα gives the least squares
  deviation of the data from coplanarity under the scaling constraint
   α = 1.
  This measure depends only on the data and is therefore
  parameter-free.


    Model checking, multistability, and spatial models   Heather Harrington   14 / 40
Assess coplanarity: remarks



(1) Note that this applies for any choice of α, regardless of whether
    it can be realized by the original parameters a.
(2) In this sense, the condition of small σn provides a necessary but
    not sufficient criterion for model compatibility.




     Model checking, multistability, and spatial models   Heather Harrington   15 / 40
Assess coplanarity: remarks



(1) Note that this applies for any choice of α, regardless of whether
    it can be realized by the original parameters a.
(2) In this sense, the condition of small σn provides a necessary but
    not sufficient criterion for model compatibility.
(3) This is in contrast to traditional approaches based on parameter
    fitting, which provide a sufficient but not necessary condition,
    since local minima may prevent a compatible model from being
    fitted correctly.
(4) The additional degrees of freedom introduced by neglecting the
    functional forms fj effectively linearizes the compatibility
    condition (I (ˆobs,i ; a) = 0), allowing for a simple direct solution.
                  x



     Model checking, multistability, and spatial models   Heather Harrington   15 / 40
Assess coplanarity: noise in data

To account for the presence of noise, let                     x      x
                                                           = ∆ˆobs / ˆobs be the relative error
                  x
in a measurement ˆobs .




      Model checking, multistability, and spatial models           Heather Harrington   16 / 40
Assess coplanarity: noise in data

To account for the presence of noise, let                     x      x
                                                           = ∆ˆobs / ˆobs be the relative error
                  x
in a measurement ˆobs .
(1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is
                                                   ˆ     ˆ    x
    propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where
               ϕ(x) x
    β (x) =    ϕ(x)
                       is the noise amplification factor, and ϕ is the Jacobian of
    ϕ, with elements ( ϕ)ij = ∂ξi /∂xj .




      Model checking, multistability, and spatial models           Heather Harrington   16 / 40
Assess coplanarity: noise in data

To account for the presence of noise, let                     x      x
                                                           = ∆ˆobs / ˆobs be the relative error
                  x
in a measurement ˆobs .
(1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is
                                                   ˆ     ˆ    x
    propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where
               ϕ(x) x
    β (x) =    ϕ(x)
                       is the noise amplification factor, and ϕ is the Jacobian of
    ϕ, with elements ( ϕ)ij = ∂ξi /∂xj .
(2) To quantify the overall level of noise across all measurements, we define
              √
                                   x              x
    β = β / m, where β = (β(ˆobs,1 ), . . . , β(ˆobs,m )) is a vector containing
    each noise amplification factor, and the effective relative error as eff = β .




      Model checking, multistability, and spatial models           Heather Harrington   16 / 40
Assess coplanarity: noise in data

To account for the presence of noise, let                     x      x
                                                           = ∆ˆobs / ˆobs be the relative error
                  x
in a measurement ˆobs .
(1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is
                                                   ˆ     ˆ    x
    propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where
               ϕ(x) x
    β (x) =    ϕ(x)
                       is the noise amplification factor, and ϕ is the Jacobian of
    ϕ, with elements ( ϕ)ij = ∂ξi /∂xj .
(2) To quantify the overall level of noise across all measurements, we define
              √
                                   x              x
    β = β / m, where β = (β(ˆobs,1 ), . . . , β(ˆobs,m )) is a vector containing
    each noise amplification factor, and the effective relative error as eff = β .
(3) Since the introduction of noise in Ξ of order eff in general gives a lower
                   √
    bound of σn ∼ m eff ∼ β , we should reject the model only if σn            β .
    We therefore define the coplanarity error
                                                            σn
                                                   ∆=          ,
                                                            β
     in terms of which the rejection criterion is simply ∆   1. Observe that as
    increases, ∆ decreases, so we lose rejection power, as expected.

      Model checking, multistability, and spatial models           Heather Harrington   16 / 40
Example application: multisite phosphorylation


Distributive Phosphorylation of MAPK
                                                Disassociation

          MAPKK                                    MAPKK                              MAPKK

                              MAPKK                                  MAPKK
                                   P                P            P      P       P      P




    Model checking, multistability, and spatial models           Heather Harrington    17 / 40
Example application: multisite phosphorylation


Distributive Phosphorylation of MAPK
                                                Disassociation

          MAPKK                                    MAPKK                                  MAPKK

                              MAPKK                                      MAPKK
                                   P                P                P      P         P    P




Processive Phosphorylation of MAPK
                  MAPKK                                                          MAPKK
                                                    Slide
                                       MAPKK                     MAPKK
                                            P               P       P        P    P




    Model checking, multistability, and spatial models               Heather Harrington    17 / 40
Example application: multisite phosphorylation


Distributive Phosphorylation of MAPK
                                                 Disassociation

           MAPKK                                    MAPKK                                  MAPKK

                               MAPKK                                      MAPKK
                                    P                P                P      P         P    P




Processive Phosphorylation of MAPK
                   MAPKK                                                          MAPKK
                                                     Slide
                                        MAPKK                     MAPKK
                                             P               P       P        P    P



Dephosphorylation can also occur in a processive or a distributive
manner. We would like to know which mechanism operates in vivo.

     Model checking, multistability, and spatial models               Heather Harrington    17 / 40
Multisite phosphorylation: eliminate variables


                                                             Each enzyme can be either processive (P),
        u     cuv  a
K + Su −− KSu −→ K + Sv ,
       −−      −                                             where more than one phosphate modification
                   bu
                                                             may be achieved in a single step, or
                vu αv                γ
 F + Sv −− FSv −→ F + Su ,
         −−     −                                            distributive (D), where only one modification
                   βv
                                                             is allowed before the enzyme dissociates from
                            Phosphorylation                  the substrate.
                          E + S01           ES01
                                                             Models: PP, PD, DP and DD; where the first
                                                             letter designates the mechanisms of the
 E + S00           ES00                            E + S11
                                                             kinase, and the second, that of the
                          E + S10           ES10             phosphatase.
                                                             We considered only the concentrations
           F S01          F + S01
                                                             xobs = (s00 , s01 , s10 , s11 ) as observable, and
                                                             were able to eliminate all other variables
 F + S00                            F S11          F + S11
                                                             except the concentration f of F from the
           F S10          F + S10                            dynamics of each model.
       Dephosphorylation



      Model checking, multistability, and spatial models                  Heather Harrington   18 / 40
Multisite phosphorylation: assess coplanarity




  Each model has three steady-state invariants.




    Model checking, multistability, and spatial models   Heather Harrington   19 / 40
Multisite phosphorylation: assess coplanarity




  Each model has three steady-state invariants.
  Invariants share same transformed variables ξ = ϕ(xobs ) so only
  the kinase is discriminative.




    Model checking, multistability, and spatial models   Heather Harrington   19 / 40
Multisite phosphorylation: assess coplanarity


  Each model has three steady-state invariants.
  Invariants share same transformed variables ξ = ϕ(xobs ) so only
  the kinase is discriminative.

        Data generated under this model:                 PP/PD           DP/DD
             Reject model PP/PD?                           No              No
             Reject model DP/DD?                          Yes              No


           ξ PP/PD = s00 s10 , s00 s11 , s01 s10 , s01 s11 , s10 , s10 s11 ,
                                                              2

          ξ DP/DD = s00 s11 , s01 s10 , s01 s11 , s10 , s10 s11 .
                                                   2




    Model checking, multistability, and spatial models   Heather Harrington   19 / 40
Multisite phosphorylation: coplanarity results




    Model checking, multistability, and spatial models   Heather Harrington   20 / 40
Examples: apoptosis activation
    Chapter 7. Fas trimerization model
s for each of the DISC, MAC, and apoptosome modules are described
                                                                                                        145



tation is understood to apply only within each module.

                          Crosslinking model
    !


rization kinetics are simplified from the crosslinking model (Delisi,
4, 1981) of Lai and Jackson, 2004 and follow the reactions

    "                                                     3kf !
                      FasL + FasR −− FasL-FasR,
                                   −−
                                                           kr
                                                          2kf
        FasL-FasR + FasR −− FasL-FasR2 ,
                          −−
                                                          2kr
                                                           kf
    FasL-FasR2 + FasR −− FasL-FasR3 ,
                       −−
                                                          3kr

                    Lai & Jackson (2004) Math Biosci Eng

    Figure 7.4: Comparison with the crosslinking model. (A) Process diagram (comply with the SBGN Pro-
    cess Description language Level 1 (Le Nov` re et al., 2009)) of the crosslinking model. (B) Variation of
                                                e
    the steady-state signaling Fas fraction ζ∞ with respect to the model parameter κ. (C) Minimization errors
      of the steady-state invariants ωH and ωC for the hysteron and crosslinking models, respectively (Ap-
    pendix B.2), over data generated from each model (Datasets 3 and 4) using nonnegative least squares (see
    Materials and methods for details).


                      Model checking, multistability, and spatial models                                        Heather Harrington   21 / 40
[33], irreversible bistability is achieved, implementing a perma-
                                                                                                            nent cell death decision. Thus, our model suggests a primary role

        Examples: apoptosis activation
    Chapter 7. Fas trimerization model
s for each of the DISC, MAC, and apoptosome modules are described
                                                                                                            for death receptors in deciding cell fate. Moreover, our results offer
                                                                                                        145 novel functional interpretations of ligand trimerism and receptor
                                                                                                            pre-association and localization within the unified context of
                                                                                                                                                                                          The first reaction describes spo
                                                                                                                                                                                          closing; the second, constitutive
                                                                                                                                                                                          third, ligand-independent recept
                                                                                                            bistability.                                                                  fourth, ligand-dependent recepto
                                                                                                                                                                                          The orders of the cluster-stabiliz
tation is understood to apply only within each module.
                                                Results                                                                                                                                   parameters m and n, which captu
                                                                                                                                                                                          and Fas coordination by FasL, r
                                                                                                                Model formulation                                                         stabilization (m~n~2) has been
                                                                                                                  Constructing a mathematical model of Fas dynamics is not                higher-order analogues, for exam
                                                                                                                entirely straightforward as receptors can form highly oligomeric          interactions, are not unreasonabl

                          Crosslinking model                                                                                                 Cluster model
    !


rization kinetics are simplified from the crosslinking model (Delisi,
4, 1981) of Lai and Jackson, 2004 and follow the reactions

    "                                                     3kf !
                      FasL + FasR −− FasL-FasR,
                                   −−
                                                           kr
                                                                                                                Figure 1. Cartoon of model interactions. The transmembrane death receptor Fas natively adopts a closed co
                                                          2kf                                                   the binding of FADD, an adaptor molecule that facilitates apoptotic signal transduction. Open Fas can self-st
        FasL-FasR + FasR −− FasL-FasR2 ,
                          −−                                                                                    interactions, which is enhanced by receptor clustering through association with the ligand FasL.
                                                                                                                doi:10.1371/journal.pcbi.1000956.g001
                                                          2kr
                                                                                                                      PLoS Computational Biology | www.ploscompbiol.org               2                      October 2010 |
                                                           kf
    FasL-FasR2 + FasR −− FasL-FasR3 ,
                       −−
                                                          3kr

                    Lai & Jackson (2004) Math Biosci Eng                                                          Figure 2. Schematic of cluster-stabilization reactions. Examples
                                                                                                                          Ho & Harrington (2010) PLoS Comput Biol
                                                                                                                  of ligand-independent cluster-stabilization reactions involving unstable
                                                                                                                  (Y ) and stable (Z) open receptors of molecularities two (A), three (B),
    Figure 7.4: Comparison with the crosslinking model. (A) Process diagram (comply with the SBGN Pro-
    cess Description language Level 1 (Le Nov` re et al., 2009)) of the crosslinking model. (B) Variation of
                                                e
                                                                                                                  and four (C). Higher-order reactions follow the same pattern. Ligand-
    the steady-state signaling Fas fraction ζ∞ with respect to the model parameter κ. (C) Minimization errors     dependent reactions are identical except that FasL (L) must be added
      of the steady-state invariants ωH and ωC for the hysteron and crosslinking models, respectively (Ap-        to each reacting state.
    pendix B.2), over data generated from each model (Datasets 3 and 4) using nonnegative least squares (see      doi:10.1371/journal.pcbi.1000956.g002
    Materials and methods for details).


                                                                                                                    Formally, these reactions are to be interpreted as state transitions
                      Model checking, multistability, and spatial models                                                      Heather Harrington 21 / 40
                                                                                                                  on the space of cluster tuples. However, the reaction notation is
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data
Non-parametric analysis of models and data

More Related Content

What's hot

Bayesian Nonparametrics: Models Based on the Dirichlet Process
Bayesian Nonparametrics: Models Based on the Dirichlet ProcessBayesian Nonparametrics: Models Based on the Dirichlet Process
Bayesian Nonparametrics: Models Based on the Dirichlet Process
Alessandro Panella
 
Machine learning and Neural Networks
Machine learning and Neural NetworksMachine learning and Neural Networks
Machine learning and Neural Networks
butest
 
FOCUS.doc
FOCUS.docFOCUS.doc
FOCUS.doc
butest
 

What's hot (20)

Bayesian Nonparametrics, Applications to biology, ecology, and marketing
Bayesian Nonparametrics, Applications to biology, ecology, and marketingBayesian Nonparametrics, Applications to biology, ecology, and marketing
Bayesian Nonparametrics, Applications to biology, ecology, and marketing
 
Additive Smoothing for Relevance-Based Language Modelling of Recommender Syst...
Additive Smoothing for Relevance-Based Language Modelling of Recommender Syst...Additive Smoothing for Relevance-Based Language Modelling of Recommender Syst...
Additive Smoothing for Relevance-Based Language Modelling of Recommender Syst...
 
Module 4 part_1
Module 4 part_1Module 4 part_1
Module 4 part_1
 
High-Dimensional Methods: Examples for Inference on Structural Effects
High-Dimensional Methods: Examples for Inference on Structural EffectsHigh-Dimensional Methods: Examples for Inference on Structural Effects
High-Dimensional Methods: Examples for Inference on Structural Effects
 
Bayesian Nonparametrics: Models Based on the Dirichlet Process
Bayesian Nonparametrics: Models Based on the Dirichlet ProcessBayesian Nonparametrics: Models Based on the Dirichlet Process
Bayesian Nonparametrics: Models Based on the Dirichlet Process
 
Dependent processes in Bayesian Nonparametrics
Dependent processes in Bayesian NonparametricsDependent processes in Bayesian Nonparametrics
Dependent processes in Bayesian Nonparametrics
 
testing as a mixture estimation problem
testing as a mixture estimation problemtesting as a mixture estimation problem
testing as a mixture estimation problem
 
Machine Learning for Actuaries
Machine Learning for ActuariesMachine Learning for Actuaries
Machine Learning for Actuaries
 
Nature-Inspired Metaheuristic Algorithms
Nature-Inspired Metaheuristic AlgorithmsNature-Inspired Metaheuristic Algorithms
Nature-Inspired Metaheuristic Algorithms
 
Nber slides11 lecture2
Nber slides11 lecture2Nber slides11 lecture2
Nber slides11 lecture2
 
Machine learning and Neural Networks
Machine learning and Neural NetworksMachine learning and Neural Networks
Machine learning and Neural Networks
 
ppt0320defenseday
ppt0320defensedayppt0320defenseday
ppt0320defenseday
 
My data are incomplete and noisy: Information-reduction statistical methods f...
My data are incomplete and noisy: Information-reduction statistical methods f...My data are incomplete and noisy: Information-reduction statistical methods f...
My data are incomplete and noisy: Information-reduction statistical methods f...
 
Inference for stochastic differential equations via approximate Bayesian comp...
Inference for stochastic differential equations via approximate Bayesian comp...Inference for stochastic differential equations via approximate Bayesian comp...
Inference for stochastic differential equations via approximate Bayesian comp...
 
MUMS: Bayesian, Fiducial, and Frequentist Conference - Including Factors in B...
MUMS: Bayesian, Fiducial, and Frequentist Conference - Including Factors in B...MUMS: Bayesian, Fiducial, and Frequentist Conference - Including Factors in B...
MUMS: Bayesian, Fiducial, and Frequentist Conference - Including Factors in B...
 
効率的反実仮想学習
効率的反実仮想学習効率的反実仮想学習
効率的反実仮想学習
 
FOCUS.doc
FOCUS.docFOCUS.doc
FOCUS.doc
 
isi
isiisi
isi
 
A likelihood-free version of the stochastic approximation EM algorithm (SAEM)...
A likelihood-free version of the stochastic approximation EM algorithm (SAEM)...A likelihood-free version of the stochastic approximation EM algorithm (SAEM)...
A likelihood-free version of the stochastic approximation EM algorithm (SAEM)...
 
Accelerated approximate Bayesian computation with applications to protein fol...
Accelerated approximate Bayesian computation with applications to protein fol...Accelerated approximate Bayesian computation with applications to protein fol...
Accelerated approximate Bayesian computation with applications to protein fol...
 

Viewers also liked

The mc nemar test for significance of changes
The mc nemar test for significance of changesThe mc nemar test for significance of changes
The mc nemar test for significance of changes
Zuhdha Basofi Nugroho
 

Viewers also liked (20)

The mc nemar test for significance of changes
The mc nemar test for significance of changesThe mc nemar test for significance of changes
The mc nemar test for significance of changes
 
Chi square ppt
Chi square pptChi square ppt
Chi square ppt
 
Non-Parametric Inference : Chi-Square and The Sign Test
Non-Parametric Inference : Chi-Square and The Sign TestNon-Parametric Inference : Chi-Square and The Sign Test
Non-Parametric Inference : Chi-Square and The Sign Test
 
Estudio de brote
Estudio de broteEstudio de brote
Estudio de brote
 
Sign test
Sign testSign test
Sign test
 
Chi square
Chi squareChi square
Chi square
 
The Sign Test
The Sign TestThe Sign Test
The Sign Test
 
Wilcoxon example2008
Wilcoxon example2008Wilcoxon example2008
Wilcoxon example2008
 
Biostatistics in Bioequivalence
Biostatistics in BioequivalenceBiostatistics in Bioequivalence
Biostatistics in Bioequivalence
 
5. Non parametric analysis
5. Non parametric analysis5. Non parametric analysis
5. Non parametric analysis
 
Stat
StatStat
Stat
 
Advance Statistics - Wilcoxon Signed Rank Test
Advance Statistics - Wilcoxon Signed Rank TestAdvance Statistics - Wilcoxon Signed Rank Test
Advance Statistics - Wilcoxon Signed Rank Test
 
Non-parametric analysis: Wilcoxon, Kruskal Wallis & Spearman
Non-parametric analysis: Wilcoxon, Kruskal Wallis & SpearmanNon-parametric analysis: Wilcoxon, Kruskal Wallis & Spearman
Non-parametric analysis: Wilcoxon, Kruskal Wallis & Spearman
 
Sample size issues on reliability test design
Sample size issues on reliability test designSample size issues on reliability test design
Sample size issues on reliability test design
 
The Green Lab - [09 A] Statistical tests and effect size
The Green Lab - [09 A] Statistical tests and effect sizeThe Green Lab - [09 A] Statistical tests and effect size
The Green Lab - [09 A] Statistical tests and effect size
 
non parametric statistics
non parametric statisticsnon parametric statistics
non parametric statistics
 
Wilcoxon Signed Rank Test
Wilcoxon Signed Rank Test Wilcoxon Signed Rank Test
Wilcoxon Signed Rank Test
 
Parametric tests
Parametric testsParametric tests
Parametric tests
 
Non Parametric Tests
Non Parametric TestsNon Parametric Tests
Non Parametric Tests
 
Statistical software
Statistical softwareStatistical software
Statistical software
 

Similar to Non-parametric analysis of models and data

Robust Immunological Algorithms for High-Dimensional Global Optimization
Robust Immunological Algorithms for High-Dimensional Global OptimizationRobust Immunological Algorithms for High-Dimensional Global Optimization
Robust Immunological Algorithms for High-Dimensional Global Optimization
Mario Pavone
 
original
originaloriginal
original
butest
 
Intro to Model Selection
Intro to Model SelectionIntro to Model Selection
Intro to Model Selection
chenhm
 
Probability density estimation using Product of Conditional Experts
Probability density estimation using Product of Conditional ExpertsProbability density estimation using Product of Conditional Experts
Probability density estimation using Product of Conditional Experts
Chirag Gupta
 
Bayesian inference for mixed-effects models driven by SDEs and other stochast...
Bayesian inference for mixed-effects models driven by SDEs and other stochast...Bayesian inference for mixed-effects models driven by SDEs and other stochast...
Bayesian inference for mixed-effects models driven by SDEs and other stochast...
Umberto Picchini
 

Similar to Non-parametric analysis of models and data (20)

ABC-Gibbs
ABC-GibbsABC-Gibbs
ABC-Gibbs
 
Predictive Modeling in Insurance in the context of (possibly) big data
Predictive Modeling in Insurance in the context of (possibly) big dataPredictive Modeling in Insurance in the context of (possibly) big data
Predictive Modeling in Insurance in the context of (possibly) big data
 
Varese italie #2
Varese italie #2Varese italie #2
Varese italie #2
 
Considerate Approaches to ABC Model Selection
Considerate Approaches to ABC Model SelectionConsiderate Approaches to ABC Model Selection
Considerate Approaches to ABC Model Selection
 
Robust Immunological Algorithms for High-Dimensional Global Optimization
Robust Immunological Algorithms for High-Dimensional Global OptimizationRobust Immunological Algorithms for High-Dimensional Global Optimization
Robust Immunological Algorithms for High-Dimensional Global Optimization
 
Principle of Maximum Entropy
Principle of Maximum EntropyPrinciple of Maximum Entropy
Principle of Maximum Entropy
 
Laplace's Demon: seminar #1
Laplace's Demon: seminar #1Laplace's Demon: seminar #1
Laplace's Demon: seminar #1
 
Multiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximationsMultiple estimators for Monte Carlo approximations
Multiple estimators for Monte Carlo approximations
 
original
originaloriginal
original
 
Sequential Monte Carlo algorithms for agent-based models of disease transmission
Sequential Monte Carlo algorithms for agent-based models of disease transmissionSequential Monte Carlo algorithms for agent-based models of disease transmission
Sequential Monte Carlo algorithms for agent-based models of disease transmission
 
Intro to Model Selection
Intro to Model SelectionIntro to Model Selection
Intro to Model Selection
 
asymptotics of ABC
asymptotics of ABCasymptotics of ABC
asymptotics of ABC
 
Kernel methods for data integration in systems biology
Kernel methods for data integration in systems biologyKernel methods for data integration in systems biology
Kernel methods for data integration in systems biology
 
Slides econometrics-2018-graduate-3
Slides econometrics-2018-graduate-3Slides econometrics-2018-graduate-3
Slides econometrics-2018-graduate-3
 
Jsm09 talk
Jsm09 talkJsm09 talk
Jsm09 talk
 
Lausanne 2019 #1
Lausanne 2019 #1Lausanne 2019 #1
Lausanne 2019 #1
 
Probability density estimation using Product of Conditional Experts
Probability density estimation using Product of Conditional ExpertsProbability density estimation using Product of Conditional Experts
Probability density estimation using Product of Conditional Experts
 
About functional SIR
About functional SIRAbout functional SIR
About functional SIR
 
Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2
 
Bayesian inference for mixed-effects models driven by SDEs and other stochast...
Bayesian inference for mixed-effects models driven by SDEs and other stochast...Bayesian inference for mixed-effects models driven by SDEs and other stochast...
Bayesian inference for mixed-effects models driven by SDEs and other stochast...
 

Recently uploaded

Recently uploaded (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 

Non-parametric analysis of models and data

  • 1. Non-parametric analysis of mass-action models and data Heather Harrington Theoretical Systems Biology Imperial College London May 8, 2012 Model checking, multistability, and spatial models Heather Harrington 1 / 40
  • 2. Outline and collaborators (1) Motivation Michael Stumpf Theoretical Systems Biology, Imperial College London (2) Model checking using coplanarity Kenneth Ho Courant Institute of Mathematical Sciences, New York University Thomas Thorne Theoretical Systems Biology, Imperial College London (3) Multistationarity via spatial compartmentalization Elisenda Feliu Institute of Mathematical Sciences, University of Copenhagen Carsten Wiuf Institute of Mathematical Sciences, University of Copenhagen (4) Conclusions Model checking, multistability, and spatial models Heather Harrington 2 / 40
  • 3. Overview: Cell decisions Cell decisions Cellular decision-making is necessary for preservation of homeostasis in an organism, e.g., apoptosis, proliferation, and differentiation. Model checking, multistability, and spatial models Heather Harrington 3 / 40
  • 4. Overview: Cell decisions Cell decisions Cellular decision-making is necessary for preservation of homeostasis in an organism, e.g., apoptosis, proliferation, and differentiation. Mechanisms that regulate these processes are often feedback loops. Model checking, multistability, and spatial models Heather Harrington 3 / 40
  • 5. Overview: Cell decisions Cell decisions Cellular decision-making is necessary for preservation of homeostasis in an organism, e.g., apoptosis, proliferation, and differentiation. Mechanisms that regulate these processes are often feedback loops. Feedbacks can affect the behavior of the system (number of response states). Model checking, multistability, and spatial models Heather Harrington 3 / 40
  • 6. Overview: Cell decisions Cell decisions Cellular decision-making is necessary for preservation of homeostasis in an organism, e.g., apoptosis, proliferation, and differentiation. Mechanisms that regulate these processes are often feedback loops. Feedbacks can affect the behavior of the system (number of response states). Many models can be constructed to describe the same system. Model checking, multistability, and spatial models Heather Harrington 3 / 40
  • 7. Theoretical Systems Biology Aims of the research group: Reverse engineering Inverse problems Bayesian statistics Model checking, multistability, and spatial models Heather Harrington 4 / 40
  • 8. Statistical Inference For any model, M(θ), we can infer the parameters in light of data. In a statistical framework, for example, we use the likelihood L(θ) = P(D|θ). Maximizing the likelihood gives us the value of the parameter θ that maximizes the probability of observing the data D. Model checking, multistability, and spatial models Heather Harrington 5 / 40
  • 9. Statistical Inference For any model, M(θ), we can infer the parameters in light of data. In a statistical framework, for example, we use the likelihood L(θ) = P(D|θ). Maximizing the likelihood gives us the value of the parameter θ that maximizes the probability of observing the data D. Model Selection If, however, we have a set of candidate models, M1 , M2 , . . . we have to employ other criteria to choose which model is best. Model checking, multistability, and spatial models Heather Harrington 5 / 40
  • 10. Statistical Inference For any model, M(θ), we can infer the parameters in light of data. In a statistical framework, for example, we use the likelihood L(θ) = P(D|θ). Maximizing the likelihood gives us the value of the parameter θ that maximizes the probability of observing the data D. Model Selection If, however, we have a set of candidate models, M1 , M2 , . . . we have to employ other criteria to choose which model is best. The Akaike and Bayesian information criteria, for example, penalize models that are overly complex. Model checking, multistability, and spatial models Heather Harrington 5 / 40
  • 11. Bayesian Inference In the Bayesian framework, parameter inference centers around finding the posterior distribution P(D|θ)π(θ) P(θ|D) = , P(D|θ)π(θ)dθ where P(D|θ) is the likelihood and π(θ) is called the prior of θ. Model checking, multistability, and spatial models Heather Harrington 6 / 40
  • 12. Bayesian Inference In the Bayesian framework, parameter inference centers around finding the posterior distribution P(D|θ)π(θ) P(θ|D) = , P(D|θ)π(θ)dθ where P(D|θ) is the likelihood and π(θ) is called the prior of θ. For model selection, the key quantity is the Evidence (marginal likelihood): P(D|θ)π(θ)dθ, which is calculated by integrating the likelihood over the parameter space. Given a set of models, we prefer the one for which the evidence is the highest. Model checking, multistability, and spatial models Heather Harrington 6 / 40
  • 13. The Problem of Model Selection In maximum likelihood estimation (or in optimization approaches more generally) model selection needs to be addressed in an ad hoc fashion. Bayesian approaches integrate out parameter dependencies along the way towards model selection. In a Bayesian framework, model selection is natural but computationally expensive: often prohibitively expensive. Model checking, multistability, and spatial models Heather Harrington 7 / 40
  • 14. The Problem of Model Selection In maximum likelihood estimation (or in optimization approaches more generally) model selection needs to be addressed in an ad hoc fashion. Bayesian approaches integrate out parameter dependencies along the way towards model selection. In a Bayesian framework, model selection is natural but computationally expensive: often prohibitively expensive. Can we do better? Can we do parameter-free model selection? Model checking, multistability, and spatial models Heather Harrington 7 / 40
  • 15. The Problem of Model Selection In maximum likelihood estimation (or in optimization approaches more generally) model selection needs to be addressed in an ad hoc fashion. Bayesian approaches integrate out parameter dependencies along the way towards model selection. In a Bayesian framework, model selection is natural but computationally expensive: often prohibitively expensive. Can we do better? Can we do parameter-free model selection? We will try ... Model checking, multistability, and spatial models Heather Harrington 7 / 40
  • 16. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 17. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: N N k sij Xj −i → sij Xj , i = 1, . . . , R j=1 j=1 Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 18. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 19. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 These equations provide a quantitative description of the model. Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 20. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 These equations provide a quantitative description of the model. In principle, the equations can be used to test the model’s validity by assessing the degree to which they are satisfied by observed data. Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 21. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 These equations provide a quantitative description of the model. In principle, the equations can be used to test the model’s validity by assessing the degree to which they are satisfied by observed data. However, in practice, the required variables are rarely available. Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 22. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 These equations provide a quantitative description of the model. In principle, the equations can be used to test the model’s validity by assessing the degree to which they are satisfied by observed data. However, in practice, the required variables are rarely available. In particular the velocities x = (x1 , . . . , xN ) are difficult to measure, so we ˙ ˙ ˙ consider only the steady state x = 0. ˙ Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 23. Background: Model selection using algebraic geometry Techniques from algebraic geometry for model discrimination. Using results from Manrai and Gunawardena (2008) Biophys J. Chemical reaction network: Dynamics from mass action kinetics: N N R N k s sij Xj −i → sij Xj , i = 1, . . . , R xi = ˙ kj sji − sji xj jk , i = 1, . . . , N j=1 j=1 j=1 k=1 These equations provide a quantitative description of the model. In principle, the equations can be used to test the model’s validity by assessing the degree to which they are satisfied by observed data. However, in practice, the required variables are rarely available. In particular the velocities x = (x1 , . . . , xN ) are difficult to measure, so we ˙ ˙ ˙ consider only the steady state x = 0. ˙ We eliminate these variables from the equations if possible. Model checking, multistability, and spatial models Heather Harrington 8 / 40
  • 24. Background: tools from algebraic geometry For simple systems, this elimination can be done by hand. But in general, a more systematic approach is often required. Model checking, multistability, and spatial models Heather Harrington 9 / 40
  • 25. Background: tools from algebraic geometry For simple systems, this elimination can be done by hand. But in general, a more systematic approach is often required. Gr¨bner basis nonlinear generalization of Gaussian elimination. o Model checking, multistability, and spatial models Heather Harrington 9 / 40
  • 26. Background: tools from algebraic geometry For simple systems, this elimination can be done by hand. But in general, a more systematic approach is often required. Gr¨bner basis nonlinear generalization of Gaussian elimination. o Elimination ideal allows us to perform elimination without having to know the numerical values of the parameters a = (k1 , . . . , kR ) by treating them symbolically. Model checking, multistability, and spatial models Heather Harrington 9 / 40
  • 27. Background: tools from algebraic geometry For simple systems, this elimination can be done by hand. But in general, a more systematic approach is often required. Gr¨bner basis nonlinear generalization of Gaussian elimination. o Elimination ideal allows us to perform elimination without having to know the numerical values of the parameters a = (k1 , . . . , kR ) by treating them symbolically. Gr¨bner bases automatically give equations that are fulfilled by any o steady-state solution and only involve a subset of variables. Model checking, multistability, and spatial models Heather Harrington 9 / 40
  • 28. Background: variable elimination and invariants After variable elimination we are left with: ni Nobs t Ii (xobs ; a) = fij (a) xkijk , i = 1, . . . , Ninv . (1) j=1 k=1 Model checking, multistability, and spatial models Heather Harrington 10 / 40
  • 29. Background: variable elimination and invariants After variable elimination we are left with: ni Nobs t Ii (xobs ; a) = fij (a) xkijk , i = 1, . . . , Ninv . (1) j=1 k=1 Ii is a polynomial in xobs that vanishes at steady state. Model checking, multistability, and spatial models Heather Harrington 10 / 40
  • 30. Background: variable elimination and invariants After variable elimination we are left with: ni Nobs t Ii (xobs ; a) = fij (a) xkijk , i = 1, . . . , Ninv . (1) j=1 k=1 Ii is a polynomial in xobs that vanishes at steady state. We call the Ii steady-state invariants. Model checking, multistability, and spatial models Heather Harrington 10 / 40
  • 31. Background: variable elimination and invariants After variable elimination we are left with: ni Nobs t Ii (xobs ; a) = fij (a) xkijk , i = 1, . . . , Ninv . (1) j=1 k=1 Ii is a polynomial in xobs that vanishes at steady state. We call the Ii steady-state invariants. Invariants of a model (if they exist) describe relationships between observable variables that hold a steady state for any given realization of parameter values, regardless of other factors (such as initial conditions). Model checking, multistability, and spatial models Heather Harrington 10 / 40
  • 32. Model Model Model1.1. .Model 22 L 2 Model Model 1 Model Model Model 1 Model 2 Model 1Model 1 2 x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ . .˙ ˙ = ˙ .. ... Assessing coplanarity: overview . . x = 1 . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . . .. . .. . ... xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ N .=. ˙ = ˙ N . . x . ˙N . ... Models Models Observed Data DataData Data Observed Observed Data Data Observed Observed Observed Calculate elimination ideal Models (Steadymeasurements) Calculate elimination ideal elimination. .ideal (Steadymeasurements) Calculate (Steady state state state measurements) (Steady measurements) Model 1 Model. 2 . . . . Model L (Steady state measurements) Model 1 . . (Steady state state measurements) Calculate elimination ideal ... ... Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . . . . . . . . . x1 . .. . x11 ˆˆ ˆ ˆ 1 1 . .x1ˆ. x1 =˙ 1 = . . . . . . ˙ x x ˆ Assess coplanarity ˆ ˆ . ˆˆ . .x2 ........ . . . .. .. . . . . . Assess coplanarity1x2 . . . x.22 . xx2 Assess coplanarity . . . . . . . . x = ˙ x ˆ 2 ˆ . . ... ... ... ... Assess coplanarity .. . ... . . . . .. .. .. ........ . . . .. .. . . . . . .. . Assess coplanarity . xN =N = . . . . . . ˙ x ˙ . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . . ˆ ˆ m ˆˆ x ˆ m x Reduce number ˙of = variables ... ... ... ... Reduce number xN variables Reduce number of variables of Reduce number of variables to include only observables observables only observables to include to include onlyReduce number of variables to include only observablesSteady statestate invariants Steady state invariants Data SteadySteady Steady state invariants state invariants Steady state state invariants Steady invariants invariants Observed to include only observablesstate invariants Steady (Steady state measurements) of models Characterize steady states Characterize steady states of. .models states of models Characterize steady . x1Characterize steady ˆ Calculate elimination ideal states of models Characterize steady states of elimination ideal . . . Calculate models x2 ˆ 1 1 1 11 1 . Transform model variables, . Transform .model variables, parameters, and data .. Transform model variables, AssessTransform model variables, coplanarity . . . and data parameters, xm parameters, and data ˆ Transform model variables, parameters, and data Assess coplanarity parameters, and data parameters, and data Steady state invariants Data coplanar Data not coplanar 1 1 1 2 2 Data not coplanar 2 2 2 Data not coplanar Model compatible Model compatible Model incompatible Data coplanar 2 Data not coplanar 3 Model checking, multistability, and spatial models Heather Harrington 11 / 40 Model incompatible
  • 33. Model Model Model1.1. .Model 22 L 2 Model Model 1 Model Model Model 1 Model 2 Model 1Model 1 2 x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ . .˙ ˙ = ˙ .. ... Assessing coplanarity: overview . . x = 1 . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . . .. . .. . ... xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ N .=. ˙ = ˙ N . . x . ˙N . ... Models Models Observed Data DataData Data Observed Observed Data Data Observed Observed Observed Calculate elimination ideal Models (Steadymeasurements) Calculate elimination ideal elimination. .ideal (Steadymeasurements) Calculate (Steady state state state measurements) (Steady measurements) Model 1 Model. 2 . . . . Model L (Steady state measurements) . . (Steady state state measurements) Model 1 Calculate elimination ideal Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . . . . . . . . . x1 . .. . x11 ˆˆ ˆ ˆ 1 1 . .x1ˆ. ... ... We are interested in how to x1 =˙ 1 = . . . . . . ˙ x x ˆ Assess coplanarity ˆ ˆ . ˆˆ . .x2 ........ . . . .. .. . . . . Assess coplanarity1x2 . . . x.22 . xx2 Assess coplanarity . . . . . . . . . . x = ˙ ... ... ... ... Assess coplanarity . x ˆ 2 ˆ. ... . . . . .. .. .. ........ . . . .. .. . . . . . .. check if models and data are Assess coplanarity .. . . xN =N = . . . . . . ˙ x ˙ . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . . Reduce number ˙of = Reduce number xN variables of ˆ variables ˆ m ˆˆ x ˆ ... m x ... ... ... coplanar. Reduce number of variables Reduce number of variables to include only observables observables only observables to include to include onlyReduce number of variables to include only observablesSteady statestate invariants Steady state invariants Data SteadySteady Steady state invariants state invariants Steady state state invariants Steady invariants invariants Observed to include only observablesstate invariants Steady (Steady state measurements) of models Characterize steady states Characterize steady states of. .models states of models Characterize steady . x1Characterize steady ˆ Calculate elimination ideal states of models Characterize steady states of elimination ideal . . . Calculate models x2 ˆ 1 1 1 11 1 . Transform model variables, . Transform .model variables, parameters, and data .. Transform model variables, AssessTransform model variables, coplanarity . . . and data parameters, xm parameters, and data ˆ Transform model variables, parameters, and data Assess coplanarity parameters, and data parameters, and data Steady state invariants Data coplanar Data not coplanar 1 1 1 2 2 Data not coplanar 2 2 2 Data not coplanar Model compatible Model compatible Model incompatible Data coplanar 2 Data not coplanar 3 Model checking, multistability, and spatial models Heather Harrington 11 / 40 Model incompatible
  • 34. Model Model Model1.1. .Model 22 L 2 Model Model 1 Model Model Model 1 Model 2 Model 1Model 1 2 x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ . .˙ ˙ = ˙ .. ... Assessing coplanarity: overview . . x = 1 . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . . .. . .. . ... xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ N .=. ˙ = ˙ N . . x . ˙N . ... Models Models Observed Data DataData Data Observed Observed Data Data Observed Observed Observed Calculate elimination ideal Models (Steadymeasurements) Calculate elimination ideal elimination. .ideal (Steadymeasurements) Calculate (Steady state state state measurements) (Steady measurements) Model 1 Model. 2 . . . . Model L (Steady state measurements) . . (Steady state state measurements) Model 1 Calculate elimination ideal Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . . . . . . . . . x1 . .. . x11 ˆˆ ˆ ˆ 1 1 . .x1ˆ. ... ... We are interested in how to x1 =˙ 1 = . . . . . . ˙ x x ˆ Assess coplanarity ˆ ˆ . ˆˆ . .x2 ........ . . . .. .. . . . . Assess coplanarity1x2 . . . x.22 . xx2 Assess coplanarity . . . . . . . . . . x = ˙ ... ... ... ... Assess coplanarity . x ˆ 2 ˆ. ... . . . . .. .. .. ........ . . . .. .. . . . . . .. check if models and data are Assess coplanarity .. . . xN =N = . . . . . . ˙ x ˙ . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . . Reduce number ˙of = Reduce number xN variables of ˆ variables ˆ m ˆˆ x ˆ ... m x ... ... ... coplanar. Reduce number of variables Reduce number of variables to include only observables observables only observables to include to include onlyReduce number of variables to include only observablesSteady statestate invariants Steady state invariants Data Observed SteadySteady Steady state invariants state invariants Steady state state invariants Steady invariants invariants Assess if the invariants and to include only observablesstate invariants Steady (Steady state measurements) of models Characterize steady states data, when transformed, lie on Characterize steady states of. .models states of models Characterize steady . x1Characterize steady ˆ Calculate elimination ideal states of models x2 ˆ Characterize steady states of elimination ideal . . . Calculate models 1 1 1 11 1 a common plane. . Transform model variables, . Transform .model variables, parameters, and data .. Transform model variables, AssessTransform model variables, coplanarity . . . and data parameters, xm parameters, and data ˆ Transform model variables, parameters, and data Assess coplanarity parameters, and data parameters, and data Steady state invariants Data coplanar Data not coplanar 1 1 1 2 2 Data not coplanar 2 2 2 Data not coplanar Model compatible Model compatible Model incompatible Data coplanar 2 Data not coplanar 3 Model checking, multistability, and spatial models Heather Harrington 11 / 40 Model incompatible
  • 35. Model Model Model1.1. .Model 22 L 2 Model Model 1 Model Model Model 1 Model 2 Model 1Model 1 2 x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ . .˙ ˙ = ˙ .. ... Assessing coplanarity: overview . . x = 1 . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . . .. . .. . ... xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ N .=. ˙ = ˙ N . . x . ˙N . ... Models Models Observed Data DataData Data Observed Observed Data Data Observed Observed Observed Calculate elimination ideal Models (Steadymeasurements) Calculate elimination ideal elimination. .ideal (Steadymeasurements) Calculate (Steady state state state measurements) (Steady measurements) Model 1 Model. 2 . . . . Model L (Steady state measurements) . . (Steady state state measurements) Model 1 Calculate elimination ideal Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . . . . . . . . . x1 . .. . x11 ˆˆ ˆ ˆ 1 1 . .x1ˆ. ... ... We are interested in how to x1 =˙ 1 = . . . . . . ˙ x x ˆ Assess coplanarity ˆ ˆ . ˆˆ . .x2 ........ . . . .. .. . . . . Assess coplanarity1x2 . . . x.22 . xx2 Assess coplanarity . . . . . . . . . . x = ˙ ... ... ... ... Assess coplanarity . x ˆ 2 ˆ. ... . . . . .. .. .. ........ . . . .. .. . . . . . .. check if models and data are Assess coplanarity .. . . xN =N = . . . . . . ˙ x ˙ . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . . Reduce number ˙of = Reduce number xN variables of ˆ variables ˆ m ˆˆ x ˆ ... m x ... ... ... coplanar. Reduce number of variables Reduce number of variables to include only observables observables only observables to include to include onlyReduce number of variables to include only observablesSteady statestate invariants Steady state invariants Data Observed SteadySteady Steady state invariants state invariants Steady state state invariants Steady invariants invariants Assess if the invariants and to include only observablesstate invariants Steady (Steady state measurements) of models Characterize steady states data, when transformed, lie on Characterize steady states of. .models states of models Characterize steady . x1Characterize steady ˆ Calculate elimination ideal states of models x2 ˆ Characterize steady states of elimination ideal . . . Calculate models 1 1 1 11 1 a common plane. . Transform model variables, . Transform .model variables, parameters, and data .. Transform model variables, AssessTransform model variables, coplanarity . . . and data parameters, xm parameters, and data ˆ Transform model variables, parameters, and data Assess coplanarity In a sense, we are checking the parameters, and data parameters, and data coplanarity of transformed Steady state invariants Data coplanar Data not coplanar invariants and data. 1 1 1 2 2 Data not coplanar 2 2 2 Data not coplanar Model compatible Model compatible Model incompatible Data coplanar 2 Data not coplanar 3 Model checking, multistability, and spatial models Heather Harrington 11 / 40 Model incompatible
  • 36. Model Model Model1.1. .Model 22 L 2 Model Model 1 Model Model Model 1 Model 2 Model 1Model 1 2 x1 = x˙11 =. xx1=......x.1..=. . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ . .˙ ˙ = ˙ .. ... Assessing coplanarity: overview . . x = 1 . . . . . . ...... . .... . . .. ...... . . . ...... .. . ....... . . . . . . .. . .. . ... xN = x˙N =xxN=.....x. ...= . .. ...... . . . ...... .. . ....... . . . . . . ˙ ˙ N .=. ˙ = ˙ N . . x . ˙N . ... Models Models Observed Data DataData Data Observed Observed Data Data Observed Observed Observed Calculate elimination ideal Models (Steadymeasurements) Calculate elimination ideal elimination. .ideal (Steadymeasurements) Calculate (Steady state state state measurements) (Steady measurements) Model 1 Model. 2 . . . . Model L (Steady state measurements) . . (Steady state state measurements) Model 1 Calculate elimination ideal Calculate elimination. .ideal..Model xx1 Model 2 ...... . . . . . . . . . . . . . . x1 . .. . x11 ˆˆ ˆ ˆ 1 1 . .x1ˆ. ... ... We are interested in how to x1 =˙ 1 = . . . . . . ˙ x x ˆ Assess coplanarity ˆ ˆ . ˆˆ . .x2 ........ . . . .. .. . . . . Assess coplanarity1x2 . . . x.22 . xx2 Assess coplanarity . . . . . . . . . . x = ˙ ... ... ... ... Assess coplanarity . x ˆ 2 ˆ. ... . . . . .. .. .. ........ . . . .. .. . . . . . .. check if models and data are Assess coplanarity .. . . xN =N = . . . . . . ˙ x ˙ . . . . . . . . .xm . .. .. .xm xxm . .ˆ.m ...... . . . . . . . Reduce number ˙of = Reduce number xN variables of ˆ variables ˆ m ˆˆ x ˆ ... m x ... ... ... coplanar. Reduce number of variables Reduce number of variables to include only observables observables only observables to include to include onlyReduce number of variables to include only observablesSteady statestate invariants Steady state invariants Data Observed SteadySteady Steady state invariants state invariants Steady state state invariants Steady invariants invariants Assess if the invariants and to include only observablesstate invariants Steady (Steady state measurements) of models Characterize steady states data, when transformed, lie on Characterize steady states of. .models states of models Characterize steady . x1Characterize steady ˆ Calculate elimination ideal states of models x2 ˆ Characterize steady states of elimination ideal . . . Calculate models 1 1 1 11 1 a common plane. . Transform model variables, . Transform .model variables, parameters, and data .. Transform model variables, AssessTransform model variables, coplanarity . . . and data parameters, xm parameters, and data ˆ Transform model variables, parameters, and data Assess coplanarity In a sense, we are checking the parameters, and data parameters, and data coplanarity of transformed Steady state invariants Data coplanar Data not coplanar invariants and data. 1 1 1 Model rejection can then be 2 2 2 2 Data not coplanar performed by assessing the Data not coplanar 2 Model compatible degree to which the transformed data deviate from coplanarity. Model compatible Model incompatible Data coplanar 2 Data not coplanar 3 Model checking, multistability, and spatial models Heather Harrington 11 / 40 Model incompatible
  • 37. Assess coplanarity: question Data coplanarity Given a set of steady-state measurements xobs,i for i = 1, . . . , m, and ˆ model with steady-state invariants I = {I1 , . . . , INinv }, we need a procedure for deciding whether it is possible that the invariant is compatible with the data, i.e., I (ˆobs,i ; a) = 0, x i = 1, . . . , m, (2) for some choice of a. Model checking, multistability, and spatial models Heather Harrington 12 / 40
  • 38. Assess coplanarity: transform variables and data Consider an invariant I ∈ I, written in somewhat simplified form as n Nobs t I (xobs ; a) = fj (a) xkjk (3) j=1 k=1 To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as: x n I (ξ; α) = α i ξi . i=1 Model checking, multistability, and spatial models Heather Harrington 13 / 40
  • 39. Assess coplanarity: transform variables and data Consider an invariant I ∈ I, written in somewhat simplified form as n Nobs t I (xobs ; a) = fj (a) xkjk (3) j=1 k=1 To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as: x n I (ξ; α) = α i ξi . i=1 Let ϕ: xobs → ξ. Model checking, multistability, and spatial models Heather Harrington 13 / 40
  • 40. Assess coplanarity: transform variables and data Consider an invariant I ∈ I, written in somewhat simplified form as n Nobs t I (xobs ; a) = fj (a) xkjk (3) j=1 k=1 To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as: x n I (ξ; α) = α i ξi . i=1 ˆ Compatibility implies that the transformed variable ξ = ϕ(ˆobs )x x corresponding to any observation ˆobs with coordinates ˆ ˆ (ξ1 , . . . , ξn ), lies on the plane defined by the coefficients α. Model checking, multistability, and spatial models Heather Harrington 13 / 40
  • 41. Assess coplanarity: transform variables and data Consider an invariant I ∈ I, written in somewhat simplified form as n Nobs t I (xobs ; a) = fj (a) xkjk (3) j=1 k=1 To assess coplanarity (I (ˆobs,i ; a) = 0), we rewrite eq. 3 as: x n I (ξ; α) = α i ξi . i=1 ˆ Compatibility implies that the transformed variable ξ = ϕ(ˆobs ) x x corresponding to any observation ˆobs with coordinates ˆ ˆ (ξ1 , . . . , ξn ), lies on the plane defined by the coefficients α. In other words, compatibility with the data xobs,i implies that the ˆ corresponding transformed data ξ ˆi = ϕ(ˆobs,i ) are coplanar. x Model checking, multistability, and spatial models Heather Harrington 13 / 40
  • 42. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 43. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Then the data are coplanar if and only if Ξα = 0 for some column vector α = 0. Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 44. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Then the data are coplanar if and only if Ξα = 0 for some column vector α = 0. Such a vector resides in the null space of Ξ, spanned by the right singular vectors of Ξ corresponding to zero singular values. Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 45. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Then the data are coplanar if and only if Ξα = 0 for some column vector α = 0. Such a vector resides in the null space of Ξ, spanned by the right singular vectors of Ξ corresponding to zero singular values. Thus, assuming that m > n, if the smallest singular value σn of Ξ is nonzero, then the data cannot be coplanar. Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 46. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Then the data are coplanar if and only if Ξα = 0 for some column vector α = 0. Such a vector resides in the null space of Ξ, spanned by the right singular vectors of Ξ corresponding to zero singular values. Thus, assuming that m > n, if the smallest singular value σn of Ξ is nonzero, then the data cannot be coplanar. More generally, σn = min α =1 Ξα gives the least squares deviation of the data from coplanarity under the scaling constraint α = 1. Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 47. Assess coplanarity: SVD ˆ Let Ξ ∈ Rm×n be the matrix whose rows consist of the ξ i . Then the data are coplanar if and only if Ξα = 0 for some column vector α = 0. Such a vector resides in the null space of Ξ, spanned by the right singular vectors of Ξ corresponding to zero singular values. Thus, assuming that m > n, if the smallest singular value σn of Ξ is nonzero, then the data cannot be coplanar. More generally, σn = min α =1 Ξα gives the least squares deviation of the data from coplanarity under the scaling constraint α = 1. This measure depends only on the data and is therefore parameter-free. Model checking, multistability, and spatial models Heather Harrington 14 / 40
  • 48. Assess coplanarity: remarks (1) Note that this applies for any choice of α, regardless of whether it can be realized by the original parameters a. (2) In this sense, the condition of small σn provides a necessary but not sufficient criterion for model compatibility. Model checking, multistability, and spatial models Heather Harrington 15 / 40
  • 49. Assess coplanarity: remarks (1) Note that this applies for any choice of α, regardless of whether it can be realized by the original parameters a. (2) In this sense, the condition of small σn provides a necessary but not sufficient criterion for model compatibility. (3) This is in contrast to traditional approaches based on parameter fitting, which provide a sufficient but not necessary condition, since local minima may prevent a compatible model from being fitted correctly. (4) The additional degrees of freedom introduced by neglecting the functional forms fj effectively linearizes the compatibility condition (I (ˆobs,i ; a) = 0), allowing for a simple direct solution. x Model checking, multistability, and spatial models Heather Harrington 15 / 40
  • 50. Assess coplanarity: noise in data To account for the presence of noise, let x x = ∆ˆobs / ˆobs be the relative error x in a measurement ˆobs . Model checking, multistability, and spatial models Heather Harrington 16 / 40
  • 51. Assess coplanarity: noise in data To account for the presence of noise, let x x = ∆ˆobs / ˆobs be the relative error x in a measurement ˆobs . (1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is ˆ ˆ x propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where ϕ(x) x β (x) = ϕ(x) is the noise amplification factor, and ϕ is the Jacobian of ϕ, with elements ( ϕ)ij = ∂ξi /∂xj . Model checking, multistability, and spatial models Heather Harrington 16 / 40
  • 52. Assess coplanarity: noise in data To account for the presence of noise, let x x = ∆ˆobs / ˆobs be the relative error x in a measurement ˆobs . (1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is ˆ ˆ x propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where ϕ(x) x β (x) = ϕ(x) is the noise amplification factor, and ϕ is the Jacobian of ϕ, with elements ( ϕ)ij = ∂ξi /∂xj . (2) To quantify the overall level of noise across all measurements, we define √ x x β = β / m, where β = (β(ˆobs,1 ), . . . , β(ˆobs,m )) is a vector containing each noise amplification factor, and the effective relative error as eff = β . Model checking, multistability, and spatial models Heather Harrington 16 / 40
  • 53. Assess coplanarity: noise in data To account for the presence of noise, let x x = ∆ˆobs / ˆobs be the relative error x in a measurement ˆobs . (1) Then from the perturbation equation ξ + ∆ξ = ϕ (x + ∆x) , this is ˆ ˆ x propagated to the transformed variables as ∆ξ / ξ ∼ β(ˆobs ) , where ϕ(x) x β (x) = ϕ(x) is the noise amplification factor, and ϕ is the Jacobian of ϕ, with elements ( ϕ)ij = ∂ξi /∂xj . (2) To quantify the overall level of noise across all measurements, we define √ x x β = β / m, where β = (β(ˆobs,1 ), . . . , β(ˆobs,m )) is a vector containing each noise amplification factor, and the effective relative error as eff = β . (3) Since the introduction of noise in Ξ of order eff in general gives a lower √ bound of σn ∼ m eff ∼ β , we should reject the model only if σn β . We therefore define the coplanarity error σn ∆= , β in terms of which the rejection criterion is simply ∆ 1. Observe that as increases, ∆ decreases, so we lose rejection power, as expected. Model checking, multistability, and spatial models Heather Harrington 16 / 40
  • 54. Example application: multisite phosphorylation Distributive Phosphorylation of MAPK Disassociation MAPKK MAPKK MAPKK MAPKK MAPKK P P P P P P Model checking, multistability, and spatial models Heather Harrington 17 / 40
  • 55. Example application: multisite phosphorylation Distributive Phosphorylation of MAPK Disassociation MAPKK MAPKK MAPKK MAPKK MAPKK P P P P P P Processive Phosphorylation of MAPK MAPKK MAPKK Slide MAPKK MAPKK P P P P P Model checking, multistability, and spatial models Heather Harrington 17 / 40
  • 56. Example application: multisite phosphorylation Distributive Phosphorylation of MAPK Disassociation MAPKK MAPKK MAPKK MAPKK MAPKK P P P P P P Processive Phosphorylation of MAPK MAPKK MAPKK Slide MAPKK MAPKK P P P P P Dephosphorylation can also occur in a processive or a distributive manner. We would like to know which mechanism operates in vivo. Model checking, multistability, and spatial models Heather Harrington 17 / 40
  • 57. Multisite phosphorylation: eliminate variables Each enzyme can be either processive (P), u cuv a K + Su −− KSu −→ K + Sv , −− − where more than one phosphate modification bu may be achieved in a single step, or vu αv γ F + Sv −− FSv −→ F + Su , −− − distributive (D), where only one modification βv is allowed before the enzyme dissociates from Phosphorylation the substrate. E + S01 ES01 Models: PP, PD, DP and DD; where the first letter designates the mechanisms of the E + S00 ES00 E + S11 kinase, and the second, that of the E + S10 ES10 phosphatase. We considered only the concentrations F S01 F + S01 xobs = (s00 , s01 , s10 , s11 ) as observable, and were able to eliminate all other variables F + S00 F S11 F + S11 except the concentration f of F from the F S10 F + S10 dynamics of each model. Dephosphorylation Model checking, multistability, and spatial models Heather Harrington 18 / 40
  • 58. Multisite phosphorylation: assess coplanarity Each model has three steady-state invariants. Model checking, multistability, and spatial models Heather Harrington 19 / 40
  • 59. Multisite phosphorylation: assess coplanarity Each model has three steady-state invariants. Invariants share same transformed variables ξ = ϕ(xobs ) so only the kinase is discriminative. Model checking, multistability, and spatial models Heather Harrington 19 / 40
  • 60. Multisite phosphorylation: assess coplanarity Each model has three steady-state invariants. Invariants share same transformed variables ξ = ϕ(xobs ) so only the kinase is discriminative. Data generated under this model: PP/PD DP/DD Reject model PP/PD? No No Reject model DP/DD? Yes No ξ PP/PD = s00 s10 , s00 s11 , s01 s10 , s01 s11 , s10 , s10 s11 , 2 ξ DP/DD = s00 s11 , s01 s10 , s01 s11 , s10 , s10 s11 . 2 Model checking, multistability, and spatial models Heather Harrington 19 / 40
  • 61. Multisite phosphorylation: coplanarity results Model checking, multistability, and spatial models Heather Harrington 20 / 40
  • 62. Examples: apoptosis activation Chapter 7. Fas trimerization model s for each of the DISC, MAC, and apoptosome modules are described 145 tation is understood to apply only within each module. Crosslinking model ! rization kinetics are simplified from the crosslinking model (Delisi, 4, 1981) of Lai and Jackson, 2004 and follow the reactions " 3kf ! FasL + FasR −− FasL-FasR, −− kr 2kf FasL-FasR + FasR −− FasL-FasR2 , −− 2kr kf FasL-FasR2 + FasR −− FasL-FasR3 , −− 3kr Lai & Jackson (2004) Math Biosci Eng Figure 7.4: Comparison with the crosslinking model. (A) Process diagram (comply with the SBGN Pro- cess Description language Level 1 (Le Nov` re et al., 2009)) of the crosslinking model. (B) Variation of e the steady-state signaling Fas fraction ζ∞ with respect to the model parameter κ. (C) Minimization errors of the steady-state invariants ωH and ωC for the hysteron and crosslinking models, respectively (Ap- pendix B.2), over data generated from each model (Datasets 3 and 4) using nonnegative least squares (see Materials and methods for details). Model checking, multistability, and spatial models Heather Harrington 21 / 40
  • 63. [33], irreversible bistability is achieved, implementing a perma- nent cell death decision. Thus, our model suggests a primary role Examples: apoptosis activation Chapter 7. Fas trimerization model s for each of the DISC, MAC, and apoptosome modules are described for death receptors in deciding cell fate. Moreover, our results offer 145 novel functional interpretations of ligand trimerism and receptor pre-association and localization within the unified context of The first reaction describes spo closing; the second, constitutive third, ligand-independent recept bistability. fourth, ligand-dependent recepto The orders of the cluster-stabiliz tation is understood to apply only within each module. Results parameters m and n, which captu and Fas coordination by FasL, r Model formulation stabilization (m~n~2) has been Constructing a mathematical model of Fas dynamics is not higher-order analogues, for exam entirely straightforward as receptors can form highly oligomeric interactions, are not unreasonabl Crosslinking model Cluster model ! rization kinetics are simplified from the crosslinking model (Delisi, 4, 1981) of Lai and Jackson, 2004 and follow the reactions " 3kf ! FasL + FasR −− FasL-FasR, −− kr Figure 1. Cartoon of model interactions. The transmembrane death receptor Fas natively adopts a closed co 2kf the binding of FADD, an adaptor molecule that facilitates apoptotic signal transduction. Open Fas can self-st FasL-FasR + FasR −− FasL-FasR2 , −− interactions, which is enhanced by receptor clustering through association with the ligand FasL. doi:10.1371/journal.pcbi.1000956.g001 2kr PLoS Computational Biology | www.ploscompbiol.org 2 October 2010 | kf FasL-FasR2 + FasR −− FasL-FasR3 , −− 3kr Lai & Jackson (2004) Math Biosci Eng Figure 2. Schematic of cluster-stabilization reactions. Examples Ho & Harrington (2010) PLoS Comput Biol of ligand-independent cluster-stabilization reactions involving unstable (Y ) and stable (Z) open receptors of molecularities two (A), three (B), Figure 7.4: Comparison with the crosslinking model. (A) Process diagram (comply with the SBGN Pro- cess Description language Level 1 (Le Nov` re et al., 2009)) of the crosslinking model. (B) Variation of e and four (C). Higher-order reactions follow the same pattern. Ligand- the steady-state signaling Fas fraction ζ∞ with respect to the model parameter κ. (C) Minimization errors dependent reactions are identical except that FasL (L) must be added of the steady-state invariants ωH and ωC for the hysteron and crosslinking models, respectively (Ap- to each reacting state. pendix B.2), over data generated from each model (Datasets 3 and 4) using nonnegative least squares (see doi:10.1371/journal.pcbi.1000956.g002 Materials and methods for details). Formally, these reactions are to be interpreted as state transitions Model checking, multistability, and spatial models Heather Harrington 21 / 40 on the space of cluster tuples. However, the reaction notation is