SlideShare a Scribd company logo
1 of 137
Ishanu Chattopadhyay
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Disambiguation Of Stochasic Processes
                            Competence Response Of Transgenic B. subtilis



                    Bacillus subtilis

                                                                       Strains




Comptence Circuit
  (Wild Type)




   Comptence Response




                                Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
Motivating Questions On Stochastic Processes
Basic Idea: Negate & Subtract!
             Just Like Real Numbers, · · · Well Almost




     x + (−y) = 0 ⇔ x = y

Example:    0.375 + (−0.375) = 0
Basic Idea: Negate & Subtract!
             Just Like Real Numbers, · · · Well Almost




     x + (−y) = 0 ⇔ x = y

Example:    0.375 + (−0.375) = 0
Symbols Can Be Anything
                           Individual Symbols Need Not Have Algebraic Properties




Manipulate the information content in symbolic streams. . .




                                      +

   −


No matter what the symbols are. . .
Quantization Of Observed Sequences
                                              How Do We Get Symbols?


                 σ6
           σ5
                σ8
                               σ7           σ1 σ1 σ3 · · ·
                                         · · · σ5 σ3 σ3 · · ·
                     σ2
      σ1                                                   (a) Phase Space Quantization
                          σ3
                σ4




σ5                                             Binary
                                             Quantization
σ4

      σ3
 σ2                                                      (b) Data Range Discretization
 σ1

Continuous                                 8 symbol
  Signal                                  Quantization
Probabilistic Finite State Automata As Stochastic
                                     Models
                                      Syntactic Definition: The Anatomy


     σ1 |0.9                                σ2 |0.2
                                                            States
                          q2
      q1
                                                         Transition
                                                        (Events From
                                                          Alphabet)
           σ1 |0.8          σ1 |0.3

σ2 |0.1
                     q3                                   Alphabet
                                                          Symbol

                                        σ2 |0.7

                                                         Probability of
                                                         generating σ2
                                                           at state q3
                          PFSA



           Can act as symbolic generators
Probabilistic Finite State Automata As Stochastic
                                     Models
                                      Syntactic Definition: The Anatomy


     σ1 |0.9                                σ2 |0.2
                                                            States
                          q2
      q1
                                                         Transition
                                                        (Events From
                                                          Alphabet)
           σ1 |0.8          σ1 |0.3

σ2 |0.1
                     q3                                   Alphabet
                                                          Symbol

                                        σ2 |0.7

                                                         Probability of
                                                         generating σ2
                                                           at state q3
                          PFSA



           Can act as symbolic generators
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8
σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8

σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2σ1
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Probabilsitic Automata As Stcoachstic Models
                                                                  Can Act As Generators




     σ1 |0.9                             σ2 |0.2
                                                      States
                           q2
      q1
                                                     Transition
                                                   (Events From
                            σ1 |0.3                  Alphabet)
           σ1 |0.8
σ2 |0.1                                                                 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2σ1σ2
                     q3                             Alphabet
                                                    Symbol

                                      σ2 |0.7
                                                   Probability of
                                                   generating σ2
                          PFSA                       at state q3
Causal States Of Dynamical Processes
                                                 Equivalence Classes Of The Nerode Relation




              Future-equivalent Strings
              Go To The Same ”State“

         Equality Of Distributions over...


                           future symbols
                    future substrings
                          of length 2

          future substrings                                             What Does
                of length 3
                                                                 ”Equivalence Of Futures“
future substrings
      of length 4                                                         Mean ?


          all lengths of future substrings
Causal States Of Dynamical Processes
                                                 Equivalence Classes Of The Nerode Relation




              Future-equivalent Strings
              Go To The Same ”State“

         Equality Of Distributions over...


                           future symbols
                    future substrings
                          of length 2

          future substrings                                             What Does
                of length 3
                                                                 ”Equivalence Of Futures“
future substrings
      of length 4                                                         Mean ?


          all lengths of future substrings
Stochastic Processes As Probabilistic Dynamical
                                   Systems
                                     Measures On Infinite Strings



     Present
                                                                   Dynamics completely
                                                                   specified by the
                                                                   probabilites:
                                                                                
                                                                       p(τ1 Σω )
                                                                                
                                                                       
                                                                       p(τ2 Σω )
                                                                                 
                                                                       
                                                                                
                                                                                 
   Past                                                                p(τ3 Σ 
                                                                       
                                                                              ω )
Observation                                                            
                                                                                
                                                                                 
                                                                       
                                                                           .
                                                                            .    
                                                                                 
    τ                                                                       .
                            All Possible
                              Infinite
                            Futures (Σω )




                        Quantized
   Stochastic Process   −− − − − −
                        − − − − −→    Probability space (Σω , B, P)

                                            Finite Encoding
        Probability space (Σω , B, P)       −− − − − − − − −
                                            − − − − − − − −→   PFSA
Stochastic Processes As Probabilistic Dynamical
                                   Systems
                                     Measures On Infinite Strings



     Present
                                                                   Dynamics completely
                                                                   specified by the
                                                                   probabilites:
                                                                                
                                                                       p(τ1 Σω )
                                                                                
                                                                       
                                                                       p(τ2 Σω )
                                                                                 
                                                                       
                                                                                
                                                                                 
   Past                                                                p(τ3 Σ 
                                                                       
                                                                              ω )
Observation                                                            
                                                                                
                                                                                 
                                                                       
                                                                           .
                                                                            .    
                                                                                 
    τ                                                                       .
                            All Possible
                              Infinite
                            Futures (Σω )




                        Quantized
   Stochastic Process   −− − − − −
                        − − − − −→    Probability space (Σω , B, P)

                                            Finite Encoding
        Probability space (Σω , B, P)       −− − − − − − − −
                                            − − − − − − − −→   PFSA
Stochastic Processes As Probabilistic Dynamical
                                   Systems
                                     Measures On Infinite Strings



     Present
                                                                   Dynamics completely
                                                                   specified by the
                                                                   probabilites:
                                                                                
                                                                       p(τ1 Σω )
                                                                                
                                                                       
                                                                       p(τ2 Σω )
                                                                                 
                                                                       
                                                                                
                                                                                 
   Past                                                                p(τ3 Σ 
                                                                       
                                                                              ω )
Observation                                                            
                                                                                
                                                                                 
                                                                       
                                                                           .
                                                                            .    
                                                                                 
    τ                                                                       .
                            All Possible
                              Infinite
                            Futures (Σω )




                        Quantized
   Stochastic Process   −− − − − −
                        − − − − −→    Probability space (Σω , B, P)

                                            Finite Encoding
        Probability space (Σω , B, P)       −− − − − − − − −
                                            − − − − − − − −→   PFSA
Stochastic Processes As Probabilistic Dynamical
                                   Systems
                                     Measures On Infinite Strings



     Present
                                                                   Dynamics completely
                                                                   specified by the
                                                                   probabilites:
                                                                                
                                                                       p(τ1 Σω )
                                                                                
                                                                       
                                                                       p(τ2 Σω )
                                                                                 
                                                                       
                                                                                
                                                                                 
   Past                                                                p(τ3 Σ 
                                                                       
                                                                              ω )
Observation                                                            
                                                                                
                                                                                 
                                                                       
                                                                           .
                                                                            .    
                                                                                 
    τ                                                                       .
                            All Possible
                              Infinite
                            Futures (Σω )




                        Quantized
   Stochastic Process   −− − − − −
                        − − − − −→    Probability space (Σω , B, P)

                                            Finite Encoding
        Probability space (Σω , B, P)       −− − − − − − − −
                                            − − − − − − − −→   PFSA
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
Relationship Between Space of Automata & Space Of
                                          Measures
                                    Multiple PFSA May Map To Same Measure


                                      Any two PFSA can be
Dynamics-equivalent                  made structure equivalent
      PFSA




                             Space Of PFSA (A )             Non-minimal realizations exist
                                                            Structue is not that important




                                                        measure 2


      measure 1
                          Space Of measures on                   Each measure defines
                           infinite strings (P)                   a probability space: (Σω , B, p1 )
PFSAs Are Encodings Of Measure Spaces
                                                                             · · · And Not Just Graphs!

                                                            Any string
                   1(0.1)
                                                         terminating in 10
                                 0(0.9)
                                               q2
                            q1
                                 1(0.2)
                                           0(0.8)
   Any string
terminating in 1
                     1(0.7)
                                          q3
                                                        0(0.3)
               Any string
            terminating in 00


                                                                                      • Causality Structure
                                                                                            How many causal states?
                                                                                            Interdependence between causal states




                                                                                      • Probability Morph
                                                          Σ⋆                                Immediate future from causal states
                                                       (Set of all
                                                    finite strings on                        Analogous to tangent vectors
                                                      alphabet Σ)
PFSAs Are Encodings Of Measure Spaces
                                                                                · · · And Not Just Graphs!

                                                               Any string
                      1(0.1)
                                                            terminating in 10
                                    0(0.9)
                                                  q2
                               q1
                                    1(0.2)
                                              0(0.8)
   Any string
terminating in 1
                        1(0.7)
                                             q3
                                                           0(0.3)
                   Any string
                terminating in 00


                                                                                         • Causality Structure
                                                                                               How many causal states?
                                                                                               Interdependence between causal states
      string:
       ω′ 01


      1
                                                                                         • Probability Morph
      string:
       ω00                                                   Σ⋆                                Immediate future from causal states
                                                          (Set of all
                       0            string:            finite strings on                        Analogous to tangent vectors
                                     ω′ 00               alphabet Σ)
      (A)
    Transition
    Structure
   induced by
state definitions
PFSAs Are Encodings Of Measure Spaces
                                                                                       · · · And Not Just Graphs!

                                                                    Any string
                   1(0.1)
                                                                 terminating in 10
                                  0(0.9)
                                                q2
                            q1
                                  1(0.2)
                                               0(0.8)
   Any string
terminating in 1
                     1(0.7)
                                           q3
                                                            0(0.3)
               Any string
            terminating in 00
                                      0(0.9)
                             1(0.1)
                                                 1(0.1)
                                                                                                 • Causality Structure
                                                        0(0.9)
                                                                      1(0.2)                          How many causal states?
                                                                                (B)
                                                                                Symbol                Interdependence between causal states
                                                                     0(0.8)     probabilities
                                                                                identical from
                                                                     1(0.2)     same state
                                                                       0(0.8)

                                                                                                 • Probability Morph
                                                           Σ⋆                                         Immediate future from causal states
                                                        (Set of all
                                                     finite strings on                                 Analogous to tangent vectors
                                                       alphabet Σ)
PFSAs Are Encodings Of Measure Spaces
                                                                                          · · · And Not Just Graphs!

                                                                       Any string
                      1(0.1)
                                                                    terminating in 10
                                     0(0.9)
                                                   q2
                               q1
                                     1(0.2)
                                                  0(0.8)
   Any string
terminating in 1
                        1(0.7)
                                              q3
                                                               0(0.3)
                   Any string
                terminating in 00
                                         0(0.9)
                                1(0.1)
                                                    1(0.1)
                                                                                                    • Causality Structure
                                                           0(0.9)
                                                                         1(0.2)                          How many causal states?
                                                                                   (B)
                                                                                   Symbol                Interdependence between causal states
      string:                                                           0(0.8)     probabilities
                                                                                   identical from
       ω′ 01
                                                                        1(0.2)     same state
                                                                          0(0.8)
      1
                                                                                                    • Probability Morph
      string:                                                                                            Immediate future from causal states
       ω00                                                    Σ⋆
                                                           (Set of all
                       0             string:            finite strings on                                 Analogous to tangent vectors
                                      ω′ 00               alphabet Σ)
      (A)
    Transition
    Structure
   induced by
state definitions
PFSAs Are Encodings Of Measure Spaces
                                                             · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)


                                 0(0.9)
                                               1(0.1)
                        1(0.1)
                                                 0(0.9)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
PFSAs Are Encodings Of Measure Spaces
                                                                               · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)

                                                                                    1(0.1)
                                 0(0.9)
                                               1(0.1)                 0(0.9)
                        1(0.1)                                                        0(0.9)
                                                 0(0.9)      1(0.1)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
PFSAs Are Encodings Of Measure Spaces
                                                                               · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)

                                                                                      1(0.1)
                                 0(0.9)
                                               1(0.1)                 0(0.9)
                        1(0.1)                                                          0(0.9)
                                                 0(0.9)      1(0.1)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
PFSAs Are Encodings Of Measure Spaces
                                                                        · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)

                                                                                    1(0.1)
                                 0(0.9)
                                               1(0.1)                 0(0.9)
                        1(0.1)                                                        0(0.9)
                                                 0(0.9)      1(0.1)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
PFSAs Are Encodings Of Measure Spaces
                                                                · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)

                                                                                1(0.1)
                                 0(0.9)
                                               1(0.1)                 0(0.9)
                        1(0.1)                                                    0(0.9)
                                                 0(0.9)      1(0.1)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
PFSAs Are Encodings Of Measure Spaces
                                                             · · · And Not Just Graphs!


And the exact graphs are not even that important.....

                   1(0.1)
                             0(0.9)
                        q1                q2
                             1(0.2)
   Any string                         0(0.8)
terminating in 1
                    1(0.7)          q3
                                                    0(0.3)

                                                                                 1(0.1)
                                 0(0.9)
                                               1(0.1)                   0(0.9)
                        1(0.1)                                                     0(0.9)
                                                 0(0.9)        1(0.1)




                                            Σ⋆
                                      (Set of all finite
                                  strings on alphabet Σ)




                   State splitting produces
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann
Presentann

More Related Content

Recently uploaded

SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 

Recently uploaded (20)

SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Presentann

  • 2. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 3. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 4. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 5. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 6. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 7. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 8. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 9. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 10. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 11. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 12. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 13. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 14. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 15. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 16. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 17. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 18. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 19. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 20. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 21. Disambiguation Of Stochasic Processes Competence Response Of Transgenic B. subtilis Bacillus subtilis Strains Comptence Circuit (Wild Type) Comptence Response Experimental Data: G. Suel (U. Of Texas, Southwestern Med. School)
  • 22. Motivating Questions On Stochastic Processes
  • 23. Basic Idea: Negate & Subtract! Just Like Real Numbers, · · · Well Almost x + (−y) = 0 ⇔ x = y Example: 0.375 + (−0.375) = 0
  • 24. Basic Idea: Negate & Subtract! Just Like Real Numbers, · · · Well Almost x + (−y) = 0 ⇔ x = y Example: 0.375 + (−0.375) = 0
  • 25. Symbols Can Be Anything Individual Symbols Need Not Have Algebraic Properties Manipulate the information content in symbolic streams. . . + − No matter what the symbols are. . .
  • 26. Quantization Of Observed Sequences How Do We Get Symbols? σ6 σ5 σ8 σ7 σ1 σ1 σ3 · · · · · · σ5 σ3 σ3 · · · σ2 σ1 (a) Phase Space Quantization σ3 σ4 σ5 Binary Quantization σ4 σ3 σ2 (b) Data Range Discretization σ1 Continuous 8 symbol Signal Quantization
  • 27. Probabilistic Finite State Automata As Stochastic Models Syntactic Definition: The Anatomy σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From Alphabet) σ1 |0.8 σ1 |0.3 σ2 |0.1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 at state q3 PFSA Can act as symbolic generators
  • 28. Probabilistic Finite State Automata As Stochastic Models Syntactic Definition: The Anatomy σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From Alphabet) σ1 |0.8 σ1 |0.3 σ2 |0.1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 at state q3 PFSA Can act as symbolic generators
  • 29. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 30. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 31. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 32. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 33. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 34. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 35. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 36. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 37. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 38. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 39. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 40. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 41. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2σ1 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 42. Probabilsitic Automata As Stcoachstic Models Can Act As Generators σ1 |0.9 σ2 |0.2 States q2 q1 Transition (Events From σ1 |0.3 Alphabet) σ1 |0.8 σ2 |0.1 σ1σ1σ2σ2σ1σ1σ1σ1σ2σ1σ2σ2σ1σ2 q3 Alphabet Symbol σ2 |0.7 Probability of generating σ2 PFSA at state q3
  • 43. Causal States Of Dynamical Processes Equivalence Classes Of The Nerode Relation Future-equivalent Strings Go To The Same ”State“ Equality Of Distributions over... future symbols future substrings of length 2 future substrings What Does of length 3 ”Equivalence Of Futures“ future substrings of length 4 Mean ? all lengths of future substrings
  • 44. Causal States Of Dynamical Processes Equivalence Classes Of The Nerode Relation Future-equivalent Strings Go To The Same ”State“ Equality Of Distributions over... future symbols future substrings of length 2 future substrings What Does of length 3 ”Equivalence Of Futures“ future substrings of length 4 Mean ? all lengths of future substrings
  • 45. Stochastic Processes As Probabilistic Dynamical Systems Measures On Infinite Strings Present Dynamics completely specified by the probabilites:   p(τ1 Σω )    p(τ2 Σω )      Past p(τ3 Σ   ω ) Observation       . .   τ . All Possible Infinite Futures (Σω ) Quantized Stochastic Process −− − − − − − − − − −→ Probability space (Σω , B, P) Finite Encoding Probability space (Σω , B, P) −− − − − − − − − − − − − − − − −→ PFSA
  • 46. Stochastic Processes As Probabilistic Dynamical Systems Measures On Infinite Strings Present Dynamics completely specified by the probabilites:   p(τ1 Σω )    p(τ2 Σω )      Past p(τ3 Σ   ω ) Observation       . .   τ . All Possible Infinite Futures (Σω ) Quantized Stochastic Process −− − − − − − − − − −→ Probability space (Σω , B, P) Finite Encoding Probability space (Σω , B, P) −− − − − − − − − − − − − − − − −→ PFSA
  • 47. Stochastic Processes As Probabilistic Dynamical Systems Measures On Infinite Strings Present Dynamics completely specified by the probabilites:   p(τ1 Σω )    p(τ2 Σω )      Past p(τ3 Σ   ω ) Observation       . .   τ . All Possible Infinite Futures (Σω ) Quantized Stochastic Process −− − − − − − − − − −→ Probability space (Σω , B, P) Finite Encoding Probability space (Σω , B, P) −− − − − − − − − − − − − − − − −→ PFSA
  • 48. Stochastic Processes As Probabilistic Dynamical Systems Measures On Infinite Strings Present Dynamics completely specified by the probabilites:   p(τ1 Σω )    p(τ2 Σω )      Past p(τ3 Σ   ω ) Observation       . .   τ . All Possible Infinite Futures (Σω ) Quantized Stochastic Process −− − − − − − − − − −→ Probability space (Σω , B, P) Finite Encoding Probability space (Σω , B, P) −− − − − − − − − − − − − − − − −→ PFSA
  • 49. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 50. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 51. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 52. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 53. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 54. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 55. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 56. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 57. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 58. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 59. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 60. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 61. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 62. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 63. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 64. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 65. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 66. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 67. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 68. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 69. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 70. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 71. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 72. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 73. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 74. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 75. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 76. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 77. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 78. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 79. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 80. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 81. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 82. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 83. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 84. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 85. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 86. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 87. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 88. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 89. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 90. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 91. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 92. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 93. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 94. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 95. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 96. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 97. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 98. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 99. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 100. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 101. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 102. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 103. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 104. Relationship Between Space of Automata & Space Of Measures Multiple PFSA May Map To Same Measure Any two PFSA can be Dynamics-equivalent made structure equivalent PFSA Space Of PFSA (A ) Non-minimal realizations exist Structue is not that important measure 2 measure 1 Space Of measures on Each measure defines infinite strings (P) a probability space: (Σω , B, p1 )
  • 105. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! Any string 1(0.1) terminating in 10 0(0.9) q2 q1 1(0.2) 0(0.8) Any string terminating in 1 1(0.7) q3 0(0.3) Any string terminating in 00 • Causality Structure How many causal states? Interdependence between causal states • Probability Morph Σ⋆ Immediate future from causal states (Set of all finite strings on Analogous to tangent vectors alphabet Σ)
  • 106. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! Any string 1(0.1) terminating in 10 0(0.9) q2 q1 1(0.2) 0(0.8) Any string terminating in 1 1(0.7) q3 0(0.3) Any string terminating in 00 • Causality Structure How many causal states? Interdependence between causal states string: ω′ 01 1 • Probability Morph string: ω00 Σ⋆ Immediate future from causal states (Set of all 0 string: finite strings on Analogous to tangent vectors ω′ 00 alphabet Σ) (A) Transition Structure induced by state definitions
  • 107. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! Any string 1(0.1) terminating in 10 0(0.9) q2 q1 1(0.2) 0(0.8) Any string terminating in 1 1(0.7) q3 0(0.3) Any string terminating in 00 0(0.9) 1(0.1) 1(0.1) • Causality Structure 0(0.9) 1(0.2) How many causal states? (B) Symbol Interdependence between causal states 0(0.8) probabilities identical from 1(0.2) same state 0(0.8) • Probability Morph Σ⋆ Immediate future from causal states (Set of all finite strings on Analogous to tangent vectors alphabet Σ)
  • 108. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! Any string 1(0.1) terminating in 10 0(0.9) q2 q1 1(0.2) 0(0.8) Any string terminating in 1 1(0.7) q3 0(0.3) Any string terminating in 00 0(0.9) 1(0.1) 1(0.1) • Causality Structure 0(0.9) 1(0.2) How many causal states? (B) Symbol Interdependence between causal states string: 0(0.8) probabilities identical from ω′ 01 1(0.2) same state 0(0.8) 1 • Probability Morph string: Immediate future from causal states ω00 Σ⋆ (Set of all 0 string: finite strings on Analogous to tangent vectors ω′ 00 alphabet Σ) (A) Transition Structure induced by state definitions
  • 109. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 0(0.9) 1(0.1) 1(0.1) 0(0.9) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces
  • 110. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 0(0.9) 1(0.1) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces
  • 111. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 0(0.9) 1(0.1) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces
  • 112. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 0(0.9) 1(0.1) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces
  • 113. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 0(0.9) 1(0.1) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces
  • 114. PFSAs Are Encodings Of Measure Spaces · · · And Not Just Graphs! And the exact graphs are not even that important..... 1(0.1) 0(0.9) q1 q2 1(0.2) Any string 0(0.8) terminating in 1 1(0.7) q3 0(0.3) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 1(0.1) 0(0.9) 0(0.9) 1(0.1) Σ⋆ (Set of all finite strings on alphabet Σ) State splitting produces