2. Luc_Faucheux_2021
In this section
ยจ We finally look at the non-linear SDE
ยจ We will introduce the [๐ผ] calculus in order to not get confused with the factor (1/2)
ยจ We will look also at the backward and forward formalism for PDE
ยจ Maybe if we have time some examples (OU canonical process)
ยจ SDE: Stochastic Differential Equations
ยจ SIE: Stochastic Integral Equations
ยจ PDE: Partial Differential Equations
ยจ PDF: Probability Distribution Function
2
3. Luc_Faucheux_2021
In this deck - II
ยจ More importantly we will discuss at length (and maybe ad nauseam for some of you) the so
called โITO-STRATANOVITCH controversyโ
ยจ That was something that for some reason was quite popular in the 90s
ยจ Like a lot of things that were popular in the 90s, there was maybe not a good rationale for it,
and that kind of faded away
ยจ So we will use it more as an example on how to use, and make sure that we understand
stochastic calculus
3
4. Luc_Faucheux_2021
In this deck - III
ยจ If you Google โITO-STRATANOVITCH controversyโ, you can see that it is still creating a lot of
confusion out there, especially in the fields of Physics for non-homogeneous diffusion
coefficients (in the field of finance that would be for a volatility that is a function of the
stochastic underlier like equity for example)
ยจ So that would be for modeling an SDE that would look something like that:
ยจ dX(t)= a(X(t),t).dt+b(X(t),t).dW(t)
ยจ We will show, that unlike all the previous examples in the deck II, writing something like the
above is actually not well defined.
ยจ That is where the confusion comes from
ยจ Interestingly enough it also comes from the fact that people started using digital computers
to simulate diffusion process, and in a nutshell (running the risk of oversimplifying):
ยจ DIGITAL COMPUTERS LIVE IN AN ITO WORLD
ยจ ANALOG COMPUTERS LIVE IN A STRATANOVITCH WORLD
4
5. Luc_Faucheux_2021
In this deck - IV
ยจ To quote Manella:
ยจ โ The Itรด versus Stratonovich controversy, about the "correct" calculus to use for integration
of Langevin equations, was settled to general satisfaction some 30 years ago. Recently,
however, it has started to re-emerge, following the advent of new experimental techniques.โ
ยจ That was written in 2012 or so.
ยจ But a lot of people are still confused by it.
ยจ I get also confused all the time, and then I have a panic attack, then I take a couple of deep
breathes, and redo a bunch of pages of derivations to make sure that I still understand it.
ยจ The older I get the more frequent that happens.
5
8. Luc_Faucheux_2021
Finally
ยจ We are almost there, so just before we tackle that one, because the factor (1/2) are
confusing (is that coming from the middle point in STRATO, or is is coming from the second
term in a Taylor expansion?), we generalize a little the formalism
8
10. Luc_Faucheux_2021
Introducing the [๐ผ] calculus
ยจ Here is where we take a pause to avoid being confused with factors 2
ยจ Ito when defining the Ito integral of a function took the left-side
ยจ Strato took the middle point
ยจ Hence the existence of a factor (1/2) in the conversion between Ito and Strato
ยจ HOWEVER, now that we are dealing with PDE, there is another factor (1/2) that crops up a
lot (from the integration by part of the second moment ๐ฅ!)
ยจ Those 2 factors are NOT related (although in way they are, Strato chose middle point
specifically so that the rules of usual calculus would be formally conserved, so essentially he
solved for which point to use to offset the (1/2) term in Ito lemma)
ยจ So they will be related, but in the mean-time we could get confused between the two
ยจ Some authors (Gleeson, Arovas) have pointed out that it is somewhat easier to carry
derivations โin the [๐ผ] calculusโ, and then setting the value of ๐ผ, as opposed to duplicating
everything in Ito then Strato and carrying (1/2) factors
10
11. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - II
ยจ The ITO integral is defined as:
ยจ โซ
"#"$
"#"%
๐ ๐ ๐ก . ([). ๐๐(๐ก) = lim
&โ(
{โ)#*
)#&
๐(๐(๐ก))). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ The Stratonovitch integral is defined as:
ยจ โซ
"#"$
"#"%
๐ ๐ ๐ก . (โ). ๐๐(๐ก) = lim
&โ(
{โ)#*
)#&
๐ [๐(๐ก) + ๐(๐ก)+*)]/2). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ We can define the [๐ผ] integral as:
ยจ โซ
"#"$
"#"%
๐ ๐ ๐ก . ([๐ผ]). ๐๐(๐ก) =
lim
&โ(
{โ)#*
)#&
๐(๐(๐ก)) + ๐ผ. [๐(๐ก)+*) โ ๐(๐ก))]). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ ITO will be the case ๐ผ = 0
ยจ STRATO will be the case ๐ผ = 1/2
11
14. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - V
ยจ For the SDE we had the following mapping between ITO and STRATO
ยจ The ITO SDE:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ Has the same solution (is the same) as the STRATO SDE in STRATO calculus:
ยจ ๐๐ ๐ก = [๐ ๐ก, ๐ ๐ก โ
*
!
. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก ]. ๐๐ก + ๐ ๐ก, ๐ ๐ก . (โ). ๐๐
ยจ The STRATO SDE
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐
ยจ Has the same solution (is the same) as the ITO SDE in ITO calculus
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก +
*
!
. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([). ๐๐
14
15. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - VI
ยจ This now becomes:
ยจ The ITO SDE:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ Has the same solution (is the same) as the [๐ผ] SDE in [๐ผ] calculus:
ยจ ๐๐ ๐ก = [๐ ๐ก, ๐ ๐ก โ ๐ผ. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก ]. ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ The [๐ผ] SDE
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ Has the same solution (is the same) as the ITO SDE in ITO calculus
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([). ๐๐
15
16. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - VII
ยจ The ITO lemma (chain rule) reads:
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. ([). ๐๐(๐ก) +
*
!
โซ
"#"$
"#"% ,!/
,0! (๐ ๐ก ). ๐ ๐ก, ๐ ๐ก
!
๐๐ก
ยจ In the โlimitโ of small time increments, this can be written formally as the Ito lemma:
ยจ ๐ฟ๐ =
,.
,-
. ๐ฟ๐ +
*
!
.
,!/
,0! . ๐!๐ฟ๐ก
ยจ The STRATO lemma reads:
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. (โ). ๐๐(๐ก)
ยจ In the โlimitโ of small time increments, this can be written formally as the Strato lemma:
ยจ ๐ฟ๐ =
,.
,-
. โ . ๐ฟ๐
16
17. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - VIII
ยจ In the [๐ผ] calculus the [๐ผ] lemma (chain rule) now reads :
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. ([๐ผ]). ๐๐(๐ก) +
*
!
โ ๐ผ . โซ
"#"$
"#"% ,!/
,0! ๐ ๐ก . ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก
ยจ In the โlimitโ of small time increments, this can be written formally as the [๐ผ] lemma:
ยจ ๐ฟ๐ =
,.
,-
. ๐ฟ๐ +
*
!
โ ๐ผ .
,!/
,0! . ๐!. ๐ฟ๐ก
ยจ NOTE: you can convince yourselves by redoing the derivation we had on pages 55-60
ยจ This actually highlights why STRATO took the middle point ๐ผ = 1/2 , as this is the point
that cancels out the (1/2) coming from the Taylor expansion of ๐ ๐ ๐ก% from the left point.
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = lim
&โ(
โ)#*
)#&
{๐(๐(๐ก))) โ ๐(๐(๐ก)1*))}
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = lim
&โ(
โ)#*
)#&
{
,.
,-
. ([). ๐ฟ๐ +
*
!
.
,!/
,0! . ([). (๐ฟ๐)!}
17
18. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - IX
ยจ This is kind of nice, because we only have to do one derivation, and we do not get confused
where the factor (1/2) comes from in STRATO, and whether or not it is the same factor (1/2)
that comes from the integration by part of the second moment.
ยจ Factors (1/2) are very confusing, so whenever possible it is better to keep them as variable
18
19. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - X
ยจ As an illustrated example of [๐ผ] calculus, we calculate
ยจ ๐ด[๐ผ] = ๐ผ{โซ
"#"$
"#"%
๐(๐ก). ([๐ผ]). ๐๐(๐ก)} and with ๐ ๐ ๐ก = ๐(๐ก)
ยจ ๐ด[๐ผ] = ๐ผ{ lim
&โ(
โ)#*
)#&
๐(๐(๐ก)) + ๐ผ. [๐(๐ก)+*) โ ๐(๐ก))]). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ ๐ด[๐ผ] = ๐ผ{ lim
&โ(
โ)#*
)#&
(๐(๐ก)) + ๐ผ. [๐(๐ก)+*) โ ๐(๐ก))]). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ ๐ผ{๐ ๐ก . ๐(๐ก2)} = min(๐ก, ๐ก2)
ยจ ๐ผ ๐ ๐ก . ๐ ๐ก2 โ ๐ ๐ก22 = min ๐ก, ๐ก2 โ min ๐ก, ๐ก22 = 0 when ๐ก < ๐ก2 < ๐กโฒโฒ
ยจ ๐ผ ๐ ๐ก โ ๐ ๐ก2 !
= ๐ก + ๐ก2 โ 2. min ๐ก, ๐ก2 = |๐ก โ ๐กโฒ|
ยจ ๐ด[๐ผ] = ๐ผ{ lim
&โ(
โ)#*
)#&
๐ผ. [๐ก)+* โ ๐ก)]} = ๐ผ. [๐ก% โ ๐ก$]
ยจ Remember if you could integrate X? Worth revisiting within the [๐ผ] calculus
19
23. Luc_Faucheux_2021
Introducing the [๐ผ] calculus โ XIII a
ยจ No idea what the advantages of the KLIMONTOVITCH calculus since, the integral is not a
martingale like ITO, the usual rules of calculus are not respected like STRATO
ยจ But it is in the literature out there so thought I would include it
ยจ Might be useful when you do backward numerical simulations on a digital computer, but not
sure, will look into this further
23
24. Luc_Faucheux_2021
Introducing the [๐ผ] calculus - XIV
ยจ ๐ด[๐ผ] = ๐ผ{โซ
"#"$
"#"%
๐(๐ก). ([๐ผ]). ๐๐(๐ก)} and with ๐ ๐ ๐ก = ๐(๐ก)
ยจ ๐ด[๐ผ] = ๐ผ{ lim
&โ(
โ)#*
)#&
๐ผ. [๐ก)+* โ ๐ก)]} = ๐ผ. [๐ก% โ ๐ก$]
ยจ ITO ๐ผ = 0
ยจ ๐ผ{โซ
"#"$
"#"%
๐(๐ก). ([). ๐๐(๐ก)} = 0
ยจ No surprise there as the ITO integral is a MARTINGALE
ยจ STRATO ๐ผ = 1/2
ยจ ๐ผ{โซ
"#"$
"#"%
๐(๐ก). (โ). ๐๐(๐ก)} = (1/2). [๐ก% โ ๐ก$]
ยจ KLIMONTOVITCH ๐ผ = 1
ยจ ๐ผ{โซ
"#"$
"#"%
๐(๐ก). (]). ๐๐(๐ก)} = [๐ก% โ ๐ก$]
24
32. Luc_Faucheux_2021
A very quick summary
ยจ In the deck II on stochastic calculus, we reviewed the following equations in increasing order
of complexity:
ยจ ๐๐ ๐ก = ๐. ๐๐ก
ยจ ๐๐ ๐ก = ๐. ๐๐
ยจ ๐๐ ๐ก = ๐. ๐๐ก + ๐. ๐๐
ยจ ๐๐ ๐ก = ๐ ๐ก . ๐๐ก + ๐. ๐๐
ยจ ๐๐ ๐ก = ๐ ๐ก . ๐๐
ยจ ๐๐ ๐ก = ๐ ๐ก . ๐๐ก + ๐ ๐ก . ๐๐
ยจ In all cases we were justified to write โ.โ, and this was the โusualโ product that we are used
to. There was no confusion. This is because the drift and diffusion coefficients were NOT
functions of the stochastic variables
32
33. Luc_Faucheux_2021
A very quick summary - II
ยจ HOWEVER, if there is one thing that you should remember from this deck, is that you
CANNOT write something like:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ๐๐(๐ก)
ยจ The โ.โ is meaningless if you want in this formulation
ยจ As soon as the diffusion coefficient becomes inhomogeneous (depends on the position if
you thinking about a physical diffusion process), or the volatility depends on the level of the
underlier in Finance, you need to pick a convention (Ito, Strato, Klimontovitch, or anything
else) to explain what you mean by โ.โ in the term ๐ ๐ก, ๐ ๐ก . ๐๐(๐ก)
ยจ Stochastic calculus is a very strange world as we saw in deck I, and just because you are
writing something that looks familiar does not mean that you are allowed to do it and use it.
ยจ You should just go the extra mile and really write:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐
ยจ Just to know that you cannot use โ.โ in the diffusive term
33
34. Luc_Faucheux_2021
A very quick summary - III
ยจ Note that the drift term is ok
ยจ You do not need to specify:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก)
ยจ This has to do with the definition of the integral
ยจ Remember you cannot differentiate in stochastic calculus (or at least if you do you should be
very careful), always better to integrate and write SIE instead of SDE
ยจ For all the previous examples, and even for a non-homogeneous drift term, the point you
pick inside the bin when you define the integral as the limit of a sum, does not matter, tey all
converge to the same usual Riemann integral.
ยจ HOWEVER for non-homogeneous diffusion, the point you pick does matter
34
35. Luc_Faucheux_2021
A very quick summary - IV
ยจ You pick the left point -> ITO
ยจ which in the [๐ผ] calculus means ๐ผ = 0
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ = 0). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
35
36. Luc_Faucheux_2021
A very quick summary - V
ยจ You pick the middle point -> STRATANOVITCH
ยจ which in the [๐ผ] calculus means ๐ผ = 1/2
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ = 1/2). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
36
37. Luc_Faucheux_2021
A very quick summary - VI
ยจ You pick the right point -> KLIMONTOVITCH
ยจ which in the [๐ผ] calculus means ๐ผ = 1
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (๐ผ = 1). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (]). ๐๐(๐ก)
37
38. Luc_Faucheux_2021
A very quick summary - VII
ยจ ALWAYS go back to the SIE:
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. ([๐ผ]). ๐๐(๐ก) +
*
!
โ ๐ผ . โซ
"#"$
"#"% ,!.
,0! ๐ ๐ก . ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก
ยจ ONLY in the STRATNOVITCH case of ๐ผ = 1/2 does the above reduces to:
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. ([๐ผ]). ๐๐(๐ก)
ยจ Which FORMALLY looks like the usual rules of calculus
ยจ But think of this more as a coincidence than something that you can use willy nilly with
utmost confidence.
ยจ A little like Malliavin derivation operator has been designed to formally follow the usual
chain rule, it is more of a coincidence than a given, so always be super careful
38
39. Luc_Faucheux_2021
A very quick summary - VIII
ยจ Also another quick note
ยจ For sake of simplicity a lot of books or also in this deck we write:
,.
,-
ยจ What we mean really is:
ยจ ๐ is a regular function of say variable ๐ฅ
ยจ Partial derivatives
,.
,0
and
,!.
,0! are well defined quantities
ยจ We can evaluate those quantities for ๐ฅ = ๐(๐ก)
ยจ We would then write something like
,.
,0
|0#-(") and
,!.
,0! |0#-(")
ยจ But sometimes because we are lazy or want to keep the notations simple we just write:
ยจ
,.
,-
and
,!.
,-!
39
40. Luc_Faucheux_2021
A very quick summary - IX
ยจ
,.
,-
and
,!.
,-! are really not well defined quantity
ยจ Remember that we said right at the beginning that one of the defining charaterictic of a
stochastic process is that it was NOT differentiable
ยจ So really what a lot of textbooks (like Hull for example) mean (or in this deck also), is that we
are trying to not make the equations too cumbersome, so really when we write:
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,0
. ([๐ผ]). ๐๐(๐ก) +
*
!
โ ๐ผ . โซ
"#"$
"#"% ,!.
,0! ๐ ๐ก . ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก
ยจ or
ยจ ๐ ๐ ๐ก% โ ๐ ๐ ๐ก$ = โซ
"#"$
"#"% ,.
,-
. ([๐ผ]). ๐๐(๐ก) +
*
!
โ ๐ผ . โซ
"#"$
"#"% ,!.
,-! ๐ ๐ก . ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก
40
41. Luc_Faucheux_2021
A very quick summary - X
ยจ We really should be writing:
ยจ ๐ ๐ ๐ก" โ ๐ ๐ ๐ก# = โซ
$%$#
$%$" &'())
&)
|)%+($). ([๐ผ]). ๐๐(๐ก) +
,
-
โ ๐ผ . โซ
$%$#
$%$" &!'())
&)! |)%+($). ๐ ๐ก, ๐ ๐ก
-
. ๐๐ก
ยจ That is getting a little cumbersome
ยจ Baxter is one of the few textbooks that actually bothers to be fully rigorous in his notations.
ยจ So many apologies in those deck if depending on how much space I have on the line, but sometimes
I will use one of those notations or another, but what I mean really is, going from the most exact and
rigorous to the simplest in notation but least rigorous
ยจ
,.(0)
,0
|0#-(") =
,.(0#-("))
,0
=
,.(-("))
,0
=
,.(-("))
,-
=
,.
,-
ยจ Same for the other higher order of derivatives
41
42. Luc_Faucheux_2021
The McKean and Goodman derivation of the
link between SDE and PDE for the PDF, a
first taste of the Feynmann-Kac theorem
42
43. Luc_Faucheux_2021
Non-linear SDE โ backward equation
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ We are in the general case now ๐ ๐ก, ๐ ๐ก and ๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ก% โ ๐ ๐ก$ = โซ
"#"$
"#"%
๐๐ ๐ก = โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ๐๐ก) + โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ We follow here the derivation from McKean and Goodman, but might actually also re-derive
it from first principle after just to convince ourselves
ยจ We are in ITO calculus, and will use the fact that the ITO integral of a trading strategy is a
martingale.
ยจ For any function ๐ถ(๐ ๐ก , ๐ก) (hint: we are using ๐ถ notation like in a call option, so people who
have derived before the Black-Sholes equation should be in familiar territory).
ยจ The Ito lemma reads:
43
44. Luc_Faucheux_2021
Non-linear SDE โ backward equation - II
ยจ ๐ถ ๐ ๐ก% , ๐ก% โ ๐ถ ๐ ๐ก$ , ๐ก$ = โซ
"#"$
"#"% ,8
,-
. ([). ๐๐(๐ก) +
*
!
โซ
"#"$
"#"% ,!8
,-! ๐ ๐ก . ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก +
โซ
"#"$
"#"% ,8
,"
(๐ ๐ก ). ๐๐ก
ยจ In the โlimitโ of small time increments, this can be written formally as the Ito lemma:
ยจ ๐ฟ๐ถ =
,8
,-
. ๐ฟ๐ +
*
!
.
,!8
,-! . ๐ฟ๐! +
,8
,"
. ๐ฟ๐ก
ยจ Note here the factor (1/2) coming from the Taylor expansion
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ ๐๐ ๐ก ! = ๐ ๐ก, ๐ ๐ก
!
. ๐๐ก
ยจ ๐ฟ๐ถ =
,8
,-
. ๐ฟ๐ +
*
!
.
,!8
,-! . ๐!๐ฟ๐ก +
,8
,"
. ๐ฟ๐ก
44
45. Luc_Faucheux_2021
Non-linear SDE โ backward equation - III
ยจ ๐ฟ๐ถ =
,8
,-
. ๐ฟ๐ +
*
!
.
,!8
,-! . ๐!๐ฟ๐ก +
,8
,"
. ๐ฟ๐ก
ยจ ๐ฟ๐ถ =
,8
,"
+
*
!
.
,!8
,-! . ๐! +
,8
,-
. ๐ . ๐ฟ๐ก +
,8
,-
. ๐. ๐ฟ๐
ยจ ๐ถ ๐ ๐ก% , ๐ก% โ ๐ถ ๐ ๐ก$ , ๐ก$ = โซ
"#"$
"#"% ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก)
+ โซ
"#"$
"#"% ,8(- " ,")
,"
+
*
!
.
,!8(- " ,")
,-! . ๐(๐ ๐ก , ๐ก)! +
,8(- " ,")
,-
. ๐(๐ ๐ก , ๐ก) . ๐๐ก
ยจ It would be nice if the term of first order in time would disappear.
ยจ This is what the Feynman-Kac theorem is about
ยจ IF the function ๐ถ(๐ ๐ก , ๐ก) is such that:
ยจ
,8(- " ,")
,"
+
*
!
. ๐(๐ ๐ก , ๐ก)!.
,!8(- " ,")
,-! + ๐ ๐ ๐ก , ๐ก .
,8(- " ,")
,-
= 0
45
46. Luc_Faucheux_2021
Non-linear SDE โ backward equation - IV
ยจ Then:
ยจ ๐ถ ๐ ๐ก% , ๐ก% โ ๐ถ ๐ ๐ก$ , ๐ก$ = โซ
"#"$
"#"% ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก)
ยจ Fixing ๐ก% = ๐ maturity of the option (boundary condition)
ยจ And the conditional expectation:
ยจ ๐ผ{๐ถ(๐ ๐ก , ๐ก)|๐ ๐ก$ = ๐$}
ยจ ๐ผ ๐ถ ๐ ๐ก% , ๐ก% ๐ ๐ก$ = ๐$ = ๐ผ ๐ถ ๐ ๐ก$ , ๐ก$ ๐ ๐ก$ = ๐$ +
๐ผ โซ
"#"$
"#"% ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก) ๐ ๐ก$ = ๐$
ยจ ๐ผ ๐ถ ๐ ๐ก$ , ๐ก$ ๐ ๐ก$ = ๐$ = ๐ถ ๐ ๐ก$ , ๐ก$
ยจ ๐ผ โซ
"#"$
"#"% ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก) ๐ ๐ก$ = ๐$ = 0
ยจ because this is an ITO integral (note that this would NOT be the case in STRATO, so here it
actually pays to work in ITO)
46
47. Luc_Faucheux_2021
Non-linear SDE โ backward equation - V
ยจ ๐ถ ๐ ๐ก$ , ๐ก$ = ๐ผ ๐ถ ๐ ๐ก% , ๐ก% ๐ ๐ก$ = ๐$
ยจ This is essentially the Feynman-Kac formula
ยจ IF ๐ถ(๐ฅ, ๐ก) follows the BACKWARD Kolmogorov (FP) equation:
ยจ
,8(0,")
,"
+
*
!
. ๐(๐ฅ, ๐ก)!.
,!8(0,")
,0! + ๐ ๐ฅ, ๐ก .
,8(0,")
,0
= 0
ยจ Then ๐ถ(๐ฅ, ๐ก) can be written as a conditional expectation:
ยจ ๐ถ ๐ฅ, ๐ก = ๐ผ ๐ถ ๐ ๐ก% , ๐ก% ๐ ๐ก = ๐ฅ
ยจ Under the probability measure such that ๐ ๐ก is an ITO process with the ITO SDE:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ ๐๐ is a Wiener process (Brownian motion) under that probability measure, and the initial
condition is ๐ ๐ก = ๐ฅ
47
48. Luc_Faucheux_2021
Non-linear SDE โ backward equation - VI
ยจ Note that it is called BACKWARD because it concerns the expectation of something that is
fixed in the future at time ๐ก% = ๐ (Boundary condition)
ยจ Just to be in familiar territory, if the boundary condition is a call payoff
ยจ ๐ถ ๐ ๐ก% , ๐ก% = ๐ถ ๐ ๐ , ๐ = ๐๐ด๐(๐ ๐ โ ๐พ, 0)
ยจ ๐ถ ๐ฅ, ๐ก = ๐ผ ๐๐ด๐(๐ ๐ โ ๐พ, 0) ๐ ๐ก = ๐ฅ
ยจ
,8(0,")
,"
+
*
!
. ๐(๐ฅ, ๐ก)!.
,!8(0,")
,0! + ๐ ๐ฅ, ๐ก .
,8(0,")
,0
= 0
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ From the deck on numeraire, using the Money Market account:
ยจ ๐ ๐ก, ๐ ๐ก = ๐๐
ยจ ๐ ๐ก, ๐ ๐ก = ๐๐
ยจ ๐๐ ๐ก = ๐๐. ๐๐ก + ๐๐. ([). ๐๐
48
49. Luc_Faucheux_2021
Non-linear SDE โ backward equation - VII
ยจ
,8(0,")
,"
+
*
!
. ๐(๐ฅ, ๐ก)!.
,!8(0,")
,0! + ๐ ๐ฅ, ๐ก .
,8(0,")
,0
= 0
ยจ
,8(:,")
,"
+
*
!
. (๐๐)!.
,!8(:,")
,:! + ๐๐.
,8(:,")
,:
= 0
ยจ This is exactly the Black-Sholes equation for ๐ถ ๐, ๐ก = ๐ถ5(๐, ๐ก)/๐1;(<1")
ยจ Backward equations are for conditional expectations (we know the final value, we want to
evaluate the value of a derivative or a claim now)
ยจ Forward equations like the one we have been working on for the PDF tend to be for
probability distributions (we know the starting point, usually a Dirac peak, and we look at
the evolution in time)
ยจ Note that in the BACKWARD equation, the terms ๐(๐ฅ, ๐ก) and ๐(๐ฅ, ๐ก) are OUTSIDE the partial
derivatives (because that came from using Ito lemma)
ยจ Note that in the FORWARD equation, the terms will be INSIDE
ยจ Note that the PDF will follow BOTH the backward and forward (PDF is expectation of a Delta
peak payoff, following Dupire, we will do it again)
49
50. Luc_Faucheux_2021
Non-linear SDE โ forward equation -
ยจ OK, so we still do not know what equation does the PDF follow.
ยจ We almost there
ยจ ๐ถ ๐ ๐ก% , ๐ก% โ ๐ถ ๐ ๐ก$ , ๐ก$ = โซ
"#"$
"#"% ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก)
+ โซ
"#"$
"#"% ,8(- " ,")
,"
+
*
!
.
,!8(- " ,")
,-! . ๐(๐ ๐ก , ๐ก)! +
,8(- " ,")
,-
. ๐(๐ ๐ก , ๐ก) . ๐๐ก
ยจ Letโs not assume that the term in time vanishes
ยจ Letโs actually assume that ๐ถ ๐ ๐ก , ๐ก can be ANY function, and in particular we can choose
ยจ ๐ถ ๐ ๐ก = โ , ๐ก = โ = 0
ยจ ๐ถ ๐ ๐ก = ๐ก$ , ๐ก = ๐ก$ = 0
ยจ 0 = โซ
"#".
"#( ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก)
+ โซ
"#".
"#( ,8(- " ,")
,"
+
*
!
.
,!8(- " ,")
,-! . ๐(๐ ๐ก , ๐ก)! +
,8(- " ,")
,-
. ๐(๐ ๐ก , ๐ก) . ๐๐ก
50
51. Luc_Faucheux_2021
Non-linear SDE โ forward equation - II
ยจ Let us look again at the conditional expectation, but this time we will explicitly write it as an
integral over the possible outcomes
ยจ ๐ผ ๐ต ๐ ๐ก , ๐ก ๐ ๐ก$ = ๐$ = โซ
0#1(
0#+(
๐ต ๐ฅ, ๐ก . ๐(๐ฅ, ๐ก|๐$, ๐ก$) . ๐๐ฅ
ยจ We are obviously after what kind of equation could ๐(๐ฅ, ๐ก|๐$, ๐ก$) verify
ยจ Now again, because we are in ITO calculus:
ยจ ๐ผ โซ
"#".
"#< ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก) ๐ ๐ก$ = ๐$ = 0
ยจ In particular:
ยจ ๐ผ โซ
"#".
"#+( ,8
,-
. ๐ ๐ ๐ก , ๐ก . ([). ๐๐(๐ก) ๐ ๐ก$ = ๐$ = 0
51
52. Luc_Faucheux_2021
Non-linear SDE โ forward equation - III
ยจ 0 =
๐ผ โซ
"#".
"#( ,8(- " ,")
,"
+
*
!
.
,!8(- " ,")
,-! . ๐(๐ ๐ก , ๐ก)! +
,8(- " ,")
,-
. ๐(๐ ๐ก , ๐ก) . ๐๐ก ๐ ๐ก$ = ๐$
ยจ 0 = ๐ผ โซ
"#".
"#( ,8
,"
+
*
!
. ๐(๐ ๐ก , ๐ก)!.
,!8
,-! + ๐ ๐ ๐ก , ๐ก .
,8
,-
. ๐๐ก ๐ ๐ก$ = ๐$
ยจ 0 = โซ
"#".
"#(
โซ
0#1(
0#+( ,8
,"
+
*
!
. ๐(๐ฅ, ๐ก)!.
,!8
,0! + ๐ ๐ฅ, ๐ก .
,8
,0
. ๐(๐ฅ, ๐ก|๐$, ๐ก$) . ๐๐ฅ. ๐๐ก
ยจ Remember that this is true for ANY function ๐ถ(๐ ๐ก , ๐ก) that we can choose arbitrarily so
that the boundary values, as well as the derivatives, vanishes
ยจ We now integrate by part the above integral (we are now in the world of regular calculus, so
the usual rules of calculus apply, none of this ITO / STRATO issue)
ยจ 0 = โซ
"#".
"#(
โซ
0#1(
0#+(
โ๐ถ
,=
,"
+ ๐ถ.
*
!
.
,!
,0! [๐(๐ฅ, ๐ก)!. ๐] โ ๐ถ.
,
,0
[๐ ๐ฅ, ๐ก . ๐] . ๐๐ฅ. ๐๐ก
52
53. Luc_Faucheux_2021
Non-linear SDE โ forward equation - IV
ยจ 0 = โซ
"#".
"#(
โซ
0#1(
0#+(
โ๐ถ
,=
,"
+ ๐ถ.
*
!
.
,!
,0! [๐(๐ฅ, ๐ก)!. ๐] โ ๐ถ.
,
,0
[๐ ๐ฅ, ๐ก . ๐] . ๐๐ฅ. ๐๐ก
ยจ This is true for any function ๐ถ(๐ฅ, ๐ก)
ยจ And so:
ยจ 0 = โ
,=
,"
+
*
!
.
,!
,0! [๐(๐ฅ, ๐ก)!. ๐] โ
,
,0
[๐ ๐ฅ, ๐ก . ๐]
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ +
*
!
.
,!
,0! [๐(๐ฅ, ๐ก)!. ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,0
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ This is the FORWARD Kolmogorov (FP) equation, because we know the initial condition and
we are looking at an advection/diffusion in time
ยจ Note that in the FORWARD equation the terms ๐ ๐ ๐ก , ๐ก and ๐ ๐ ๐ก , ๐ก are INSIDE the
partial derivatives (because that came from integrating by parts the ITO lemma)
53
55. Luc_Faucheux_2021
Non-linear SDE โ Summary
ยจ As we saw with the Dupire approach, what is interesting is that the PDF follows BOTH a
FORWARD and a BACKWARD equation:
ยจ In short in ITO: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,-
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ ] +
*
!
.
,!
,-! [. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ This is the FORWARD equation: given the starting point (๐$, ๐ก$), the conditional probability
๐(๐ฅ, ๐ก|๐$, ๐ก$) evolves forward in time
ยจ
,=(0,"|-.,".)
,".
= โ๐ ๐$, ๐ก$
,
,-.
๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
*
!
. ๐(๐$, ๐ก$)! ,!
,-.
! ๐(๐ฅ, ๐ก|๐$, ๐ก$)
ยจ This is the BACKWARD equation: given the end point (๐ฅ, ๐ก), the conditional probability can
also be expressed as an expectation (of the Delta peak), and will thus follow a BACKWARD FP
diffusing backward in time
55
56. Luc_Faucheux_2021
Non-linear SDE โ Summary II
ยจ ๐(๐%, ๐ก%|๐$, ๐ก$) = โซ
0#1(
0#+(
๐(๐ฅ, ๐ก%|๐$, ๐ก$). ๐ฟ(๐ฅ โ ๐%). ๐๐ฅ
ยจ This is fairly obvious, and recast ๐(๐%, ๐ก%|๐$, ๐ก$) as an expectation of a terminal payoff,
which is the Delta peak ๐ฟ(๐ฅ โ ๐%), with the probability measure associated to
๐(๐%, ๐ก%|๐$, ๐ก$) .
ยจ Just like the call option was the expectation of the terminal payoff ๐๐ด๐(๐2 โ ๐พ, 0)
ยจ So the idea is that we can apply ITO lemma to ๐(๐%, ๐ก%|๐$, ๐ก$) (this time on the โstartingโ
variables (๐$, ๐ก$)
ยจ This s exactly what we just did, but because it can be confusing since in some ways, the
conditional probability is โtwo thingsโ: it is the conditional probability that we use in order
to calculate the expectation (integral) of ANY derivative function, and hence will follow the
FORWARD equation, it is ALSO the expectation of a claim (mainly in an evident manner the
Delta peak), and so will follow the BACKWARD equation
ยจ Note: only in ITO calculus can we zero out the integral as a martingale, otherwise we would
have to carry those terms in the derivation
56
58. Luc_Faucheux_2021
Why did we go through all this trouble?
ยจ Letโs recap:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐ in ITO calculus
ยจ We have shown that in that case the PDF follows a FORWARD ITO Kolmogorov (FP)
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,0
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ < โ๐ > = ๐ธ โ๐ =< ๐ฅ >"+โ" โ< ๐ฅ >"= ๐ ๐ ๐ก , ๐ก . โ๐ก (advection term)
ยจ < โ๐!> = ๐ธ โ๐! =< (๐ฅโ< ๐ฅ >"+โ")!>"+โ"= ๐(๐ ๐ก , ๐ก)!. โ๐ก (diffusion term)
58
59. Luc_Faucheux_2021
Why did we go through all this trouble? - II
ยจ We ALSO know that going between ITO and [๐ผ]:
ยจ The ITO SDE:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ Has the same solution (is the same) as the [๐ผ] SDE in [๐ผ] calculus:
ยจ ๐๐ ๐ก = [๐ ๐ก, ๐ ๐ก โ ๐ผ. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก ]. ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ The [๐ผ] SDE
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ Has the same solution (is the same) as the ITO SDE in ITO calculus
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([). ๐๐
59
60. Luc_Faucheux_2021
Why did we go through all this trouble? - III
ยจ And so, if we start with an [๐ผ] SDE: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ It has the same solution (is the same) as the ITO SDE in ITO calculus
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ Which will then follow the ITO FORWARD Kolmogorov (FP):
ยจ
,@(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,0
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ With:
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ ๐ก , ๐ก = A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
60
61. Luc_Faucheux_2021
Why did we go through all this trouble? โ III - a
ยจ < โ๐ > = ๐ธ โ๐ =< ๐ฅ >"+โ" โ< ๐ฅ >"= ๐ ๐ ๐ก , ๐ก . โ๐ก (advection term)
ยจ < โ๐!> = ๐ธ โ๐! =< (๐ฅโ< ๐ฅ >"+โ")!>"+โ"= ๐(๐ ๐ก , ๐ก)!. โ๐ก (diffusion term)
ยจ With:
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ ๐ก , ๐ก = A
๐ ๐ก, ๐ ๐ก
ยจ Remember that we started from : ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ So: < โ๐ > = ๐ ๐ ๐ก , ๐ก . โ๐ก = {@
๐ ๐ก, ๐ ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก }. โ๐ก
ยจ < โ๐ > = @
๐ ๐ก, ๐ ๐ก . โ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . โ๐ก
ยจ < โ๐ > =< @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . [๐ผ] . ๐๐ >
61
62. Luc_Faucheux_2021
Why did we go through all this trouble? โ III - b
ยจ < โ๐ > = @
๐ ๐ก, ๐ ๐ก . โ๐ก + ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . โ๐ก
ยจ < โ๐ > = < @
๐ ๐ก, ๐ ๐ก . ๐๐ก > + < A
๐ ๐ก, ๐ ๐ก . [๐ผ] . ๐๐ >
ยจ And
ยจ < @
๐ ๐ก, ๐ ๐ก . ๐๐ก > = @
๐ ๐ก, ๐ ๐ก . โ๐ก
ยจ So we have:
ยจ < A
๐ ๐ก, ๐ ๐ก . [๐ผ] . ๐๐ > = ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . โ๐ก
ยจ In particular:
ยจ ITO : < A
๐ ๐ก, ๐ ๐ก . [ . ๐๐ > = 0
ยจ STRATO: < A
๐ ๐ก, ๐ ๐ก . โ . ๐๐ > = [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . โ๐ก
62
63. Luc_Faucheux_2021
Why did we go through all this trouble? โ III - c
ยจ ITO : < A
๐ ๐ก, ๐ ๐ก . [ . ๐๐ > = 0
ยจ One can also go back to the definition of the ITO integral (because remember it is never a
SDE, it is ALWAYS and SIE) , but essentially the convention [ of taking the value โbefore the
jumpโ, implies that the ITO integral is a martingale of expected value 0
ยจ STRATO: < A
๐ ๐ก, ๐ ๐ก . โ . ๐๐ > = [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . โ๐ก
ยจ Again we can explicitly derive this from the integral, but the convention โ implies taking
the value โin the middle of the jumpโ, hence the STRATO integral CANNOT be a martingale
and has a non zero expected value.
ยจ We did this derivation when we looking at the correspondence between the ITO and
STRATO.
ยจ It has been a while so might take a few pages here to redo it.
63
64. Luc_Faucheux_2021
Why did we go through all this trouble? โ III - d
ยจ So essentially here is the deal:
ยจ A PDE is well defined, it is just a Partial Differential Equation where the
usual/Leibniz/regular/Leibniz calculus applies
ยจ A SDE is NOT well defined, unless you specify which ๐ผ-calculus you use (essentially which
point within the bin you take when defining the integral as a limit of sum)
ยจ Left point of the bin -> ITO , ๐ผ = 0
ยจ Middle point of the bin -> STRATO, ๐ผ = 1/2
ยจ Right point of the bin -> KLIMONT, ๐ผ = 1
ยจ Letโs summarize again before we delve more into the reason for the controversy
64
67. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - a
ยจ
,=
,"
= โ
,
,0
๐๐ โ
,
,0
(๐ท๐)
ยจ Physicists like a diffusion equation for particles that looks like:
ยจ
,=
,"
= โ
,
,0
๐ ๐๐๐๐กโ๐๐๐
ยจ Because when integrating over the x-axis, and assuming some reasonable (read 0) value for
the distribution function at infinity, the integral of the density is invariant with time
(conservation of matter), or:
ยจ
,
,"
โซ
1(
+(
๐ ๐ฅ, ๐ก . ๐๐ฅ = 0
ยจ That is a good thing.
ยจ Physicists also like something called โsteady-state solutionโ, meaning at equilibrium (think
very long time),
,=
,"
= 0
67
68. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - b
ยจ
,=
,"
= 0 leads to:
ยจ โ
,
,0
๐๐ โ
,
,0
(๐ท๐)
ยจ For simplicity of argument, in the case of no external forcing (๐ = 0)
ยจ
,
,0
โ
,
,0
(๐ท๐) = 0
ยจ So the solution of that is:
ยจ
,
,0
๐ท๐ = ๐๐ก๐
ยจ Again for things to no blow up at infinity, that means:
,
,0
๐ท๐ = ๐๐ก๐ = 0
ยจ That means that ๐ท๐ = ๐๐ก๐ with the normalization condition of โซ
1(
+(
๐ ๐ฅ, ๐ก . ๐๐ฅ = 1 usually
68
69. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - c
ยจ ๐ท๐ = ๐๐ก๐ with the normalization condition of โซ
1(
+(
๐ ๐ฅ, ๐ก . ๐๐ฅ = 1, which allows to
calculate the value of that constant.
ยจ And that is when physicists lost their wits in the 80s/90s, because the diffusion is a dynamic
effect, and should not impact the equilibrium solution.
ยจ The equilibrium solution is given by the laws of thermodynamics, and the equilibrium
density should not depend on something like ๐ท
ยจ Essentially the argument was that, if you give it enough time, the equilibrium distribution
will be uniform, and should not depend on how fast or slow you diffuse in some regions
ยจ That is a first flavor of the controversy that arose when we started to look in earnest in non-
homogeneous diffusion processes
ยจ Remember that it was not that long ago on the scale of the planet, Bachelier / Langevin /
Einstein were just over a century ago now, Ito/Doelin in the 50s, so all in all fairly new
69
70. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - II
ยจ [๐ผ] SDE is: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ This implies that the PDF follows the FORWARD [๐ผ] Kolmogorov PDE
ยจ
&/(),$|+",$")
&$
= โ
&
&)
{1
๐ ๐ฅ, ๐ก + ๐ผ. 4
๐ ๐ฅ, ๐ก .
&
&)
4
๐ ๐ฅ, ๐ก }. ๐ ๐ฅ, ๐ก ๐#, ๐ก# โ
&
&)
[
,
-
. [4
๐(๐ฅ, ๐ก)-
. ๐(๐ฅ, ๐ก|๐#, ๐ก#)]
ยจ
,=
,"
= โ
,
,0
@
๐๐ + ๐ผ. A
๐.
,
,0
A
๐. ๐ โ
,
,0
[
*
!
. [A
๐! . ๐]
ยจ
,=
,"
= โ
,
,0
@
๐๐ + ๐ผ. A
๐.
,
,0
A
๐. ๐ โ
,
,0
B
%!=
!
= โ
,
,0
@
๐๐ +
,
,0
๐ผ. A
๐.
,
,-
A
๐. ๐ +
*
!
,!
,0! [
B
%!=
!
]
ยจ
,=
,"
= โ
,
,0
@
๐๐ + ๐ผ. A
๐.
,B
%
,0
. ๐ โ A
๐.
,B
%
,0
. ๐ โ
*
!
. A
๐!.
,
,0
๐
ยจ
,=
,"
= โ
,
,0
๐๐ + ๐ผ.
,C
A
,0
. ๐ โ
,C
A
,0
. ๐ โ b
๐ท.
,
,0
๐
70
73. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - IIIb
ยจ That is right there in essence the crux of the matter:
ยจ
,@
,"
= โ
,
,0
@
๐๐ โ
*
!
.
,C
A
,0
. ๐ โ b
๐ท.
,
,0
๐ = โ
,
,0
@
๐๐ +
*
!
.
,C
A
,0
. ๐ โ
,
,0
(b
๐ท๐)
ยจ Because of course:
ยจ
,
,0
b
๐ท๐ = b
๐ท.
,
,0
๐ + ๐.
,
,0
b
๐ท
ยจ So you can see how that, combined with the {
*
!
.
,C
A
,0
. ๐} term, can easily get people confused,
because in a way you are โmixingโ the drift term and the diffusion term.
ยจ In some ways you should not do that, what is drift is drift, and what is diffusion is diffusion
ยจ It is clear when you write the SDE/SIE, because the drift term is in ๐๐ก, and the diffusive term
is in ๐๐, assuming that you have specified in which calculus you operate
ยจ But when writing the PDE, it looks like you can willy nilly mix the two terms.
73
74. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - IV
ยจ ITO SDE is: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ This implies that the PDF follows the FORWARD ITO Kolmogorov PDE
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,0
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ The PDF ALSO follows the BACKWARD ITO Kolmogorov PDE:
ยจ
,=(0,"|-.,".)
,".
= โ๐ ๐$, ๐ก$
,
,-.
๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
*
!
. ๐(๐$, ๐ก$)! ,!
,-.
! ๐(๐ฅ, ๐ก|๐$, ๐ก$)
ยจ
,=
,".
= โ๐
,=
,-.
โ
*
!
. ๐! ,!=
,-.
!
ยจ
,=
,".
= โ๐
,=
,-.
โ ๐ท
,!=
,-.
!
ยจ Where I have explicitly kept the notation ๐ก$ and ๐$ to indicate the fact that this is a
BACKWARD PDE (expectation of a payoff at maturity)
74
75. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - V
ยจ [๐ผ] SDE is: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ This implies that the PDF follows the FORWARD [๐ผ] Kolmogorov PDE
ยจ
&/(),$|+",$")
&$
= โ
&
&)
{1
๐ ๐ฅ, ๐ก + ๐ผ. 4
๐ ๐ฅ, ๐ก .
&
&)
4
๐ ๐ฅ, ๐ก }. ๐ ๐ฅ, ๐ก ๐#, ๐ก# โ
&
&)
[
,
-
. [4
๐(๐ฅ, ๐ก)-
. ๐(๐ฅ, ๐ก|๐#, ๐ก#)]
ยจ The PDF ALSO follows the BACKWARD ITO Kolmogorov PDE:
ยจ
!"($,&|(!,&!)
!&!
= โ G
๐ ๐ก*, ๐ ๐ก* + ๐ผ. B
๐ ๐ก*, ๐ ๐ก* .
!
!(!
B
๐ ๐ก*, ๐ ๐ก*
!
!(!
๐ ๐ฅ, ๐ก ๐*, ๐ก* โ
+
,
. ๐(๐*, ๐ก*), !"
!(!
" ๐(๐ฅ, ๐ก|๐*, ๐ก*)
ยจ
,=
,".
= โ @
๐ + ๐ผ. A
๐
,
,-.
A
๐
,
,-.
๐ โ
*
!
. ๐! ,!
,-.
! ๐
ยจ
,=
,".
= โ @
๐ + ๐ผ.
,C
A
,-.
,=
,-.
โ b
๐ท
,!=
,-.
!
75
76. Luc_Faucheux_2021
We need a nice summary to avoid any confusion - VI
ยจ [๐ผ = 1/2] STRATO SDE is: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . ([๐ผ]). ๐๐
ยจ This implies that the PDF follows the FORWARD STRATO Kolmogorov PDE
ยจ
&/(),$|+",$")
&$
= โ
&
&)
{1
๐ ๐ฅ, ๐ก +
,
-
. 4
๐ ๐ฅ, ๐ก .
&
&)
4
๐ ๐ฅ, ๐ก }. ๐ ๐ฅ, ๐ก ๐#, ๐ก# โ
&
&)
[
,
-
. [4
๐(๐ฅ, ๐ก)-
. ๐(๐ฅ, ๐ก|๐#, ๐ก#)]
ยจ The PDF ALSO follows the BACKWARD ITO Kolmogorov PDE:
ยจ
!"($,&|(!,&!)
!&!
= โ G
๐ ๐ก*, ๐ ๐ก* +
+
,
. B
๐ ๐ก*, ๐ ๐ก* .
!
!(!
B
๐ ๐ก*, ๐ ๐ก*
!
!(!
๐ ๐ฅ, ๐ก ๐*, ๐ก* โ
+
,
. ๐(๐*, ๐ก*), !"
!(!
" ๐(๐ฅ, ๐ก|๐*, ๐ก*)
ยจ
,=
,".
= โ @
๐ +
*
!
. A
๐
,
,-.
A
๐
,
,-.
๐ โ
*
!
. A
๐! ,!
,-.
! ๐
ยจ
,=
,".
= โ @
๐ +
*
!
.
,C
A
,-.
,=
,-.
โ b
๐ท
,!=
,-.
!
76
77. Luc_Faucheux_2021
We need a nice summary to avoid any confusion โ VI-a
ยจ Note that we can also write as:
ยจ
,=
,".
= โ @
๐ +
*
!
.
,C
A
,-.
,=
,-.
โ b
๐ท
,!=
,-.
!
ยจ
,=
,".
= โ @
๐ +
*
!
. A
๐
,
,-.
A
๐
,
,-.
๐ โ
*
!
. A
๐! ,!
,-.
! ๐
ยจ And since:
,
,-.
A
๐.
,=
,-.
=
,B
%
,-.
.
,=
,-.
+ A
๐.
,!=
,-.
!
ยจ
,=
,".
= โ@
๐.
,=
,-.
โ
*
!
. A
๐
,
,-.
[A
๐.
,=
,-.
]
ยจ
,=(0,"|-.,".)
,"
= โ@
๐ ๐ก$, ๐ ๐ก$ .
,=(0,"|-.,".)
,-.
โ
*
!
. A
๐ ๐ก$, ๐ ๐ก$
,
,-.
A
๐ ๐ก$, ๐ ๐ก$ .
,=(0,"|-.,".)
,-.
77
80. Luc_Faucheux_2021
We need a nice summary to avoid any confusion โ IX
ยจ Note that one of the characteristic of the STRATO equations is that they are much more
symmetrical forward and backward (physicist like that because it does not break the time
symmetry as much as ITO)
ยจ In Ito, there is a clear distinction: the diffusion appears INSIDE the derivative for the
FORWARD equation, and OUTSIDE for the BACKWARD
ยจ In STRATO, it is split more equally
ยจ STRATO FORWARD
ยจ
,=
,"
= โ
,
,0
@
๐๐ +
,
,0
[ b
๐ท
,
,-
{ b
๐ท. ๐}]
ยจ STRATO BACKWARD
ยจ
,=
,"
= โ@
๐.
,=
,-.
โ b
๐ท
,
,-.
b
๐ท.
,=
,-.
80
81. Luc_Faucheux_2021
We need a nice summary to avoid any confusion โ X
ยจ Note that we in doubt it is also safe to recast the STRATO as an ITO using the rules of
transformation:
ยจ If we start from a STRATO SDE: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐
ยจ The corresponding ITO SDE is: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ With:
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ ๐ก , ๐ก = A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + [
*
!
]. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
81
82. Luc_Faucheux_2021
We need a nice summary to avoid any confusion โ XI
ยจ And conversely:
ยจ If we start from a ITO SDE: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐
ยจ The corresponding STRATO SDE is: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐
ยจ With:
ยจ @
๐ ๐ก, ๐ ๐ก = ๐ ๐ ๐ก , ๐ก โ [
*
!
]. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
ยจ A
๐ ๐ก, ๐ ๐ก = ๐ ๐ ๐ก , ๐ก
ยจ @
๐ ๐ก, ๐ ๐ก = ๐ ๐ ๐ก , ๐ก โ [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
82
84. Luc_Faucheux_2021
The crux of the matter
ยจ The main reason for the confusion is that people write something that looks like an ODE and
assume that because we are using the same usual notations, a lot of the baggage we
accumulated on regular calculus (Taylor expansion, Leibniz rule, chain rule,..) will also carry
over.
ยจ I think an easy rule to remember is that writing an SDE like:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ๐๐(๐ก)
ยจ Makes NO sense and is not well defined.
84
86. Luc_Faucheux_2021
The crux of the matter - II
ยจ That way it is obvious that we are not writing the same thing:
ยจ ITO
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ๐ผ = 0 . ๐๐(๐ก)
ยจ STRATONOVITCH
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ๐ผ = 1/2 . ๐๐(๐ก)
86
87. Luc_Faucheux_2021
The crux of the matter - III
ยจ Writing it like this makes it obvious that we are NOT writing the same SDE, we are writing
two very different processes
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ IN FACT, if we want the two different equations to represent the same process, then
obviously the coefficients cannot be the same. It turns out that we are quite lucky in the
sense that there is a simple relations between the two. We are maybe too lucky because
the fact that this relationship is simple sort of pushed people into believing that the two
representations (Ito and Strato) are very close to each other, if not similar. Maybe if would
have been easier if there had been not simple relationship between the coefficients, or a
very complicated one
87
88. Luc_Faucheux_2021
The crux of the matter โ III a
ยจ Say it another way
ยจ Stochastic (Brownian) calculus is very different from regular (Newtonian/Leibniz) calculus
ยจ ITO calculus is one possible definition of stochastic calculus
ยจ STRATO calculus is one possible definition of stochastic calculus
ยจ ITO calculus is very different from STRATO calculus
ยจ However there is a relationship between the ITO integral and the STRATO integral
ยจ ALWAYS go back to the integral form when dealing with stochastic calculus
ยจ ALWAYS use an SIE if possible as opposed to an SDE
88
89. Luc_Faucheux_2021
The crux of the matter - IV
ยจ So it is actually easier in order not to get confused to add the โtildeโ on top of the
coefficients when dealing with Strato
ยจ STRATO SDE: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ ITO SDE: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ Just to emphasize the point that we are not writing the same equation and that those are
two different processes
89
90. Luc_Faucheux_2021
The crux of the matter - V
ยจ If we start from a STRATO SDE: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ The corresponding ITO SDE is: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ With:
ยจ ๐ ๐ ๐ก , ๐ก = @
๐ ๐ก, ๐ ๐ก + [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ก, ๐ ๐ก = A
๐ ๐ก, ๐ ๐ก
ยจ ๐ ๐ก, ๐ ๐ก = @
๐ ๐ก, ๐ ๐ก + [
*
!
]. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
ยจ In that case, the two different SDE will describe the same stochastic process
90
91. Luc_Faucheux_2021
The crux of the matter - VI
ยจ And conversely:
ยจ If we start from a ITO SDE: ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ The corresponding STRATO SDE is: ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ With:
ยจ @
๐ ๐ก, ๐ ๐ก = ๐ ๐ก, ๐ ๐ก โ [
*
!
]. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
ยจ A
๐ ๐ก, ๐ ๐ก = ๐ ๐ก, ๐ ๐ก
ยจ @
๐ ๐ก, ๐ ๐ก = ๐ ๐ก, ๐ ๐ก โ [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก
ยจ In that case, the two different SDE will describe the same stochastic process
91
92. Luc_Faucheux_2021
The crux of the matter - VII
ยจ Some note on notation:
ยจ To be even more rigorous, we should not even write something like this:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ We should say that there is an analytical function ๐ ๐ก, ๐ฅ and ๐ ๐ก, ๐ฅ , and that the process is:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ฅ = ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ฅ = ๐ ๐ก . ([). ๐๐(๐ก)
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ฅ = ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ฅ = ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ And so really we should not write:
ยจ @
๐ ๐ก, ๐ ๐ก = ๐ ๐ก, ๐ ๐ก โ [
*
!
]. ๐ ๐ก, ๐ ๐ก .
,
,-
๐ ๐ก, ๐ ๐ก
ยจ But:
ยจ @
๐ ๐ก, ๐ฅ = ๐ ๐ก, ๐ฅ โ
*
!
. ๐ ๐ก, ๐ฅ .
,
,0
๐ ๐ก, ๐ฅ
92
93. Luc_Faucheux_2021
The crux of the matter - VIII
ยจ In fact, whenever the notation doe not get too cumbersome, we should not even write and
SDE but and SIE
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ ๐ ๐ก% โ ๐ ๐ก$ = โซ
"#"$
"#"%
๐๐ ๐ก = โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ๐๐ก) + โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ Knowing that all terms are well defined with the added :
ยจ โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก) = lim
&โ(
{โ)#*
)#&
๐(๐ก), ๐(๐ก))). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ Where the mesh or partition {๐ก)} is not completely pathological
ยจ Also for STRATO:
ยจ โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก) = lim
&โ(
{โ)#*
)#&
๐ ๐ก),
[-("2)+-("234)]
!
. [๐(๐ก)+*) โ ๐(๐ก))]}
93
94. Luc_Faucheux_2021
The crux of the matter - IX
ยจ So in the end, this is the only way to write a process that leaves no room for error:
ยจ When writing something like this, we have no idea what it means
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ๐๐(๐ก)
ยจ Really we should write:
ยจ ๐ ๐ก% โ ๐ ๐ก$ = โซ
"#"$
"#"%
๐๐ ๐ก = โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . ๐๐ก) + โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก)
ยจ โซ
"#"$
"#"%
๐ ๐ก, ๐ ๐ก . (๐ผ). ๐๐(๐ก) = lim
&โ(
{โ)#*
)#&
๐(๐ก), ๐R[๐ก), ๐ก)+*]). [๐(๐ก)+*) โ ๐(๐ก))]}
ยจ Where the function ๐R[๐ก), ๐ก)+*] indicates where in the partition [๐ก), ๐ก)+*] we should take
the value of the stochastic process ๐ ๐ก
94
95. Luc_Faucheux_2021
The crux of the matter - X
ยจ If ITO, ๐ผ = 0, and ๐R ๐ก), ๐ก)+* = ๐(๐ก))
ยจ If STRATO, ๐ผ = 1/2, and ๐R ๐ก), ๐ก)+* =
[-("2)+-("234)]
!
ยจ If anything in between, ๐R ๐ก), ๐ก)+* = ๐(๐ก)) + ๐ผ. [ ๐(๐ก)+* โ ๐(๐ก))]
ยจ The nice thing about ITO is that the integral is a martingale, and that the integral also flows
the isometry rule.
ยจ The price to pay is that the usual rules of calculus (chain rule, Leibniz, Taylor expansion,
integration by part,..) are pretty much out of the window
ยจ The nice thing about STRATO is that the usual rules of calculus carry over FORMALLY in the
same manner (careful, they are not the same, it is a formal relation), so that is nice
ยจ However the integral is not a martingale and does not follow the isometry rule
95
97. Luc_Faucheux_2021
A brief history
ยจ Because :
ยจ 1) it is a nice way to apply our knowledge of stochastic calculus
ยจ 2) you encounter it in textbooks
ยจ 3) it is still super confusing at times, I know I am still confused
ยจ It pays to explain why that came about.
ยจ But first of all, letโs go one more time over the fact that actually there is NO controversy
ยจ By the way, if you meet anyone who tells you that they understand Ito versus Stratanovitch
perfectly, that person is either a liar or Van Kampen
97
99. Luc_Faucheux_2021
There is no controversy
ยจ In order to make things less confusing that they could be, we are going to be a little literal on
the notation
ยจ Essentially,
ยจ PDEs are well defined, and rely on Newtonian/Leibniz/regular calculus
ยจ SDEs and SIEs for non-homogeneous diffusion coefficients (non-linear), or level depenedent
volatilities, are NOT well defined, and you need to choose a value for ๐ผ
ยจ There is a correspondence between the different [๐ผ] calculus
99
100. Luc_Faucheux_2021
There is no controversy - II
ยจ Ito is ๐ผ = 0
ยจ Strato is ๐ผ = 1/2
ยจ Because the factor (1/2) also shows up in Taylor expansion and Ito lemma, that is where a
lot of the confusion comes from. BTW, Ito lemma is NOT a Taylor expansion, it formally
looks like one and comes from using a Taylor expansion in calculating the integral as a limit
of sum, but it is NOT a Taylor expansion
ยจ So you cannot say (as sometimes it seems to be implied in textbooks).
ยจ Hey in stochastic calculus, it is the same as regular calculus, just go up one more level in the
Taylor expansion
100
101. Luc_Faucheux_2021
There is no controversy - III
ยจ An ITO SDE is of the form:
ยจ ๐๐ ๐ก = ๐ ๐ก, ๐ ๐ก . ๐๐ก + ๐ ๐ก, ๐ ๐ก . ([). ๐๐(๐ก)
ยจ This implies that the PDF follows the FORWARD ITO Kolmogorov PDE
ยจ
,=(0,"|-.,".)
,"
= โ
,
,0
๐ ๐ฅ, ๐ก . ๐ ๐ฅ, ๐ก ๐$, ๐ก$ โ
,
,0
[
*
!
. [๐(๐ฅ, ๐ก)! . ๐(๐ฅ, ๐ก|๐$, ๐ก$)]
ยจ With simpler notation:
ยจ An ITO SDE is of the form:
ยจ ๐๐ = ๐. ๐๐ก + ๐. ([). ๐๐
ยจ This implies that the PDF follows the FORWARD ITO Kolmogorov PDE (Fokker-Planck)
ยจ
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. [๐! . ๐]
101
102. Luc_Faucheux_2021
There is no controversy - IV
ยจ An STRATO SDE is of the form:
ยจ ๐๐ ๐ก = @
๐ ๐ก, ๐ ๐ก . ๐๐ก + A
๐ ๐ก, ๐ ๐ก . (โ). ๐๐(๐ก)
ยจ This implies that the PDF follows the FORWARD STRATO Kolmogorov PDE
ยจ
!"($,&|(!,&!)
!&
= โ
!
!(
{G
๐ ๐ก, ๐ ๐ก +
+
,
. B
๐ ๐ก, ๐ ๐ก .
!
!(
B
๐ ๐ก, ๐ ๐ก }. ๐ ๐ฅ, ๐ก ๐*, ๐ก* โ
!
!(
[
+
,
. [B
๐(๐ ๐ก , ๐ก), . ๐(๐ฅ, ๐ก|๐*, ๐ก*)]
ยจ With simpler notation:
ยจ An STRATO SDE is of the form:
ยจ ๐๐ = @
๐. ๐๐ก + A
๐. (โ). ๐๐
ยจ This implies that the PDF follows the FORWARD STRATO Kolmogorov PDE (Fokker-Planck)
ยจ
,=
,"
= โ
,
,0
{@
๐ +
*
!
. A
๐.
,
,0
A
๐}. ๐ โ
,
,0
[
*
!
. [A
๐! . ๐]
102
103. Luc_Faucheux_2021
There is no controversy - V
ยจ So and ITO SDE is:
ยจ ๐๐ = ๐. ๐๐ก + ๐. ([). ๐๐
ยจ And corresponds to a diffusion equation for the PDF:
ยจ
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ A STRATO SDE is:
ยจ ๐๐ = @
๐. ๐๐ก + A
๐. (โ). ๐๐
ยจ And corresponds to a diffusion equation for the PDF:
ยจ
,=
,"
= โ
,
,0
{@
๐ +
*
!
. A
๐.
,
,0
A
๐}. ๐ โ
,
,0
[
*
!
. A
๐! . ๐]
103
104. Luc_Faucheux_2021
There is no controversy - VI
ยจ So if we want the same solution, meaning we want the 2 equations for the PDE to be equal:
ยจ
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ
,=
,"
= โ
,
,0
{@
๐ +
*
!
. A
๐.
,
,0
A
๐}. ๐ โ
,
,0
[
*
!
. A
๐! . ๐]
ยจ That means as we have seen before that we need to write:
ยจ A
๐ = ๐
ยจ ๐ = @
๐ +
*
!
. A
๐.
,
,0
A
๐
ยจ That is the correspondence between the ITO and STRATO coefficients for the SDEs
ยจ Pointing out the obvious one more time, when
,
,0
A
๐ =
,
,0
๐ = 0, both calculus will return
exactly the same SDE and PDE, the SDE is called linear
104
105. Luc_Faucheux_2021
Back to a brief history of the Ito-
Stratanovitch controversy
(a physicistโs point of view)
105
106. Luc_Faucheux_2021
A brief history - II
ยจ So if you are a physicist, you like to write diffusion equations like:
ยจ
,=
,"
= โ
,
,0
[๐ฝ/ + ๐ฝA]
ยจ ๐ฝA is the diffusion current (hence the D notation)
ยจ ๐ฝ/ is the drift current, coming usually from an external force (hence the F notation)
ยจ In the absence of external force, physicist would expect the equilibrium solution to be
uniform (meaning ๐ = ๐๐ก๐), and so it makes sense for them to write the diffusion current
as:
ยจ ๐ฝA = โ๐ท.
,=
,0
ยจ If the diffusion coefficient is a function of the position (and the physical system described is
such that the diffusive process does not impact the long term equilibrium steady state
derived from thermodynamics), physicists will still expect a uniform distribution and will still
want the diffusion coefficient to be outside the derivative
ยจ ๐ฝA = โ๐ท(๐ฅ).
,=
,0
106
107. Luc_Faucheux_2021
A brief history - III
ยจ For sake of simplicity letโs say that there is no external forcing right now, ๐ฝ/ = 0
ยจ So physicist in the presence of non-homogeneous diffusion would like the PDE to look like:
ยจ
,=
,"
= โ
,
,0
๐ฝA = โ
,
,0
โ๐ท(๐ฅ).
,=
,0
ยจ Nothing wrong so far.
ยจ The problem arose when we started using digital computers and started running Monte
Carlo simulations
ยจ This is fairly recent so we should not beat ourselves too much on the fact that we tripped on
that one.
ยจ Following the work of Bachelier, Bernouilli and such, we started modeling the stochastic
process as:
ยจ ๐ฟ๐ ๐ก = ยฑ 2๐ท with the ยฑ being a random number generator (head or tail)
107
108. Luc_Faucheux_2021
A brief history - IV
ยจ ๐ฟ๐ ๐ก = ยฑ 2๐ท
ยจ Is essentially what we looked at in the firs deck, as well as the Bachelier deck
108
X
i i+1
i-1
109. Luc_Faucheux_2021
A brief history - V
ยจ We know for a contant spacing (constant
diffusion coefficient), the distribution is the
usual binomial which converges to the
Gaussian, as illustrated by the Galton
machine.
ยจ By the way Galton was born not even 200
years ago, so again we should go easy on
ourselves
109
110. Luc_Faucheux_2021
A brief history - VI
ยจ Ok so so far so good.
ยจ The issue is when we started simulating on a digital computer something like that:
ยจ ๐ฟ๐ ๐ก = ยฑ 2๐ท(๐ ๐ก )
ยจ Because, when we write something like the above, even without knowing it, we are in ITO
calculus and we are writing really:
ยจ ๐๐(๐ก) = 2๐ท(๐ ๐ก ). ([). ๐๐(๐ก)
ยจ This will give a PDE:
ยจ
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ With:
ยจ ๐ = 0
ยจ ๐ = 2๐ท(๐ฅ)
110
111. Luc_Faucheux_2021
A brief history - VII
ยจ
,=
,"
= โ
,
,0
โ
,
,0
[
*
!
. 2๐ท(๐ฅ)
!
. ๐]
ยจ
,=
,"
= โ
,
,0
โ
,
,0
[๐ท(๐ฅ). ๐]
ยจ The solution of that (subject to non-diverging boundary conditions) is:
ยจ ๐ = 1/๐ท(๐ฅ)
ยจ And NOT ๐ = ๐๐ก๐, uniform distribution as expected.
ยจ So that was the first sign that something was wrong.
111
112. Luc_Faucheux_2021
A brief history - VIII
ยจ Letโs recap.
ยจ You want to model:
ยจ
,=
,"
= โ
,
,0
๐ฝA = โ
,
,0
โ๐ท(๐ฅ).
,=
,0
ยจ You do a discrete numerical simulation:
ยจ ๐ฟ๐ ๐ก = ยฑ 2๐ท(๐ ๐ก )
ยจ You get:
ยจ
,=
,"
= โ
,
,0
โ
,
,0
[๐ท(๐ฅ). ๐]
ยจ Not good, you do not get what you expected
112
113. Luc_Faucheux_2021
A brief history - IX
ยจ So at that point, if physicists in the 80s were as good on stochastic calculus as they should
be, they should have said.
ยจ Well yeah, a discrete simulation is by definition in the world of ITO calculus
ยจ If I write: ๐ฟ๐ ๐ก = ยฑ 2๐ท(๐ ๐ก )
ยจ I really am writing: ๐๐(๐ก) = 2๐ท(๐ ๐ก ). ([). ๐๐(๐ก)
ยจ Which will give me:
,=
,"
= โ
,
,0
โ
,
,0
[๐ท(๐ฅ). ๐]
ยจ But I want:
,=
,"
= โ
,
,0
โ๐ท(๐ฅ).
,=
,0
113
114. Luc_Faucheux_2021
A brief history - X
ยจ Since I want:
,=
,"
= โ
,
,0
โ๐ท(๐ฅ).
,=
,0
ยจ I can write:
ยจ
,=
,"
= โ
,
,0
โ
,
,0
๐ท ๐ฅ . ๐ = โ
,
,0
โ
,
,0
๐ท ๐ฅ . ๐ โ
,
,0
๐ . ๐ท(๐ฅ)
ยจ
,=
,"
= โ
,
,0
โ
,
,0
๐ท ๐ฅ . ๐ โ ๐ท(๐ฅ).
,=
,0
ยจ That is of the form:
ยจ
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ Which in ITO will give the SDE
ยจ ๐๐ = ๐. ๐๐ก + ๐. ([). ๐๐
ยจ With: ๐ = โ
,
,0
๐ท ๐ฅ and ๐ = 2๐ท(๐ ๐ก )
114
115. Luc_Faucheux_2021
A brief history - XI
ยจ Soooโฆ bear with me here a few more slides..
ยจ If I write:
ยจ ๐๐ = {
,
,0
๐ท ๐ฅ }. ๐๐ก + 2๐ท(๐ ๐ก ). ([). ๐๐
ยจ Numerically I will simulate it as:
ยจ ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ ยฑ 2๐ท(๐ ๐ก )
ยจ That is assuming units of time equal to 1, if not you write
ยจ ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ . ๐ฟ๐ก ยฑ 2๐ท ๐ ๐ก . ๐ฟ๐ก
115
116. Luc_Faucheux_2021
A brief history - XII
ยจ I simulate: ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ . ๐ฟ๐ก ยฑ 2๐ท ๐ ๐ก . ๐ฟ๐ก
ยจ That is an ITO SDE: ๐๐ = {
,
,0
๐ท ๐ฅ }. ๐๐ก + 2๐ท(๐ ๐ก ). ([). ๐๐
ยจ That has a PDE solution:
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ With: ๐ =
,
,0
๐ท ๐ฅ and ๐ = 2๐ท(๐ ๐ก )
ยจ So you get the PDE:
,=
,"
= โ
,
,0
,
,0
๐ท ๐ฅ . ๐ โ
,
,0
[๐ท. ๐]
ยจ And:
ยจ
,=
,"
= โ
,
,0
,
,0
๐ท ๐ฅ . ๐ โ
,
,0
๐ท. ๐ = โ
,
,0
,A
,0
. ๐ โ
,A
,0
. ๐ โ ๐ท.
,=
,0
= โ
,
,0
โ๐ท.
,=
,0
ยจ Which is what I want
116
117. Luc_Faucheux_2021
A brief history - XIII
ยจ SOโฆ
ยจ If I want to simulate:
,=
,"
= โ
,
,0
โ๐ท(๐ฅ).
,=
,0
ยจ Which has no drift term, and has the equilibrium long-term steady state uniform distribution
as the desired solution, I need to simulate on a discrete digital computer:
ยจ ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ . ๐ฟ๐ก ยฑ 2๐ท ๐ ๐ก . ๐ฟ๐ก
ยจ Which seems weird, because the first term
,
,0
๐ท ๐ฅ . ๐ฟ๐ก looks like the drift term.
ยจ This is when the whole confusion started
117
118. Luc_Faucheux_2021
A brief history - XIV
ยจ ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ . ๐ฟ๐ก ยฑ 2๐ท ๐ ๐ก . ๐ฟ๐ก
ยจ The term
,
,0
๐ท ๐ฅ . ๐ฟ๐ก looks like indeed what you would simulate if you were to simulate
a drift
ยจ It is NOT a physical drift
ยจ Your PDE that you wanted to simulate was
,=
,"
= โ
,
,0
โ๐ท.
,=
,0
and had NO drift
ยจ It is purely a term that you need to add to the simulation to recover your PDE
ยจ This is why it was called a โspurious driftโ (Ryter 1980).
ยจ Again, it is NOT a drift, you are not extraction motion out of noise, you need to have it in
there because you are using Ito calculus, and plain and simple:
ยจ ๐๐ = ๐. ๐๐ก + ๐. ([). ๐๐ will give you
,=
,"
= โ
,
,0
๐. ๐ โ
,
,0
[
*
!
. ๐! . ๐]
ยจ Period..end of storyโฆ
118
119. Luc_Faucheux_2021
A brief history - XV
ยจ But you can see why that was confusing, and why it tripped at the time a lot of people, yours
truly included.
ยจ And that was confusing for 2 main reasons:
ยจ Reason 1: Maxwell demon and Thermal ratchets
ยจ Reason 2: Stratanovitch
ยจ They are somewhat related but distinct.
ยจ Letโs go over Stratanovitch first
119
120. Luc_Faucheux_2021
A brief history โ XVI
ยจ To be fair, I was also a little harsh and oversimplifying.
ยจ There is also another reason why the question of Ito versus Stratanovitch came about, it has
to do with the autocorrelation of the random forcing (the noise). Is it white noise with 0
memory, and so Ito would be appropriate, or is it coloured noise, with some non zero
autocorrelation function, and in this case Strato would be more appropriate.
ยจ Again it really depends on the physical system, an what PDE you want
ยจ Radioactive particle decay lends itself well to Ito
ยจ Diffusion in a viscous medium lends itself better to Strato from a physics point of view
ยจ So as always things are a little more complicated that I would make them out to be, so you
should take what I say with a grain of salt.
120
121. Luc_Faucheux_2021
A brief history โ XVII
ยจ In particular, if there is any kind of correlation, then an non-ITO approach is sometimes
justified.
ยจ Remember that we had from the earlier part of the deck:
ยจ < A
๐ ๐ก, ๐ ๐ก . [๐ผ] . ๐๐ > = ๐ผ. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก
ยจ In particular:
ยจ ITO : < A
๐ ๐ก, ๐ ๐ก . [ . ๐๐ > = 0
ยจ STRATO: < A
๐ ๐ก, ๐ ๐ก . โ . ๐๐ > = [
*
!
]. A
๐ ๐ก, ๐ ๐ก .
,
,-
A
๐ ๐ก, ๐ ๐ก . ๐๐ก
121
123. Luc_Faucheux_2021
Reason #2 for the confusion - Stratanovitch
ยจ So first of all ITO calculus is weird because of ITO lemma, and the fact that the usual rules of
calculus (Leibniz rule, chain rule) are not formally respected
ยจ Second ITO is very well adapted to DISCRETE processes in time (finance, but also simulations
on digital computers)
ยจ Physicists do not like to learn new rules of calculus, they would rather stick to the usual one
ยจ More seriously, in physics, it could be argued that VERY FEW processes are truly discrete
(radioactive decay for example being one of them), but most of the processes (like
diffusion), are not discrete but continuous
123
124. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - II
ยจ We know that using STRATO calculus:
ยจ ๐๐ = @
๐. ๐๐ก + A
๐. (โ). ๐๐
ยจ Corresponds to a diffusion equation for the PDF:
ยจ
,=
,"
= โ
,
,0
{@
๐ +
*
!
. A
๐.
,
,0
A
๐}. ๐ โ
,
,0
[
*
!
. A
๐! . ๐]
ยจ We can expand the last term into:
ยจ
,
,0
*
!
. A
๐! . ๐ =
,
,0
*
!
. A
๐. A
๐. ๐ =
*
!
.
,
,0
A
๐. A
๐. ๐ =
*
!
.
,
,0
A
๐. A
๐. ๐
ยจ
,
,0
*
!
. A
๐! . ๐ =
*
!
. A
๐. ๐ .
,
,0
A
๐ +
*
!
. A
๐.
,
,0
A
๐. ๐
ยจ
,
,0
*
!
. A
๐! . ๐ =
*
!
. A
๐.
,B
%
,0
. ๐ +
*
!
. A
๐.
,
,0
A
๐. ๐
124
125. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - III
ยจ
,=
,"
= โ
,
,0
{@
๐ +
*
!
. A
๐.
,
,0
A
๐}. ๐ โ
,
,0
[
*
!
. A
๐! . ๐]
ยจ
,=
,"
= โ
,
,0
@
๐ +
*
!
. A
๐.
,
,0
A
๐ . ๐ โ {
*
!
. A
๐.
,B
%
,0
. ๐ +
*
!
. A
๐.
,
,0
A
๐. ๐ }
ยจ
,=
,"
= โ
,
,0
@
๐ . ๐ โ
*
!
. A
๐.
,
,0
A
๐. ๐
ยจ So a STRATO SDE of the form:
ยจ ๐๐ = @
๐. ๐๐ก + A
๐. (โ). ๐๐
ยจ Will give a PDE of the form:
ยจ
,=
,"
= โ
,
,0
@
๐ . ๐ โ
*
!
. A
๐.
,
,0
A
๐. ๐
125
126. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - IV
ยจ Again in order to illustrate letโs assume no drift term in the PDE
ยจ So a STRATO SDE of the form:
ยจ ๐๐ = A
๐. (โ). ๐๐
ยจ Will give a PDE of the form:
ยจ
,=
,"
= โ
,
,0
โ
*
!
. A
๐.
,
,0
A
๐. ๐
ยจ Again, nothing wrong there, but physicist got confused because they starting saying things
like the next slide:
126
127. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - V
ยจ If I write: ๐๐ = A
๐. (โ). ๐๐
ยจ On a computer I simulate ๐ฟ๐ = ยฑA
๐
ยจ And that gives me a PDE with no drift:
,=
,"
= โ
,
,0
โ
*
!
. A
๐.
,
,0
A
๐. ๐
ยจ So I am happy, but now my diffusion current is no longer:
ยจ
,=
,"
= โ
,
,0
๐ฝA = โ
,
,0
โ๐ท(๐ฅ).
,=
,0
with A
๐ = 2๐ท
ยจ But:
ยจ
,=
,"
= โ
,
,0
โ
*
!
. A
๐.
,
,0
A
๐. ๐
ยจ So my diffusion current is really: ๐ฝA = โ
*
!
. A
๐.
,
,0
A
๐. ๐ = โ ๐ท.
,
,0
๐ท. ๐
127
128. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - VI
ยจ So if I do not want to simulate a drit term (because my PDE has no drift term), then really I
need to write the diffusion current as:
ยจ ๐ฝA = โ ๐ท.
,
,0
๐ท. ๐
ยจ But thenโฆwait a minute, if I plug this back into the PDE, then my equilibrium distribution is
no longer uniform (in fact it will be ๐ท. ๐ = ๐๐ก๐ or ๐ = 1/ ๐ท. )
ยจ So when the diffusion coefficient is non-homogeneous it will change my equilibrium
distribution.
ยจ I have โextractedโ motion our of random noise
ยจ This is maybe an example of the Maxwell demon
ยจ I have broken the law of thermodynamics, so what is next ? Perpetual motion ?
128
129. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - VII
ยจ The previous 2 slides are obviously wrong but at the time that was a real debate in Physics
ยจ For a constant diffusion the diffusion current is :
ยจ ๐ฝA = โ ๐ท.
,
,0
๐ท. ๐ = โ๐ท.
,
,0
๐ = โ
,
,0
๐ท. ๐
ยจ Because who cares, ๐ท is a constant
ยจ But now if we have ๐ท(๐(๐ก)) for a Brownian particle, which one is the real diffusion current?
ยจ And then there were even more confusion about the Ryter spurious drift maybe being an
actual drift because
ยจ
,
,0
๐ท. ๐ =
,
,0
๐ท . ๐ + ๐ท.
,
,0
๐
ยจ So maybe ๐ท.
,
,0
๐ is the โrealโ diffusion current and the term
,
,0
๐ท . ๐ is the Maxwell
demon term extracting directed motion out of a purely random diffusion process?
129
130. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - VIII
ยจ The whole controversy could have been squashed had there been one good math guy who
understood Ito and Strato well enough to explain it simply to physicist and say:
ยจ Listen you idiots, all that really matters is the PDE
ยจ If you want to play with a computer and burn some CPUs and start global warming by
writing something like: ๐ฟ๐ ๐ก = ยฑ 2๐ท(๐ ๐ก )
ยจ That is fine by me, but you are by definition using ITO calculus and writing:
ยจ ๐๐(๐ก) = 2๐ท(๐ ๐ก ). ([). ๐๐(๐ก)
ยจ Which will give you:
,=
,"
= โ
,
,0
โ
,
,0
[๐ท(๐ฅ). ๐]
ยจ Which will not give you a uniform distribution for the steady state regime.
ยจ Period, full stop, end of story.
130
131. Luc_Faucheux_2021
Reason #2 for the confusion โ Stratanovitch - IX
ยจ And then this math guy could have added:
ยจ If you idiots want to simulate the SDE that corresponds to the PDE:
,=
,"
= โ
,
,0
โ๐ท(๐ฅ).
,=
,0
ยจ And if you insist on using discrete numerical simulations, then sorry mate but you have no
choice but to write:
ยจ ๐ฟ๐ ๐ก =
,
,0
๐ท ๐ฅ ยฑ 2๐ท ๐ ๐ก
ยจ So yeah, the first term looks like a drift term, but there is no physical drift in your PDE, it is
just a โspuriousโ drift because you now have entered the mysterious world of stochastic
calculus, and more precisely ITO calculus. And please leave at the door all the intuitions you
had built on Newtonian/Leibniz/regular calculus, and buckle up buttercup, because you not
in Kansas anymore Toto.
ยจ Sometimes I wish math guys could not talk to physicists in such condescending manner.
131
133. Luc_Faucheux_2021
Maxwell demon - I
ยจ The other reason why there was some confusion is that at the same time a lot of physicists
were looking at issues like Maxwell demon, Brownian engines, Brownian ratchets, Thermal
ratchetsโฆ
ยจ The Maxwell demon is a possible (but very improbable) entity that drive a system towards a
state that is possible but very improbable
ยจ To quote the adventures of Mr. Tompkins, it is possible (but very unlikely) the ice cube that
you melted in your coke will spontaneously re-form as an ice cube and that the surrounding
liquid will warm back up again.
ยจ That is possible, there is nothing in Physics that says that it is impossible, it is just very
unlikely
ยจ Winning the lottery is also possible, it is just also highly unlikely
133
134. Luc_Faucheux_2021
Maxwell demon - II
ยจ The Maxwell demon is intriguing because the 2nd Law of Thermodynamics says that usually
things tend to decay, and that a measure of disorder that you can define (entropy) usually
always increase at the end.
ยจ That law makes sense, we all see it in our lives everyday, things always tend to go to sh..,
never (or highly unlikely) the other way around
ยจ What is true for our personal lives is true for the Universe
ยจ Nothing shocking there, since we are part of the universe, so the laws should be somewhat
universal
134
135. Luc_Faucheux_2021
Maxwell demon - III
ยจ The Maxwell demon putting the moves on Mr. Tompkins fiancรฉe and trying to impress her
with his tennis skills by reconstructing an ice cube without violating the 2nd law of
Thermodynamics
135
137. Luc_Faucheux_2021
Brownian Engines
ยจ So it would make sense for physicists to ask if it was possible to build a Maxwell demon.
ยจ Feynman in his lecture has a great chapter on this.
ยจ He even offered a prize to the first person / team who could build one.
137
139. Luc_Faucheux_2021
Brownian engines - III
ยจ There was also another reason why physicists were excited by all this, (none withstanding
the fact that if you could receive a check from Richard Feynman, that would be the coolest
thing ever, and you would have so much street cred), was that we were starting to look in
real-time in-vivo inside the cells and human body, and whether we like it or not (and again
nothing really to do with intelligent design theory), there were some really cool things
happening there.
ยจ Vesicles are transported within the cell, to the place where they should be, in a very highly
โnoisyโ (read bombarded by random fluctuations) environment that should make it
impossible. Yet it works.
ยจ Spermatozoides are able to โswimโ to where they were supposed to go, again in a very
random and viscous environment.
ยจ Trying to build a typical inertial engine and computing how much energy that required lead
to the conclusion that it was impossible, so clearly there was something akin to a Thermal
ratchet, or Brownian engine at work there. So somehow Nature found a way to extract
directed motion out of random noise, or at least found a way to still be able to build things
in a highly noisy, random and viscous regime without โforcingโ its way through the way an
inertial engine (think of a car or a rocket) would do at the scale we are used to
139
140. Luc_Faucheux_2021
Brownian engines - IV
ยจ I was lucky enough to work at the time in the lab of Albert Libchaber, who was
fascinated with those problems.
ยจ I have never met in my life someone who was so pure in his search of the truth and who
was so keen on lifting the curtains, and who had the intellectual power to cut through
the math, or the obstacles between him and the hidden simple principles at work
ยจ I count myself as being fortunate to have been able to witness him at work, and in his
life.
140
141. Luc_Faucheux_2021
Brownian engines - V
ยจ I could write a book about how much fun we had in his lab (and maybe I should), but suffice
to say that we were all involved in the subject of Brownian engines, whether on the biology
side or on the more Physics side. If you guys are interested you have to read this one:
141
142. Luc_Faucheux_2021
Brownian engines - VI
ยจ So anyways long story short, I spent a lot of time then on those issues, had the pleasure of
working with some of the finest minds of the time (too numerous to name all, and am not
even going to try, but of course Albert Libchaber, Mike Shelley, Dave Muraki, Marcello
Magnasco, Erez Braun, Elisha Moses, Drew Belmonte, Deborah Fygenson, Albrecht Ott,
Andreas Tilgner, Gustavo Stolovitsky, Rolf Landauer and is famous shout โcomplex is complex
is complex!โ, and again way too many I apologize for not including in the short list above)
ยจ But anyways we built the first optical thermal ratchet !
142
143. Luc_Faucheux_2021
Brownian engines - VII
ยจ It turns out that there is a cool connection to Finance.
ยจ If you replace the position by the accumulated PL, the thermal ratchet becomes what is
known as the Parrondo Paradox.
ยจ If we just had thought about replacing X by $, that could have been known as the Libchaber
paradox
ยจ Another example of the work of an illustrious Frenchman that is easily applicable to finance
but somehow someone else takes it through the goal lineโฆ
ยจ Essentially, just like the thermal ratchet, you can โextractโ some direction our of random
fluctuations (no worries about the 2nd law, it is still intact, because you need to dump energy
into the ratchet to make it work)
ยจ So in Finance, you could have 2 losing strategies (2 loser PM in a fund), but if you switch
randomly the allocation of $ between those 2 strategies, you can find a regime where the
resulting strategy will make $ on average
143
144. Luc_Faucheux_2021
Brownian engines - VIII
ยจ There are actually applications in Finance of the Maxell demon, known as the Parrondo
paradox.
ยจ Two trading strategies (PM at a hedge fund) on average lose money (B and C, blue and green
line)
ยจ However you can alternate between the two strategies to create one (A-red line) that on
average will be profitable, like the thermal ratchet who is extracting work out of thermal
noise, this Parrondo construct extract positive return out of random switches between two
losing strategies
144
146. Luc_Faucheux_2021
Another way to tell the story โ I
ยจ This was a first draft of the story, it was a little more complicated than the one I went
through, but thought I would keep it here for sake of completeness.
ยจ No need to read it
ยจ It has nice pictures though
ยจ Please enjoy
146
147. Luc_Faucheux_2021
Another way to tell the story - II
ยจ All right, this is where all the confusion came about the Ito-Stratanovitch controversy (and
also that physicists tend to glance over stochastic calculus and be quite liberal and not that
mathematically rigorous, I have to admit)
ยจ Suppose that we start with a PDE describing the following process:
ยจ
,=(0,")
,"
= โ
,
,-
๐ ๐ ๐ก , ๐ก . ๐(๐ฅ, ๐ก) โ
,
,-
[
*
!
. [๐(๐ ๐ก , ๐ก)! . ๐(๐ฅ, ๐ก)]
ยจ
,
,"
. ๐ ๐ฅ, ๐ก = โ
,
,0
[๐ฝ/+๐ฝA]
ยจ ๐ฝ/ ๐ฅ, ๐ก = ๐(๐ก). ๐ ๐ฅ, ๐ก and ๐ฝA ๐ฅ, ๐ก = โ
,
,-
[
*
!
. [๐(๐ ๐ก , ๐ก)! . ๐(๐ฅ, ๐ก)]
ยจ ๐ฝA ๐ฅ, ๐ก = โ
,
,-
[
*
!
. [๐(๐ ๐ก , ๐ก)! . ๐(๐ฅ, ๐ก)]
ยจ ๐ฝA ๐ฅ, ๐ก = โ
,
,-
[๐ท(๐ฅ, ๐ก). ๐(๐ฅ, ๐ก)] with ๐ท ๐ฅ, ๐ก =
*
!
. [๐(๐ ๐ก , ๐ก)! ]
147