Characterization of Markov processes and reciprocal classes
6.2. Derivative operator for functionals of unit jump processes
In § 5.1 we restricted the path perturbationθεu(ω) = ω + εhui. to directions u ∈ Ed with hui=R
Iutdt= 0. These perturbations do not influence the final state of the path X1◦θεu= X1, an essential factor in the derivation of the duality formula (5.33) that characterized the reciprocal class of the Wiener measure.
In the unit jump context the perturbation ¯θε¯v(ω0, ω) = ω + Yε ¯v(ω0) as defined in (2.32) is a random addition of jumps of size one. This addition of jumps will influence the final state X1◦θ¯ε¯v = X1+ Y1ε ¯v, regardless of the direction of perturbation ¯v ∈ ¯E. For the study of the reciprocal class of a Poisson process, we therefore have to introduce a different perturbation.
6.2.1. Definition and properties of the jump-time derivative.
We follow an idea of perturbation of the jump-times that was introduced independently by Carlen, Pardoux [CP90] and Elliott, Tsoi [ET93].
Definition 6.9. Given a bounded, measurable u: I → R and small ε ≥ 0 we define the perturbation πεu: J1(I) → J1(I), (x, {t1, . . . , tm}) 7→ (x, {t1+ εhuit1, . . . , tm+ εhuitm} ∩ I).
Let Q be any probability on J1(I). A functional F ∈ L2(Q) is called differentiable in direction u if the limit
(6.10) DuF := − lim
ε→0
1
ε F ◦πεu−F
exists in L2(Q). If F is differentiable in all directions u ∈ E, we denote by DF = (DtF)t∈I ∈ L2(dt ⊗ Q) the unique process such that
DuF= Z
I
DtFutdt= hDF, ui holds Q-a.s. for every u ∈ E.
Note that the perturbation is well defined forε small enough, since −1 < εutfor all t ∈ I implies that the mapping t 7→ t+ εhuitis strictly monotone. We defined a true derivative operator in the following sense.
Lemma 6.11. The standard rules of differential calculus apply:
• Let F, G and FG be differentiable in direction u, then the product rule holds:
Du(FG)= GDuF+ FDuG.
• Let F be differentiable in direction u, φ ∈ C∞b (R), then φ(F) is differentiable in direction u and the chain rule holds:
Du(φ(F)) = φ0(F)DuF.
Proof. Let us first proof the product rule: For F and G given in the statement we get
−Du(FG) = lim
ε→0
1
ε (F ◦πεu)(G ◦πεu) − FG
= G lim
ε→0
1
ε F ◦πεu−F+ F lim
ε→0
1
ε G ◦πεu−G+ lim
ε→0
1
ε F ◦πεu−F
G ◦πεu−G. The last term converges to zero by the Cauchy-Schwarz inequality:
Q
1
ε F ◦πεu−F
G ◦πεu−G2!
≤ Q
1
ε(F ◦πεu−F)
2!12 Q
G ◦πεu−G212 . As for the proof of the chain rule, we just have to use the Taylor expansion ofφ
1
εφ(F ◦ πεu) −φ(F) = φ0(F)1
ε(F ◦πεu−F)+1 ε
(F ◦πε−F)2O(1)
∧K,
for some K> 0. Then the second term converges to zero. 6.2.2. Fundamental examples and counterexamples of derivability.
By Lemma 6.2 the knowledge of the jump-times and initial condition is equivalent to the knowledge of the canonical process X. Instead of cylindric functionals F(X)= f (Xt1, . . . , Xtn) of the canonical process, it is natural in the context of unit jump processes to consider functionals of the jump-times:
SJ1 :=n
F : J1(I) → R, F((x, {t1, . . . , tm}))= f (x, t1, . . . , tn∧m, 1, . . . ), f ∈ C∞b (R × In), n ∈ No . For F ∈ SJ1 we have F(X) = f (X0, T1∧ 1, . . . , Tn∧ 1) under the convention ∞ ∧ 1 = 1. We use the shorthand F(X)= f∧1(X0, T1, . . . , Tn) := f (X0, T1∧ 1, . . . , Tn∧ 1) ∈ SJ1.
Proposition 6.12. Let Q be an arbitrary probability on the space of unit jump paths J1(I). Then all functionals F(X)= f∧1(X0, T1, . . . , Tn) ∈ SJ1are differentiable in direction of any bounded function u : I → R. The derivative is given by DuF(X)=R
IDtF(X) utdt with DtF(ω) = DtF((x, {t1, . . . , tm})) := −
m∧nX
i=1
∂1+if (x, t1, . . . , tn∧m, 1, . . . )1[0,ti](t).
Proof. Let F(X) = f∧1(X0, T1, . . . , Tn) ∈ SJ1 and a bounded u : I → R be arbitrary. By definition of the perturbation
F(X) ◦πεu= f∧1(X0, T1+ εhuiT1, . . . , Tn+ εhuiTn),
where Ti+ εhuiTi := ∞ if Ti= ∞ already. We use the Taylor expansion to get
−1
ε F(X) ◦πεu−F(X)= −
η∧n
X
i=1
∂1+if∧1(X0, T1, . . . , Tn)huiTi+ O(ε).
Then dominated convergence gives the L2(Q)-limit.
Unfortunately it is fairly easy to find functionals that are not differentiable. The following example explains why functionals of the type F(X)= f (Xt1, . . . , Xtn) ∈ S are in general not differentiable.
Example 6.13. Let P be the law of a Poisson process. Take F = Xt ∈ L2(P) for some fixed t ∈ I and chose u ∈ E such that u ≥ 0 on I and huit > 0. We define the time-inversion related to the perturbationπεuby
(6.14)
Z
[0,τεu(t)]
(1+ εus)ds= t.
Thenτεu : I → [0, τεu(1)] is a deterministic function and (τεu)−1(t) = t + εhuit. The perturbed functional is
F ◦πεu= Xτεu(t),
since by u ≥ 0 and huit > 0 we have τεu(t) < t and τεu(t) → t ifε → 0. Since X is stochastically continuous under P we get
− lim
ε→0
1
ε(Xτεu(t)−Xt)= 0 holds P-a.s.
Thus if a derivative of Xt in direction u in the sense of Definition 6.9 exists, it has to be zero: The L2(P)-convergence of the perturbed functional Xτεu(t)would imply the almost sure convergence of a subsequence to the L2(P)-limit. But since the almost sure limit exists and is zero, the L2(P)-limit needs to be zero too. But since t −τεu(t)= εhuiτεu(t)we get
E
1
ε(Xt−Xτεu(t)) − 0
2!
= 1 ε2
∞
X
k=0
k2e−εhuiτεu(t)(εhuiτεu(t))k
k! = 1
ε2 ε2hui2τε
u(t)+ εhuiτεu(t) , which diverges forε → 0. Thus Xtis not differentiable in direction u if huit> 0.
In the next example we present a class of jump-time functionals that are not generally differentiable.
Example 6.15. Given a sequence( fj)j≥0of functions fj ∈ C∞
b(R × Ij) we define (6.16) F(ω) = F((x, {t1, . . . , tm})) :=
∞
X
j=0
fj(x, t1, . . . , tj)1{j=m}.
In the canonical form such functionals are conveniently given by F(X)= fη(X0, T1, . . . , Tη). Using an alternating sequence of ( fj)j≥0 we present a specific example of such functionals that is not differentiable with respect to the bridge of a Poisson process. Take f2 j ≡ 1 and f2 j+1 ≡ 0 for j ∈ N and u ≡ 1 ∈ E, then
1 ε
F(X◦πεu) − F(X)
= 1
ε(1η◦πεu=η−1+ 1η◦πεu=η−3+ . . . ),
and with respect to a Poisson bridge P0,1(. ) = P( . |X0 = 0, X1 = 1) the a.s. limit of the above is zero since P0,1(T1 = 1) = 0. Remark that τεu(t) = t/(1 + ε) for u ≡ 1. We use P0,1(η = 1) = 1 to compute
E0,1
1
ε(F(X ◦πεu) − F(X)) − 0
2!12
= 1
εP0,1(η ◦ πεu= 0)12
= 1
εP0,1(Xτεu(1)= 0)12
= 1 ε
P(Xτεu(1)= 0, X1= 1|X0= 0)/P(X1= 1|X0= 0)12
= 1 ε
√ε
√ 1+ ε,
which diverges for ε → 0. We conclude that functionals of the form (6.16) are not in general differentiable in the sense of Definition 6.9.
In what follows, we are in particular interested in the differentiability of functionals of the stochastic integral type. Let us remark that the stochastic integral over the canonical unit jump process is always well defined as the finite sum
Z
I
usdXs:=
η
X
i=1
u(Ti) for any measurable u : I × J1(I) → R.
We define the compensated integral (6.17) δ(u) :=
Z
I
us(dXs−ds), u : I × J1(I) → R predictable, u(., ω) ∈ L1(dt), ∀ω ∈ J1(I).
It will be the dual operator of the derivative operator D with respect to a Poisson process.
In Example 6.13 we have seen thatδ(1[0,t]) = Xt−X0−t is not differentiable with respect to the law P of a Poisson process. In the last two examples we develop conditions that guarantee differentiability for the compensated integrals δ(u).
Example 6.18. Let Q be an arbitrary probability on J1(I), v ∈ C1b(I) be deterministic and the total number of jumpsη ∈ L2(Q) be square integrable. Then the functional δ(v) is differentiable in direction of every u ∈ E with hui= 0.
Proof. We know that δ(v) =
η
X
i=1
v(Ti) − Z
I
vsds, and δ(v) ◦ πεu=
η◦πεu
X
i=1
v(Ti+ εhuiTi) − Z
I
vsds.
Under the assumption hui= 0 we have t+ εhuit= t − ε
Z
[t,1]usds ≤ t+ εK(1 − t) ≤ 1, ∀t ∈ I,
ifεK < 1, where K > 0 is a global bound for the absolute value of u. Therefore η ◦ πεu= η identically on J1(I) for smallε > 0, and we can apply the differentiability of v ∈ C1b(I) to see that
(6.19) lim
ε→0
1
ε δ(v) ◦ πεu−δ(v) = Xη
i=1
v0(Ti)huiTi holds Q-a.s.
Since the increment of X is square-integrable and v0.hui.is bounded we can apply dominated
convergence to get the L2(Q)-convergence.
In particular we have seen that the derivative ofδ(v) in direction u ∈ E with hui = 0 is given by (6.19). We define the process
(6.20) Dδ(v) = (Dtδ(v))t∈I, with Dtδ(v) = − Xη
i=1
v0(Ti)1[0,Ti](t),
even if δ(v) is not differentiable in directions of bounded u with hui , 0. An additional assumption on v will allow differentiation in every direction.
Example 6.21. Let Q be a probability on J1(I) such thatη ∈ L2(Q) and v ∈ C1c(I) in the sense that v= 0 in a neighborhood of t = 0 and t = 1. Then the functional δ(v) is differentiable in every direction u ∈ E with respect to Q.
Proof. By assumption there exists a constantδ > 0 such that vt = 0 for all t ∈ [2δ, 1 − 2δ]c.
which in combination with the above implies the result.
We define the derivative of Dδ(v) of δ(v) as given in Example 6.21 by (6.20).