Pavel V. Gapeev
Bayesian switching multiple disorder
problems
Article (Accepted version)
(Refereed)
Original citation:
Gapeev, Pavel V. (2016) Bayesian switching multiple disorder problems. Mathematics of Operations Research, 141 (3). pp. 1108-1124. ISSN 0364-765X
DOI: 10.1287/moor.2015.0770
Β© 2016 INFORMS
This version available at: http://eprints.lse.ac.uk/62436/
Available in LSE Research Online: August 2016
LSE has developed LSE Research Online so that users may access research output of the School. Copyright Β© and Moral Rights for the papers on this site are retained by the individual authors and/or other copyright owners. Users may download and/or print one copy of any article(s) in LSE Research Online to facilitate their private study or for non-commercial research. You may not engage in further distribution of the material or use it for any profit-making activities or any commercial gain. You may freely distribute the URL (http://eprints.lse.ac.uk) of the LSE Research Online website.
This document is the authorβs final accepted version of the journal article. There may be differences between this version and the published version. You are advised to consult the publisherβs version if you wish to cite from it.
Bayesian switching multiple disorder problems
Pavel V. Gapeev
βTo appear in Mathematics of Operations Research
The switching multiple disorder problem seeks to determine an ordered inο¬nite se-quence of times of alarms which are as close as possible to the unknown times of disorders, or change-points, at which the observable process changes its probability characteristics. We study a Bayesian formulation of this problem for an observable Brownian motion with switching constant drift rates. The method of proof is based on the reduction of the ini-tial problem to an associated optimal switching problem for a three-dimensional diο¬usion posterior probability process and the analysis of the equivalent coupled parabolic-type free-boundary problem. We derive analytic-form estimates for the Bayesian risk function and the optimal switching boundaries for the components of the the posterior probability process.
1
Introduction.
Suppose that, at time π‘ = 0, we begin to observe a sample path of some stochastic process π = (ππ‘)π‘β₯0, with probability characteristics changing their values at some unknown disorder
times at which an unobservable two-state process Ξ = (Ξπ‘)π‘β₯0 switches between one state
and the other. The switching multiple disorder problem is to decide at which time instants (ππ)πββ one should give alarm signals to indicate the occurrence of changes in the current state
of the process Ξ, as close as possible to the initial disorder times. Such quickest disorder, or change-point, detection problems have originally arisen and still play a prominent role in quality control, where one observes the output of a production line and wishes to detect deviations from the acceptable levels. After the introduction of the original control charts by Shewhart [34], various modiο¬cations of the disorder problem have been recognised (see, e.g. Page [27]) and implemented in a number of applied sciences (see, e.g. Carlstein, MΒ¨uller, and Siegmund [11]).
βLondon School of Economics, Department of Mathematics, Houghton Street, London WC2A 2AE, United
Kingdom; e-mail: [email protected]
Mathematics Subject Classiο¬cation 2010. Primary: 60G40, 62M20, 34K10. Secondary: 62C10, 60J60, 60J75.
Key words and phrases: Bayesian switching multiple disorder problem, optimal switching problem, Brownian motion, diο¬usion process, continuous-time Markov chain, coupled parabolic-type free-boundary problem, a change-of-variable formula with local time on surfaces, Heunβs double conο¬uent function.
History: Received October 31, 2010; revised December 21, 2012, and June 22, 2014; accepted March 29, 2015.
The problem of detecting a single change in the constant drift rate of a Brownian motion (Wiener process) was formulated and explicitly solved by Shiryaev [35]-[36] and [39]-[40] (see also Shiryaev [41; Chapter IV] and Peskir and Shiryaev [29; Chapter VI, Section 22] for further references). The optimal time of alarm was sought as a stopping time minimising a linear combination of the false alarm probability and the expected delay time in the detection of the disorder. Shiryaev [35] and [37] proposed another formulation of the problem in which the occurrence of a single change should be preceded by a long period of observations, under which a stationary regime has been established. The resulting optimal multi-stage detection procedure consisted in searching for a sequence of stopping times minimising the average delay time given that the mean time between two false alarms is ο¬xed. More recently, Feinberg and Shiryaev [15] derived an explicit solution of the quickest detection problem in the generalised Bayesian formulation and proved the asymptotic optimality of the associated detection procedure for the related minimax formulation. Extensive overviews of these and other related sequential quickest change-point detection methods were provided in Shiryaev [42] and Poor and Hadjiliadis [31].
In the present paper, we formulate and solve the switching multiple disorder problem for an observed Wiener process π changing its drift rate from ππ to π1βπ, when Ξ changes its state
from π to 1 β π, for every π = 0, 1. In contrast to the problem of detecting a single change, in the switching multiple disorder problem, one looks for an inο¬nite non-decreasing sequence of the alarm times (ππ)πββ minimising a series of linear combinations of discounted average losses
due to false alarms and delay penalty costs in the detection of the disorder times. We propose a formulation of the problem in which Ξ is assumed to be a continuous time Markov chain of intensity π, started at the state 0 or 1 with probabilities 1 β π and π , respectively.
Apart from other possible areas of application, such a situation usually happens in models of illiquid ο¬nancial markets, which have trading investors of diο¬erent kinds. It is natural to assume that the small investors can only inο¬uence little ο¬uctuations of the market prices of risky assets, while the large investors can aο¬ect the pricing trends as well, by means of either buying or selling substantial amounts of assets. More precisely, the pricing trends should either rise up or fall down at some random times, after essential amounts of assets are bought or sold, respectively. We can thus consider a model of such ο¬nancial markets in which the dynamics (of logarithms) of the asset prices are described by a Brownian motion with switching drift rates. We may further assume that our model allows for an inο¬nite number of free-of-charge transactions on the inο¬nite time interval and use an exponential constant discounting rate π which can be chosen equal to the riskless short rate of a bank account. The problem of detecting a single change in the probability characteristics of the accessible ο¬nancial data, which is associated with the appearance of arbitrage opportunities in the market, was considered by Shiryaev [42]. In the present paper, we reduce the initial Bayesian switching multiple disorder problem to an associated optimal switching problem for the posterior probability process, which is a ο¬ltering estimate of the current state of the unobservable drift rate of a Brownian motion. The use of exponential discounting makes our problem well-connected to the problem of single disorder detection with exponential delay penalty costs studied by Shiryaev [38], Poor [30], Beibel [6], and Bayraktar and Dayanik [1] (see also Bayraktar, Dayanik and Karatzas [2]-[3] for other important quickest detection problems for Poisson processes). We show that the op-timal switching times can be expressed as the ο¬rst times at which the appropriate posterior probability process exits certain connected regions restricted by boundaries, depending on the running states of some other conditional probability processes. We verify that the Bayesian
risk functions and the optimal switching boundaries are uniquely characterised by means of the equivalent coupled free-boundary problem for a parabolic-type partial diο¬erential operator. We derive analytic form estimates for the resulting Bayesian risk functions and the optimal switch-ing boundaries and formulate the appropriate explicit sequential switchswitch-ing multiple disorder detection procedure.
Optimal switching problems represent extensions of the corresponding optimal stopping problems and games in which one looks for an inο¬nite sequence of optimal stopping times. A general approach for studying such problems was developed in Bensoussan and Friedman [7]-[8], and Friedman [16] (see also Friedman [17; Chapter XVI]). This investigation was continued by Brekke and Γksendal [10], Duckworth and Zervos [13], Yushkevich and Gordienko [46], and
Hamad`ene and Jeanblanc [21] among others for the continuous time case, and by Yushkevich
[44]-[45] for the discrete time case. Other optimal switching and impulse control problems, involving hidden Markov chains in the observable jump processes, were recently studied by Bayraktar and Ludkovski [4]-[5].
The paper is organised as follows. In Section 2, for the initial Bayesian quickest multiple disorder detection problem, we construct the associated optimal switching problem and reduce the latter to the appropriate three-dimensional coupled optimal stopping problem. In Section 3, we present the equivalent free-boundary problem and describe the structure of the optimal stopping boundaries. Applying the change-of-variable formula with local time on surfaces, obtained by Peskir [28], we prove that the solution of the coupled optimal stopping problem can be determined as a unique solution of the free-boundary problem, satisfying the appropriate smooth-ο¬t conditions. In Section 4, we reduce the resulting parabolic-type partial diο¬erential operator to the normal form, which is amenable for further considerations. We derive closed form estimates for the Bayesian risk functions and the optimal switching boundaries, which are expressed in terms of Heunβs double conο¬uent functions, and describe the resulting sequential switching multiple disorder detection procedure. The main results are stated in Theorem 3.1 and Corollary 4.1. The optimal sequential detecting scheme is displayed more explicitly in Corollary 3.1.
2
Formulation of the problem.
In this section, we present a Bayesian formulation of the switching multiple disorder problem for an observable Brownian motion (see, e.g. [41; Chapter IV, Section 4] or [29; Chapter VI, Section 22] for the single disorder case). In these formulations, it is assumed that one observes a
sample path of a Brownian motion π with the drift rate switching between π0 and π1 at some
unobservable random times (we assume that π0 = 0 and π1 = π, without loss of generality).
2.1
The setting.
Let us assume that all the considerations take place on a probability space (Ξ©, π’, ππ) with a
continuous-time Markov chain Ξ = (Ξπ‘)π‘β₯0 with two states, 0 and 1, and an independent of Ξ
standard Brownian motion (Wiener process) π΅ = (π΅π‘)π‘β₯0 started at zero under ππ. Assume
that Ξ has the initial distribution {1 β π, π}, the transition-probability matrix {(π0πβ(π0+π1)π‘+
π1)}, so that the intensity-matrix {βπ0, π0; π1, βπ1}, for all π‘ β₯ 0 and some ππ > 0, π = 0, 1,
ο¬xed. In other words, the Markov chain Ξ changes its state from π to 1 β π at exponentially distributed times of intensity ππ, for every π = 0, 1, which are independent of the dynamics of
the Brownian motion π΅ . Such a process Ξ is called telegraphic signal in the literature (see, e.g. [25; Chapter IX, Section 4] or [14; Chapter VIII]).
Suppose that we observe a continuous process π = (ππ‘)π‘β₯0 given by the expression:
ππ‘ = π
β« π‘ 0
Ξπ ππ + π π΅π‘ (2.1)
where π β= 0 and π > 0 are some given constants. Being based upon the continuous observation
of π , our task is to ο¬nd among (non-decreasing) sequences of stopping times (ππ)πββ of π
(i.e., stopping times with respect to the natural ο¬ltration β±π‘= π(ππ β£ 0 β€ π β€ π‘) of the process
π , for π‘ β₯ 0) an optimal sequence (ππβ)πββ at which the alarms should be sounded as close as possible to the unknown switching times of the process Ξ. More precisely, the Bayesian switching multiple disorder problem consists of computing the Bayesian risk function:
πβ(π) = inf (ππ)πββ β β π=1 πΈπ [ πβππ2πβ1πΌ(Ξ π2πβ1 = Ξ0) + π βππ2ππΌ(Ξ π2π β= Ξ0) (2.2) + π β« π2πβ1 π2πβ2 πβππ‘πΌ(Ξπ‘β= Ξ0) ππ‘ + π β« π2π π2πβ1 πβππ‘πΌ(Ξπ‘= Ξ0) ππ‘ )]
and ο¬nding the non-decreasing sequence of optimal stopping times (ππβ)πββ with π0β = 0, at which the inο¬mum is attained in (2.2), where πΌ(β ) denotes the indicator function. Note that the function πβ(π) expresses the Bayesian risk of the whole sequence (ππ)πββ in the case in
which the process Ξ starts at Ξ0, which has the prior distribution ππ(Ξ0 = 1) = π and
ππ(Ξ0 = 0) = 1 β π , for all π β [0, 1]. We therefore see that πΈπ[πβππ2πβ1πΌ(Ξπ2πβ1 = Ξ0) ] and πΈπ[πβππ2ππΌ(Ξπ2π β= Ξ0)
]
expresses the average discounted loss due to a false alarm, and πΈπ β«π2πβ1 π2πβ2 π βππ‘πΌ(Ξ π‘ β= Ξ0) ππ‘ and πΈπ β«π2π π2πβ1π βππ‘πΌ(Ξ
π‘ = Ξ0) ππ‘ expresses the average discounted
loss due to a delay in detecting of the time at which Ξ changes its state either from Ξ0 to
1 β Ξ0, or from 1 β Ξ0 to Ξ0, respectively, for any π β β. In this case, π > 0 is a cost rate
due to a delay in detection, and π > 0 is a discounting rate.
Using the fact that (ππ)πββ is a non-decreasing sequence of stopping times with respect to
the ο¬ltration (β±π‘)π‘β₯0, by means of standard arguments, which are similar to those presented in
[41; pages 195-197], we obtain: πΈπ [ πβππππΌ(Ξ ππ βͺ Ξ0 )] = πΈπ [ πΈπ [ πβππππΌ(Ξ ππ βͺ Ξ0 ) β±ππ ]] (2.3) = πΈπ [ πβππππ π ( Ξππ βͺ Ξ0 β±ππ )] and πΈπ β« ππ ππβ1 πβππ‘πΌ(Ξππ βͺ Ξ0 ) ππ‘ = πΈπ β« β 0 πβππ‘πΌ(ππβ1β€ π‘, Ξπ‘βͺ Ξ0, π‘ < ππ ) ππ‘ (2.4) = πΈπ β« β 0 πΈπ [ πβππ‘πΌ(ππβ1 β€ π‘, Ξπ‘βͺ Ξ0, π‘ < ππ ) β±π‘ ] ππ‘ = πΈπ β« ππ ππβ1 πβππ‘ππ ( Ξπ‘βͺ Ξ0 β±π‘ ) ππ‘ holds for every π = 0, 1 and any π β β.
2.2
Suο¬cient statistics.
It is known from [25; Theorem 9.1] (see also [25; Chapter IX, Example 3]) that the posterior probability process Ξ = (Ξ π‘)π‘β₯0 deο¬ned by Ξ π‘= ππ(Ξπ‘ = 1 β£ β±π‘) solves the stochastic diο¬erential
equation:
πΞ π‘=(π0β (π0+ π1)Ξ π‘) ππ‘ +
π
πΞ π‘(1 β Ξ π‘) ππ΅π‘ (2.5)
with Ξ 0 = π , where the innovation process π΅ = (π΅π‘)π‘β₯0 deο¬ned by:
π΅π‘= 1 π ( ππ‘β β« π‘ 0 π Ξ π ππ ) (2.6) is a standard Brownian motion under the probability measure ππ, with respect to the ο¬ltration
(β±π‘)π‘β₯0, according to P. LΒ΄evyβs characterisation theorem (see, e.g. [25; Chapter IV,
Theo-rem 4.1]). It is also seen from (2.5) that Ξ is a (time-homogeneous strong) Markov process with respect to its natural ο¬ltration, which obviously coincides with (β±π‘)π‘β₯0. It also follows
from [25; Theorem 9.3] that the process Ξ π = (Ξ π
π‘)π‘β₯0 deο¬ned by Ξ ππ‘ = ππ(Ξπ‘= π, Ξ0 = π β£ β±π‘),
for π = 0, 1, solves the stochastic diο¬erential equation: πΞ ππ‘=(π1βπ(2π β 1) (π β Ξ π‘) β π0Ξ 0π‘ β π1Ξ 1π‘ ) ππ‘ + π πΞ π π‘(π β Ξ π‘) ππ΅π‘ (2.7) with Ξ 1
0 = 1 β Ξ 00 = π , for any π β [0, 1]. It follows from [26; Chapter VII, Theorem 7.2.4] that
the (time-homogeneous) process (Ξ , Ξ 0, Ξ 1) = (Ξ
π‘, Ξ 0π‘, Ξ 1π‘)π‘β₯0 has the strong Markov property
with respect to its natural ο¬ltration, which inherently coincides with (β±π‘)π‘β₯0.
Taking into account the expressions in (2.3) and (2.4), and the fact that Ξ 0
π‘+ Ξ 1π‘ = ππ(Ξπ‘=
Ξ0β£ β±π‘), we therefore conclude that the Bayesian risk function from (2.2) admits the
represen-tation: πβ(π) = inf (ππ)πββ β β π=1 πΈπ [ πβππ2πβ1(Ξ 0 π2πβ1+ Ξ 1 π2πβ1) + π βππ2π(1 β Ξ 0 π2π β Ξ 1 π2π) (2.8) + π β« π2πβ1 π2πβ2 πβππ‘(1 β Ξ 0π‘ β Ξ 1 π‘) ππ‘ + π β« π2π π2πβ1 πβππ‘(Ξ 0π‘ + Ξ 1π‘) ππ‘ ]
where the inο¬mum is taken over all non-decreasing sequences of stopping times (ππ)πββ. By
virtue of the strong Markov property of the process (Ξ , Ξ 0, Ξ 1), we can reduce the problem of
(2.8) to the following coupled optimal stopping problem: ππβ(π, π0, π1) = inf ππ πΈπ,π0,π1 [ πβπππ((2π β 1) (π β Ξ 0 ππβ Ξ 1 ππ) + π β 1βπ(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) ) (2.9) + π β« ππ 0 πβππ‘(1 β 2π) (1 β π β Ξ 0π‘ β Ξ 1 π‘) ππ‘ ]
where the inο¬mum is taken over all stopping times ππ, π = 0, 1, of the process (Ξ , Ξ 0, Ξ 1),
3
Main results and proofs.
In this section, we formulate and prove the main assertions of the paper, which are related to the coupled optimal stopping problem in (2.9), and thus to the quickest switching multiple disorder detection problem in (2.2) and (2.8).
3.1
The structure of the optimal stopping times.
In order to specify the structure of the optimal stopping times in the problem of (2.9), let us introduce the function:
πΉπ(π, π0, π1) = ππ0 π(π0+ π1+ π) β π(1 β π) π + π(π1β π0) π(π0+ π1+ π) π + 1 β π=0 π(π1βπβ ππ+ π) π(π0+ π1+ π) ππ (3.1)
and use ItΛoβs formula (see, e.g. [25; Theorem 4.4]) to obtain: πβππ‘πΉπ(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) = πΉπ(π, π0, π1) + π β« π‘ 0 πβππ (1 β π β Ξ 0π β Ξ 1π ) ππ + ππ π‘ (3.2)
where the process ππ = (ππ
π‘)π‘β₯0 deο¬ned by: ππ‘π = β« π‘ 0 πβππ π π ( π(π1β π0) π(π0+ π1+ π) Ξ π (1 β Ξ π ) + 1 β π=0 π(π1βπβ ππ+ π) π(π0+ π1+ π) Ξ ππ (π β Ξ π ) ) ππ΅π (3.3)
is a continuous square integrable martingale under ππ,π0,π1. Then, applying Doobβs optional sampling theorem (see, e.g. [25; Theorem 3.6]), we get from the expression in (3.2) that:
πΈπ,π0,π1[π βππππΉ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ)] = πΉπ(π, π0, π1) + π πΈπ,π0,π1 β« ππ 0 πβππ‘(1 β π β Ξ 0π‘ β Ξ 1 π‘) ππ‘ (3.4)
holds for all (π, π0, π1) β [0, 1]3 and any stopping time ππ. Hence, inserting the expression of
(3.4) into the one of (2.9), we see that the coupled optimal stopping problem takes the form: ππβ(π, π0, π1) = inf ππ πΈπ,π0,π1[π βπππ((1 β 2π) πΊ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) + π β 1βπ(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) )] (3.5) with ππβ(π, π0, π1) = ππβ(π, π0, π1) + (1 β 2π)πΉπ(π, π0, π1) and πΊπ(π, π0, π1) = πΉπ(π, π0, π1) + πΉ1βπ(π, π0, π1) + π0+ π1β π (3.6) = 2π(π1 β π0) π(π0+ π1+ π) π + 1 β π=0 ( 2π(π1βπ β ππ+ π) π(π0+ π1+ π) + 1 ) ππ+ π(π0β π1β π) π(π0+ π1+ π) β π
for all (π, π0, π1) β [0, 1]3 and π = 0, 1. Thus, by means of the results of general theory of
optimal stopping problems (see, e.g. [41; Chapter III, Section 3] and [29; Chapter I, Section 2]), it follows from the structure of the reward in (3.5) that the optimal stopping times are given by:
ππβ = inf{π‘ β₯ 0ππβ(Ξ π‘, Ξ 0π‘, Ξ 1π‘) = (1 β 2π) πΊπ(Ξ π‘, Ξ 0π‘, Ξ 1π‘) + π1βπβ (Ξ π‘, Ξ 0π‘, Ξ 1π‘) }
for π = 0, 1, whenever they exist. It is seen from the structure of the function πΉπ(π, π0, π1) in
(3.6) that if the point (π, π0, π1) belongs to the corresponding continuation region:
πΆπβ = {(π, π0, π1) β [0, 1]3β£ ππβ(π, π0, π1) < (1 β 2π) πΊπ(π, π0, π1) + π1βπβ (π, π0, π1)} (3.8)
then the points (π, πβ²0, πβ²1), with either ππβ² β₯ ππ or πβ²π β€ ππ and π1βπβ² = π1βπ when ππ β€ π1βπ
holds for some π = 0, 1, belong to either πΆ0β or πΆ1β, respectively. Then, taking into account the concavity of the functions (1 β 2π)πΊπ(π, π0, π1) + π1βπβ (π, π0, π1) in ππ on [0, 1], we may therefore
conclude that there exist functions 0 < πβ(π, π1βπ), πβ(π, π1βπ) < 1 such that the continuation
regions in (3.8) for the coupled optimal stopping problems of (2.9) and (3.5) take the form: πΆ0β = {(π, π0, π1) β [0, 1]3β£ ππ > πβ(π, π1βπ)} and πΆ1β = {(π, π0, π1) β [0, 1]3β£ ππ < πβ(π, π1βπ)}
(3.9) so that the corresponding stopping regions are the closures of the sets:
π·β0 = {(π, π0, π1) β [0, 1]3β£ ππ < πβ(π, π1βπ)} and π·1β = {(π, π0, π1) β [0, 1]3β£ ππ > πβ(π, π1βπ)}
(3.10)
when ππ β€ π1βπ holds for some π = 0, 1. It follows from the facts that the gain function
πΊπ(π, π0, π1) in (3.6) is linear and the diο¬erence function (ππβ β π1βπβ )(π, π0, π1) in (3.5) is
concave in the closure of π·βπ from (3.10), for every π = 0, 1, that the boundaries πβ(π, π1βπ)
and πβ(π, π1βπ) are continuous and of bounded variation.
Summarising the facts proved above, we are now ready to formulate the following assertion. Lemma 3.1 Let the process π be given by the equation in (2.1). Then, the optimal stopping times ππβ, π = 0, 1, in the coupled optimal stopping problems of (2.9) and (3.5) take the form:
π0β = inf{π‘ β₯ 0Ξ π‘π β€ πβ(Ξ π‘, Ξ 1βππ‘ )
}
and π1β = inf{π‘ β₯ 0Ξ π‘π β₯ πβ(Ξ π‘, Ξ 1βππ‘ )
}
(3.11) whenever they exist, for some continuous functions of bounded variation 0 < πβ(π, π1βπ), πβ(π, π1βπ) <
1, when ππ β€ π1βπ holds for some π = 0, 1. In that case, the optimal Bayesian times of alarms
(ππβ)πββ in the quickest switching multiple disorder detection problem of (2.8) are given by: π2πβ1β = inf{π‘ β₯ π2πβ2β Ξ ππ‘ β€ πβ(Ξ π‘, Ξ 1βππ‘ )} and π β 2π = inf{π‘ β₯ π β 2πβ1 Ξ ππ‘ β₯ πβ(Ξ π‘, Ξ 1βππ‘ ) } (3.12) for every π β β.
3.2
The coupled free-boundary problem.
By means of standard arguments based on the application of ItΛoβs formula (see, e.g. [22;
Chapter V, Section 5.1] or [26; Chapter VII, Section 7.3]), it is shown that the inο¬nitesimal operator π(Ξ ,Ξ 0,Ξ 1) of the process (Ξ , Ξ 0, Ξ 1) from (2.5) and (2.7) has the structure:
π(Ξ ,Ξ 0,Ξ 1)= (π0β (π0+ π1) π) βπ+ 1 2 (π π )2 π2(1 β π)2βππ2 β(π π )2 π0π2(1 β π) βππ2 0 (3.13) + (π1(π β π1) β π0π0) βπ0 + 1 2 (π π )2 π02π2βπ2 0π0 + (π π )2 π1π(1 β π)2βππ2 1 + (π0(1 β π β π0) β π1π1) βπ1 + 1 2 (π π )2 π21(1 β π)2βπ2 1π1 β (π π )2 π0π1π(1 β π) βπ20π1
for all (π, π0, π1) β (0, 1)3. We also note that the fact that the stochastic diο¬erential equations
for the posterior probabilities in (2.5) and (2.7) are driven by the same (one-dimensional) innovation Brownian motion yields the property that the inο¬nitesimal operator in (3.13) is of parabolic type.
In order to characterise the unknown value functions ππβ(π, π0, π1), π = 0, 1, from (3.5), as
well as the unknown boundaries πβ(π, π1βπ) and πβ(π, π1βπ) from (3.11), we may use the results
of the general theory of optimal stopping problems for continuous time Markov processes (see, e.g. [20], [41; Chapter III, Section 8] and [29; Chapter IV, Section 8]). More precisely, we formulate the associated coupled free-boundary problem:
(π(Ξ ,Ξ 0,Ξ 1)ππβ πππ)(π, π0, π1) = 0 for (π, π0, π1) β πΆπ (3.14) (π0β π1 β πΊ0)(π, π0, π1) ππ=π(π,π1βπ)+= (π1 β π0 + πΊ1)(π, π0, π1) ππ=π(π0,π1βπ)β= 0 (3.15) (ππβ π1βπ)(π, π0, π1) = (1 β 2π) πΊπ(π, π0, π1) for (π, π0, π1) β π·π (3.16) (ππβ π1βπ)(π, π0, π1) < (1 β 2π) πΊπ(π, π0, π1) for (π, π0, π1) β πΆπ (3.17) (π(Ξ ,Ξ 0,Ξ 1)ππβ πππ)(π, π0, π1) > 0 for (π, π0, π1) β π·π (3.18)
with 0 < π(π, π1βπ), π(π, π1βπ) < 1, where the instantaneous-stopping conditions of (3.15)
are satisο¬ed at πβ(π, π1βπ) and πβ(π, π1βπ) for all (π, π1βπ) β [0, 1]2, when ππ β€ π1βπ for
some π = 0, 1. Note that the superharmonic characterisation of the value function (see, e.g. [41; Chapter III, Section 8] and [29; Chapter IV, Section 9]) implies that ππβ(π, π0, π1), π =
0, 1, from (3.5) are the largest functions satisfying the expressions in (3.14)-(3.18) with the boundaries πβ(π, π1βπ) and πβ(π, π1βπ), respectively. Moreover, since the system in (3.14)-(3.18)
admits multiple solutions, we need to use certain additional conditions which would specify the appropriate solution providing the value function and the optimal switching boundaries for the initial problem of (3.5). For this, let us assume that the following smooth-ο¬t conditions:
(π0β π1 β πΊ0)ππ(π, π0, π1) ππ=π(π,π1βπ)+ = (π1β π0+ πΊ1)ππ(π, π0, π1) ππ=π(π,π1βπ)β= 0 (3.19) hold for all (π, π1βπ) β (0, 1)2, when ππ β€ π1βπ for some π = 0, 1.
We further provide an analysis of the parabolic-type free-boundary problem in (3.14)-(3.17), satisfying the inequality in (3.18) and the conditions of (3.19), and such that the resulting boundaries are continuous and of bounded variation. Since such free-boundary problems can-not normally be solved explicitly, the existence and uniqueness of classical as well as viscosity solutions of the variational inequalities, arising in the context of optimal stopping problems, have been extensively studied in the literature (see, e.g. Friedman [17], Bensoussan and Li-ons [9], Krylov [24], or Γksendal [26]). Although the necessary conditiLi-ons for existence and uniqueness of such solutions in [17; Chapter XVI, Theorem 11.1], [24; Chapter V, Section 3, Theorem 14] with [24; Chapter VI, Section 4, Theorem 12], and [26; Chapter X, Theorem 10.4.1] can be veriο¬ed by virtue of the regularity of the coeο¬cients of the three-dimensional diο¬usion process, the application of these classical results would still have rather inexplicit character.
We therefore continue with the following veriο¬cation assertion related to the free-boundary problem formulated above.
Lemma 3.2 Assume that the optimal stopping times ππβ, π = 0, 1, in the problem of (3.5) have a form of (3.11) with the continuous boundaries of bounded variation 0 < πβ(π, π1βπ), πβ(π, π1βπ) <
1, when ππ β€ π1βπ holds for some π = 0, 1. Then, the value functions from (3.5) admit the representations: π0β(π, π0, π1) = { π0(π, π0, π1; πβ(π, π1βπ)), for ππ > πβ(π, π1βπ) πΊ0(π, π0, π1) + π1β(π, π0, π1), for ππ β€ πβ(π, π1βπ) (3.20) and π1β(π, π0, π1) = { π1(π, π0, π1; πβ(π0, π1)), for ππ < πβ(π, π1βπ) βπΊ1(π, π0, π1) + π0β(π, π0, π1), for ππ β₯ πβ(π, π1βπ) (3.21) with π0(π, π0, π1; πβ(π, π1βπ)) = πΈπ,π0,π1[π βππβ 0 (πΊ 0(Ξ πβ 0, Ξ 0 πβ0, Ξ 1 π0β) + π β 1(Ξ πβ 0, Ξ 0 π0β, Ξ 1 πβ0) )] (3.22) and π1(π, π0, π1; πβ(π0, π1βπ)) = πΈπ,π0,π1[π βππβ 1 ( β πΊ 1(Ξ πβ1, Ξ 0 πβ 1, Ξ 1 πβ 1) + π β 0(Ξ π1β, Ξ 0 πβ 1, Ξ 1 πβ 1) )] (3.23) whenever the inequalities of (3.18) hold in the regions from (3.10) for every π = 0, 1, where the boundaries πβ(π, π1βπ) and πβ(π, π1βπ) are uniquely determined by the conditions of (3.19).
Proof. In order to verify the assertions stated above, let us denote by ππ(π, π0, π1), π =
0, 1, the right-hand sides of the expressions in (3.22) and (3.23), respectively. It follows by the strong Markov property of the process (Ξ , Ξ 0, Ξ 1) that the functions π0(π, π0, π1; πβ(π, π1βπ))
in (3.22) and π1(π, π0, π1; πβ(π, π1βπ)) in (3.23) solve the partial diο¬erential equation of (3.14)
and satisfy the instantaneous-stopping conditions of (3.15). Then, using the fact that the function ππ(π, π0, π1) satisο¬es the conditions of (3.16)-(3.17) by construction, we can apply the
local time-space formula from Peskir [28] (see also [29; Chapter II, Section 3.5] for a summary of the related results and further references) to obtain:
πβππ‘ππ(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) = ππ(π, π0, π1) + ππ‘π+ πΏ π π‘ (3.24) + β« π‘ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ πππ)(Ξ π , Ξ π 0, Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ) ππ
where the process ππ = (ππ
π‘)π‘β₯0 deο¬ned by: ππ‘π = β« π‘ 0 πβππ ( (ππ)π(Ξ π , Ξ 0π , Ξ 1 π ) π π Ξ π (1 β Ξ π ) + 1 β π=0 (ππ)ππ(Ξ π , Ξ 0 π , Ξ 1 π ) π π Ξ π π (π β Ξ π ) ) (3.25) Γ πΌ(Ξ π π β= πβ(Ξ π , Ξ 1βππ ), Ξ π π β= πβ(Ξ π , Ξ 1βππ )) ππ΅π
is a continuous local martingale under the probability measure ππ,π0,π1 with respect to the ο¬ltration (β±π‘)π‘β₯0, for every π = 0, 1. Here, the process πΏπ = (πΏππ‘)π‘β₯0 is given by:
πΏππ‘= 1 2 β« π‘ 0 πβππ Ξππππ(Ξ π , Ξ 0 π , Ξ 1 π ) πΌ(Ξ π π = ππ(Ξ 0π , Ξ 1βπ π )) πβ π π (3.26)
where we set Ξππππ(π, ππ(π, π1βπ), π1βπ) = (ππ)ππ(π, ππ(π, π1βπ)+, π1βπ)β(ππ)ππ(π, ππ(π, π1βπ)β, π1βπ) with π0(π, π1βπ) = π(π, π1βπ) and π1(π, π1βπ) = π(π, π1βπ), and the process βπ = (βππ‘)π‘β₯0 deο¬ned
by: βππ‘ = ππ,π0,π1 β lim πβ0 1 2π β« π‘ 0 πΌ( β π < Ξ ππ β ππ(Ξ π , Ξ 1βππ ) < π )(π π )2 β¨Ξ π β π π(Ξ , Ξ 1βπ)β©π (3.27)
is the local time of Ξ π at the surface π
π(Ξ , Ξ 1βπ) at which the partial derivative (ππ)ππ(π, π0, π1) may not exist, and β¨Ξ πβ π
π(Ξ , Ξ 1βπ)β© is the quadratic variation of the process Ξ πβ ππ(Ξ , Ξ 1βπ).
It follows from the structure of the gain function (1 β 2π)πΊπ(π, π0, π1) + π1βπβ (π, π0, π1) in (3.5),
and the optimal stopping times ππβ in (3.11), that the inequalities Ξππππ(π, ππ(π, π1βπ), π1βπ) β€ 0 should hold for all (π, π1βπ) β [0, 1]2, when ππ β€ π1βπ for some π = 0, 1, so that the continuous
process πΏπ deο¬ned in (3.26) is non-increasing. We may therefore conclude that πΏππ‘ = 0, π = 0, 1, can hold for all π‘ β₯ 0 if and only if the smooth-ο¬t conditions of (3.19) are satisο¬ed.
Using the assumption that the inequality in (3.18) holds with the boundaries πβ(π, π1βπ) and
πβ(π, π1βπ), we conclude from the conditions in (3.15)-(3.17) that (π(Ξ ,Ξ 0,Ξ 1)ππβπππ)(π, π0, π1) β₯ 0 holds for any ππ β= πβ(π, π1βπ) and ππ β= πβ(π, π1βπ), when ππ β€ π1βπ for some π =
0, 1. Moreover, by virtue of the fact that ππβ is an optimal stopping time, the inequality
(ππβ π1βπ)(π, π0, π1) β€ (1 β 2π)πΊπ(π, π0, π1) holds for all (π, π0, π1) β [0, 1]3 and every π = 0, 1.
Since the time spent by Ξ π at the surfaces π
β(Ξ , Ξ 1βπ) and πβ(Ξ , Ξ 1βπ) of bounded variation
is of Lebesgue measure zero, the indicators which appear in the integrals in the second lines of (3.24) and in (3.25) can be ignored. Thus, the expression in (3.24) yields that the inequalities:
πβπππ((1 β 2π) πΊ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) + π1βπ(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ)) + πΏ π ππ (3.28) β₯ πβππππ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) + πΏ π ππ β₯ ππ(π, π0, π1) + π π ππ
hold for any stopping time ππ and every π = 0, 1. Let (πππ)πββ be an arbitrary localising
sequence of stopping times for the processes ππ. Then, taking the expectations with respect
to ππ,π0,π1 in (3.28), by means of the optional sampling theorem (see, e.g. [25; Theorem 3.6]), we get that the inequalities:
πΈπ,π0,π1[π βπ(ππβ§πππ)((1 β 2π) πΊ π(Ξ ππβ§πππ, Ξ 0 ππβ§πππ, Ξ 1 ππβ§πππ) + π1βπ(Ξ ππβ§π π π, Ξ 0 ππβ§πππ, Ξ 1 ππβ§πππ)) + πΏ π ππβ§πππ ] β₯ πΈπ,π0,π1[π βπ(ππβ§πππ)π π(Ξ ππβ§πππ, Ξ 0 ππβ§πππ, Ξ 1 ππβ§πππ) + πΏ π ππβ§πππ ] (3.29) β₯ ππ(π, π0, π1) + πΈπ,π0,π1π π ππβ§πππ = ππ(π, π0, π1)
hold. Hence, letting π go to inο¬nity and using Fatouβs lemma, we obtain: πΈπ,π0,π1[π βπππ((1 β 2π) πΊ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) + π1βπ(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ)) + πΏ π ππ ] (3.30) β₯ πΈπ,π0,π1[π βππππ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ) + πΏ π ππ] β₯ ππ(π, π0, π1) for any stopping time ππ such that πΈπ,π0,π1πΏ
π
ππ > ββ and all (π, π0, π1) β [0, 1]
3, where πΏπ ππ = 0 holds whenever the conditions of (3.19) are satisο¬ed. By virtue of the structure of the stopping times in (3.11), it is readily seen that the equalities in (3.30) hold with ππβ instead of ππ when
(π, π0, π1) β π·βπ, for every π = 0, 1.
Let us now show that the equalities are attained in (3.30) when ππβ replaces ππ when
of the fact that the function ππ(π, π0, π1) and the continuous boundaries of bounded variation
πβ(π, π1βπ) and πβ(π, π1βπ) solve the partial diο¬erential equation in (3.14) and satisfy the
con-ditions of (3.15) and (3.19), it follows from the expression in (3.24) and the structure of the stopping times in (3.11) that the equalities:
πβπ(πβπβ§πππ)((1 β 2π) πΊ π(Ξ πβ πβ§πππ, Ξ 0 ππββ§ππ π , Ξ 1 ππββ§ππ π) + π1βπ(Ξ π β πβ§πππ, Ξ 0 ππββ§ππ π , Ξ 1 ππββ§ππ π) ) (3.31) = πβπ(ππββ§πππ)π π(Ξ πβ πβ§πππ, Ξ 0 ππββ§ππ π, Ξ 1 πβπβ§ππ π) + πΏ π ππββ§ππ π = ππ(π, π0, π1) + π π ππββ§ππ π
hold for (π, π0, π1) β πΆπβ and any localising sequence (πππ)πββ of ππ. Hence, taking expectations
and letting π go to inο¬nity in (3.31), and using the fact that πΊπ(π, π0, π1) and ππ(π, π0, π1),
π = 0, 1, are bounded functions, we apply the Lebesgue dominated convergence theorem to obtain the equalities:
πΈπ,π0,π1[π βππβ π ((1 β 2π) πΊ π(Ξ πβ π, Ξ 0 πβπ, Ξ 1 ππβ) + π1βπ(Ξ πβ π, Ξ 0 ππβ, Ξ 1 ππβ))] = ππ(π, π0, π1) (3.32)
for all (π, π0, π1) β [0, 1]3. We may therefore conclude that the function ππ(π, π0, π1) coincides
with the value function ππβ(π, π0, π1) of the optimal stopping problem in (3.5), for π = 0, 1,
whenever the smooth-ο¬t conditions of (3.19) hold.
In order to prove uniqueness of the value functions ππβ(π, π0, π1), π = 0, 1, and the
bound-aries πβ(π, π1βπ) and πβ(π, π1βπ) as solutions of the free-boundary problem in (3.14)-(3.17)
with the smooth-ο¬t conditions of (3.19), let us assume that there exist other continuous bound-aries of bounded variation πβ²(π, π1βπ) and πβ²(π, π1βπ) such that the inequality in (3.18) is
satisο¬ed. Then, deο¬ne the functions ππβ²(π, π0, π1), π = 0, 1, as in (3.20) and (3.21) with
π0β²(π, π0, π1; πβ²(π, π1βπ)) and π1β²(π, π0, π1; πβ²(π, π1βπ)) as in (3.22) and (3.23), and the stopping
times ππβ², π = 0, 1, as in (3.11) with πβ²(π, π1βπ) and πβ²(π, π1βπ) instead of πβ(π, π1βπ) and
πβ(π, π1βπ), respectively. Following the arguments from the previous part of the proof and
us-ing the fact that the functions ππβ²(π, π0, π1), π = 0, 1, solve the partial diο¬erential equation in
(3.14) and satisο¬es the conditions of (3.15) and (3.19) with πβ²(π, π1βπ) and πβ²(π, π1βπ) instead
of π(π, π1βπ) and π(π, π1βπ) by construction, we apply the change-of-variable formula from [28]
to get: πβππ‘ππβ²(Ξ π‘, Ξ 0π‘, Ξ 1π‘) = π β² π(π, π0, π1) + ππ‘π β² (3.33) + β« π‘ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ²β πππβ²)(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ²) ππ where the process ππβ²= (ππ
π‘ β²
)π‘β₯0 deο¬ned as in (3.25) with (ππβ²)π(π, π0, π1) and (ππβ²)ππ(π, π0, π1) instead of (ππβ²)π(π, π0, π1) and (ππβ²)ππ(π, π0, π1) is a continuous local martingale with respect to the probability measure ππ,π0,π1, and πΆ
β²
π is deο¬ned as in (3.9) with πβ(π, π1βπ) and πβ(π, π1βπ)
instead of πβ²(π, π1βπ) and πβ²(π, π1βπ). Thus, taking into account the structure of the stopping
times ππβ², π = 0, 1, we obtain from (3.33) that: πβπ(ππβ²β§πππ β²) ((1 β 2π) πΊπ(Ξ πβ² πβ§πππ β², Ξ 0 ππβ²β§ππ π β², Ξ 1πβ² πβ§πππ β²) + π1βπβ² (Ξ πβ² πβ§πππ β², Ξ 0 ππβ²β§ππ π β², Ξ 1πβ² πβ§πππ β²) ) (3.34) = πβπ(ππβ²β§πππ β²) ππβ²(Ξ πβ² πβ§πππ β², Ξ 0 πβ² πβ§πππβ², Ξ 1 πβ² πβ§πππβ²) = π β² π(π, π0, π1) + πππβ²β² πβ§πππβ² holds for (π, π0, π1) β πΆπβ² and any localising sequence (πππ
β²)
πββ of ππβ². Hence, taking
π = 0, 1, are bounded functions, by means of the Lebesgue dominated convergence theorem, we have that the equality:
πΈπ,π0,π1[π βππβ² π((1 β 2π) πΊ π(Ξ πβ²π, Ξ 0πβ² π, Ξ 1 πβ² π) + π β² 1βπ(Ξ ππβ², Ξ 0πβ² π, Ξ 1 πβ² π))] = π β² π(π, π0, π1) (3.35)
is satisο¬ed. Therefore, recalling the fact that ππβ, π = 0, 1, are the optimal stopping times in (3.5) and comparing the expressions in (3.32) and (3.35), we see that the inequality ππβ²(π, π0, π1) β₯
ππ(π, π0, π1) should hold for all (π, π0, π1) β [0, 1]3.
To prove the fact that πβ(π, π1βπ) β€ πβ²(π, π1βπ) and πβ²(π, π1βπ) β€ πβ(π, π1βπ) holds, let us
take a point ππ < πβ(π, π1βπ) β§ πβ²(π, π1βπ) or ππ > πβ(π, π1βπ) β¨ πβ²(π, π1βπ), for which we have
ππβ²(π, π0, π1) = ππ(π, π0, π1) = πΊπ(π, π0, π1), π = 0, 1. For this, we consider the stopping times:
Ο°0β = inf{π‘ β₯ 0 Ξ π π‘ β₯ πβ(Ξ π‘, Ξ 1βππ‘ ) } and Ο°1β = inf{π‘ β₯ 0Ξ π π‘ β€ πβ(Ξ π‘, Ξ 1βππ‘ )}. (3.36)
Then, inserting Ο°βπβ§πππ and Ο°πββ§πππ β²
into (3.24) and (3.33) in place of π‘, and using the arguments similar to the ones above, we obtain:
πΈπ,π0,π1[π βπΟ°β π π π(Ξ Ο°πβ, Ξ 0 Ο°βπ, Ξ 1 Ο°βπ)] = ππ(π, π0, π1) (3.37) + πΈπ,π0,π1 β« Ο°βπ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ πππ)(Ξ π , Ξ π 0, Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ) ππ and πΈπ,π0,π1[π βπΟ°β π πβ² π(Ξ Ο°βπ, Ξ 0 Ο°πβ, Ξ 1 Ο°πβ)] = π β² π(π, π0, π1) (3.38) + πΈπ,π0,π1 β« Ο°πβ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ²β πππβ²)(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ²) ππ
for all (π, π0, π1) β [0, 1]3. Hence, taking into account the fact that ππβ²(π, πβ(π, π1βπ), π1βπ) β₯
ππ(π, πβ(π, π1βπ), π1βπ) and ππβ²(π, πβ(π, π1βπ), π1βπ) β₯ ππ(π, πβ(π, π1βπ), π1βπ) holds for every π =
0, 1, we get from (3.37) and (3.38) that the inequality: πΈπ,π0,π1 β« Ο°πβ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ πππ)(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ 0π , Ξ 1π ) /β πΆπβ) ππ (3.39) β€ πΈπ,π0,π1 β« Ο°πβ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ²β πππβ²)(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ²) ππ
is satisο¬ed. Thus, by virtue of the assumption of continuity of πβ²(π, π1βπ) and πβ²(π, π1βπ),
we see from (3.39) that πβ(π, π1βπ) β€ πβ²(π, π1βπ) and πβ²(π, π1βπ) β€ πβ(π, π1βπ) holds for all
(π, π0, π1) β [0, 1]3.
We ο¬nally show that πβ²(π, π1βπ) and πβ²(π, π1βπ) should coincide with πβ(π, π1βπ) and
πβ(π, π1βπ). For this, we take ππ β (πβ(π, π1βπ), πβ²(π, π1βπ)) or ππ β (πβ²(π, π1βπ), πβ(π, π1βπ))
for some (π, π1βπ) β [0, 1]2 for such it exists. Hence, inserting ππββ§ πππ
β² into (3.33) in place of π‘
and using the arguments similar to the ones above, we obtain: πΈπ,π0,π1[π βππβ π πβ² π(Ξ ππβ, Ξ 0ππβ, Ξ 1 πβπ)] = π β² π(π, π0, π1) (3.40) + πΈπ,π0,π1 β« ππβ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ²β πππβ²)(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ π 0, Ξ 1π ) /β πΆπβ²) ππ
for all (π, π0, π1) β [0, 1]3. Thus, since we have ππβ²(π, π0, π1) = ππ(π, π0, π1) = πΊπ(π, π0, π1)
for ππ = πβ(π, π1βπ) and ππ = πβ(π, π1βπ), and ππβ²(π, π0, π1) β₯ ππ(π, π0, π1), we see from the
expressions in (3.32) and (3.40) that the inequality: πΈπ,πβ 0,π1
β« ππβ
0
πβππ (π(Ξ ,Ξ 0,Ξ 1)ππβ²β πππβ²)(Ξ π , Ξ π 0, Ξ 1π ) πΌ((Ξ π , Ξ 0π , Ξ 1π ) /β πΆπβ²) ππ β€ 0 (3.41) should hold for every π = 0, 1, but that is impossible due to the assumption of continuity of πβ(π, π1βπ) and πβ(π, π1βπ). We may therefore conclude that πβ(π, π1βπ) = πβ²(π, π1βπ) and
πβ(π, π1βπ) = πβ²(π, π1βπ), so that ππβ²(π, π0, π1) coincides with ππ(π, π0, π1) for all (π, π0, π1) β
[0, 1]3 and every π = 0, 1. β‘
3.3
The location of the optimal stopping boundaries.
Suppose that the inequality πβ(π, π1βπ) < πβ(π, π1βπ) holds for all (π, π1βπ) β [0, 1]2 when
ππ β€ π1βπ for some π = 0, 1. This property means that the solution of the coupled optimal
stopping problem and the corresponding optimal quickest switching multiple disorder detection procedure is nontrivial. In this case, the equalities in (3.14) and (3.16) directly imply that the inequality in (3.18) takes the form:
(1 β 2π) π»π(π, π0, π1) > 0 for (π, π0, π1) β π·π (3.42)
with
π»π(π, π0, π1) = π0+ π + ππ + (π1β π0) π β (2(π0+ π) + π) π0β (2(π1+ π) + π) π1 (3.43)
for every π = 0, 1. Observe that the expressions in (3.42)-(3.43) are equivalent to the fact that the sets:
π 0 = {(π, π0, π1) β [0, 1]3β£ (2(π0+ π) + π) π0+ (2(π1+ π) + π) π1 > π0+ π + (π1β π0) π} (3.44)
and
π 1 = {(π, π0, π1) β [0, 1]3β£ (2(π0+π)+π) π0+(2(π1+π)+π) π1 < π +π0+π+(π1βπ0) π} (3.45)
belong to the continuation regions πΆ0β and πΆ1β from (3.9), which means that the inequalities: πβ(π, π1βπ) < π(π, π1βπ) β‘ π0+ π + (π1β π0)π β (2(π1βπ + π) + π)π1βπ 2(ππ + π) + π (3.46) and πβ(π, π1βπ) > π(π, π1βπ) β‘ π + π0+ π + (π1β π0)π β (2(π1βπ + π) + π)π1βπ 2(ππ+ π) + π (3.47) are satisο¬ed, so that 0 < πβ(π, π1βπ) < π(π, π1βπ) < π(π, π1βπ) < πβ(π, π1βπ) < 1 holds for all
(π, π1βπ) β (0, 1)2. It is therefore natural to call the parameters of the model admissible when
the inequalities in (3.46)-(3.47) are satisο¬ed, since otherwise, the optimal stopping times in the problem of (3.5) do not have the structure of (3.11) whenever they exist.
3.4
The structure of the optimal stopping boundaries.
Applying ItΛoβs formula to the expression in (3.6), we get: πβππ‘πΊπ(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) = πΊπ(π, π0, π1) + β« π‘ 0 πβππ π»π(Ξ π , Ξ 0π , Ξ 1 π ) ππ + π βπ π‘ (3.48)
where the function π»π(π, π0, π1) is given by (3.43), the process πβπ= (ππ‘βπ)π‘β₯0 deο¬ned by:
ππ‘βπ = ππ‘π+ ππ‘1βπ+ 1 β π=0 β« π‘ 0 πβππ π π Ξ π π (π β Ξ π ) ππ΅π (3.49)
is a continuous square integrable martingale under the probability measure ππ,π0,π1, and the processes ππ = (ππ‘π)π‘β₯0, π = 0, 1, are deο¬ned in (3.3). Then, applying Doobβs optional sampling
theorem, we get from the expression in (3.48) that: πΈπ,π0,π1[π βππβ π πΊ π(Ξ ππ, Ξ 0 ππ, Ξ 1 ππ)] = πΊπ(π, π0, π1) + πΈπ,π0,π1 β« ππ 0 πβππ‘π»π(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) ππ‘ (3.50)
holds for all (π, π0, π1) β [0, 1]3 and any stopping time ππ. Moreover, we can observe from the
application of the change-of-variable formula in (3.24) that the expression: πβππ‘π1βπβ (Ξ π‘, Ξ 0π‘, Ξ 1 π‘) = π β 1βπ(π, π0, π1) + π β(1βπ) π‘ (3.51) + β« π‘ 0 πβππ (π(Ξ ,Ξ 0,Ξ 1)π1βπβ β ππ1βπβ )(Ξ π , Ξ 0π , Ξ 1π ) πΌ((Ξ π , Ξ 0π , Ξ 1π ) β π·1βπβ ) ππ holds, where πβ(1βπ) = (ππ‘β(1βπ))π‘β₯0 deο¬ned by:
ππ‘β(1βπ) = β« π‘ 0 πβππ (π1βπβ )π(Ξ π , Ξ 0π , Ξ 1 π ) π π Ξ π (1 β Ξ π ) ππ΅π (3.52) + 1 β π=0 β« π‘ 0 πβππ (π1βπβ )ππ(Ξ π , Ξ 0 π , Ξ 1π ) π π Ξ π π (π β Ξ π ) ππ΅π
is a continuous local martingale under ππ,π0,π1, for every π = 0, 1. By virtue of the concavity of the value functions ππβ(π, π0, π1), π = 0, 1, it follows that the derivatives in (3.52) are bounded,
so that the process (ππβ(1βπ)β
πβ§π‘ )π‘β₯0 is a square integrable integrable martingale under ππ,π0,π1. Hence, applying Doobβs optional sampling theorem, we get from the expressions in (3.51) that:
πΈπ,π0,π1[π βππβ π πβ 1βπ(Ξ πβ π, Ξ 0 πβ π, Ξ 1 πβ π)] = π β 1βπ(π, π0, π1) (3.53) + πΈπ,π0,π1 β« ππβ 0 πβππ‘(π(Ξ ,Ξ 0,Ξ 1)π1βπβ β ππ1βπβ )(Ξ π‘, Ξ 0π‘, Ξ 1π‘) πΌ((Ξ π‘, Ξ 0π‘, Ξ 1π‘) β π·β1βπ) ππ‘
holds for all (π, π0, π1) β [0, 1]3 and every π = 0, 1. Thus, getting the expressions in (3.50) and
(3.53) together, we obtain from the deο¬nition of the optimal stopping times in (3.5) that: (ππββ π1βπβ β (1 β 2π) πΊπ)(π, π0, π1) = πΈπ,π0,π1 β« ππβ 0 πβππ‘(1 β 2π) π»π(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) ππ‘ (3.54) + πΈπ,π0,π1 β« πβπ 0 πβππ‘(π(Ξ ,Ξ 0,Ξ 1)π1βπβ β ππ1βπβ )(Ξ π‘, Ξ 0π‘, Ξ 1π‘) πΌ((Ξ π‘, Ξ 0π‘, Ξ 1π‘) β π·β1βπ) ππ‘
holds for all (π, π0, π1) β [0, 1]3 and every π = 0, 1.
Let us now ο¬x some (π, π0, π1) β πΆπβ and denote by π β π = π
β
π(π, π0, π1) the optimal stopping
time in the problem of (3.5). In this case, it follows from (3.54) and the structure of the optimal stopping times in (3.7) that the inequality:
(ππββ π1βπβ β (1 β 2π) πΊπ)(π, π0, π1) β€ πΈπ,π0,π1 β« ππββ§π1βπβ 0 πβππ‘(1 β 2π) π»π(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) ππ‘ < 0 (3.55)
holds, where the function π»π(π, π0, π1) deο¬ned in (3.43) admits the representation:
π»π(π, π0, π1) = π0+ π + 2π(π(π1βπ β ππ β π0β π1) β ππ(π0+ π1+ π)) 2π(π1βπ β ππ+ π) + π(π0+ π1+ π) π (3.56) + π(2(ππ+ π) + π)(π0 β π1β π) 2π(π1βπ β ππ + π) + π(π0+ π1+ π) β π(2(ππ + π) + π)(π0 + π1 + π) 2π(π1βπβ ππ+ π) + π(π0+ π1+ π) πΊπ(π, π0, π1) + (π1βπ β ππ) 2π(π0+ π1+ 2(π + π)) + π(π0+ π1+ π) 2π(π1βπ β ππ+ π) + π(π0+ π1+ π) ((1 β 2π) π β π1βπ )
for every π = 0, 1, when ππ β€ π1βπ for some π = 0, 1. Let us then take (πβ², π0β², π β²
1) β [0, 1]3
such that πΊπ(π, π0, π1) = πΊπ(πβ², π0β², π β²
1) holds with π1βπ β€ πβ²1βπ in case π = 0 and π β²
1βπ β€ π1βπ
in case π = 1, as well as πβ² β€ π in case π = π and π β€ πβ² in case π β= π . Hence, using the facts
that (Ξ , Ξ 0, Ξ 1) is a time-homogeneous strong Markov process and πβ π = π
β
π(π, π0, π1) does not
depend on (πβ², π0β², π1β²), taking into account the comparison results for solutions of stochastic diο¬erential equations in Veretennikov [43], we obtain:
(ππββ π1βπβ β (1 β 2π) πΊπ)(πβ², π0β², π β² 1) β€ πΈπβ²,πβ² 0,πβ²1 β« ππββ§πβ1βπ 0 πβππ‘(1 β 2π) π»π(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) ππ‘ (3.57) β€ πΈπ,π0,π1 β« ππββ§πβ1βπ 0 πβππ‘(1 β 2π) π»π(Ξ π‘, Ξ 0π‘, Ξ 1 π‘) ππ‘
holds for every π = 0, 1. By virtue of the inequality in (3.55) and the expression in (3.56), we may therefore conclude that (πβ², π0β², π1β²) β πΆπβ, so that the functions:
πβ(π, π1βπ) + 2π(1 β 2π)(π1βπβ ππ)π + (2π(ππ β π1βπ + π) + π(π0+ π1+ π))π1βπ 2π(π1βπ β ππ + π) + π(π0+ π1+ π) (3.58) and πβ(π, π1βπ) + 2π(1 β 2π)(π1βπ β ππ)π + (2π(ππβ π1βπ + π) + π(π0+ π1+ π))π1βπ 2π(π1βπ β ππ + π) + π(π0+ π1+ π) (3.59)
are decreasing in π1βπ and increasing or decreasing in π on [0, 1] in case π = 0 or π = 1,
respectively.
We are now in a position to formulate the main assertion of the paper, which follows from a straightforward combination of Lemmata 3.1 and 3.2 together with the arguments above. Theorem 3.1 Suppose that the assumptions of Lemmata 3.1 and 3.2 hold for admissible pa-rameters of the model. Then, the value functions ππβ(π, π0, π1), π = 0, 1, in the coupled optimal
stopping problem of (2.9) are given by ππβ(π, π0, π1) = ππβ(π, π0, π1) β (1 β 2π)πΉπ(π, π0, π1) with
πΉπ(π, π0, π1) deο¬ned in (3.1). Here, the value functions ππβ(π, π0, π1), π = 0, 1, in (3.5) have
the form of (3.20)-(3.21) with (3.22)-(3.23), and the continuous optimal stopping boundaries πβ(π, π1βπ) and πβ(π, π1βπ) in (3.11) are uniquely speciο¬ed by the smooth-ο¬t conditions of (3.19)
and satisfy the properties proved above, when ππ β€ π1βπ holds for some π = 0, 1. Moreover,
the boundaries πβ(π, π1βπ) and πβ(π, π1βπ) satisfy the inequalities in (3.46)-(3.47) and are such
that the functions in (3.58)-(3.59) are decreasing in π1βπ, and either increasing or decreasing
in π on [0, 1] in case of either π = 0 or π = 1, respectively.
Based on the result proved above, let us ο¬nally formulate the following explicit optimal sequential procedure for the Bayesian switching multiple disorder detection.
Corollary 3.1 Suppose that the assumptions of Theorem 3.3 hold. Then, in the quickest
switching multiple disorder detection problem of (2.8) for the observation process π from (2.1), the Bayesian risk function takes the form πβ(π) = π0β(π, 1 β π, π), for all π β [0, 1], and the optimal switching times (ππβ)πββ have the form of (3.12). Moreover, the following quickest multiple disorder detection procedure is optimal for every π β β:
(i) stop the observations at time π2πβ1β from (3.12), that is, as soon as the process Ξ π from
(2.7) exits the region (πβ(Ξ , Ξ 1βπ), 1], conclude that the process Ξ has switched from the state
Ξ0 to 1 β Ξ0, when ππ β€ π1βπ holds for some π = 0, 1, and then, continue with step (ii);
(ii) stop the observations at time π2πβ from (3.12), that is, as soon as the process Ξ π exits
the region [0, πβ(Ξ , Ξ 1βπ)), conclude that the process Ξ has switched from the state 1 β Ξ0 to
Ξ0, when ππ β€ π1βπ holds for some π = 0, 1, and then, continue with the step (i).
4
Some analytic-form estimates.
In this section, we provide analytic-form estimates for the value functions of the coupled optimal stopping problems of (2.9) and (3.5), and thus, for the Bayesian risk function in (2.8) as well as for the optimal stopping boundaries from (3.11) and (3.12).
4.1
The change of variables.
In order to derive such estimates, we shall reduce the operator in (3.13) to the normal form, by means of the one-to-one correspondence transformation process proposed by A.N. Kolmogorov in [23] (see also [18]-[19]). For this, let us deο¬ne the processes π = (ππ‘)π‘β₯0 and π = (ππ‘)π‘β₯0 by:
ππ‘ = Ξ 0π‘/(1 β Ξ π‘) β‘ ππ(Ξ0 = 0 β£ β±π‘, Ξπ‘= 0) and ππ‘= Ξ 1π‘/Ξ π‘β‘ ππ(Ξ0 = 1 β£ β±π‘, Ξπ‘ = 1) (4.1)
for all π‘ β₯ 0. Then, by means of ItΛoβs formula, we get that the processes π and π admit the
representations: πππ‘= π1 (Ξ π‘β Ξ 1π‘)(1 β Ξ π‘) β Ξ 0π‘Ξ π‘ (1 β Ξ π‘)2 ππ‘ = π1 Ξ π‘ 1 β Ξ π‘ (1 β ππ‘β ππ‘) ππ‘ (4.2) and πππ‘ = π0 (Ξ π‘β Ξ 1π‘)(1 β Ξ π‘) β Ξ 0π‘Ξ π‘ Ξ 2 π‘ ππ‘ = π0 1 β Ξ π‘ Ξ π‘ (1 β ππ‘β ππ‘) ππ‘ (4.3)
with π0 = π0 = 1. It is seen from the equations in (4.2)-(4.3) that the processes π and π are
of bounded variation on their state space [0, 1].
It follows from the expressions in (4.1) that there exists a one-to-one correspondence between the processes (Ξ , Ξ 0, Ξ 1) and (Ξ , π, π). Hence, the function ππβ(π, π0, π1) from (2.9) is equal
to the one of the coupled optimal stopping problem: ππβ(π, π¦, π§) = inf
ππ
πΈπ,π¦,π§[πβπππ((1 β 2π)πΊΛπ(Ξ ππ, πππ, πππ) + π1βπβ (Ξ ππ, πππ, πππ) )]
(4.4)
where the inο¬mum is taken over all stopping times ππ, for every π = 0, 1, and the function
Λ
πΊπ(π, π¦, π§) = πΊπ(π, π¦(1 β π), π§π) admits the representation:
Λ πΊπ(π, π¦, π§) = π΄(π¦, π§) π + ( 2π(π1β π0+ π) π(π0+ π1+ π) + 1 ) π¦ +π(π0β π1β π) π(π0+ π1+ π) β π (4.5) with π΄(π¦, π§) = 2π(π1β π0) π(π0+ π1+ π) +( 2π(π0β π1+ π) π(π0+ π1+ π) + 1 ) π§ β( 2π(π1β π0+ π) π(π0+ π1+ π) + 1 ) π¦ (4.6)
for all (π, π¦, π§) β [0, 1]3. Here ππ,π¦,π§ is a probability measure under which the diο¬usion process
(Ξ , π, π) = (Ξ π‘, ππ‘, ππ‘)π‘β₯0 starts at some (π, π¦, π§) β [0, 1]3 and solves the equations of (2.5) and
(4.2)-(4.3). It thus follows from (3.11) that there exist functions πβ(π¦, π§) and ββ(π¦, π§) such that
0 < πβ(π¦, π§) βΆ ββ(π¦, π§) < 1 when π΄(π¦, π§) β· 0, and the optimal stopping times in the problem
of (4.4) have the structure:
π0β = inf{π‘ β₯ 0Ξ π‘β πβ(ππ‘, ππ‘) when π΄(ππ‘, ππ‘) β· 0 } (4.7) and π1β = inf{π‘ β₯ 0 Ξ π‘β ββ(ππ‘, ππ‘) when π΄(ππ‘, ππ‘) β· 0}. (4.8)
In this case, the continuation regions from (3.9) take the form: πΆ0β ={(π, π¦, π§) β [0, 1]3 π β· πβ(π¦, π§) when π΄(π¦, π§) β· 0 } (4.9) and πΆ1β ={(π, π¦, π§) β [0, 1]3π βΆ ββ(π¦, π§) when π΄(π¦, π§) β· 0 } (4.10) so that the corresponding regions from (3.10) are given by:
π·0β ={(π, π¦, π§) β [0, 1]3π βΆ πβ(π¦, π§) when π΄(π¦, π§) β· 0 } (4.11) and π·1β ={(π, π¦, π§) β [0, 1]3π β· ββ(π¦, π§) when π΄(π¦, π§) β· 0 } (4.12) respectively. Here, due to the monotonicity of the functions in (3.58)-(3.59), the boundaries πβ(π¦, π§) and ββ(π¦, π§) are uniquely determined from the equations π§π(π¦, π§) = πβ(π(π¦, π§), π¦(1 β
π(π¦, π§))) and π§β(π¦, π§) = πβ(β(π¦, π§), π¦(1 β β(π¦, π§))) in case π1 β€ π0, and π¦(1 β π(π¦, π§)) =
4.2
The coupled free-boundary problem.
Standard arguments then show that the inο¬nitesimal operator π(Ξ ,π,π) of the process (Ξ , π, π)
from (2.5) and (4.2)-(4.3) has the structure: π(Ξ ,π,π) = (π0β (π0+ π1) π) βπ + 1 2 (π π )2 π2(1 β π)2βππ2 (4.13) + π1 π 1 β π(1 β π¦ β π§) βπ¦+ π0 1 β π π (1 β π¦ β π§) βπ§ (4.14)
for all (π, π¦, π§) β (0, 1)3. It can be shown by means of the same arguments as in the proof of
Theorem 3.3 above that the value functions ππβ(π, π¦, π§), π = 0, 1, from (4.4) and the boundaries πβ(π¦, π§) and ββ(π¦, π§) from (4.7)-(4.8) solve the free-boundary problem:
(π(Ξ ,π,π)ππβ πππ)(π, π¦, π§) = 0 for (π, π¦, π§) β πΆπ (4.15) (π0β π1β ΛπΊ0)(π, π¦, π§) π=π(π¦,π§)Β± = 0 when π΄(π¦, π§) β· 0 (4.16) (π1β π0+ ΛπΊ1)(π, π¦, π§) π=β(π¦,π§)β = 0 when π΄(π¦, π§) βΆ 0 (4.17) (ππβ π1βπ)(π, π¦, π§) = (1 β 2π) ΛπΊπ(π, π¦, π§) for (π, π¦, π§) β π·π (4.18) (ππβ π1βπ)(π, π¦, π§) < (1 β 2π) ΛπΊπ(π, π¦, π§) for (π, π¦, π§) β πΆπ (4.19) (π(Ξ ,π,π)ππβ πππ)(π, π¦, π§) > 0 for (π, π¦, π§) β π·π (4.20) with (π0β π1β ΛπΊ0)π(π, π¦, π§) π=π(π¦,π§)Β± = 0 when π΄(π¦, π§) β· 0 (4.21) (π1β π0+ ΛπΊ1)π(π, π¦, π§) π=β(π¦,π§)β = 0 when π΄(π¦, π§) βΆ 0 (4.22)
where the instantaneous-stopping conditions in (4.16)-(4.17) and the smooth-ο¬t conditions (4.21)-(4.22) hold for all (π¦, π§) β (0, 1)2.
Since the solution of the free-boundary problem of (4.15)-(4.20) with (4.21)-(4.22) cannot be found in an explicit form, let us introduce the functions Λππ(π, π¦, π§) and the boundaries
Λ
π(π¦, π§) and Λβ(π¦, π§) satisfying the boundary conditions of (4.16)-(4.19) and (4.21)-(4.22) and the expressions: (π(Ξ ,π,π)ππβ πππ)(π, π¦, π§) (4.23) = π1 π 1 β π (1 β π¦ β π§) (ππ)π¦(π, π¦, π§) + π0 1 β π π (1 β π¦ β π§) (ππ)π§(π, π¦, π§) for (π, π¦, π§) β πΆπ (π(Ξ ,π,π)ππβ πππ)(π, π¦, π§) (4.24) > π1 π 1 β π (1 β π¦ β π§) (ππ)π¦(π, π¦, π§) + π0 1 β π π (1 β π¦ β π§) (ππ)π§(π, π¦, π§) for (π, π¦, π§) β π·π for ΛπΆπ and Λπ·π deο¬ned as in (4.9)-(4.12) withΛπ(π¦, π§) and Λβ(π¦, π§) instead of πβ(π¦, π§) and ββ(π¦, π§), respectively. Observe that the equalities in (4.23) and (4.18) directly imply that the inequality in (4.24) takes the form:
with Λ
π»π(π, π¦, π§) = π + ππ + π0(1 β π) (1 β 2π¦) + π1π (1 β 2π§) β (2π + π) (π¦ + (π§ β π¦) π) (4.26)
for every π = 0, 1. We further look for functions which solve the resulting ordinary diο¬eren-tial coupled free-boundary problem of (4.23)+(4.16)-(4.19)+(4.21)-(4.22)+(4.24) in which the variables π¦ and π§ are parameters.
4.3
The existence of solution of the ordinary free-boundary
prob-lem.
The general solution of the second-order ordinary diο¬erential equation in (4.23) has the form:
ππ(π, π¦, π§) = 1
β
π=0
πΎππ(π¦, π§) ππ(π) (4.27)
where πΎππ(π¦, π§), π, π = 0, 1, are some continuously diο¬erentiable functions, and the functions
ππ(π), π = 0, 1, are given by:
ππ(π) = β π(1 β π) ( π 1 β π )(π1βπ0)/π exp( 2π0+ (π1β π0)(π + π) π(π + (1 β 2π)π) ) (4.28) Γ ππ ( (β1)π+1π, π0, π, π1; β π0(1 β π) + β π1π β π0(1 β π) β β π1π )
for all π β (0, 1) with
π =(π π )2 , π = 8 β π0π1 π , π = 32βπ0π1(π0 β π1) π2 (4.29) and ππ = (β1)π+1 π2 (π 2+ 4(2π + π 0+ π1) + 4(π1β π0)2β 16(π0π1+ (β1)ππ β π0π1)). (4.30)
Here, the functions ππ(πΌ, π½, πΎ, πΏ; π₯), π = 0, 1, are two positive fundamental solutions (i.e.
non-trivial linearly independent particular solutions) of Heunβs double conο¬uent ordinary diο¬erential equation: πβ²β²(π₯) + 2π₯ 5β πΌπ₯4β 4π₯3+ 2π₯ + πΌ (π₯ β 1)3(π₯ + 1)3 π β² (π₯) + π½π₯ 2+ (2πΌ + πΎ)π₯ + πΏ (π₯ β 1)3(π₯ + 1)3 π(π₯) = 0 (4.31)
with the boundary conditions π(0) = 1 and πβ²(0) = 0. Note that the series expansion of the
solution of the equation in (4.31) converges under all β1 < π₯ < 1, and the appropriate analytic continuation can be obtained through the identity π(πΌ, π½, πΎ, πΏ; π₯) = π(βπΌ, βπΏ, βπΎ, βπ½; 1/π₯). The (irregular) singularities at β1 and 1 of the equation in (4.31) are of unit rank and can be transformed into that of a conο¬uent hypergeometric equation (see, e.g. Decarreau et al. [12] and Ronveaux [33] for an extensive overview and further details). According to the results