multivariate autoregressive series - The case with deterministic components
.
White Rose Research Online URL for this paper:
http://eprints.whiterose.ac.uk/589/
Article:
Larsson, R. and Abadir, K.M. (2001) The joint moment generating function of quadratic
forms in multivariate autoregressive series - The case with deterministic components.
Econometric Theory. pp. 222-246. ISSN 0266-4666
https://doi.org/10.1017/S0266466601171070
[email protected]
https://eprints.whiterose.ac.uk/
Reuse
Items deposited in White Rose Research Online are protected by copyright, with all rights reserved unless
indicated otherwise. They may be downloaded and/or printed for private study, or other acts as permitted by
national copyright laws. The publisher or other rights holders may allow further reproduction and re-use of
the full text version. This is indicated by the licence information on the White Rose Research Online record
for the item.
Takedown
If you consider content in White Rose Research Online to be in breach of UK law, please notify us by
THE JOINT MOMENT GENERATING
FUNCTION OF QUADRATIC
FORMS IN MULTIVARIATE
AUTOREGRESSIVE SERIES
The Case with Deterministic Components
K
AARARRIIIMMMM. A
BABBAADDDIIIRRR University of YorkR
OOOLLLFFFL
ARAARRSSSSSSOOONNN Stockholm UniversityLet$Xt%follow a discrete Gaussian vector autoregression with deterministic com-ponents+ We derive the exact finite-sample joint moment generating function ~MGF!of the quadratic forms that form the basis for the sufficient statistic+The formula is then specialized to the limiting MGF of functionals involving multi-variate and unimulti-variate Ornstein–Uhlenbeck processes,drifts,and time trends+Such processes arise asymptotically from more general non-Gaussian processes and also from the Gaussian$Xt% and have also been used in areas other than time series,
such as the “goodness of fit” literature+
1. INTRODUCTION
Let the k31 vector of discrete time series$Xt%1
T
be generated by the vector autoregression~VAR!
Xt5
(
j50 pmjtj1AX
t211«t[ mtt1AXt211«t, «t;NID~0,V!, (1) wherem [ @ m0,m1, + + + ,mp#is k3~p11!,tt[ @1,t, + + + ,tp#' is~p11!31,
A is k3k, X0 is a known constant vector, andV is k3 k positive definite+ The moment generating function~MGF!derivations given subsequently are not affected by the value ofV,which we take for simplicity to be Ik,the identity matrix of order k+Also,because the process includes a drift term,we can take
The first author gratefully acknowledges ESRC~UK!grant R000236627+We thank the co-editor and a referee for helpful comments+Address correspondence to:Karim M+Abadir,Department of Mathematics and Depart-ment of Economics,University of York,Heslington,York Y010 5DD,England;e-mail:kma4@york+ac+uk+
X05 0 without loss of generality+ For example, defining $Yt% [ $Xt 2 X0%
and using~1!,
~Yt1X0!5mtt1A~Yt211X0!1«t,
leading to the VAR
Yt5~ mtt1~A2Ik!X0!1AYt211«t[mtI t1AYt211«t,
where Y050,m [ @I mI0,m1, + + + ,mp#,andmI0[ m01~A2Ik!X0+
The likelihood of this model can be written as
L~ m,A;X0, + + + ,XT!
5~2p!2~Tk02!6V62~T02!
3etr
F
21 2V21
(
t51 T
~Xt2mt
t2AXt21!~Xt2mtt2AXt21!
'
G
, (2)where6{6[det~{!and etr~{! [exp@tr~{!#and the corresponding sufficient sta-tistic is extracted from
(
Xt@Xt' tt' Xt'21# and(
F
tt
Xt21
G
@tt' Xt'21#,
where henceforth all the summations are from t51, + + + ,T except when stated explicitly+There are two obvious reductions in our special setting to
S
(
Xttt',(
Xt21tt',
(
XtXt21' ,
(
Xt21Xt21'
D
,unlike in the full linear model+First,
(
tttt'is deterministic and need notap-pear+Second,
(
XtXt'and(
Xt21Xt21' differ by X
TXT
',which is already
obtain-able from the first element XT of
(
Xttt'2(
Xt21tt'+There remains one final and more subtle simplification+To this end,note that
(
Xttt'2(
Xt21tt'5X
TtT11
' 1
(
Xt~tt'2tt11
' !
and
(
Xt~tt11' 2t
t
'!5
(
Xt@0, 1, 2t11, 3t213t11, + + +#is a function of
(
Xttt'only+~When p5 0, the term is the null function andmay be omitted altogether+!The reduction is therefore to replace
(
Xttt'by XT,
and the sufficient statistic is
S
XT,(
Xt21tt',
(
XtXt21' ,
(
Xt21Xt21'
D
+The sufficient statistic is minimal if one furthermore excludes terms that are repeated in the symmetric matrix
(
Xt21Xt21' +The elimination matrix could be
follows where the off-diagonal elements of parameter matrices corresponding to symmetric matrices are customarily scaled by 12
_ anyway+
For the purpose of the asymptotic analysis in Section 3,it is more conve-nient to work with the basis for the sufficient statistic
S[ ~S1,S2,S3,S4! [
S
XT,(
Xt21tt',(
«tXt'21,(
Xt21Xt'21D
, (3)which is a 121 transform of the sufficient statistic,by~1!+
Distributional results for such models are patchy and are summarized in Tanaka~1996!+See also Nielsen~1997!,Rothenberg~1999!,Gönen,Puri, Ruym-gaart,and van Zuijlen~1999!+In this paper,we present the exact MGF of the general S in Section 2+This extends earlier work by Abadir and Larsson~1996! and opens the way for a systematic study of the effects of including drifts and trends in VAR models+For example,results along the lines of Abadir,Hadri, and Tzavalis~1999! may now be investigated+In Abadir and Larsson~1996!, the marginal MGF for the different basis
S
XTXT',(
«tXt'21,(
Xt21Xt'21D
was derived because there were no deterministic components there,hence the irrelevance of the sign of XT,from a distributional viewpoint,and its inclusion
through XTXT'+
In Section 3,we specialize the MGF to the asymptotic case,which happens to allow the process~1! to cover more general error structures$«t%+We do so
while focusing on the casem50+The result is the joint MGF of functionals involving Ornstein–Uhlenbeck processes,drifts, and time trends,all of which had no known joint MGF ’s except for some~not all!of the univariate special cases+Other potential uses for our results can be found in the literature on good-ness of fit, where these functionals arise~see,e+g+,d’Agostino and Stephens, 1986!+
All the proofs are collected in the Appendix+As for the general notation,we follow the one summarized in the appendix of Abadir and Larsson~1996!+ Ad-ditionally,the change of a variable of integration that maps u°v[ l~u!,for some functionl~{!,will be written in the inverse-mapping form ual21~v!,
whereby u is replaced byl21~v!in the integrand+
2. THE MOMENT GENERATING FUNCTION
Consider the block-tridiagonal nonsingular Tk3Tk symmetric matrix
Ds5
3
P Q' 0 J 0
Q P Q' L I
0 L L L 0
I L Q P Q'
0 J 0 Q M
4
where M,P,Q are k-square full-rank matrices with M and P symmetric and 0 denotes null matrices of appropriate dimensions+The following lemma is ex-tracted from the proofs in Abadir and Larsson~1996!and will be used in our derivations here+
LEMMA 1+ The determinant of Dsis given by
6Ds6562Q6T21
*
@Ik 0#
F
2PQ212Ik
Q'Q21 0
G
T21
F
M 2Q'G
*
+We need to derive one further lemma about Dsbefore proceeding to obtain the
main result of this section+Following Abadir and Larsson~1996,Theorem 2+1!, define
C0[Ik
C1[PQ21 ,
Cj[Cj21PQ 212C
j22Q'Q
21, j[Z,
whose solution is
@Cj Cj21#5@Ik 0#
F
PQ21 I
k
2Q'Q21
0
G
j
5 2Q@0 ~Q'!21
#
F
PQ21 I
k
2Q'Q21
0
G
j11
(5)
for any integer~including negative!j+Then we have the following lemma+
LEMMA 2+ The typical block of the inverse of Dsis given by
DsT2t111j,T2t11
5~21!jQ21
~Ct2j22M2Ct2j23Q
'!
3
(
n50 T2t
~Ct1n21M2Ct1n22Q
'!21
Q'~MCt1n22
' 2QC
t1n23
' !21
3~MCt'222QCt'23!~Q'!21 ,
where t51, + + + ,T and j50, + + + ,t21 and the superscripts refer to (block-) row and column numbers,respectively,starting from the top left corner. The terms above the diagonal blocks are obtained by DsT
2t11,T2t111j
5~DsT2t111j,T2t11 !'+
This lemma is general and, as pointed out by the referee, can be used in problems that are not necessarily related to our work~or to statistics!+
We can now derive the main result of this section+
THEOREM 3+ The MGF of S is
wT,m~u1,U2,U3,U4!5wT,0~0,0,U3,U4!etr
S
22 12m'm
(
tttt
'
D
exp~2 1
2z'D
s 21
where~u1,U2,U3,U4!correspond to ~S1,S2,S3,S4!,respectively,U4is
symmet-ric,and
M[Ik
P[Ik22U41U3A1A'U3'1A'A5P' Q[2A2U
3
'
wT,0~0,0,U3,U4!5det~2Q! ~12T!02
3det
S
@Ik 0#F
2PQ212Ik
Q'Q21
0
G
T21
F
Ik 2Q'GD
2~102!
+
Finally,Ds 21
is defined explicitly in Lemma 2,andz [ ~z1', + + + ,zT'!'with
zt'[ t
t11
' ~U
22m
'U
3
'2m'A!1t
t
'm', t51, + + + ,T21,
zT' [u
1
'1t
T
'm'+
The theorem can be made more explicit in a variety of directions,depending on the required application+For example,the~p11!3~p11!matrix
(
tttt'can be written as
(
tttt'5(
3
1 t J
t t2 J
I I L
4
5
3
T T~T
11!
2 J
T~T11!
2
T~T11!~2T11!
6 J
I I L
4
;
3
Ti1j21
i1j21
4
,where i,j are the row and column numbers,respectively+This theorem can also be simplified to a variety of published univariate asymptotic special cases+ How-ever, more important,we can specialize this theorem to a general asymptotic nearly nonstationary case that arises frequently in connection with limiting dis-tributions in time series+This is the purpose of the next section+
3. THE NEARLY NONSTATIONARY LIMITING CASE
Letm50 and A5Ik1~10T!H,where H is an arbitrary k3k matrix+Then, defining
G [diag~1,T21
it can be shown that
S
1!
T XT, 1!
T3(
Xt21tt'G,1
T
(
«tXt21' , 1
T2
(
Xt21Xt21'
D
d
&
&
S
JH~1!,E
0 1
JH~r! @1,r, + + + ,rp#dr,
S
E
0 1
JH~r!dW~r!'
D
',
E
01JH~r!JH~r!'dr
D
[ ~SD1,SD2,SD3,SD4! [S,D (6)
where d&& denotes convergence in distribution, W~r! is the standard
k-dimensional Wiener process on r [ @0,1#, and JH~r! is the corresponding
Ornstein–Uhlenbeck process defined by
JH~r! [
E
0
r
exp@~r2s!H#dW~s!
when X050+These limiting distributions hold under less restrictive
distribu-tional assumptions on$«t%+
In view of~6!,the limiting MGF of interest becomes
fH~u1,U2,U3,U4! [E@etr~u1'SD11U
2SD21U3SD31U4SD4!#
5 lim
Tr`wT,0
S
1
!
T u1, 1!
T3 GU2,1
T U3, 1
T2 U4
D
,which is the joint MGF ofSD [ ~SD1,SD2,SD3,SD4!+When H50,J0~r!5W~r!and
the resulting MGF is denoted byf~u1,U2,U3,U4! [ f0~u1,U2,U3,U4!,and the
functionals contain no stochastic components other than Wiener processes+
COROLLARY 4+ The joint MGF ofS isD
fH~u1,U2,U3,U4!5exp@221~,
11,21,3!#etr@2 1 2
_~H'1U
3!#0
!
det~g~1!!,where
F[H'H1H'U3'1U3H22U4, G[H'2H1U
32U3',
,1[u1'
E
0 1
~g~12z!'g~12z!!21 dz u1,
,
2[2u1
'
E
0 1
,3[
E
0 1
f~z!'~g~12z!'g~12z!!21f~z!dz,
g~z! [ @Ik 0#exp
S
zF
G Ik F 0G
D
F
Ik
2H'2U
3
G
,
f~z!'[
(
i50 p
@ui1 + + + uik, 0'#
(
j50 i
~2i! j~21!j
3
S
zi2jexp
S
~12z!F
G IkF 0
G
D
2I2kD
3
F
G Ik
F 0
G
2j21
F
Ik2H'2U
3
G
,
with z being a scalar,uinbeing the typical element ~row i, column n!of U2,
and~2i!j[
)
n50 j21~n2i!denoting the Pochhammer symbol+
We have not worked out the integrals in z for the general case,as they are more easily manipulated numerically~the integration is over the interval~0,1! in one dimension!in applications+Note that any function of an n3n matrix can be written as a polynomial of degree n21 in the matrix,by the Cayley– Hamilton theorem,so that infinite series of matrices are not required numeri-cally+ This comment applies to exp~{! and also to matrix functions such as ~g~{!g~{!'!21
+
In f~{!,the finite series in j is Tricomi’s confluent hypergeometric function+ Little additional insight is gained from using the hypergeometric formulation here,so we have refrained from doing so+
We now illustrate our corollary by specializing it to the univariate case with general trend components+In the univariate case,G50 and,furthermore,put F5f,H5h,and U35u3 to stress that these quantities have become scalars+
Because
F
G I1F 0
G
5F
0 1
f 0
G
,it is now possible to evaluate the exponential of this matrix explicitly+To this end,a series expansion yields
exp
S
zF
0 1f 0
G
D
53
cosh~z
!
f! 1!
f sinh~z!
f!!
f sinh~z!
f! cosh~z!
f!4
,implying
g~z!5cosh~z
!
f!2vsinh~z!
f!, v[h1u3In connection with ,1,,2,,3 of Corollary 4, we have the following further reductions+
COROLLARY 5+ In the univariate case~k51!,we have
,
15u12
sinh
!
f g~1!!
f,,
25 2
u1
g~1!f i
(
50 pui1
S
i!~11~21!i!
~
!
f!
i2
(
j50 i ~2i!
j
~
!
f!
j~
e!f1~21!je2!f
!
D
,,35 1 2g~1!f i
(
50p
(
j50
p
ui1uj1gij,
where ui1is the typical element of the vector u2and
gij5 2
i!~11~21!i!
~
!
f!
i11F
j!
~
~12v!e!f2~21!j~11v!e2!f!
~
!
f!
j1
(
n50 j ~2j!
n~~11v!2~21!n~12v!!
~
!
f!
nG
1
(
m50 i ~2i!
m
~
!
f!
mF
~12v!e!f1~21!m~11v!e2!f j1i2m11
1~
21!m~j1i2m!!
~
~12v!e!f2~21!i1j~11v!e2!f!
~2!
f!j1i2m111
(
n50
j1i2m~m2i2j! n
~2
!
f!n11~
~11v!e!f2~21!m1n~12v!e2!f
!
G
+It is worth observing that,in the asymptotics for the univariate case,matters simplify further+This is because,from~6!,
D
S35
E
0 1
Jh~r!dW~r!5Jh~1!
221
2 2h
E
0 1Jh~r!2dr
5 SD1
221
2 2hSD4,
so that we may set u350+This, however,induces no simplifications for the
preceding derivations,other than settingv[h
YY
!
f ~i+e+,u350!in~7!+For thevector case,inequalities such as
E
01Jh~r!dW~r!'Þ
S
E
0 1
Jh~r!dW~r!'
D
'Some special cases follow directly from these corollaries by setting some components of u•to zero,hence obtaining marginal MGF ’s+For example,when
only a constant is fitted to the model,we get the MGF of sufficient statistics associated with de-meaned Brownian motions which are particularly useful in connection with the goodness-of-fit literature~see,e+g+,d’Agostino and Stephens, 1986!+In this case,the joint MGF of the sufficient statistic
S
W~1!,E
0 1
W~r!dr,
E
0 1
W~r!2dr
D
is
f0~u1,u2,0,u4!5 exp@
1 2 _~,
11,21,3!#
!
cosh~
!
22u4!
with the ordering of u1,u2,u4 corresponding to the respective variates given earlier,and
,15 u1
2
!
22u4
tanh
~
!
22u4!
,,
25
u1u2
u4
S
1
cosh
~
!
22u4!
21D
,,35 u2
2
2u4
S
tanh
~
!
22u4
!
!
22u4
21
D
+The marginal MGF of a famous related stochastic integral has been obtained by Anderson and Darling~1952!and used further by Abadir and Paruolo~1997!; see also Rothenberg~1999!+
REFERENCES
Abadir,K+M+,K+Hadri,& E+Tzavalis~1999!The influence of VAR dimensions on estimator bi-ases+Econometrica 67,163–181+
Abadir,K+M+& R+Larsson~1996!The joint moment generating function of quadratic forms in multivariate autoregressive series+Econometric Theory 12,682–704+
Abadir,K+M+& P+Paruolo~1997!Two mixed normal densities from cointegration analysis+ Econ-ometrica 65,671– 680+
d’Agostino,R+B+& M+A+Stephens~eds+! ~1986!Goodness-of-fit Techniques+New York:Marcel Dekker+
Anderson,T+W+& D+A+Darling ~1952!Asymptotic theory of certain “goodness of fit” criteria based on stochastic processes+Annals of Mathematical Statistics 23,193–212+
Gönen,M+,M+L+Puri,F+H+Ruymgaart,& M+C+A+van Zuijlen~1999!The limiting density of unit root test statistics:A unifying technique+Journal of Time Series Analysis,forthcoming+
Nielsen,B+~1997!On the Distribution of Cointegration Tests+Ph+D+Thesis,University of Copen-hagen,Institute of Mathematical Statistics+
Rothenberg,T+J+~1999!Some Elementary Distribution Theory for an Autoregression Fitted to a Random Walk+Mimeo,University of California,Berkeley+
Tanaka,K+~1996!Time Series Analysis: Nonstationary and Noninvertible Distribution Theory+New York:Wiley+
APPENDIX
:
PROOFS
Proof of Lemma 1. See Theorem 2+3 of Abadir and Larsson~1996!+
Proof of Lemma 2. Let
Ds
215
3
cT CT '
CT cT21 CT21 '
CT21 L L
L c2 C2'
C2 c1
4
,
wherectis k3k andCtis the~t21!k3k matrix of all the blocks belowct,therefore
expanding with t+Abadir and Larsson~1996,BTof Theorems 2+2 and 2+3 there!derive cTby recursive partitioned inverse,but here we need to derive the whole matrix+
Define Ds~t!as the matrix Ds~T! [Dsbut of dimensions tk3tk instead of Tk3Tk and denote the leftmost upper block of Ds
21~t! by B
t+Notice that BtÞct except for t5T+First,partition Dsinto
Ds5
3
P Q' 0
Q
0 Ds~T21!
4
+Then,using the partitioned inverse formula,the first component of the second diagonal block is
cT215@Ik 0#
S
Ds21~T21!1D s
21~T21!
F
Ik0
G
QcTQ'@
Ik 0#Ds
21~T21!
D
F
Ik0
G
5B
T211BT21QcTQ '
BT21+ Second,partition Dsinto
Ds5
3
P Q'Q P
0 0 J
Q' 0 J
0 Q
0 0
I I
and repeat a similar operation to get
cT225@Ik 0#
1
Ds21~T22!1D s
21~T22!
3
0 Q
0 0
I I
4
3
F
+ +
+ cT21
GF
0 0 J
Q' 0 J
G
Ds21~T22!
2
F
Ik0
G
5B
T221BT22QcT21Q '
BT22
as before+By induction,this relation
ct215Bt211Bt21QctQ'Bt21
holds for all partitions of Dsbecause B15M
21+As a result,
ct5Bt1BtQBt11Q '
Bt1{{{1BtQBt11+ + +QBTQ '+ + +
Bt11Q '
Bt+ (A.1)
For the explicit solution of this formula,we need to work out BtQ+ + +Bt1jQ using
BtQ5@0 ~Q'!
21#
F
PQ21 I k
2Q'Q21 0
G
t21F
M2Q'
G
3
S
@0 ~Q'!21#F
PQ21 I k
2Q'Q21 0
G
tF
M2Q'
G
D
21
, (A.2)
which we deduce from Abadir and Larsson~1996,Theorem 2+3!+We have reformulated the power of the first~2k!3~2k! matrix in their formula for Bt, so that the required typical product simplifies sequentially to
BtQ+ + +Bt1nQ5@0 ~Q
'!21#
F
PQ21 I k
2Q'Q21 0
G
t21F
M2Q'
G
3
S
@0 ~Q'!21#F
PQ21 I k
2Q'Q21 0
G
t1nF
M2Q'
G
D
21
5Q21~C
t22M2Ct23Q '!~
Ct1n21M2Ct1n22Q
'!21Q (A.3)
by~5!+We also need to work out Q'B
t1n21+ + +Q'Btto solve~A+1!explicitly+Because the B+matrices are symmetric,Q'Bt1n21+ + +Q'Bt5~BtQ+ + +Bt1n21Q!',and using the trans-pose of~A+3!with n21 in place of n,
Q'B
t1n21+ + +Q'Bt5Q'~MCt'1n222QCt'1n23!
21~MC
t'222QCt'23!~Q'!
Combining it with~A+3!,
BtQBt11+ + +QBt1nQ'+ + +Bt11Q'Bt
5Q21~C
t22M2Ct23Q'!~Ct1n21M2Ct1n22Q'!
21
3Q'~MC
t'1n222QCt'1n23!
21~MC
t'222QCt'23!~Q'!
21, which upon substitution in~A+1!gives
ct5
(
n50 T2tQ21~C
t22M2Ct23Q '!~
Ct1n21M2Ct1n22Q '!21
3Q'~MC
t'1n222QCt'1n23!
21~MC
t'222QCt'23!~Q'!
21, (A.4)
as the required diagonal blocks+
Now we turn to the off-diagonal blocks of Ds
21~T!+ By symmetry of D s
21~T!, we only need the blocksCtthat are below any typical diagonal blockct+For this,we need to calculate the complete first block-column of Ds
21~t!,which we denote by
Ds
21~t!
F
Ik0
G
[F
BtBt
G
+
By the recursive partitioned inversion of Ds21~t! for successive t,
Bt5 2Ds
21~t21!
F
Q0
G
Bt5 2F
Bt21Bt21
G
QBt53
2Bt21QBt
1B
t22QBt21QBt
2Bt23QBt22QBt21QBt
I
4
+
Similarly,
CT5 2Ds
21~T21!
F
Q0
G
cT5 2F
BT21BT21
G
QcT,and by repeated use of the partitioned inverse formula as we did earlier forct,
CT215 2Ds
21~T22!
3
0 Q
0 0
I I
4
F
+ +
+ cT21
GF
0
Ik
G
5 2Ds21~T22!
F
QcT210
G
5 2
F
BT22
BT22
G
QcT21+By induction,
Ct5 2
F
Bt21Bt21
G
Qct53
2Bt21Qct
1B
t22QBt21Qct
2Bt23QBt22QBt21Qct
I
4
Changing tat2j and naj21 in~A+3!,we have
Bt2jQ+ + +Bt21Q5Q
21~C
t2j22M2Ct2j23Q '!~
Ct22M2Ct23Q
'!21Q, (A.6)
which together with~A+4!and~A+5!gives the stated result+
n
Proof of Theorem 3. The MGF of S [ ~S1,S2,S3,S4! [ ~XT,
(
Xt21tt ',(
«tXt'21,(
Xt21Xt'21!is wT,m~u1,U2,U3,U4![E
F
expS
u1 'XT1
(
tt 'U2Xt211
(
Xt21 'U3«t1
(
Xt21 'U4Xt21
D
G
5~2p!2~Tk02!
E
exp
S
u1 'xT1
(
xt21 'U2 't
t1
(
xt21 'U3«t
1
(
xt21 ' U4xt212 1 2
(
«t'«
t
D
~dx! (A.7)by using~2!withV5Ikand where the integral is overRTkwith~dx!being the exterior product dx11dx12+ + +dxkT+ Using the VAR formulation~1! to substitute for«t, we can decompose these sums into deterministic and stochastic components
(
xt21 'U3«t5
(
xt21 'U3~xt2mtt2Axt21!,
2 1
2
(
«t'« t5 2
1
2
(
~xt2mt
t2Axt21!'~xt2mtt2Axt21!
5 21
2
(
tt'm'mt t
1
S
(
xt 'mt
t2 1 2
(
xt'
xt1
(
xt21 'A'
S
xt2mtt2 12Axt21
DD
Substituting back into~A+7!,rearranging,then using x050,these givewT,m~u1,U2,U3,U4!
5~2p!2~Tk02!exp
S
212
(
tt'm'mt t
D
3
E
expF
u1'x T1(
xt'mt t2
1 2
(
xt'x t
1
(
xt21 '
S
~U2 '2
U3m2A 'm!t
t1~U31A '!
xt
1
S
U42U3A2 1 2A'A
D
xDefine x[vec~x1, + + + ,xT!,and Dsas in~4!with M,P,Q stated in the theorem+Then,we can rewrite~A+8!as
wT,m~u1,U2,U3,U4!
5~2p!2~Tk02!etr
S
212m
'm
(
tttt'D
E
expS
z'x212x
'D sx
D
~dx!56Ds6
2~102!etr
S
212m
'm
(
tttt'D
expS
1 2z'D s
21z
D
5w
T,0~0,0,U3,U4!etr
S
2 12m
'm
(
tttt'
D
exp
S
1 2z'
Ds
21z
D
, (A.9) where we have completed the square and integrated x out and wherewT,0~0,0,U3,U4!isobtained by Lemma 1+
n
Proof of Corollary 4. From Theorem 3,
fH~u1,U2,U3,U4!5 lim Tr`wT,0
S
1
!
T u1, 1!
T3GU2, 1T U3, 1
T2U4
D
5 lim
Tr`wT,0
S
0,0,1 T U3,
1
T2U4
D
expS
1 2z'D s
21z
D
+The limit of the first component is available from Corollary 3+2 of Abadir and Larsson ~1996!as
lim
Tr`wT,0
S
0,0,1 T U3,
1
T2U4
D
5etrF
2 1 2~H'1U 3!
G
3
*
@Ik 0#exp
S
F
G Ik F 0G
D
F
Ik
2H'2U 3
G
*
2102
+
Define E [ G 2 ~10T!G~H 1 U
3 '!+
Then for the second component, limTr`
exp~221z'D s
21z!,we note the reductions M5I
k P52Ik1
1 T ~H1H
'1U
31U3'!1 1 T2F
2Q5I
k1 1
T ~H
1U
3'!
2Q215I k2
1
T ~H1U3
'!1 1
T2~H1U3
'!21O
S
1T3
D
(A.10)2PQ2152I k1
1 T E1
1
T2F1O
S
1 T3D
Q'Q215Ik1 1 T E1O
S
and dropping lower-order terms henceforth for clarity of exposition,~5!gives
~21!q@C
q Cq21#
F
M2Q'
G
5@Ik 0#F
2PQ21 2I k Q'Q21 0
G
q
F
M2Q'
G
; @Ik 0#
3
2Ik11 T E1
1
T2F 2Ik Ik1
1
T E 0
4
q
3
F
Ik
Ik1 1 T ~H
'1
U3!
G
; @Ik 0#exp
S
qT
F
G Ik F 0G
D
F
Ik
2H'2U 3
G
[g
S
q TD
+(A.11)
The latter step follows because, for any fixed ~2k!3~2k! matrixJ, and q [N an increasing function of T of maximal order O~T!,
lim Tr`
S
I2k1 1
T J
D
q5 lim
Tr`exp
F
q logS
I2k1 1
T J
DG
5 lim
Tr`exp
F
qS
1
T J1O
S
1T2
DDG
5Tlimr`expF
q T JG
,so that we could use the same steps of Corollary 3+2 of Abadir and Larsson~1996!+
Then, ~A+11! allows us to write the required blocks of Ds
21of Lemma 2 for large T, with t51, + + + ,T and j50, + + + ,t21,as
DsT
2t111j,T2t11;g
S
t2j TD
n(
50T2t
S
gS
t1n
T
D
'
g
S
t1n
T
DD
21 g
S
tT
D
'
+
We need the limit
lim Tr`z
'
Ds
21z [ lim Tr`t
(
51T
(
j50 t21
~11sgn~j!!z
T2t111j '
DsT
2t111j,T2t11z T2t11
5 lim
Tr`t
(
51 T(
j50 t21
~11sgn~j!!z
T'2t111jg
S
t2jT
D
3
(
n50 T2t
S
gS
t1n
T
D
'
g
S
t1n
T
DD
21 g
S
tT
D
' zT2t11
5 lim
Tr`t
(
51 T(
j50 t21
~11sgn~j!!z
T2t111j '
g
S
t2j
T
D
3
(
n50 T2t
S
gS
12 nT
D
'
g
S
12 nT
DD
21 g
S
tT
D
'
where sgn~{!is the signum~sign!function and we have reversed the sum in n by replac-ing naT2t2n+In the context of this corollary,
zt'5 1
!
T3tt11 ' GU2, t51, + + + ,T21,
zT ' 5 1
!
T u1',
wherett11 ' G
is a normalized bounded matrix for any t,T+For large T,the sums become integrals,and we convert successively
t
T ax[~0,1!, j
T ay[~0,x!, n
T az[~0,12x!, and
tt'11G ;
F
1, tT, + + + ,
S
tT
D
pG
a@1,x, + + + ,xp# [h~x!'+ (A.13)With these normalizations,the quadratic terms inztfor t51, + + + ,T21~which are
ob-tained when j50!vanish at a rate of T21+The remaining quadratic term is the one in zT,which is obtained when j50 and t51 in~A+12!and which we denote by,1in the limit+The cross-product terms are split in two,namely,when j5t21.0 in~A+12!
and we have products involvingzT' andz
T2t11, whose limit we denote by,2;and the remaining terms whose limit we denote by,3+This gives
lim Tr`
z'D s
21z5,
11,21,3, where
,
1[u1 '
E
0 1
~g~12z!'g~12z!!21dz u 1,
,2[2u1 '
E
0 1
E
012x~g~12z!'g~12z!!21dz g~x!'
U2 '
h~12x!dx,
,3[2
E
0 1E
0xh~12x1y!'U
2g~x2y!dy
3
E
0 12x
~g~12z!'g~12z!!21dz g~x!'U
The integral in z is the least tractable of the three,because of the inversion of g~{!+It is therefore beneficial to reverse the order of integration in,2to
,252u
1 '
E
0 1
~g~12z!'g~12z!!21
E
012z g~x!'U
2'h~12x!dxdz+ (A.15)
For,3,a change of variable of yax2y,followed by a change of order of integration ~x and z!,gives
,
352
E
0 1E
0xh~12y!'U
2g~y!dy
E
012x
~g~12z!'g~12z!!21dz g~x!'
U2 '
h~12x!dx
52
E
0 1E
012zE
0xh~12y!'U
2g~y!dy~g~12z!
'g~12z!!21g~x!'U 2
'h~12x!dxdz+
(A.16)
By symmetry of this particular integrand in x and y,we have here
E
012zE
0x+ + +dydx5
E
0 12z
E
0y+ + +dxdy,
whereas we know that,from standard changing of the order of double integrals,
E
012zE
0x+ + +dydx[
E
012z
E
y12z+ + +dxdy
for any integrand;so that
2
E
012z
E
0x+ + +dydx5
E
0 12z
E
012z+ + +dxdy
and
,35
E
0 1
S
E
012z g~x!'U2'h~12x!dx
D
'~g~12z!'g~12z!!21
E
012z g~x!'U
2'h~12x!dxdz+
(A.17)
We now work out the row vector
f~z!'[
E
012z
h~12x!'U
2g~x!dx
From the definitions of g~{!and h~{!in~A+11!and~A+13!,
f~z!'5
E
012z
@
@1,~12x!, + + + ,~12x!p#U 2 0'
#
exp
S
xF
G Ik F 0G
D
dxF
Ik
2H'2U 3
G
5
E
21
2z
@
@1,~2x!, + + + ,~2x!p#U 2 0'
#
exp
S
xF
G Ik F 0G
D
dx3exp
S
F
G Ik F 0
G
D
F
Ik
2H'2U 3
G
,
where the latter equality follows from xax11 and from the~2k!3~2k!matrix com-muting with itself+Notice that the first matrix is now a row vector and we can write
f~z!'5
(
i50 p
@ui1 J uik, 0'#
E
21
2z
~2x!iexp
S
xF
G Ik F 0G
D
dx3exp
S
F
G Ik F 0G
D
F
Ik
2H'2U 3
G
5
(
i50 p
~21!i@u
i1 + + + uik, 0'#exp
S
~x11!F
G Ik F 0GD
j(
50i ~2i!jxi
2j
*
21
2z
3
F
G Ik F 0
G
2j21
F
Ik2H'2U
3
G
5
(
i50 p
@ui1 + + + uik, 0'#
(
j50 i~2i!j~21!j
S
zi2jexp
S
~12z!F
G IkF 0
G
D
2I2kD
3
F
G Ik F 0
G
2j21
F
Ik2H'2U
3
G
,
which is the required result+
n
Proof 1 of Corollary 5. To evaluate,1,via~7!and because
d
dz
sinh~~12z!
!
f! g~12z!5 2
!
fg~12z!2, (A.18)
we simply have
,
15u12
E
01 dz
g~12z!25u12 sinh
!
fg~1!
!
f+ (A.19)As for,2,we retrace the steps of the proof of the previous corollary and observe that U2
'
h~12x!5
(
i50 p
to find
,
252u1
(
i50 pui1
E
0 1E
012x dzg~12z!2g~x!~12x!
idx+ (A.21)
Here,via~A+18!and using the identity
sinh a cosh b2cosh a sinh b5sinh~a2b!, (A.22)
we find
,25 2u1
!
f i(
50 pui1
E
0 1S
sinh!
f g~1! 2sinh~x
!
f!g~x!
D
g~x!~12x!idx (A.23)
5 2u1
g~1!
!
f i(
50 pui1
E
0 1sinh~~12x!
!
f!~12x!idx5 2u1
g~1!
!
f i(
50 pui1
E
0 1xisinh~x
!
f!dx+Further,successive integration by parts yields
E
0yxisinh~x
!
f!dx5 2i!~11~21! i! 2~
!
f!
i11 1yi 2
!
f j(
50i ~2i!j ~y
!
f!j~ey!f1~21!je2y!f!,
(A.24)
giving the desired expression for,2by letting y51+
Looking at,3,we use the proof of the preceding corollary to obtain
,35 1
2g~1!fi
(
50 p(
j50 p
ui1uj1gij, (A.25)
where,by~A+20!and~A+16!,
gij[4g~1!f
E
0 1E
0x~12y!jg~y!dy
E
012x dz
g~12z!2g~x!~12x! idx+
Now,as in~A+21!–~A+23!again,
E
012x dzg~12z!2g~x!5 1
g~1!
!
f sinh~~12x!!
f!,and
gij54
!
fE
0 1E
0x~12y!jg~y!dy sinh~~12x!
!
f!~12x!idx54
!
fE
0 1
E
012x~12y!jg~y!dy sinh~x
!
f!xidx54
!
fE
0 1
~12y!jg~y!
E
012y
sinh~x
!
f!xidxdy54
!
fE
0 1yjg~12y!
E
0 yby xa 12x, changing the integration order and ya 12y,respectively+ The inner
integral is given by~A+24!,so that
gij5 22
E
0 1yjg~12y!
S
i!~11~21! i!~
!
f!
i 2m(
50i ~2i! myi
2m
~
!
f!
m ~ey!f1~21!me2y!f!
D
dy5 2
E
0 1
yj~~12v!e~12y!!f1~11v!e2~12y!!f!
3
F
i!~11~21!i!
~
!
f!
i 2m(
50i ~2i! m
~
!
f!
myi2m~ey!f1~21!me2y!f!
G
dy5 2i!~1
1~21!i!
~
!
f!
iF
~12v!e!f
E
0 1
yje2y!fdy1~11v!e2!f
E
0 1yjey!fdy
G
1
(
m50 i ~2i!
m
~
!
f!
mF
~~12v!e!f1~21!m~11v!e2!f!
E
0 1yj1i2mdy
1~21!m~12v!e!f
E
0 1yj1i2me22y!fdy
1~11v!e2!f
E
0 1yj1i2me2y!fdy
G
by the definition of g~{!in~7!+Using
E
01yqeaydy5 q! ~2a!q111e
a
(
n50 q ~2q!
n an11
where q[Nø$0% gives the stated result+
n
Proof 2 of Corollary 5. A more conventional proof may be obtained from exploiting Girsanov’s theorem as in Perron~1991,Theorem 2!or Tanaka~1996,Ch+4!+We want to calculate the MGF of
~S1,S2 ',
S3,S4! [
S
Jh~1!,E
0 1~1,r, + + + ,rp!J
h~r!dr,
E
0 1Jh~r!dW~r!,
E
0 1Jh~r!2dr
D
,which we define as
fh~u1,u2,u3,u4! [E$exp~u1S11u2 '
S21u3S31u4S4!%, (A.27)
where u1,u3,u4are scalars and u2 '[ ~
u20, + + + ,u2p! is a~p11!-dimensional vector+At first,apply Itô’s formula to write
d~Jh~t!2!52Jh~t!dJh~t!1dt52hJh~t!2dt12Jh~t!dW~t!1dt, so that,by integrating and solving,
E
01Jh~t!dW~t!5 1 2$Jh~1!
221%2h
E
0 1and~A+27!may be reformulated as
fh~u1,u2,u3,u4!5exp
S
2u32
D
EH
expS
u1Jh~1!1u2'
E
0 1~1,t, + + + ,tp!'J h~t!dt
1 u3
2 Jh~1! 21~u
42u3h!
E
0 1Jh~t!2dt
D
J
+Now,following Tanaka~1996,p+110!,we define the auxiliary process Y~t!through
dY~t!5 2bY~t!dt1dW~t!, Y~0!50+
Putting X~t!5Jh~t! ~witha5 2h in Tanaka’s notation!and lettingmJ andmY be the
probability measures governing Jhand Y,respectively,we get
dmJ dmY
~Y!5exp
F
~h1b!E
0 1Y~t!dY~t!2h
22b2
2
E
0 1Y~t!2dt
G
5exp
F
2h 1b2 1 h1b
2 Y~1! 22h
22b2
2
E
0 1Y~t!2dt
G
,the second line following from Itô’s formula+Now,as in Tanaka~1996,p+111!,
fh~u1,u2,u3,u4!
5exp
S
2u32
D
EH
expS
u1Y~1!1u
2 '
E
0 1
~1,t, + + + ,tp!'
Y~t!dt
1 u3
2 Y~1! 21~u
42u3h!
E
0 1Y~t!2dt
D
dmJ dmY~Y!
J
5exp~2g!E
H
expS
u1Y~1!1u2 '
E
0 1
~1,t, + + + ,tp!'
Y~t!dt1gY~1!2
D
J
(A.28)by choosing
b [
!
h212hu 322u4and defining
g [ u31h1b 2 +
To go further,the idea is to define a process Z~t!5Y~t!2utY~1!,whereutis a
con-stant, chosen in such a way that Z~t! becomes independent of Y~1!+ But as is easily shown,we have that for 0,s#t#1,
E$Y~s!Y~t!%5e2btsinh~ bs!