• No results found

4 Monte Carlo and some examples

6.1 Proof of Theorem 1

6.1.1 Reduction to pure random walk data.

Let G ( ) and ~G ( ) be distribution functions that may depend on p and T and are possibly random. We shall call them asymptotically equivalent if the a.s. weak convergence G ( ) ) F ( ) to some non-random d.f. F ( ) implies similar a.s. weak convergence for ~G( ); and vice versa. Let Si and ~Si with i = 0; 1; 2 be, possibly random, matrices that may depend on p and T such that Si and ~Siare a.s. positive de…nite for i = 0; 1: Below, we shall often refer to the following auxiliary lemma.

Lemma 10 If, almost surely, 1prank Si S~i ! 0 as p; T !c1 for i = 0; 1; 2;

then G ( ) and ~G( ) are asymptoically equivalent, where G ( ) and ~G ( ) are the empirical d.f. of eigenvalues of S2S11S20S01 and ~S2S~11S~20S~01; respectively.

Proof of Lemma 10. Let R = rank S2S11S20S01 S~2S~11S~20S~01 : The a.s.

convergence 1p rank Si S~i ! 0 implies the a.s. convergence R=p ! 0: On the other hand, by the rank inequality (Theorem A43 in Bai and Silverstein (2010)), L G; ~G R=p; where L G; ~G is the Lévy distance between G ( ) and ~G( ):

Recall that the Lévy distance metrizes the weak convergence. Therefore, the almost sure convergence L G; ~G ! 0 yields the asymptotic equivalence of G ( ) and G( ):~ respectively, without loss of generality. Furthermore, scaling Sij by T does not change the product S01S111S010 S001;and thus, in the rest of the proof, we shall work

Next, we show that, still without loss of generality, we may replace the data generated process (11) by pure random walk with zero initial value. Indeed, let X = [X k+1; :::; XT]; where X k+1; :::; X0 are arbitrary and Xt with t 1 are generated by (11). Further, let ~X k+1; :::; ~X0 be zero vectors, ~Xt = Xt

s=1"t for t 1; and ~X = [ ~X k+1; :::; ~XT]:

Lemma 11 rank X X~ 2 (r + rank + k + dF) :

A proof of this lemma is given in the Supplementary Appendix. It is based on the representation of Xt as a function of the initial values, " and F (see Theorem 2.1 in Johansen (1995)), and requires only elementary algebraic manipulations.

Lemmas 11 and 10 together with the assumption (12) imply that replacing Xt and Xt 1 in (28) by X~t and ~Xt 1; respectively, does not change the weak limit of Fp;T( ):Hence, in the rest of the proof of Theorem 1, without loss of generality, we shall assume that the data are generated by

Xt= "t; t = 1; :::; T; with X0 = 0: (29) 6.1.2 Block-diagonalization

Assuming that ’s are the eigenvalues of S01S111S010 S001 with Sij satisfying (28) and (29), we can interpret them as the squared sample canonical correlations between lagged values of a random walk Xt 1 and its current innovations "t. Since the sample canonical correlations are invariant with respect to the multiplication of the data by any invertible matrix, we assume without loss of generality that the variance of "t equals = Ip=T: Further, we assume that T is even. The case of odd T can be analyzed similarly, and we omit it to save space.

Let " = ["1; :::; "T] and let U be the upper-triangular matrix with ones above the main diagonal and zeros on the diagonal. Then "U = [X0; :::; XT 1] ; so that

S00 = ""0; S01 = "U0"0; and S11= "U U0"0: (30) We shall show that the empirical d.f. of the ’s, Fp;T ( ) ;is asymptotically equiv-alent to the empirical d.f. ^Fp;T ( ) of eigenvalues of CD 1C0A 1;where

C = " 02"0; D = " 1"0; and A = ""0;

1 is a diagonal matrix,

1 = diagn

r11I2; :::; rT =21 I2o

; (31)

and 2 is a block-diagonal matrix,

2 = diagn

r11(R1 I2) ; :::; rT =21 RT =2 I2 o

: (32)

Here I2 is the 2-dimensional identity matrix, and rj; Rj are de…ned as follows. Let

= 2 =T: Then for j = 1; 2; :::

rj+1 = 2 2 cos j ; Rj+1= cos j sin j sin j cos j

!

;

whereas r1 = 4; R1 = I2:

Lemma 12 The distribution functions Fp;T ( ) and ^Fp;T ( ) are asymptotically equivalent.

Proof of Lemma 12. Let V be the circulant matrix (see Golub and Van Loan (1996, p.201)) with the …rst column v = ( 1; 1; 0; :::; 0)0: Direct calculations show that U V = IT le0T and V U = IT e1l0; where ej is the j-th column of IT; and l is the vector of ones. Using these identities, it is straightforward to verify that

U = (V + e1e01) 1 le01; and (33)

U U0 = V0V (e1 eT) (e1 eT)0+ eTe0T 1 ll0: (34) Now, let us de…ne

C1 = " (U + le01)0"0 and D1 = " (U U0 + ll0) "0:

Using identities (30) for Sij and Lemma 10, we conclude that Fp;T( )is asymptot-ically equivalent to Fp;T(1)( ), where Fp;T(1)( ) is the empirical d.f. of the eigenvalues of C1D11C10A 1:

Further, (33) and (34) yield

C1 = " (V + e1e01) 1"0 and

D1 = " V0V (e1 eT) (e1 eT)0 + eTe0T 1"0:

Applying Lemma 10 one more time, we obtain the asymptotic equivalence of Fp;T(1)( ) and Fp;T(2)( ) ; where Fp;T(2)( ) is the empirical d.f. of the eigenvalues of C2D21C20A 1 with

C2 = "V 1"0 and D2 = " (V0V ) 1"0: (35) As is well known (see, for example, Golub and Van Loan (1996), chapter 4.7.7), T T circulant matrices can be expressed in terms of the discrete Fourier transform

matrices

F = fexp (i (s 1) (t 1))gTs;t=1

with = 2 =T: Precisely, V = 1

TF diag (Fv) F; and V0V = 1

TF diag (Fw) F;

where w = (2; 1; 0; :::; 0; 1)0 and the star superscript denotes transposition and complex conjugation. For the s-th diagonal elements of diag (Fv) and diag (Fw) ; we have

diag (Fv)s = 1 + expfi (s 1)g ; and diag (Fw)s= 2 2 cos (s 1) : Note that diag (Fw)s= diag (Fw)T +2 s for s = 2; 3; ::: If T is even, as we assumed above, then there are T =2 1 pairs (s; T + 2 s), and there is one pair (1; T =2 + 1) that correspond to

diag (Fw)1 = 0; diag (Fw)T =2+1= 4:

De…ne a permutation matrix P so that the equal diagonal elements of P0diag (Fw) P are grouped in adjacent pairs. Precisely, let P = fpstg, where

pst = 8>

<

>:

1 if t = 2s 1 for s = 1; :::; T =2

1 if t = 2 (T s + 2) mod T for s = T =2 + 1; :::; T 0 otherwise

and let W be the unitary matrix

W = I2 0

0 IT =2 Z

!

with Z = 1 p2

1 1

i i

!

;

where denotes the Kronecker product. Further, let Q = p1TW P0F. As is easy to check, Q is an orthogonal matrix. Furthermore,

V = Q0 21 + 2e1e01 Q; and V V0 = Q0 11 4e1e01 Q;

where 1 and 2 are as de…ned in (31) and (32). Combining this with (35) and using Lemma 10 once again, we obtain the asymptotic equivalence of Fp;T(2)( ) and

Fp;T(3)( ) ; where Fp;T(3)( ) is the empirical d.f. of the eigenvalues of C3D31C30A 1 with

C3 = "Q0 2Q"0 and D3 = "Q0 1Q"0:

Because of the rotational invariance of the Gaussian distribution, the distributions of "Q0 and " are the same. Hence, Fp;T(3)( )is asymptotically equivalent to ^Fp;T ( ) ; and thus, ^Fp;T ( ) is asymptotically equivalent to Fp;T( ).

6.1.3 A system of equations for the Stieltjes transform

Our proof of the almost sure weak convergence of ^Fp;T( ) to the Wachter distrib-ution consists of showing that the Stieltjes transform of ^Fp;T ( ),

^

mp;T(z) =

Z 1

z

F^p;T (d ) ; (36)

almost surely converges pointwise in z 2 C+ =f : I > 0g to the Stieltjes trans-form m(z) of the Wachter distribution. To establish such a convergence, we show that, if m is a limit of ^mp;T(z) along any subsequence of p; T !c 1; then it must satisfy a system of equations with unique solution given by m(z). The almost sure convergence of ^Fp;T ( ) (and thus, also of Fp;T( )) to the Wachter distribution follows then from the Continuity Theorem for the Stieltjes transforms (see, for example, Corollary 1 in Geronimo and Hill (2003)).

We shall write ^m for the Stieltjes transform ^mp;T(z) to simplify notation. Let M = CD 1C0 zA and ~M = C0A 1C zD: (37) Then by de…nition (36), ^m must satisfy the following equations

^

m = 1

ptr AM 1 ; (38)

^

m = 1

ptrh

D ~M 1i

: (39)

Let us study the above traces in detail. De…ne

"(j)= ["2j 1; "2j] ; j = 1; :::; T =2:

We now show that the traces in (38) and (39) can be expressed as functions of the terms having form "0(j) j"(j); where j is independent from "(j): Then, we argue

that

"0(j) j"(j) 1

T tr [ j] I2

a.s. converge to zero, and use this fact to derive equations that the limit of ^m; if it exists, must satisfy.

First, consider (38). Note that 1

ptr AM 1 = 1 p

XT =2 j=1

tr "0(j)M 1"(j) : (40)

Let us introduce new notation:

1j = rj1I2; 2j = rj1(Rj I2) ; Cj = C "(j) 02j"0(j); Dj = D "(j) 1j"0(j); Aj = A "(j)"0(j); and Mj = CjDj 1Cj0 zAj: In addition, let

sj = "0(j)Dj1"(j); uj = "0(j)Dj 1Cj0Mj 1"(j); vj = "0(j)Mj 1"(j); and

wj = "0(j)Dj1Cj0Mj 1CjDj1"(j):

A straightforward algebra that involves multiple use of the Sherman-Morrison-Woodbury formula (see Golub and Van Loan (1996), p.50)

(V + XW Y ) 1 = V 1 V 1X W 1+ Y V 1X 1Y V 1; (41) and the identity

2j 0

2j = 02j 2j = 1j; (42)

establishes the following equality

"0(j)M 1"(j)= vj [vj; u0j] j[vj; u0j]0; (43)

where

j =

1

1 zI2+ vj 1 1 zrj 0

2j + u0j

1

1 zrj 2j + uj 1 zz rjI2 sj + wj

! 1

:

A derivation of (43) can be found in the Supplementary Appendix.

We have the following lemma, where k k denotes the spectral norm. Its proof is given in the Supplementary Appendix.

The lemma yields an approximation to the right hand side of (43), which we use in (40) and (38) to obtain the following result.

Proposition 14 There exists > 0 such that, for any z with zero real part, Rz = 0, and the imaginary part satisfying Iz > ; we have

^

Proof of Proposition 14. Consider a 2 2 matrix ^Sj that is obtained from

"0(j)M 1"(j) by replacing sj; vj; uj and wj in (43) with ^sI2; ^vI2; ^uI2; and ^wI2;

A simple algebra and the identity 2j + 02j = I2 yield

where Rj is an orthogonal matrix, so that krj 2jk and rj 02j are clearly bounded uniformly in j: Therefore, the norm of matrix ~j almost surely remains bounded as p; T !c1, uniformly in j: Regarding j; which appear in the denominator on the right hand side of (45), the Supplementary Appendix establishes the following result. surely remains bounded as p; T !c 1, uniformly in j: Therefore, by Lemma 13,

"0(j)M 1"(j) = ^Sj + o(1); (47) where o(1)a:s:! 0 as p; T !c1; uniformly in j:

A straightforward algebra reveals that

S^j = ( ^w s^ rj) ^v u^2

j

:

Using this in equations (47) and (40), we obtain

^

where, in the latter expression, the term corresponding to j = 0 is included in the o(1) term to take into account the special de…nition of r1:

As follows from Lemma 15 and the boundedness of ^s; ^u; ^v;and ^w;the derivative d

d'

f1(')

(1 z) f1(') + f2(')

almost surely remains bounded by absolute value as p; T !c 1; uniformly in '2 [0; 2 ] : Therefore

The statement of Proposition 14 now follows by noting that the latter integral is one quarter of the integral over [0; 2 ] :

A similar analysis of equation (39) gives us another proposition, describing ^m as function of ~s; ~u; ~v; and ~w; where

We omit the proof because it is very similar to that of Proposition 14.

Proposition 16 There exists > 0 such that, for any z with Rz = 0 and Iz > ;

we have

^ m = 1

2 c Z 2

0

g1

(1 z) g1+ g2(')d' + o(1); where (48)

g1 = ( ~w ~s 1) ~v u~2;

g2(') = ~v 4 sin2' (~s + 1 u~ w) ;~ and o(1)! 0, as p; T !a:s c1:

Although we now have two asymptotic equations for ^m; (44) and (48), they contain many unknowns: ^s; ^u; ^v; ^w; and the corresponding variables with tildes.

The following result establishes simple relationships between the unknowns with hats and tildes.

Lemma 17 We have the following three identities

^

u = ~u; z~v + ^s = ^w; and z^v + ~s = ~w: (49) Proof of Lemma 17. The identity ^u = ~uis established by the following sequence of equalities

T ^u = tr D 1C0M 1 = tr D 1C0 CD 1C0 zA 1

= tr C zA (C0) 1D

1

= tr C0 zD (C) 1A 1

= tr A 1C C0A 1C zD 1 = tr A 1C ~M 1 = T ~u:

The relationship z~v + ^s = ^w is obtained as follows

T (z~v + ^s) = tr D 1 zIp C0A 1CD 1 zIp 1+ Ip

= tr D 1 Ip+ C0A 1CD 1 C0A 1CD 1 zIp 1+ Ip

= tr D 1 Ip DC 1A (C0) 1z

1

= tr D 1C0 CD 1C0 Az 1CD 1 = T ^w:

The identity z^v + ~s = ~w is obtained similarly to z~v + ^s = ^w by interchanging the roles of D; C and A; C0.

The identities (49) imply the following equality

(1 z) f1(') + f2(') = (1 z) g1+ g2(') :

We denote the reciprocal of the common value of the right and left hand sides of this equality as ^h (z; ') :A direct calculation shows that

^h (z; ') = (1 z) z~v^v u^2 + z~v + 4 sin2' (z^v + ^u 1) 1; (50)

and the asymptotic relationships (44) and (48) can be written in the following form ( m =^ 2 c1 R2

0 ^h (z; ') z~v 4 sin2' ^v u^2 d' + o(1)

^

m = 2 c1 R2

0 ^h (z; ') ((z^v 1) ~v u^2) d' + o(1) : (51) This can be viewed as an asymptotic system of two equations with four unknowns:

^

m; ~v; ^v; and ^u: We shall now complete the system by establishing the other two asymptotic relationships connecting these unknowns.

Multiplying both sides of the identity

M A 1 = CD 1C0A 1 zIp (52)

by AM 1; taking trace, dividing by p, and rearranging terms, we obtain 1 + z ^m = 1

ptr CD 1C0M 1 : (53)

Next, we analyze (53) similarly to the above analysis of (38). That is, …rst, we note that

1

ptr CD 1C0M 1 = 1 p

XT =2 j=1

tr 02j"0(j)D 1C0M 1"(j) : (54)

Then elementary algebra, based on the Sherman-Morrison-Woodbury formula (41), yields

"0(j)D 1C0M 1"(j) = rj(rjI2+ sj) 1sj 2j vj vj; u0j j vj; u0j 0 (55) +rj(rjI2+ sj) 1 uj [uj; wj] j vj; u0j 0 :

Multiplying both sides of (55) by 02jand replacing sj; uj; vj;and wj by ^sI2; ^uI2; ^vI2; and ^wI2;respectively, yields an asymptotic approximation to 02j"0(j)D 1C0M 1"(j); which can be used in (54) and (53) to produce the following result. Its proof, as well as the proof of (55), are given in the Supplementary Appendix.

Proposition 18 There exists > 0 such that, for any z with Rz = 0 and Iz > ;

One might think that the remaining asymptotic relationship can be obtained by using the identity

M D~ 1 = C0A 1CD 1 zIp; (57)

which parallels (52). Unfortunately, following this idea delivers a relationship equivalent to (56). Therefore, instead of using (57), we consider the identity

1

Then, we proceed as in the above analysis of (54) and (40) to obtain the remaining asymptotic relationship. The proof of the following proposition is given in the Supplementary Appendix.

Summing up the results in Propositions 14, 16, 18, and 19, the unknowns

^

m; ^v; ~v; and ^u must satisfy the following system of asymptotic equations 8>

6.1.4 Solving the system

Recall that the unknowns ^m; ^v; ~v;and ^uin the asymptotic relationships (61) depend on p; T: The de…nition (36) of ^mimplies that j ^mj is bounded by (Iz) 1:Further, as shown in the proof of Proposition 14, ^u and ^v are a.s. bounded by absolute value, and it can be similarly shown that ~v is a.s. bounded by absolute value. Therefore, there exist a subsequence of p; T along which ^m; ^v; ~v; and ^u a.s. converge to some limits m; v; y; and u:

These limits must satisfy a non-asymptotic system of equations 8>

Let us consider, until further notice, only such z that have zero real part,Rz = 0, and the imaginary part satisfying Iz > ; for some > 0. Let us solve system (62) for m: Adding two times the last equation to the …rst one, and subtracting the second equation we obtain we have m = 0; which cannot be true because ^m is the Stieltjes transform of the empirical distribution of the squared canonical correlations, all of which lie between zero and one. Indeed, clearly, for any 0 1 and z with Rz = 0;

with y 6= 0 and u 6= 0 (if one of them equals zero, the other equals zero too, and m = 0 by the second equation of (62), which is impossible). Since u 6= 0; the last equation implies that v 6= 0 as well.

Further, subtracting from the third equation the sum of z times the second and u=v times the last equation, and using (64), we obtain

1 = 1 2 c

Z 2 0

h (z; ')u

v (2zv + u) (zv v 1) d': (65) This equation, together with the second equation of (62) yield

m = v (2zv + u 2)

(1 + v zv) (2zv + u): (66)

Next, for the integrand in the last equation of (62), we have h (z; ') 2v sin2' + u = 1

2 v

zv + u 1 (67)

+h (z; ')u 2

(1 z) v (2zv + u) + 2 (2zv + u 1)

zv + u 1 :

This assumes that

zv + u 16= 0: (68)

If not, then

h (z; ') = (1 z) zvy u2 + zy 1

would not depend on ' and the last equation of (62) would imply that u + v = 0: The latter equation and the equality zv + u 1 = 0 would yield v = (1 z) 1;which when combined with the second equation of (62) would give us m = c 1(1 z) 1; which cannot be true because m; being a limit of ^m, must satisfy Im 0 forIz > 0:

Equations (65), (67), and the last equation of (62) imply that

u = 2c

2c 1 (1 z) v (1 c) 2zv: (69)

Combining this with (66) yields

m = v1 c

c : (70)

Finally, elementary calculations given in the Supplementary Appendix show

The latter inclusion holds because otherwise h (z; ') is not a bounded function of '; which would contradict Lemma 15.

Using (69) in (72), and simplifying, we …nd that there exist only three possi-bilities. Either Equation (73) cannot hold because otherwise, (70) would imply that Im < 0;

which is impossible as argued above. Equation (74) taken together with (69) implies that

u + zv 1 = 0;

which was ruled out above. This leaves us with (75), so that, using (70), we get

m = (z c cz) q

(z c cz)2 4c (1 z) z

2z (1 z) c : (76)

For z 2 C+ with Rz = 0; the imaginary part of the right hand side of (76) is

negative when ‘ ’is used in front of the square root. Here we choose the branch of the square root, with the cut along the positive real semi-axis, which has positive imaginary part. Since Im cannot be negative, we conclude that

m = (z c cz) + q

(z c cz)2 4c (1 z) z

2z (1 z) c : (77)

But the right hand side of the above equality is the value of the limit of the Stieltjes transforms of the eigenvalues of the multivariate beta matrix Bp(p; (T p) =2) as p; T !c 1: This can be veri…ed directly by using the formula for such a limit, given for example in Theorem 1.6 of Bai, Hu, Pan and Zhou (2015). As follows from Wachter (1980), the weak limit of the empirical distribution of the eigen-values of the multivariate beta matrix Bp(p; (T p) =2) as p; T !c 1 equals W ( ; c= (1 + c) ; 2c= (1 + c)).

Equation (77) shows that, for z with Rz = 0 and Iz > ; any converging subsequence of ^m converges to the same limit. Hence, ^m a.s. converges for all z withRz = 0 and Iz > : Note that ^mis a sequence of bounded analytic functions in the domain fz : Iz > g ; where is an arbitrary positive number. Therefore, by Vitaly’s convergence theorem (see Titchmarsh (1939), p.168) ^m a.s. converges to m; described by (77), for any z 2 C+: The almost sure convergence of ^Fp;T ( ) (and thus, also of Fp;T ( )) to the Wachter distribution follows from the Continuity Theorem for the Stieltjes transforms (see, for example, Corollary 1 in Geronimo and Hill (2003)).

Related documents