+vec(cTe T> )’(I ®fi ^ J - v e c lC ’fi 1oc T 1a > )’ |> s s - l n s s - l I
Rem ark: The above d e riv a tio n s only b rie fly d e sc rib e th e n e c e s s a ry s te p s to re a c h th e in fo rm a tio n m a trix . H ow ever, th e r e s t of th e c a lc u la tio n s re q u ir e s tr iv ia l ex p a n sio n s o f th e e q u a tio n s show n above.
T his c o m p letes o u r d e riv a tio n o f th e F ish e r in fo rm a tio n m a tr ix and ap p en d ix B.
R ef e re n c e s
Aoki(1990) S t a t e S p a c e M o d e l l i n g o f T im e S e r i e s . S p rin g e r V erlag. B alak rish n an (1 9 8 4 ) K alm an F i l t e r i n g T h e o r y . O p tim isa tio n S o ftw a re ,
I n c ..
B reck lin g , C h am b ers, D o rfm an, Tam and W elsh(1990) Maximum L ikelihood In fe re n c e fro m Sam ple Survey D a ta . P r e p r in t .
B illin g sley ! 1961) S t a t i s t i c a l I n f e r e n c e f o r M a r k o v P r o c e s s e s . U n iv e rs ity o f Chicago P re s s .
B rockw ell and Davies! 1991) T im e S e r i e s A n a l y s i s : T h e o r y and M e t h o d s . S p rin g e r V erlag.
C rabb e and Young(1989) Model R eduction via th e In te r n a lly B alanced S t a te S p ace R e p re se n ta tio n . J . o f S ta t. Comp. S im u l ., 33, 2 3 3 -2 4 8 .
D e m p ste r, L a ird and Rubin! 1977) Maximum L ikelihood fro m Incom plete D a ta via EM a lg o rith m . J . o f R o ya l S ta t. Soc. S e r i e s B, 39, 1-38.
D unsm uir and Robinson(1981) E stim a tio n o f Tim e S e rie s Models in th e P re se n c e of M issing D ata. J . o f Am er. S ta t. A s s o c ., 76, 5 6 0 -5 6 8 .
E v an g elisti(19 68 ) C o n t r o l l a b i l i t y and O b s e r v a b ility . C.I.M .E.
Graham (1981) K r o n e c k e r P r o d u c ts and M a t r i x C a l c u l u s w ith A p p l i c a t i o n s . E llis H orwood Ltd.
Hall and Hedye(1980) M a r t i n g a le L im it T h e o r y and i t s a p p l i c a t i o n s . A cadem ic P re ss .
H annan an d D eistler(1988) The S t a t i s t i c a l T h e o r y o f L inear S y s t e m s . John Wiley and Sons.
H annan, K rish n a ia h and Rao(1985) H a n d b o o k o f S t a t i s t i c s Vol. 5: T im e S e r i e s in t h e T im e Domain. E lsev ie r Science P u b lis h e rs B.V. Huber! 1980) R o b u s t S t a t i s t i c s . John Wiley and Sons.
Jones(1979) Maximum Likelihood F ittin g of ARIMA Models to Time S e rie s w ith M issing O b serv atio n s. T e c h n o m e t r i c s , 22, 38 9-3 9 5. Jones(1978) M u ltiv a ria te A u to reg re ssio n E s tim a tio n using
R esid u als. A p p l i e d T im e S e r i e s A n a l y s i s , 139-162.
Jong P ie t de(1991) The D iffu se Kalm an F ilte r . T h e A n n a ls o f S t a t i s t i c s , 19, 1073-1083.
Kohn and Ansley(1986) E stim atio n , P re d ic tio n and I n te rp o la tio n f o r ARIMA Models w ith M issing D ata. J . o f Amer. Sta t. A s s o c ., 81,
751-761.
Louis(1982) F inding th e O bserved In fo rm a tio n M a trix w hen using th e EM a lg o rith m . J o u r n a l o f R oyal S ta t. S oc., S e rie s B (4 4 ),22 6-233 . M cCullagh and Nelder(1989) G e n e r a lis e d L in e a r M o d e l s . Chapm an and
H all.
M ehra and L ainiotis(1976) S y s t e m I d e n t i f i c a t i o n A d v a n c e s and Case S t u d i e s . A cadem ic P re ss.
O tter(1 9 8 5) D y n a m ic F e a tu r e S p a c e M o d e l l i n g , F i l t e r i n g and S e l f - T u n i n g Control o f S t o c h a s t i c S y s t e m s . S p rin g e r V erlag. Parzen (1 98 3) T im e S e r i e s A n a l y s i s o f I r r e g u l a r l y O bserved Data.
L e c tu re N otes S e rie s , S p rin g e r V erlag.
P arzen(1967) T im e S e r i e s A n a l y s i s P a p e r s . H olden-D ay.
Rao(1984) O p tim isa tio n : T h e o r y and A p p l i c a t i o n s . Wiley E a s te r n L td.
Rubin(1976) In fe re n c e and M issing D ata. B i o m e t r i k a , 63, 581-592. S e rg io B itta n ti(1 9 8 6 ) T im e S e r i e s and L in e a r S y s t e m s . S p rin g e r
V erlag .
Shum w ay and S t o f f er(1982) An A pproach to Tim e S e rie s Sm oothing and F o re c a s tin g using EM a lg o rith m . J o u r n a l o f T i m e S e r i e s A n a l y s i s , 3 ,2 5 3 -2 6 4 .
S to f f er(1986) E stim a tio n and Id e n tific a tio n o f S p ace-T im e ARMAX Models in th e P resen ce o f M issing D ata. J . o f A m e r . Sta t. A s so c ., 81, 762-772.
W hittle! 1963) On th e F ittin g of M u ltiv a ria te A u to re g re ssio n s and th e A p p ro x im ate Canonical F a c to r iz a tio n o f a S p e c tra l D ensity M a trix . B i o m e t r i k a , 50, 129-134.
Wu(1983) On th e Convergence P r o p e rtie s o f th e EM A lgorithm . T h e A n n a ls o f S t a t i s t i c s . 11, 95-103.
Moore(1978) in T i m e Series and Linear Systems, Springer Verlag, Sergio and Bittanti( 1986).
751-761.
Louis(1982) F inding th e O bserved In fo rm a tio n M a trix when using th e EM a lg o rith m . J o u r n a l o f R oya l S ta t. S o c., S e rie s B (4 4 ),22 6-2 3 3. M cCullagh and N elder(1989) G e n e r a lis e d L in e a r M o d e ls . Chapm an and
Hall.
M ehra and L ainiotis(1976) S y s te m I d e n t i f i c a t i o n A d v a n c es and C ase S tu d ie s . A cadem ic P re ss.
O tter(1985) D yn a m ic F e a tu re S p a c e M o d e llin g , F ilte r in g and S e i f - T u n i n g C ontro l o f S to c h a s tic S y s te m s . S p rin g e r V erlag. P a rze n ! 1983) T im e S e r ie s A n a ly s is o f I r r e g u l a r l y O bserved Data.
L e c tu re N otes S e rie s, S p rin g e r V erlag .
Parzen(1967) T im e S e r ie s A n a ly s is P a p e r s . H olden-D ay.
Rao(1977) O p tim isa tio n : T h e o r y and A p p lic a tio n s . Wiley E a s te rn Ltd.
Rubin(1976) In fe re n c e and M issing D ata. B io m e tr ik a , 63, 581-592. S erg io B ittan ti(1 9 8 6 ) T im e S e r ie s and L in e a r S y s te m s . S p rin g e r
V erlag.
Shum way and S to ffer(1 9 8 2 ) An A pproach to Time S e rie s Sm oothing and F o re c a s tin g u sing EM a lg o rith m . J o u r n a l o f T im e S e r ie s A n a ly s is , 3 ,2 5 3 -2 64 .
S to ffe r(1 9 8 6 ) E stim a tio n and I d e n tific a tio n o f S p ace-T im e ARMAX Models in th e P re se n c e of M issing D ata. J . o f Am er. S ta t. A sso c ., 81, 762-772.
W hittle(1963) On th e F ittin g of M u ltiv a ria te A u to re g re ssio n s and th e A p p ro xim ate Canonical F a c to r iz a tio n o f a S p e c tra l D ensity M atrix. B io m e tr ik a , 50, 129-134.
Wu(1983) On th e Convergence P r o p e rtie s of th e EM A lgorithm . T h e A n n a ls o f S t a ti s ti c s . 11, 95-103.
P ar z en( 1963) in Time Series Analysis Paper H ol d e n Day, Parzen( 1967).
R u b i n and Li t tl e(1987) Statistical Analysis with Missing Data, N e w York; J ohn Wiley.
Ha nn a n ( 1 9 8 6 ) in Time Series and Linear Systems Springer Verlag, Sergio Bi tt ant i (1986)
H a n n a n and Qu i n n( 1979) The determination o f the order o f an autoregression,
J. Roy. Stat. Soc. B. 41; P.190-195.
Da vi don, F l e t c h e r and Powell(1963) in Optimisation: Theory and Applications,
Wi l ey E a s t e r n Lt d., Rao(1984).
Box and J enki ns (1970) Time Series Analysis: Forecasting and Control,
San Francisco; H o l d en Day.
Ka l man( 1968) On Partial Realisations of a Linear input/output map,
G u i l l e m i n Anni versary Volume, Holt, Wi ns t on and Rinehart.
Kal man( 1969) Lectures on Algebraic System Theory, Springer L e c t u r e Not es.
Bucy and J os eph(1968) Filtering fo r Stochastic Processes with Applications to Guidance, N e w York; I nt er sci ence Publishers.
Ka l man and Bucy(1969) New results in linear prediction and filtering theory,
J. Basic Engr. (Trans. ASME, Ser. D), 83D, P.95-100.
P i e t de J ong and S i n g Fa t C h u - C h u n - L i n ( 1992) Stationary and Non-Stationary State Space Models, J. of T i m e Series Analysis, to appear.
Fi s he r(1925) Theory o f Statistical Estim ation, Proc. Camb. Phil. Soc., 22, P.700-725.
J ones (1983) in Handbook o f Statistics Vol. 5: Time Series in Time Domain,
E l sevi er Sci ence Publ i she rs B.V., Ha n n a n , Krishnaiah and Rao(1985).
Cox and W e r mu t h ( 1 9 9 2 ) A Comment on the Coefficient o f Determination fo r Binary Responses, T h e American Statistician, Vol. 46, No. 1, P.1-3.
L j u n g and S oders t rom( 1983) Theory and Practice of Recursive Identification,
C a m b r i d g e , Mass., M I T Press.