Available Online at www.ijpret.com 1
INTERNATIONAL JOURNAL OF PURE AND
APPLIED RESEARCH IN ENGINEERING AND
TECHNOLOGY
A PATH FOR HORIZING YOUR INNOVATIVE WORK
TUTORIAL IN PANEL DATA MODEL
AMEERA JABER MOHAISEN, SAJA YASEEN ABDULSAMAD
Mathematics Department College of Education for Pure Science AL-Basrah University-Iraq
Accepted Date: 09/04/2017; Published Date: 01/06/2017
\
Abstract: - The contribution of this paper is to provide of theoretical results for panel data
model, We consider the random effect panel data model. Maximum likelihood method is employed to making inferences on the model, and we prove some properties about the parameters estimators.
Keywords: Panel Data Model, Maximum Likelihood Method, Best Linear Unbiased Estimator
(BLUE), Sufficiency, Efficiency, Likelihood Ratio Test.
Corresponding Author: MS. AMEERA JABER MOHAISEN Access Online On:
www.ijpret.com
How to Cite This Article:
Available Online at www.ijpret.com 2 INTRODUCTION
The statistical data is important to study most of phenomena as economical, social, psychological phenomena. etc. The analysis of this data via the statistical methods gives the researcher or the decision maker more information about the studied phenomenon to make the suitable decision. The data availability needs to limit a mathematic model which represents them by the researcher and to put in consideration the type of the available data. One of the these data is panel which can be defined (that they are repeated measurements to the studied phenomena for N from the cross section and for T from the time series) which can be represented by one of the model (fixed effect model or random effect model).
One of the aims of science is to describe and predict events in the world in which we live. One way this is accomplished is by finding a formula or equation that relates quantities in the real world,[2].
In spite of the availability of highly innovative tools in statistics, the main tool of the applied statistician remains the linear model. The linear model involves the simplest and seemingly most restrictive statistical properties: independence, normality, constancy of variance, and linearity . However, the model and the statistical methods associated with it are surprisingly versatile and robust. More importantly, mastery of linear model is a prerequisite to work with advanced statistical tools because most advanced tools are generalizations of the linear model. The linear model is thus central to the training of any statistician, applied or theoretical, [6] .
In applied sciences, ones is often confronted with the collection of correlated data. This generic term embraces a multitude of data structures, such as multivariate observations, clustered data , repeated measurements , longitudinal data , and spatially correlated data .
Available Online at www.ijpret.com 3
The problem we are interest in this paper is that of estimating the value of an (𝐾 + 1) −dimensional vector of parameters 𝜃 as well as the values of the variances parameters 𝜎𝜀2
and 𝜎1 2 for the panel data model. Two important problems in statistical inference are estimation and tests of hypotheses are to be the subject of many books for example references [4] and [5]. In the text context of this paper we are only interested in the maximum likelihood approach.
The contribution of this paper is to provide of theoretical results for panel data model, We consider the random effect panel data model . Maximum likelihood method is employed to making inferences on the model, and we prove some properties about the likelihood estimators and likelihood ratio test statistics are given here.
2. Panel Data Model
Consider the model:
Yit = μ + ∑ βjXjit
K
j=1
+ εit , i = 1, … , N, t = 1, … , T, (1)
Where, Yit the value of response variable for 𝑖𝑡ℎ unit at time t , Xjitthe explanatory variables ,
μ , βj, j = 1, … , K are fixed parameters and εit is an error term with εit N(0, σε2)
~
iid .
Now, if the parameter μ is specified as:
𝜇 = 𝛽0+ 𝑢𝑖 , (2)
Where, 𝑢𝑖~𝑁(0,σu2) , then, the model (1) is
Yit = β0+ ∑Kj=1βjxjit+ui+ εit . ( 3)
The model (3) is rewrite as follows:
Yit = β0 + ∑ βjxjit
K
j=1
+ 𝜔𝑖𝑡 , (4)
Where, 𝜔𝑖𝑡 = ui+ εit , 𝜔𝑖𝑡~𝑁(0 , σω2 ) , σ ω 2 = σ
ε 2 +σ
u
2 , thus by using matrix notation the model
(4) is
Available Online at www.ijpret.com 4
where, F = [e , X] , 𝑒 = [ 1,1, … ,1]𝑇 has length 𝑁𝑇 , Y =
[ Y11, … , Y1T, Y21, … Y2T, … , YN1, … , YNT ]T has length NT , X = [X1, X2, … , XN ]T is a 𝑁𝑇 × 𝐾
design matrix of fixed effects , 𝜃 = [β0, β1, … , βK]T has length 𝐾 + 1, and
ω = [ ω11, … , ω1T, ω21, … ω2T, … , ωN1, … , ωNT ]T has length NT . From model ( 5 ) , we have
Y~ N ( F θ , Ψ ) , where Ψ = E (ωωT )= I
N (σε2 Іt+ σu 2eeT)
= σε2(І
NІt) + σu2(ІN eeT),
replace ІTby ( ET+ JT ) and eeT by T Ј
T , where ЈT = 1
𝑇𝑒𝑒
𝑇 and E
T = ІT− ЈT, then
Ψ = σε2 [ І
N ( ET+ ЈT ) ] + σu2 ( ІN T ЈT )
= σε2 (ІN ET ) + σε2 (ІN ЈT ) + Tσu2 ( ІN ЈT ) ,
by collecting terms with the same matrices, we get
Ψ = σε2 (ІN ET ) + (σε2+ Tσu2) (ІN ЈT ) = σε2 Q + σ12 P, where , σ12 = (σε2+ Tσu2) and
Ψ−1= Q
σε2+
P
σ12 , |Ψ| = product of its characteristic roots, [1] → |Ψ| = (σε
2 )N(T−1)( σ 1 2 )N .
Theorem1 : Let Y is NNT( Fθ , Ψ ) , then the likelihood estimators of parameters θ , σε2 , σu2 are
θ̂ = ( FT Ψ−1 F )−1 ( FT Ψ−1 Y ) , σ̂
ε
2 = 1
N (T−1 ) (Y − F θ̂)
T
Q ( (Y − Fθ̂) and
σ
̂u2 = 1
N (Y − F θ̂)
T
P (Y − Fθ̂) − 1
Tσ̂ε 2 .
Proof :
Since Y~ NNT( Fθ , Ψ ) , then , the density function of Y is
𝑓( Y; θ, Ψ ) = (2π)−NT2 |Ψ|
−1
2 exp {−1
2 ( Y − Fθ)
TΨ−1 (Y − Fθ) }, then , the likelihood function
is the joint density of the 𝑌′𝑠 that is
L(Y ; θ, Ψ ) = (2𝜋)−𝑁𝑇2 |Ψ|
−1
2 exp {−1
2 ( Y − Fθ)
T Ψ−1 (Y − Fθ) },
→ L(Y; θ, σε2 , σ12) = (2π)−NT2 ( σε 2 )
−N(T−1)
2 (σ12) −N
2 exp{ −1
2 ( Y − Fθ)
T Ψ−1 (Y − Fθ) },
∴ L(Y; θ, σε2 , σ
1
2) = (2π)−NT2 ( σ ε
Available Online at www.ijpret.com 5
(σ12)−N2 exp{ −1
2 (Y – Fθ )
T[Q
σε2+
P
σ12 ] (Y– Fθ )}, (6) Then,
ln L =− NT
2 ln(2π) −
N(T−1)
2 ln( σε
2) – N
2ln ( σ1
2 ) – 1
2 ( Y – Fθ )
T [Q σε2+
P
σ12 ] ( Y – Fθ ).
Since (Y- F θ )TΨ−1 ( Y – F θ) = YTΨ−1Y − 2 θTFTΨ−1 Y + θTFTΨ−1Fθ , then
∂ ln L
∂θ =
−1
2 [ −2 F
T Ψ−1 Y + 2 FTΨ−1Fθ ] = 0 → FTΨ−1Fθ = FT Ψ−1 Y
∴ 𝜃̂ = ( FT Ψ−1 F )−1FT Ψ−1 Y . (7)
Now, derivative the ln L with respect to σε2 and σ 1
2 , we obtain
∂ ln L ∂σε2 =
−N(T−1) 2σε2 +
(Y− Fθ)TQ ( Y –Fθ)
2σε4 →
−N𝜎̂ε2 (T−1)+(Y –F𝜃̂ )TQ ( Y− F𝜃̂ )
2𝜎̂ε4 = 0
→(Y – F𝜃̂)TQ (Y – F𝜃̂) = N(T − 1)𝜎̂
ε2
∴ σ̂ε2= 1
N (T−1 ) (Y – Fθ̂ )
TQ ( Y – Fθ̂), (8)
and, ∂ ln L
∂σ12
=2σ−N 1
2 – (Y – Fθ)
T P ( Y – Fθ )
2σ14 = 0 →N 𝜎̂1
2 = (Y – F𝜃̂)T P ( Y – F𝜃̂) .
∴ σ̂12= 1
N (Y – Fθ̂)
TP ( Y – Fθ̂), (9)
→( σ̂ε2 + Tσ̂ u 2 ) = 1
N( Y – Fθ̂)
T P ( Y – Fθ̂)
∴ σ̂u2 = 1
NT (Y – Fθ̂ )
T P ( Y – Fθ̂)− 1
Tσ̂ε
2 ∎
Theorem2: Let Y is NNT( Fθ , Ψ ) , then the maximum likelihood estimator of parameter θ is the best linear unbiased estimator (BLUE).
Proof:
Since θ̂ =( FTΨ−1F)−1FTΨ−1Y→E(θ̂) = E[ ( FTΨ−1F)−1FTΨ−1Y ]
Available Online at www.ijpret.com 6
𝑉𝑎𝑟(θ̂) = 𝑉𝑎𝑟 [ ( FTΨ−1F)−1FTΨ−1 Y ]
= ( FTΨ−1F)−1FTΨ−1{𝑉ar (Y)} Ψ−1 F ( FTΨ−1F)−1
= ( FTΨ−1F)−1( FTΨ−1F )( FTΨ−1F)−1 = ( FTΨ−1F)−1.
Now, le t 𝜃̂• = DY is another unbiased estimator for θ, where
D =(FTΨ−1F)−1FTΨ−1+ G , where G is (𝐾 + 1) × 𝑁𝑇 matrix,
Since E(𝜃̂•) = θ → E(DY) = E { [ ( FTΨ−1F)−1FTΨ−1+ G ] Y }
= [ ( FTΨ−1F)−1FTΨ−1+ G ] E ( Y) = [ ( FTΨ−1F)−1FTΨ−1+ G ] Fθ
= ( FTΨ−1F)−1FTΨ−1Fθ + G Fθ = I . θ + 0 = θ , that is G F = 0
𝑉𝑎𝑟(𝜃̂•) = 𝑉𝑎𝑟 (DY) = D 𝑉𝑎𝑟 𝑌 DT
= [ ( FTΨ−1F)−1FTΨ−1+ G ] Ψ[ ( FTΨ−1F)−1FTΨ−1+ G ]T
= [ ( FTΨ−1F)−1 ( FTΨ−1F) ( FTΨ−1F)−1+ G Ψ GT = ( FTΨ−1F)−1+ G Ψ GT
= 𝑉𝑎𝑟( θ̂) + G Ψ GT , thus 𝑉𝑎𝑟 (θ̂) < 𝑉𝑎𝑟(𝜃̂•) ∎
Theorem3: suppose that Y is NNT( Fθ , Ψ ) ,where F is 𝑁𝑇 × (𝐾 + 1)of rank(𝐾 + 1) < 𝑁𝑇 and
𝜃 = [β0, β1, … , βK]T.Then the maximum likelihood estimator of θ is an efficient statistic for θ .
Proof:
Since Y~ NNT( Fθ , Ψ ), then , the density function of Y is
𝑓( Y; θ, Ψ ) = (2π)−NT2 |Ψ|
−1
2 exp {−1
2 ( Y − Fθ)
TΨ−1 (Y − Fθ) }, and the likelihood function is
L(Y ; θ, Ψ ) =(2π)−NT2 |Ψ|
−1
2 exp {−1
2 ( Y − Fθ)
TΨ−1 (Y − Fθ) },
then,
ln L =− NT
2 ln (2π) −
N(T−1)
2 ln( σε
2) – N
2ln ( σ1
2 ) – 1
2 ( Y – Fθ )
T [Q σε2+
P
σ12 ] ( Y – Fθ ),
→ ∂ ln L
∂θ =
−1 2 [-2F
TΨ−1Y + ( FTΨ−1F ) θ] → ∂2ln L
∂θ2 = − ( F
Available Online at www.ijpret.com 7
Then , the Rao – Cramer lower bounded is
C. R. L = −E [ ∂2ln L ∂θ2 ]
−1
= ( FT Ψ−1F )−1= 𝑉𝑎𝑟( 𝜃̂ ) ∎
Theorem4: Let Y is NNT( Fθ , Ψ ) , then the maximum likelihood estimators of parameters θ
, σε2 , and σ 1
2 are jointly sufficient for θ and σ ε
2 , and σ
1 2.
Proof:
Since Y~ NNT( Fθ , Ψ ), then , the density function of Y is
𝑓( Y; θ, Ψ ) = (2π)
−NT
2 |Ψ|
−1
2 exp {−1
2 ( Y − Fθ)
T Ψ−1 (Y − Fθ) } , we add and subtract Fθ̂ to
obtain
𝑓( Y; θ, Ψ ) = (2π)−NT2 |Ψ|
−1
2 exp [- 1
2[(Y − Fθ̂ + Fθ̂ − Fθ)
T Ѱ−1 (Y − Fθ̂ + Fθ̂ − Fθ)],
= (2π)−NT2 |Ψ| −1
2 𝑒𝑥𝑝{−1
2 [(Y − Fθ̂) + F(θ̂ − θ)]
T Ѱ−1[(Y − Fθ̂) + (θ̂ − θ)]}.
→ 𝑓(Y; θ, Ψ) =(2π)−NT2 |Ψ|
−1
2𝑒𝑥𝑝[−1
2 {(Y − Fθ̂)
T Ѱ−1(Y − F𝜃̂) + (θ̂ − θ)TFT Ѱ−1F.
(θ̂ − θ)}].
𝑓( Y; θ, Ψ) = (2π)−NT2 |Ψ|
−1
2 exp[−1
2{(Y − Fθ̂)
T[ 𝑄 σε2 +
𝑃
σ12 ](Y − F𝜃̂) + (θ̂ − θ)
T FTΨ−1F
(θ̂ − θ)}].
𝑓( Y; θ, Ψ) = (2π)−NT2 |Ψ|
−1
2 exp [−1
2{(Y − Fθ̂)
T 𝑄
σε2 (Y − F𝜃̂) + (Y − Fθ̂)
T 𝑃
σ12 (Y − F𝜃̂) +
(θ̂ − θ)T FTΨ−1F (θ̂ − θ)}]
𝑓( Y; θ, Ψ) = (2π)−NT2 |Ψ|
−1
2 exp [−1
2{(
𝑁(𝑇−1)𝜎̂𝜀2
σε2 +
𝑁𝜎̂12
σ12 ) + (θ̂ − θ)
T FTΨ−1F (θ̂ − θ)}].
We can now write the density as:
𝑓( Y ; θ, Ψ ) = g (θ̂, σ̂ε2, σ̂
12, θ , σε2 , σ12) h (Y), where h (Y) =1, therefore by the Neyman
factorization theorem θ̂and 𝜎̂𝜀2, 𝜎̂
Available Online at www.ijpret.com 8 Theorem5: Let Y is NNT( Fθ , Ψ ) , the likelihood ratio test for H0 : θ = 0 is
( YTY)
−NT2
[ (Y – Fθ̂ )T ( Y – Fθ̂) ]−NT2
~ F ( NT , NT − K − 1 )
Proof:
Since the likelihood estimators for θ,σε2 and σ
12 are
θ̂ = ( FT Ψ−1 F )−1FT Ψ−1 Y , 𝜎̂𝜀2= 1
N (T−1 )(Y – Fθ̂)
TQ ( Y – Fθ̂) and
𝜎̂12= N 1 (Y – F𝜃̂)TP ( Y – F𝜃̂), and, the maximum likelihood function is
L = (2π)−NT2 (σε2 )
−N(T−1) 2 (σ12 )
−N
2 exp{ −1
2 (Y − Fθ)
T (Q σε2+
P
σ12 ) (Y − Fθ) } , then, the likelihood
function under 𝐻1, (maxH1L ( θ , σε
2 , σ 12 ) ) is
𝐿1 = (2π)−NT2 [ 1
N (T−1 )(Y – Fθ̂)
TQ ( Y – Fθ̂) ]−N(T−1)2 [1
N (Y – Fθ̂)
TP ( Y – Fθ̂) ]−N2
exp {−1 2 [
(Y –Fθ̂)TQ ( Y –Fθ̂)
1
N (T−1 ) (Y –Fθ̂)TQ ( Y –Fθ̂)
+ 1(Y –Fθ̂)TP ( Y –Fθ̂) N (Y –Fθ̂)T P ( Y –Fθ̂)
]}
𝐿1 = (2π)−NT2 [ 1
N (T−1 ) (Y – Fθ̂)
TQ ( Y – Fθ̂) ]−N(T−1)2 [ 1
N (Y – Fθ̂)
TP ( Y – Fθ̂) ]−N2 e−NT
2.
And the likelihood function under 𝐻0, maxH0L ( θ , σε
2 , σ 1
2 ) = Max L( 0 , σ
ε 2 , σ
12 )
→ 𝐿0( 0 , σε2 , σ
1
2 ) = (2π)−NT2 (σ
ε
2 )−N(T−1)2 (σ 12 )
−N
2 exp [ −1
2 Y
T (Q
σε2+
P
σ12 ) Y ] →
ln𝐿0( 0 , σε2 , σ12 ) = −
NT
2 ln(2π) −
N(T − 1)
2 ln σε
2 −N
2ln σ1
2−1
2 Y
T (Q
σε2
+ P
σ12 ) Y,
→∂ ln L
∂σε2 =
−N(T−1) 2σε2 +
YTQ Y
2σε4 = 0 →
−N (T−1)σε2+YTQ Y
2σε4 = 0 → Y
T Q Y = N(T − 1)𝜎̂
ε2
∴ 𝜎̂𝜀2= 1
N (T−1 ) Y
T Q Y ,
and ∂ ln L
∂σ12
=2σ−N 1
2 + Y2σTP Y 1
4 = 0 →
−N σ12+ YTP Y
2σ14 = 0 →N 𝜎̂1
2 = YT P Y → 𝜎̂
12= 1
NY
Available Online at www.ijpret.com 9
Then, the likelihood function under 𝐻0 is
maxH0 L ( θ , σε2 , σ12 ) = Max L( 0 , σε2 , σ12 )
= (2π)−NT2 [ 1
N (T−1 )Y
T Q Y ]−N(T−1)2 [ 1
NY
T P Y]
−N 2
= (2π)−NT2 [ 1
N (T−1 )Y
T Q Y ]−N(T−1)2 [ 1
NY
T P Y]
−N 2
e−NT2.
Then , the likelihood ratio is
λ =MaxH0
MaxH1 =
(2π)
−NT
2 [ 1
N (T−1 ) Y
T Q Y ]−N(T−1)2 [ 1 NY
T P Y] −N
2 e−NT2
(2π)
−NT
2 [ N (T−1 ) 1 (Y –F θ̂)TQ ( Y –F 𝜃̂) ]−N(T−1)2 [1
N (Y – Fθ̂)TP ( Y – Fθ̂) ] −N
2 e−
NT 2
= ( YTY) −NT2
[ (Y – Fθ̂)T ( Y – Fθ̂) ]−NT2
=
𝜔̂ 0𝑇 𝜔̂0 NT 𝜔̂ 1𝑇 𝜔̂ 1 NT−k−1
~ F ( NT , NT − K − 1 ). (10)
Where, 𝜔̂1𝑇 𝜔̂1 = (Y – Fθ̂ )T ( Y – Fθ̂) is 𝜒2(NT − K − 1) and 𝜔̂0𝑇 𝜔̂0 = ( YT Y ) is
𝜒2(NT). ∎
Theorem6: Let Y is NNT( Fθ , Ψ ) , the likelihood ratio test for H0 : Aθ = 0, where A is 𝑞 ×
(𝐾 + 1) matrix of constants is
[
𝜔̂0𝑇𝜔̂0+𝜃̂𝑇𝐴𝑇 [𝐴 (𝐹𝑇𝐹) −1
𝐴𝑇]−1𝐴𝜃̂
𝑞 𝜔̂1𝑇𝜔̂1
𝑁𝑇−𝐾−1 ]
−𝑁𝑇
2
~𝐹(𝑞, 𝑁𝑇 − 𝐾 − 1)
Proof:
The likelihood function is
L = (2π)
−NT 2 (σε2 )
−N(T−1) 2 (σ12 )
−N
2 exp{ −1
2 (Y − Fθ)
T (Q σε2+
P
σ12 ) (Y − Fθ) }, then for test
H0 : Aθ = 0. Let L•= ln L + λTA θ
= −NT
2 ln(2π) −
N(T−1)
2 ln(σε
2) −N
2 ln (σ1
2) −1
2 (Y − Fθ)
Available Online at www.ijpret.com 10
(Q σε2+
P
σ12 ) (Y − Fθ) + λ
TA θ
→∂L•
∂θ = 2 F
T(Q
σε2+
P
σ12 ) Y − 2 F
T(Q
σε2+
P
σ12 ) Fθ + A
Tλ = 0 , (11)
→∂L∗
∂λ = A θ = 0 , (12)
→∂ ln 𝐿• ∂σε2 =
−N(T−1) 2σε2 +
(Y− Fθ̂)TQ ( Y –Fθ̂)
2σε4 = 0 , (13)
→∂ ln 𝐿• ∂σ12 =
−N 2σ12 –
(Y – Fθ̂)T P ( Y – Fθ̂)
2σ14 = 0 . (14)
Multiply ( 11 ) by A [ FT(Q σε2+
P σ12 ) F ]
−1 to obtain
2A [ FT(Q
σε2
+ P
σ12 ) F ]−1 FT(
Q σε2
+ P
σ12 ) Y − 2A [ FT(
Q σε2
+ P
σ12 ) F ]−1 [ FT(
Q σε2
+ P
σ12 ) F ]θ
+ A [ FT(Q σε2+
P σ12 ) F ]
−1ATλ = 0
→ 2A 𝜃̂ − 2Aθ + A [ FT(Q
σε2+
P σ12 ) F ]
−1ATλ = 0, since Aθ = 0
→ A [ FT(Q
σε2+
P σ12 ) F ]
−1ATλ = 2A𝜃̂ → λ = −2 ( A [ FT(Q
σε2+
P σ12 ) F ]
−1AT )−1 A𝜃̂.
From (13) and (14) ,we get
𝜎̂𝜀2= 1
N (T−1 )(Y – Fθ̂)
TQ ( Y – Fθ̂) , (15)
𝜎̂12= 1
N(Y – Fθ̂)
TP( Y – Fθ̂) . (16)
Then ,
λ = −2 ( A [ FT( Q
1
N (T−1 ) (Y –F𝜃̂)TQ ( Y –F𝜃̂)
+ 1 P
N (Y –F𝜃̂ )T P ( Y – F𝜃̂)
) F ]−1AT)
−1 A𝜃̂
→ λ = −2 (𝐴 [𝑁(𝑇−1)𝐹𝑇𝐹+𝑁𝐹𝑇𝐹
(𝑌−𝐹𝜃̂)𝑇(𝑌−𝐹𝜃̂) ] −1
𝐴𝑇) 𝐴𝜃̂ → λ = −2 (𝐴 [ 𝑁𝑇 𝐹𝑇𝐹
(𝑌−𝐹𝜃̂)𝑇(𝑌−𝐹𝜃̂) ] −1
Available Online at www.ijpret.com 11
Now, substitute λ in (11) to obtain
2 FT( 1 Q
N (T−1 ) (Y –F𝜃̂)TQ ( Y –F𝜃̂)
+ 1 P
N (Y –F𝜃̂)TP ( Y –F𝜃̂)
) Y −2 FT( 1 Q
N (T−1 ) (Y –F𝜃̂)TQ ( Y –F𝜃̂)
+
P
1
N (T−1 ) (Y –F𝜃̂)
TQ ( Y –F𝜃̂) ) Fθ − 2 ( A [
NT FTF (Y –F𝜃̂)T ( Y –F𝜃̂)]
−1
AT )
−1
A𝜃̂ = 0
→ 2NT
(Y – F𝜃̂)T ( Y – F𝜃̂) [ F
TY − FTFθ − AT[ A (FTF)−1AT ]−1 A𝜃̂ = 0
→ FTY − FTFθ − AT[ A (FTF)−1AT ]−1 A𝜃̂ = 0
𝜃̂0 = (FTF)−1 ( FTY − AT[ A (FTF)−1AT ]−1 A𝜃̂). (17)
Then ,
Y − F𝜃̂0 = Y − F𝜃̂ − F (FTF )−1 AT[ A (FTF )−1AT ]−1A𝜃̂,
u0 = 𝜔̂ − F(FTF)−1AT[ A (FTF )−1AT ]−1A𝜃̂,
Where u0 is estimated residual from the restricted model
u0Tu0 = { 𝜔̂T− 𝜃̂𝑇AT[A (FTF)−1AT]−1A(FTF)−1FT } {𝜔̂ − F(FTF)−1𝐴𝑇[A (FTF)−1AT]−1A𝜃̂}
→ u0Tu0 = 𝜔̂T𝜔̂ − 𝜔̂TF A(FTF)−1[A (FTF)−1 AT]−1A𝜃̂ − 𝜃̂𝑇AT [A (FTF)−1 AT]−1
A(FTF)−1FT𝜔̂ + AT𝜃̂𝑇 [A (FTF)−1 AT]−1A(FTF)−1FTF A (FTF)−1
[A (FTF)−1 AT]−1A𝜃̂ → u 0 Tu
0 = 𝜔̂T𝜔̂ + AT 𝜃̂𝑇[A (FTF)−1 AT]−1A𝜃̂.
We can note that 𝜔̂TF = (𝑌 − 𝐹𝜃̂)𝑇𝐹 = (𝑌𝑇− 𝜃̂𝑇𝐹𝑇)𝐹
= 𝑌𝑇𝐹 − (𝑌𝑇𝛹−1𝐹(𝐹𝑇𝛹−1𝐹)−1𝐹𝑇)𝐹
= 𝑌𝑇𝐹 − 𝑌𝑇𝐹 = 0 ,
Available Online at www.ijpret.com 12
→ u0Tu0 − 𝜔̂T𝜔̂ = AT𝜃̂𝑇 [A (FTF)−1 AT]−1A𝜃̂
→
u0Tu0 −𝜔̂𝑇𝜔̂ q 𝜔̂ 𝑇𝜔̂ NT−K−1
~ F( q , NT − K − 1).
The likelihood function under 𝐻0 is
𝑀𝑎𝑥𝐻0𝐿 ( 𝜃 , 𝜎𝜀2 , 𝜎12 ) = 𝐿 ( 𝜃̂0 , 𝜎̂𝜀(0)2 , 𝜎̂𝜀(0)2 )
=(2π)
−NT
2 [ 1
N (T−1 ) (Y – F𝜃̂0)
TQ ( Y – F𝜃̂
0) ]
−N(T−1)
2 [1
N (Y – F𝜃̂0)
TP ( Y – F𝜃̂
0) ]
−N 2 e−
NT 2,
and the likelihood function under 𝐻1 is
𝑀𝑎𝑥𝐻1 𝐿 ( 𝜃 , 𝜎𝜀
2 , 𝜎
12 ) = 𝐿 (𝜃̂ , 𝜎̂𝜀2, 𝜎̂12)
= (2π)
−NT
2 [ 1
N (T−1 )(Y – F𝜃̂)
TQ ( Y – F𝜃̂) ]−N(T−1)2 [1
N (Y – F𝜃̂ )
TP ( Y – F𝜃̂) ]−N2 e−NT2
.
Thus, the likelihood ratio is
𝜆 =𝑀𝑎𝑥𝐻0
𝑀𝑎𝑥𝐻1 =
(2𝜋)
−𝑁𝑇
2 [ 1
𝑁 (𝑇−1 ) (𝑌 –𝐹 𝜃̂0)
𝑇𝑄 ( 𝑌 –𝐹𝜃̂ 0) ]
−𝑁(𝑇−1)
2 [1
𝑁 (𝑌 – 𝐹𝜃̂0)
𝑇𝑃 ( 𝑌 –𝐹𝜃̂ 0) ]
−𝑁 2 𝑒−
𝑁𝑇 2
(2𝜋)
−𝑁𝑇
2 [ 1
𝑁 (𝑇−1 ) (𝑌 –𝐹 𝜃ˆ)𝑇𝑄 ( 𝑌 –𝐹 𝜃ˆ) ] −𝑁(𝑇−1)
2 [1
𝑁 (𝑌 – 𝐹𝜃ˆ )𝑇𝑃 ( 𝑌 – 𝐹𝜃ˆ) ] −𝑁
2 𝑒− 𝑁𝑇
2
= [ (𝑌−𝐹𝜃̂0)𝑇( 𝑌 –𝐹𝜃̂0)]− 𝑁𝑇
2
[ (𝑌 –𝐹𝜃̂)𝑇( 𝑌 – 𝐹𝜃̂)]−𝑁𝑇2
= [
𝜔̂ 𝑇𝜔̂ +𝜃̂𝑇𝐴𝑇 [𝐴 (𝐹𝑇𝐹)−1 𝐴𝑇] −1 𝐴𝜃̂ 𝑞 𝜔̂ 𝑇𝜔̂ 𝑁𝑇−𝐾−1 ] −𝑁𝑇2
∎
3. CONCLUSION
The conclusions which are obtained throughout this paper are given as follows:
1. The maximum likelihood estimators of parameters θ , σε2 , σu2 of panel data model are
θ̂ = ( FT Ψ−1 F )−1 ( F Ψ−1 Y ) , σ̂ε2 = 1
N (T−1 ) (Y − F θ̂)
T
Q ( (Y − Fθ̂) and
σ ̂u2 =
1
N (Y − F θ̂)
T
P (Y − Fθ̂) − 1
Available Online at www.ijpret.com 13
2. The maximum likelihood estimator of parameter θ of panel data model is the best linear unbiased estimator (BLUE).
3. The maximum likelihood estimator of parameter θ of panel data model is an efficient statistic for θ.
4. The maximum likelihood estimators of parameters θ, σε2 , and σ12 of panel data model are jointly sufficient for θ and σε2 , and σ12.
5. The likelihood ratio test for H0 : θ = 0 in the panel data model is
( YTY)−
NT 2
[ (Y – Fθ̂ )T ( Y – Fθ̂) ]−NT2
~ F ( NT , NT − K − 1 ).
6. The likelihood ratio test for H0 : Aθ = 0 ,where A is 𝑞 × (𝐾 + 1) matrix of constants in the panel data model is
[
𝜔̂̂ 𝑇𝜔̂̂ +𝜃̂𝑇𝐴𝑇 [𝐴 (𝐹𝑇𝐹)−1 𝐴𝑇] −1
𝐴𝜃̂ 𝑞
𝜔̂̂ 𝑇𝜔̂̂ 𝑁𝑇−𝐾−1
] −𝑁𝑇2
~𝐹(𝑞, 𝑁𝑇 − 𝐾 − 1).
4. REFERENCES
1. Baltagi, badi,” Econometric Analysis of panel data “, John Wily & Sons Inc. third edition,(2005).
2. Graybill, F.A. “Theory and Application of the Linear Model “North Scituate, MA; Duxbury Press,(1976).
3. Husio, Cheng, “Analysis of panel data “, Second edition, Cambridge university Press, (2003). 4. Hogg, Robert V., McKean, Joseph W.& Craig, Allen T., “ Introduction to Mathematical Statistics “, seven edition ,Pearson Education , Inc., (2013).
5. Mood, Alexander M., Graybill, Franklin A. & Boes , Duane C., “ Introduction to the theory of statistics “, third edition. McGraw- Hill, Inc., (1974).
6. Rencher , Alvin C. and Schaalje, G. Bruce, “ Linear Models in Statistics “ ,second edition, Wiley-Interscience, A John Wiley & Sons ,Inc., Publication,(2008).
7. Searal ,S.R.,” Linear Model .New York: Wiley, (1971).
8. Seber , G .A .F. and A.J. Lee, “ Linear Regression Analysis ( 2nd ed.). Hoboken, NJ: Wiley,(2003).
Available Online at www.ijpret.com 14