International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
797
Regular Algorithm of Adaptive Estimation of the State of a
Managed Object with Correlated Noise Object and Interference
Measurements
H. Z. Igamberdiyev
1, O. O. Zaripov
2, A. X. Abduganiyev
31,2,3Department of Electronic and Automatic, Tashkent State Technical University 1,2,3
Address: Universitetskaya st.2, 100095, Tashkent city, Republic of Uzbekistan
Abstract — The paper deals with the construction of the regular adaptive estimation algorithms with auto and cross-correlated noise object and interference measurements. In the synthesis of regular estimation algorithms in the case of autocorrelated noise and interference measurements of the object describes how to expand the state vector and difference measurements. As a regular procedure uses statistical form discrepancy principle. When constructing regular estimation algorithms in the case of cross-correlated noise and interference measurements of the object as a regularizing procedures used regularization methods M.M.Lavrentev and V.N.Strahov. These expressions allow for convergence of the estimates and to improve the accuracy of their evaluation.
Keywords — Adaptive filtering, correlated noise and interference measurements of the object, regularization, the regularization parameter.
I. INTRODUCTION
In solving various problems of estimation and filtering may be situations where noise and interference measurements of the object are auto-and cross-correlated. In these cases, for random processes due to the time dependence must be considered dynamic transformations, ie transformations, which are described by differential or difference equations.
II. TASK STATEMENT -I
We first consider the algorithms of state estimation of dynamic systems in the presence of autocorrelated noise object and interference measurements. We assume that the system model and measurements are of the form:
i i i i i i
i
A
x
Г
x
1
1|
1|
,
i1
A
~
i1|i
i
~
iw
i1, (1)1 1 1
1
i i
ii
H
x
z
,
i1
H
~
i1
i
~
iv
i1. (2) A priori data set as follows:
,
,
~
,
,
~
,
,
0
~
,
,
0
~
) ( 0 0 0
0 0 0
N
P
P
x
N
x
R
N
v
Q
N
w
i i i i
,
cov
,
0
.
cov
,
cov
,
cov
,
cov
0
0 0
0 0
i i i
i i
w
v
v
w
w
x
x
Algorithms Of The Decision
Then, following the methods of the theory of optimal filtering and dynamic evaluation [1-4], we can show that the estimation algorithms are given by:
1~
1 1 1|~
1 |
,
1 | 1 1 | 1
i i i i i i i i i i
i i i i i
x
H
H
x
H
z
H
z
K
x
x
(3)
i i i i i i i i i
i
A
x
Г
x
1|
1| |
1|
| ,
i1|i
A
~
i1|i
i|i, (4)
1~
1 1 1|~
1 |
,
) (
1 | 1 1 | 1
i i i i i i i i i i
i i i i i
x
H
H
x
H
z
H
z
K
(5)
.
~
~
1 /
| 1
1 |
| 1 |
) 1 (
1
i T i T
i i i i
i T i i i i i T i i i i
H
H
W
Г
H
H
P
A
H
P
P
(6)
1 | | | 1 |
) 2 (
1
~
~
iT i i T i i i i T i T i i
i
W
H
A
W
H
H
P
,i i i
i
W
x
,
)
|cov(
. (7)Thus gains
K
i1 andK
i(1) are determined based on the expressions:) 1 (
1 * ) 22 (
| 1
1
i i
ii
P
P
K
, (8)) 2 (
1 * ) 22 (
| 1 ) (
1
i i
ii
P
P
International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
798
where
,
~
~
~
~
1 1 | 1 1 | 1 | | 1 | 1 1 | | 1 | | 1 1 1 | 1 1 * ) 22 ( | 1 T i i i T i T i i i i i T i T i i i i T i i i i i T i T i T i T i i i i i i i i i T i i i i i iB
R
B
H
H
P
H
H
H
Г
C
A
P
H
H
H
H
C
Г
P
A
H
H
P
H
P
.
| 1 | | 1 | 1 | | 1 | 1 | | 1 | 1 | | 1 | 1 T i i i i i i T i i T i i i i T i i i i i i T i i i i i i i iГ
D
Г
A
C
Г
Г
C
A
A
P
A
P
) 1 ( 1 1 | 1 1 |1
i
i i
i ii
P
K
P
P
, T i i i i i i T i i i i i i ii
A
C
A
Г
D
A
C
1| 1| | 1| 1| | 1|~
, T i i i T i i i i i i ii
A
D
A
b
Q
b
D
1|
~
1| |~
1|
1 ,) 2 ( 1 1 | 1 1 |
1
i
i i
i ii
C
K
P
C
,D
i1|i1
D
i1|i
K
i(1)P
i(21),1
,
,
cov
| | | |1
i
i
k
D
C
C
P
Z
x
x
i k T i k i k i k i T k k k k
.In solving the problem under consideration in the evaluation of noise
i model system should be assessed by the measurement information, and the noise in the measurement modelv
i is the nuisance parameters and the evaluation can not be. Here it is advisable to use two methods [1,5]: the expansion of the state vector method and the method of difference measurements Bryson-Henriksson.The method of expansion of the state vector, in which the state vector
x
i is supplemented by the vector
i. The new state vector isx
i*
x
iT,
iT
T. Relations (1) - (2) take the form:1 * * * | 1 *
1
i i i
i ii
A
x
b
w
x
, (10)1 *
1 *
1
1
i i
ii
H
x
z
, (11) where
i i ix
x
* ,
i i i i i i i iA
Г
A
A
| 1 | 1 | 1 * | 1~
0
,
i ib
b
*0
,
10
*
1
ii
H
H
.The method of difference measurement eliminates noise
i
v
, forming a new dimensiony
i1 as a linear combination of two consecutive measurementsz
i andz
i1:i i i
i
z
H
z
y
1 1 1~
. (12)Using (10) - (12), we describe a model for measuring:
.
~
~
1 1 * * 1 * * 1 | 1 * 1 1
i i i i i i i i i i i iv
w
b
H
x
H
H
A
H
y
(13)Priori data are given by:
,
,
0
,
~
,
,
0
~
,
,
0
~
0 0 0 0 1
z
P
x
N
x
R
N
v
Q
N
w
i i i i0
)
,
(
cov
)
,
(
cov
)
,
(
cov
w
iv
j
w
ix
0
v
ix
0
. For the relations (10) and (13) it is advisable to use a filter-Glonti Liptser [1]. Then:
i i i
i i i i
i
x
K
y
y
x
1 1 1|* | 1 * 1 |
1
,
* | * | 1 * 1 | 1 * 1 * | 1 | 1 * | 1~
iii i i i i i i i i i i i i
x
A
H
H
A
H
A
y
x
,
1| 1 | 1 1
yy i i xy i i iP
P
K
, xy i i i i i ii
P
K
P
P
1|1
1|
1 1| ,T i i i T i i i i i i i
i
A
P
A
b
Q
b
P
1|
*1| | *1|
* 1 * ,
*1 1|~
1 *
* 1
*1 *
,
| 1 | 1 T i i i i T i i i i i i i xy i
i
P
H
A
H
H
b
Q
H
b
P
International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
799
Efficiency of estimation algorithms (3) - (7) substantially depends on the accuracy of calculating the gain matrix
K
i1 andK
i(1) based on the expressions (8) and (9) [1,6]. MatrixP
i(221|i)* in these expressions may be degenerate or poorly conditioned. To computeK
i1 and) (
1
i
K
, it is expedient to use a regular procedure [7-11]. Regular algorithm solutions will be considered with respect to the equation (8). The resulting algorithm may also be used in solving equation (9).Equation (8) can be written as follows:
) 1 (
, 1 ,
1 * ) 22 (
|
1 i j i j
T i
i
k
p
P
, (14)Where
k
i1,j- j-th column of the matrixn
j
K
iT1,
1
,
2
,...,
;
j i
d
, - j-th row of the matrixP
i(11)T,n
j
1
,
2
,...,
.In equation (14) the vector elements
p
i(11),j known from errors, i.e. instead ofp
i(1)1,j has its random realization) 1 (
, 1 )
1 (
, 1 )
1 (
,
1j i j i j
i
p
p
p
. To solve it, we will use the least squares method, whereby estimates of the unknownk
ˆ
i1,jnormal pseudo solution
k
i*1,j
(
P
i(122|i)*T)
p
i(1)1,j system (14) are determined as a solution of2
, 1
inf
k
i j to}
)
(
:
{
1,Q
1,Q
minK
k
i jk
i j
[11,12];)
(
inf
1, min, 1
j i R k
k
m j i
Q
Q
here, where2 ) 1 (
, 1 , 1 * ) 22 (
| 1 ,
1
)
(
k
i j
P
i i Tk
i j
p
ijQ
,||
||
- Euclidean norm of(
P
i(221|i)*T)
- toP
i(221|i)*T pseudo-inverse matrix.Ratings
k
ˆ
i1,j are the best in the class of linear unbiased estimators. However, in the case of a degenerate or ill-conditioned matrix ofP
i(221|i)*T they are unstable [13], ie,2 *
, 1 2
, 1
ˆ
j i j
i
k
k
M
.Taking into account that the main error of unbiased estimators
2 *
, 1 , 1
ˆ
j i j i
k
k
M
caused by the displacementof a square length
k
ˆ
i1,j, ie value of2 *
, 1 2
, 1
ˆ
j i j
i
k
k
M
naturally in solving degenerate or ill-conditioned systems of equations of the approximate (8), (9) instead of the class of unbiased estimators consider the class of unbiased estimates with the square of the length, ie class
}
:
{
*1, 22
, 1 ,
1j i j i j
i
M
k
k
k
K
ratings. To do this, use the fact [14] that:2 *
, 1
, 1 2
min
)
(
)
(
inf
)
(
, 1
n
k
M
k
M
l
n
M
j i
j i R
ki j m
Q
Q
Q
(15)
and
ˆ
*1, 2
2(
(221|)*)
2, 1
T i i j
i j
i
k
tr
P
k
M
, where)
(
),
ˆ
(
1, (221|)*min
T i i j
i
l
rank
P
k
Q
Q
.Inequality (15) shows that using the method of least-squares leads to the "defects" average value of the sum of squared residuals. Natural to require that the regularized estimates eliminate this defect. Then, on the basis of (15) is natural to define the regularized estimates
k
~
i1,j so as to satisfy the condition:.
)
~
(
k
1,n
2M
Q
i j
(16)The parameter
can be found from the equation residual [11] of the form:0
,
)
(
1,
Q
min
Q
k
i j . (17)Then the corresponding regularized estimates of the solutions will be determined from the joint solution of the equations:
,
~
(1), 1 * ) 22 (
| 1 ) (
, 1 )
( , 1 * ) 22 (
|
1 i j i j i i i j
T i
i
k
k
P
p
P
(18)
min
2 ) 1 (
, 1 )
( , 1 * ) 22 (
| 1
~
Q
j i j i T i
i
k
p
International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
800
To satisfy the conditions (16) the amount of δ in (17) can be selected based on the ratio
min 1
0
(
)
Q
l
n
l
. This is because.
]
)
(
[
)
(
min
0M
l
n
l
1 minn
2M
Q
Q
This method does not require any additional a priori information on an approximate equation system. Following [11,14] we can show that if the conditionlim
1 (221|)*
0
,
G
T i i n
n
P
is rated
k
~
i(opt1,j) andk
ˆ
i*1,j will be consistent and asymptotically efficient.In order to select the optimal regularization parameter instead of a class with a non-biased estimates of square of length
K
we consider the class of regularized estimates}
{
~
( ), 1
j i
k
K
.This class is determined from the Euler equation (18), and the regularization parameter
is determined from the condition of the residual:,
~
2min 2 ) 1 (
, 1 ) (
, 1 * ) 22 (
|
1
k
p
m
P
i i T i j i jQ
(20) It can be shown [11,15,16] that the regularized estimates) (
, 1
j i
k
, determined from the equations (18) and (20) satisfythe condition
2 *
, 1 2 ) (
,
1j i j
i
k
k
M
. At the same time for optimal regularized estimatesk
~
i(opt1,j) equality holds0
)
(
p
i(1)1,j
M
. This fact leads to a shift of* , 1 ) (
, 1
~
j i opt
j
i
k
k
M
andM
(
p
~
i(11),j
P
i(221|i)*Tk
~
i(opt1,j))
0
, which ultimately negatively affect the value of the mean square error estimates of solutions2 *
, 1 ) (
, 1
~
j i opt
j i
k
k
M
. To ensure conditions2 *
, 1 ) (
, 1 2
* , 1 ) (
, 1
~
j i opt
j i j
i j
i
k
M
k
k
k
M
parameter γ in (20) can be found from the condition:,
min
1 ) (
n
i i
e
M
(21)where
e
()
(
e
1(),...,
e
n())
T
~
p
i(11),j
P
i(221|i)*Tk
i(1),j. (21) that the parameter
is expedient to choose the form:
ni i m
p
e
j
i 1
) (
] ~
, 0 [ *
2 min 2 ) 1 (
, 1
min
arg
Q
.
III. TASK STATEMENT -II
We now consider the adaptive estimation algorithms with mutual correlation noise object and interference measurements. System model and the measurements will be written as:
,
1 |
1
1
i i i
i ii
A
x
Г
w
x
(22)1 1
1
1
i i
i ii
H
x
G
v
z
, (23) where
1
1
1
0
0 0
1
~
N
0
,
Q
,
v
~
N
0
,
R
,
x
~
N
x
,
P
w
i i i i ,ij i T i
i i
j j
i i
R
C
C
Q
v
w
v
w
,
cov
,ij
– Kronecker delta,Q
i
0
,C
i
0
,R
i
0
,
,
0
;
cov
,
0
cov
x
0w
i
x
0v
i
.Algorithms Of The Decision
Based on the theory of dynamic evaluation methods [1-4] the estimation algorithm in this case can be written as:
i i i i
i i i i
i
x
K
z
H
x
x
1|1
1|
1 1
1 1| , (24)
i i ii
p i i i i i i
i
A
x
K
z
H
x
x
1|
1| |
1
| , (25)
11 1 1 1 | 1 1 1 | 1 1
i i iTT i i i i T i i i
i
P
H
H
P
H
G
R
G
K
, (26)
,
| 1 | |
1 |
1
p i T i i i p i T i i i
i p i i i i i i p i i i i i
K
G
R
G
K
Г
Q
Г
H
K
A
P
H
K
A
P
(27)
i i
i ii
i
I
K
H
P
P
1|1
1 1 1| . (28) For the solution of this problem we use the method of "de correlating" noise model of the system and noise measurements. Accordingly, we shall chooseK
ip of the expressions (25) and (27) so thatw
i* andv
i were not correlated with each other:,
0
]
[
}
)
)(
(
)
(
{
)
,
(
cov
* *
i i p i i i
T i i i i i p i
i i i i
i
R
G
K
C
Г
v
v
v
v
G
K
w
w
Г
M
v
w
International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
801
where
w
*i
Г
iw
i
K
ipG
iv
i.From (29) it follows that the gain matrix
K
ip should be determined on the basis of the expression:i i i i p
i
G
R
Г
C
K
[
]
. (30) Thus, the accuracy of the solution during the filtration of correlated noise and interference measurement object substantially depends on the accuracy ofK
ip gain calculation based on equation (30). This system of equations is often ill-conditioned and leads to the application of regularization methods [7,9,10].For convenience of presentation and brevity we write the equation (30) as follows:
j i j i j i j i
i
k
d
d
d
L
,
,
,
, , (31)Where
L
i
(
R
iTG
iT)
- linear operator in a Hilbert space of H to H;k
i,j - i-th row of the matrixK
ipT,n
j
1
,
2
,...,
;d
i,j - i-th column of the matrixT i T i i
C
Г
D
approximation prerequisite form2
, 2
E j i
d
, max22
, 2
min
E j i
d
,j
1
,
2
,...,
n
;j i
d
, - the exact value of the right-hand side of equation (31).Consider the case where the operator
L
i is self-adjoint and positive. Then M.M.Lavrentev method leads to an equation of the form:
k
i,j
L
ik
i,j
d
i,j, (32)Where
- the regularization parameter. R
family of operators defined by the formula:1
)
(
)
(
L
iL
iR
, (33) generates a bounded approximation to the problem (31), if the relationlim
, , ,10
0
R
L
ik
i jk
i j ,
k
i,j,1
ker
L
i,subject to the conditions of the form:
1
,
)
(
sup
vrai
K
K
E
,
)
1
(
)
(
2
c
,
(
)
c
(
1
)
[9,10], whereE
- spectral family ofL
i,с
- constant independent of
.Equation (32) can be expressed in the form of
i i j
i i jj
i
I
L
d
L
d
k
, ,1 ,
,
(
)
(
)
,
wherein
(
)
(
)
1 - generating system functions0
- spectral parameter.Closer to
k
i j
L
id
i,j *,
pseudo solution equation (30) will be constructed in the form of:
i i j
j
i
g
L
d
k
, ,
, , (34)
i i i j i i j
j
i
g
L
L
k
g
L
d
k
, ,
, ,
, ,
g
2g
. (35) Approximation (34) and (35) can also be written as
i j
j
i
B
d
k
, ,
, ,
i j
j
i
B
d
k
, ,
, ,Where the operators:
L
ig
B
,B
B
L
iB
, (36)approximate
L
i . Then the approximation (34), (35) and (36) take the form:
i
ijj
i
L
I
d
k
,1 ,
,
,
, ,1 ,
,j i i i j
i
L
I
L
k
k
,
1
L
I
B
i
,
1
1
L
I
L
L
I
B
i
i i
.When implementing the above algorithms regularization parameter
is advisable to determine method based on the discrepancy [7].International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
802
1
,
0
,
, ,
,
j i j i i j
i
L
k
d
k
. (37)Instead of (37) can also use the expression of type
i i jj
i
v
v
i
I
L
d
k
, ,
Re
,
1 , ,or a special computational scheme Tikhonov method:
k
i jL
ik
i,j,L
id
i,j2 , ,
2
.
On the basis of the results of [18] we can show that for much better conditioning of the system (31) it is advisable to consider a system of the form:
ij
i ji
k
d
L
, , ,
, , (38) where)]
)(
1
(
)
[(
1, L L i L
i
L
L
D
D
D
,L
D
–L
i diagonal matrix,
(
,,
~
, ,)
~
, , 2E j i i j i i j
i
L
k
L
k
d
,
1/2 2 22 1
1
E L i E L E L
L
D
D
L
D
D
,
, ,
~
j i
k
- solution of systemL
i,k
~
i,j,
d
i,j.Determining the vector
k
ˆ
i,j is reduced to the definitionof the vector , ,
~
~
j i
k
, satisfying the inequality2 min 2
, , ,
~
~
E j i i j i
L
k
d
. (39)Finding , ,
~
~
j i
k
vector associated with the consideration of the set of values of
:
1,
l
q
l
l1,
l
2
,
3
,...,
which
q
l are the values that should be in the process of counting. These advantageous to determine the magnitude of the formula [18]:
2
1/21 2 min
ll
q
v
,wherein
2
, , ,
2
1 i j i i j 1 E l
d
L
k
l
v
.The value of
1 can be selected on the basis of the approximate equality of the form2 max 2 , , ,
2
1 1
E j i i j i
L
k
d
v
. Subsequent values
l should provide a sufficiently rapid determination of the vectork
~
~
i,j, for which min22
, 2 ,
~
~
E j i i j
i
L
k
d
, where2
is based on the solution of the equation2 min 2
, , 2 ,
~
~
E j i i j
i
L
k
d
. Defining vectork
i,j~
~
on the
basis of (39), then you can find along the vector
k
i,j~
~
vector
j i
k
ˆ
, , satisfying the following two conditions:,
0
)
ˆ
,
ˆ
(
,
ˆ
, ,
, 2 2
,
,
i ij i j
i i j
Ej i i j
i
L
k
L
k
d
L
k
d
Where the
2
(
min2
max2)
/
2
. It should be noted here that the values
and
are based on the selected parameter value
. In this case,
is determined by the principle of conservation of the Euclidean norm of the matrix with its regularization.IV. CONCLUSION
Thus, the above expression synthesize algorithms for adaptive state estimation of dynamic systems under correlated noise and interference measurements of the object on the basis of approximate methods for solving ill-conditioned or singular stochastic systems of linear algebraic equations, and thus ensure the convergence of the estimates and to improve the accuracy of their evaluation.
REFERENCES
[1] Ogarkov, M.A. 1990. Methods of statistical estimation of random process quality. Moscow: Energoatomizdat.
[2] Kuzovkov, N.T., Salychev O.S. 1982. Inertial and optimal filtering. Moscow: Mechanical Engineering.
[3] Leondes, K.T. 1980. Filtration and stochastic management in dynamic systems. Moscow: World.
[4] Sinitsyn, I.N. 2006. Filter of Kalman and Pugachev. Publishing house: Lagos.
International Journal of Emerging Technology and Advanced Engineering
Website: www.ijetae.com (ISSN 2250-2459, ISO 9001:2008 Certified Journal, Volume 4, Issue 9, September 2014)
803
[6] Igamberdiyev, H.Z., Yusupbekov, A.N., Zaripov, O.O. 2012. Regular methods of estimation and control of dynamic objects in the conditions of uncertainty. Tashkent: Tashkent State Technical University.
[7] Tikhonov, A.N., Goncharsky, A.V. 1987. Ill-posed problems of natural science. Moscow: Moscow University.
[8] Kabanikhin, S.I. 2008. Inverse and ill-posed problems. - Novosibirsk: Siberian Scientific Publishing House.
[9] Vajnikko, G.M., Veretennikov, A.Ju. 1986. Iterative procedures in ill-conditioned problems. Moscow: Science.
[10] Bakushinskij, A.B., Goncharsky, A.V. 1989. Iterative approach of ill-conditioned problems solution. Moscow: Science.
[11] Zhdanov, A.I. 1988. Solution of ill-posed stochastic linear algebraic equations regularized maximum likelihood method. Volume 28, №9, 1988.
[12] Albert, A. 1977. Regression pseudoinverse and recurrent otsenivanie. Moscow: Science.
[13] Demidenko, E.Z. 1981. Linear and nonlinear regression. Moscow: Finance and statistics.
[14] Draper, N., Smith H. 2007. Applied Regression Analysis. Moscow: Dialectics.
[15] Russell, D. 2013. Regression analysis. Moscow: Science.
[16] Malov, S. 2013. Regression analysis. Theoretical basis and practical recommendations. - Publishing House: Publisher of St. Petersburg University.
[17] Bakushinskii, A.B., Sizikov, V.S. 1982. Some non-standard regularization algorithms and their numerical implementation. Zh. - 1982 - T.22, №3.