= n
j ji ii
A v
1 2
1 (C.10)
and vij=0, i≠j.
Finally, when we have posed the problem and have the vectors and matrices in accordance with the last equation to get the x’ is obtained and x=Vx’ is considered. To improve convergence in the iterative process the Levenberg-Mardquardt method may be used.
D. Probabilistic methods
The probabilistic methods are based on assumption that model parameters m are random variables described by probability distribution. The methods utilizing this approach can be divided into two groups, classical and Bayesian. The former group contains maximum likelihood estimation, least squares approach, method of moments while the latter one contains so called minimum mean square error estimation, maximum a posteriori estimation or linear minimum square estimation. Moreover, each method itself contains many variants, e.g. least squares approach may be sequential, constrained or unconstrained, linear or nonlinear. Thus, it is not possible to cover all methods and their modifications and to discuss them in such short report, only some of the will be presented. Probabilistic methods can be used even though there is not a strict probabilistic behaviour of the studied problem.
a) Maximum Likelihood Estimation
This approach is very popular way to obtain estimations in complicated estimation problems. MLE has the asymptotic properties of being unbiased, thus it is considered to be asymptotically. In maximum likelihood estimation the probability density function of the experimental data d given the unknown parameter m is assumed to be known. The probability density of m is not required. The mˆ is the maximum likelihood estimation, for given data d, if the following relation is fulfilled
(
dmˆ) ( )
pdmˆp MLE ≥ (D.1)
It means that mˆMLE maximises the likelihood distribution p
( )
dm for given data d.b) Minimum mean square estimation
Methods is based on maximising the expectation of the squared norm of the estimation error
{
m−mˆ}
E (D.2)
Using Bayesian cost method it could be determined that the minimum mean square estimate mˆ MMSE is conditional expectation of m given the observation d
( )
md mThis is the MMSE that minimises
( )
{
m m} (
m m) (
pd m)
dddmE − ˆ =
∫
− ˆ 2 , (D.4)c) Bayesian approach
The description below is based on paper Malinverno A., 2000. In Bayesian approach, inferences about the parameter vector θ and the parameterisation are made using probability density functions and probabilities. In other words, the conclusions that can be drawn from Bayesian analysis are of the type “from what we know, there is a 95 per cent probability that parameter θi has a value between 0.5 and 1.3” It is important to stress at the outsets that these probabilities quantify uncertain knowledge. As such, these probabilities are always conditional on something that is assumed true: these assumptions are prior information and are denoted J. In the notation used here, the statement above on θi can be written as
∫
.3( )
=The fundamental formula in Bayesian parameter estimation is Bayes’ rule, which for a vector of parameter θ and vector of data d is
likelihood function (the pdf of the data when the parameter vector equals θ). In other words, what can be inferred about the parameter vector a posteriori is a combination of what is known a priori, independent of the data, and of the information contained in the data. The denominator in Bayes’ rule can be shown to be the integral of the numerator
( )
J =∫
p( ) (
J p J)
pd θ dθ, (D.7)
Therefore, p d
( )
J is a normalizing factor that makes the integral of the posterior pdf equal unity: since it does not depend on θ, it is typically ignored in parameter estimation. The posterior pdf, which quantifies the uncertainty of the parameter values once the information in the data is accounted for, is the solution of the inverse problem. The linear, Gaussian case is examined that is appropriate for a linear forward problem and for a prior pdf and a likelihood function that are multivariate Gaussian distributions. The natural choice for a priori pdf is the distribution that allows for the greatest uncertainty while obeying theconstraints imposed by the prior information, and it can be shown that this least informative pdf is the pdf that has maximum entropy. Suppose all one knows about the parameters a priori is that they are as likely to be positive as negative, but that their square value cannot be too large and is expected to be σθ2. For any single parameter, the pdf that has maximum entropy subject to these prior constraints is a Gaussian distribution with zero mean and a variance equal to σθ2. If there is no a priori information on correlations amongst H parameters, the maximum entropy prior pdf of θ is the product of the pdfs of ach parameter
( )
θ =( )
2πσ1θ2 2exp⎜⎜⎝⎛−2θσθθ2 ⎟⎟⎠⎞T
J H
p (D.8)
Quantities assumed a priori are denoted with bar, for example, θ, is the prior mean of the parameter vector.
The likelihood function is the pdf of the measurement error vector e, defined as the difference between the observed data d and the data predicted for a given value of the parameter vector
GAθ d
Gm d
e= − = − (D.9)
If the errors are expected a priori to have a mean square deviation from zero equal to σ2e and
to be uncorrelated the likelihood function is again a Gaussian distribution
(
,)
=( )
2 12 2 exp⎜⎜⎝⎛−2 2e⎟⎟⎠⎞The probability of having observed the data d becomes smaller as the sum of squared errors e
eT becomes larger, and the likelihood quantifies the information about θ contained in the data. If prior pdf and the likelihood function are as shown in (12) and (14), it is easy to show that the posterior pdf is also Gaussian, and has a posterior covariance matrix Cˆθ and a posterior mean vector θˆ that are as follows
1
where I is an H×H identity matrix. A posteriori quantities are denoted with hat, θˆ is the posterior mean of the parameter vector. If the posterior pdf of θ is Gaussian, the posterior pdf of m=Aθ is also Gaussian with aposterior covariance matrix and a posterior mean vector that are as follows
References
Abubakar A. and P. M. van den Berg, 2000, Non-linear three-dimensional inversion of cross-well electrical measurements, Geophysical Prospecting, 48, 109–134
Al-Nuaimy W., Y. Huang, M. Nakhkash, M.T.C. Fang, V.T. Nguyen and A. Eriksen, 2000, Automatic detection of buried utilities and solid objects with GPR using neural networks and pattern recognition, Journal of Applied Geophysics, 43, 157–165
Annan, A.P., Smith, R.S., Lemieux, J., O'Connell, M.D., and Pedersen, R.N., 1996, Resistive-limit time-domain AEM apparent conductivity: Geophysics, 61, 93-99
Apparao, G.S. Srinivas, V. S. Sarma, P. J. Thomas, M. S. Joshi and P. R. Prasad, 2000, Depth of detection of highly conducting and volume polarizable targets using induced polarization, Geophysical Prospecting, 48, 797-813
Auken E., L. Pellerin and Sřrensen K. I., Mutually Constrained Inversion (MCI) of Electrical and Electromagnetic Data,
Beard L. P., 2000, Comparison of methods for estimating earth resistivity from airborne electromagnetic measurements, Journal of Applied Geophysics, 45, 239–259
Bhattacharya B. B., Shalivahan and M. K. Sen, 1999, Use of VFSA for resolution, sensitivity and uncertainty analysis in 1D DC resistivity and IP inversion, Geophysical Prospecting, 47, 411–429
Bing Z. and S.A. Greenhalgh, 2000, Cross-hole resistivity tomography using different electrode configurations, Geophysical Prospecting, 48, 887-912
Bohm G., P. Galuppo and A. Vesnaver, 2000, 3D adaptive tomography using Delaunay trianglesand Voronoi polygons, Geophysical Prospecting, 48, 723-744
Candansayar M. E. and A. T. Basokur, 2001, Detecting small-scale targets by the 2D inversion of two-sided three-electrode data: application to an archaeological survey, Geophysical Prospecting, 49, 13 - 25
Church, P, P Wort, S Gagnon and J E McFee, 2001, Performance Assessment of an Electrical Impedance Tomography Detector for Mine-Like Objects, Proc. SPIE Conference on Detection and Remediation Technologies for Mines and Mine-like Targets VI. Vol.
4394, Orlando, FL, USA, 16-20 April
Cozzolino K., A. Q. Howard Jr. and J. S. Protazio, 2000, A new look at multiphase invasion with applications to borehole resistivity interpretation, Journal of Applied Geophysics, 43, 91–100
Curtis A., 1999, Optimal experiment design: cross-borehole tomographic examples, Geophys.
J. Int. 136, 637–650
Descloitres M., R. Guerin, Y. Albouy and A. Tabbagh, 2000, Improvement in TDEM sounding interpretation in presence of induced polarization. A case study in resistive rocks of the Fogo volcano, Cape Verde Islands, Journal of Applied Geophysics, 45, 1–
18
Dahlin T., 2000, Short note on electrode charge-up effects in DC resistivity data acquisition using multi-electrode arrays, Geophysical Prospecting, 48, 181-187
Elliott, P., 1998. The principles and practice of FLAIRTEM: Exploration Geophysics 29, 58-60.
Furche M. and A. Weller, 2002, Sensitivity distributions of different borehole electrode configurations considering a model with a cylindrical coaxial boundary, Geophys. J.
Int. 149, 338–348
Furness P., 2001, A note on magnetic modelling with remanence, Journal of Applied Geophysics, 48, 257–261
Herrmann R. B., C. J. Ammon and J. Julia, Joint inversion of receiver functions and surface-wave dispersion for crustal structure, Report Department of Earth and Atmospheric Science, Saint Louis University, Contract DSWA 01.98.C0160
Jackson P. D., S. J. Earl and G. J. Reece, 2001, 3D resistivity inversion using 2D measurements of the electric field, Geophysical Prospecting, 49, 26-39
Keller G. V. and Frischknecht F. C., 1966, Electrical Methods in Geophysical prospecting, Pergamon Press
Kis M., 2002, Generalised Series Expansion (GSE) used in DC geoelectric–seismic joint inversion, Journal of Applied Geophysics 50, 401– 416
Koefoed O., D. P. Ghosh and G. J. Polman, 1972, Computations of type curves for
electromagnetic depth sounding with horizontal transmitting coil by means of digital linear filter, Geophysical Prospecting 20, 406-420.
Lazaro-Mancilla O. and E. Gomez-Trevino, 2000, Ground penetrating radar inversion in 1-D:
an approach for the estimation of electrical conductivity, dielectric permittivity and magnetic permeability, Journal of Applied Geophysics, 43, 199–213
Lee T. J., R. S. Smith and C. S. B. Hyde, 2000, Using a non-integer moment of the impulse response to estimate the half-space conductivity, Geophysical Prospecting, 48, 887-912
Malinverno A., 2000, A Bayesian criterion for simplicity in inverse problem parametrization, Geophys. J. Int., 140, 267-285
Malinverno A., 2002, Parsimonious Bayesian Markov chain Monte Carlo inversion in a nonlinear geophysical problem Geophys. J. Int., 151, 675–688
Mauriello P. and D Patella, 1999, Resistivity anomaly imaging by probability tomography, Geophysical Prospecting, 1999, 47, 411–429
Mitsuhata Y., T. Uchida, Y. Murakami, H. Amano, 2001, The Fourier transform of controlled-source time-domain electromagnetic data by smooth spectrum inversion, Geophys. J. Int. 144, 123-135
Muiuane E. A. and B. Laust, 2001, 1D inversion of DC resistivity data using a quality-based truncated SVD, Geophysical Prospecting, 49, 387-394
Olayinka A. I. and U. Yaramanci, 2000, Use of block inversion in the 2-D interpretation of apparent resistivity data and its comparison with smooth inversion,. Journal of Applied Geophysics, 45, 63–81
Panissod C., D. Michot, Y. Benderitter and A. Tabbagh, 2001, On the effectiveness of 2D electrical inversion results: an agricultural case study, Geophysical Prospecting, 49, 570-576
Poddar M., G. Ashokbabu, S. B. Singh, and P. P. Prasad, 1999, 3-D HLEM Modeling of Tropical Weathering: A Trial from a Granitic Area of N-W Rajasthan, India, Pure Appl. Geophys., 155 169–181
Porsani M. J., S. Niwas and N. R. Ferreira, 2001, Robust inversion of vertical electrical sounding data using a multiple reweighted least-squares method, Geophysical Prospecting, 49, 255-264
Roy I. G., 1999, An efficient non-linear least-squares 1D inversion scheme for resistivity and IP sounding data, Geophysical Prospecting, 47, 527–550
Saccorotti G. and E. Del Pezzo, A probabilistic approach to the inversion of data from a seismic array and its application to volcanic signals, Geophys. J. Int. (2000) 143, 249–
261
Sambridge M., 1999, Geophysical inversion with a neighbourhood algorithm--I. Searching a parameter space, Geophys. J. Int., 138, 727-746
Sambridge M., 1999, Geophysical inversion with a neighbourhood algorithm II. Appraising the ensemble, Geophys. J. Int., 138, 479–494
Sattel D. and J. Macnae, 2001, The feasibility of electromagnetic gradiometer measurements, Geophysical Prospecting, 49, 309-320
Sharma S. P. and P. Kaikkonen, 1999, Appraisal of equivalence and suppression problems in 1D EM and DC measurements using global optimization and joint inversion, Geophysical Prospecting, 47, 219–249
Siemon S., 2001, Improved and new resistivity-depth profiles for helicopter electromagnetic data, Journal of Applied Geophysics, 46, 65–76
Slater L., A.M. Binley, W. Daily, R. Johnson, 2000, Cross-hole electrical imaging of a controlled saline tracer injection, Journal of Applied Geophysics, 44, 85–102
Slichter L. B., 1955, Geophysics applied to prospecting for ores, Econ. Geol., pp.885-969 Snieder R., 1998, The role of nonlinearity in inverse problems, Inv. Probl., 14, 387 - 404 Snieder R. and J. Trampert, 1999, Inverse problems in geophysics, [in] Wavefield Inversion,
[ed.] A. Wirgin, Spriger Verlag, New York, 119-190
Storz H., W. Storz and F. Jacobs, 2000, Electrical resistivity tomography to investigate geological structures of the earth's upper crust, Geophysical Prospecting, 48, 455-471 Szalai S. and L. Szarka, 2000, An approximate analytical approach to compute geoelectric
dipole-dipole responses due to a small buried cube, Geophysical Prospecting, 48, 871-885
Tartaras E., M. S. Zhdanov, K. Wada, A. Saito and T. Hara, 2000, Fast Imaging of TDEM data based on S-inversion, Journal of Applied Geophysics, 43, 15–32
Uyeshima M. and A. Schultz, 2000, Geoelectromagnetic induction in a heterogeneous sphere:
a new three-dimensional forward solver using a conservative staggered-grid finite difference method, Geophys. J. Int., 140, 636–650
Vasco D. W., 2000, An algebraic formulation of geophysical inverse problems, Geophys. J.
Int., 142, pp. 970 – 990
van der Kruk J., J. A. C. Meekes, P.M. Van den Berg and J. T. Fokkema, 2000, An apparent-resistivity concept for low-frequency electromagnetic sounding techniques, Geophysical Prospecting, 48, 1033-1052
van Wijk K., J. A. Scales, W. Navidi and L. Tenorio, 2002, Data and model uncertainty estimation for linear inversion, Geophys. J. Int., 149, 625 -632
Velis D. R. and T. J. Ulrych, 2001, Simulated annealing ray tracing in complex three-dimensional media, Geophys. J. Int., 145, 447–459
Vickery A. C. and B. A. Hobbs, 2002, The effect of subsurface pipes on apparent-resistivity measurements, Geophysical Prospecting, 50, 1-13
Vozoff, K. and Jupp, D. L. B., 1975, Joint inversion of geophysical data: Geophys. J.R. Astr.
Soc., 42, 977-991.
Ward S. H., 1959 AFMAG – airborne and ground, Geophysics, 24, 531 - 546
Weidelt P., 2000, Electromagnetic edge diffraction revisited: the transient field of magnetic dipole sources, Geophys. J. Int., 141, 605-622
Weller, W. Frangos, M. Seichter, 2000, Mathematical models and controlled experimental studies Three-dimensional inversion of induced polarisation data from simulated waste, Journal of Applied Geophysics, 44, 67–83
Wort P, P Church and S Gagnon, 1999, Preliminary Assessment of Electrical Impedance Tomography Technology to Detect Mine-like Objects, Proceedings of SPIE
Conference on Detection and Remediation of Mines and Mine-like Targets IV, Vol.
3710, Orlando FL USA, 5-9 April 1999, pp.895-905.
Xiang J., N.B. Jones, D. Cheng and F.S. Schlindwein, 2002, A new method to discriminate between a valid IP response and EM coupling effects, Geophysical Prospecting, 50, 565-576
Yi M.-J., J.-H. Kim, Y. Song, S.-J. Cho, S.-H. Chung and J.-H. Suh, 2001, Three-dimensional imaging of subsurface structures using resistivity data, Geophysical Prospecting, 49, 483-497
Yin C., 2000, Geoelectrical inversion for a one-dimensional anisotropic model and inherent non-uniqueness, Geophys. J. Int., 140, 11-23