University of Groningen
Considerations on modeling for early detection of abnormalities in locally autonomous distributed systems
Veelen, Martijn van
IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below.
Document Version
Publisher's PDF, also known as Version of record
Publication date:
2007
Link to publication in University of Groningen/UMCG research database
Citation for published version (APA):
Veelen, M. V. (2007). Considerations on modeling for early detection of abnormalities in locally autonomous distributed systems. s.n.
Copyright
Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons).
Take-down policy
If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.
Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum.
Bibliography
Adriaans, P.W., Knobbe, A.J. and Athier, Marc. System and method for generating performance models of complex information systems. Patent US- 6,311,175, Perot Systems, 2001.Aires et al. 1999 Aires, F. M. Schmitt, A. Chedin and N. Scott. The “Weight Smoothing” Regularisation of MLP for Jacobian stabilization. IEEE Transactions on Neural Networks, vol. 10, no. 6, pp. 1502-1510,
1999. Aires et al. 1999
Albertini, F., and E.D. Sontag, For neural networks, function determines form, Neural Networks, to appear. Summary in: For neural networks, function determines form, Proc. IEEE Conf. Deci- sion and Control, Tucson, Dec. 1992, IEEE Publications, pp. 26-31., 1992. 0, <Year>
Amari, S. Mathematical foundations of neurocomputing. Proceedings of the IEEE, Vol. 78, no. 9,
pp 1443, 1990. Amari, 1990
Amari, S. A Theory of adaptive pattern classifiers. IEEE Transactions on Electronic Computers,
vol. EC-16, pp. 299-307., 1967 0, <Year>
Amin, M., Modeling and Control of Complex Interactive Networks, IEEE Control Systems Mag-
azine 22, Nr. 1, pp. 22-27, 2002 0, <Year>
Amin, M., Towards Self-Healing Infrastructure Systems, IEEE Computer 8, Nr. 8, pp. 44-53,
2000. 0, <Year>
Amin, M., North America’s Electricity Infrastructure: are we ready for more perfect storms?, IEEE Security & Privacy (2003), pp. 19-25. 0, <Year>
T.M. Apostol. Calculus, 2nd Edition, Wiley & Sons. LCCCN 67-14605, 1967. Apostol, 1967 Atiya, A. and Chuanyi Ji. How Initial Conditions Affect Generalisation Performance in Large Networks. IEEE Transactions on Neural Networks, vol. 8 no. 2, pp. 448-451, march 1997.Atiya and Ji, 1997 Barabasi, A., Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science and Everyday Life, ISBN 0-452-28439-2, Penguin Group Ltd., 2003.0, <Year>
Barakova, E.. Learning Reliability: a study on indecisiveness in sample selection. Ph. D. Thesis, ISBN 90-367-0987-3, Groningen University, 1999. Barakova, 1999 Michèlle Basseville. Detecting changes in Signals and Systems - A Survey. Automatica, Vol. 24,
no. 3, pp. 309-326, 1988. Basseville, 1988
Bartlett, E. B. J. Dynamic Node Architecture Learning: An Information Theoretic Approach, Neural Networks, vol. 7, no. 1, pp. 129-140, 1994. Bartlett, 1994 Bleier, T. and F. Freund. Earthquake Alarm. IEEE Spectrum, pp 16-21, December 2005.0, <Year>
Bojan Basrak. The Sample Autocorrelation Function of Non-Linear time-series. ISBN
903671259 9, PhD. Thesis Groningen University, department of Mathematics and Computing
Science, 2000. Basrak, 2000
Benvenuto, N., F. Piazza and A. Unicini. Comparison of four Learning Algorithms for Multilayer Perceptron with FIR synapses, IEEE World Congress on Computational Intelligence, pp. 309-
314, 1994 Benvenuto et al.. 1994
Box, G.E.P. and G.M. Jenkins (1976), Time-Series Analysis: Forecasting and Control, Holden
Day, San Francisco, 1976 Box and Jenkins, 1976
Bishop, C.M. Neural Networks for Pattern Recognition. ISBN 0198538642. Clarendon Press,
Oxford. 1995. Bishop, 1995
Bouyssounouse, B. ; Sifakis, J. (Eds.). Embedded Systems Design - The ARTIST Roadmap for Research and Development. Series: Lecture Notes in Computer Science , Vol. 3436 Sublibrary:
Programming and Software Engineering. ISBN: 3-540-25107-3, 2005 0, <Year>
Brockwell, P.J. and R.A. Davis (1987), time-series: Theory and Methods. Springer Verlag, New
York, NY, 1987. Brockwell and Davis, 1987
Brockwell, P. J. and R. A. Davis. Introduction to time-series and Forecasting. Academic Press,
ISBN 0127678700, 1996. 0, <Year>
Bullinger, H.J., Elke Kiss-Preussinger and Dieter Spath (eds.), Automobilentwicklung in Deut- schland: wie sicher in die Zukunft?, Fraunhofer IAO, Stuttgart, Germany, 2004. 0, <Year>
Cabot, S., LOFAR System Health Management ADD (Architectural Design Document. Docu- ment-id: LOFAR-SHM-ADD-001. Astron, October 2006. Castellano, 1997 Castellano, G. T. , A. M. Mariafanelli and M. K. Pelillo, An Iterative Pruning Algorithm for Feed- forward Neural Networks, IEEE Transactions on Neural Networks, vol. 8, no. 2, pp. 519-531,
1997. Castellano, 1997
Y. Le Cun, J. S. Denker, and S. A. Solla. “Optimal brain damage”. In D. S. Touretzky, editor, Advances in Neural Information Processing Systems 2, pp. 598-605. Morgan Kaufmann, San
Mateo, CA, 1990 Le Cun, 1990
Capon, J. 1959. Nonparametric methods for the detection of signals in noise. Dept. of Electrical Engr. Technical Report No. T-1/N, Columbia Univ., New York. 0, <Year>
G.A. Carpenter and S. Grossberg. Invariant pattern recognition and recall by an attentive self- organizing ART architecture in a non-stationary world. Proc. of the first IEEE International Con- ference on Neural Networks, San Diego, CA, pp- 737-745, 1987.Carpenter and Grossberg, 1987 G. T. Castellano, A. M. Mariafanelli and M. K. Pelillo, An Iterative Pruning Algorithm for Feed forward Neural Networks, IEEE Transactions on Neural Networks, vol. 8, no. 2, pp. 519-531,
1997. 0, <Year>
Cherkassky, V. A. , X. M. Shao, F. M. Mulier and V. N. Vapnik, Model Complexity Control for Regression Using VC Generalization Bounds, IEEE Transactions on Neural Networks, vol. 10,
no. 5, pp. 1075-1088, 1999. Cherkassky et al., 1999
Caudel, T.P, and D.S. Newman. An Adapative Resonance Architecture to Define Normality and Detect Novelties in time-series and Databases. In proceedings of the International Joint Confer- ence on Neural Networks, vol.4, pp.166-175, 1993. 0, <Year>
Cybenko, G.. Approximation by superpositions of a sigmoidial function, Mathermatics of Con- trol, Signals and Systems, no. 2, pp. 303-314. 1988. Cybenko, 1988 Darken, C., J. Chang and J. Moody, Learning rate schedules for faster stochastic gradient descent., Proc. of the Neural Information Processing Signal 4. IEEE Workshop, august 1992.Darken et al. 1992 Dasgupta, D. and S. Forrest. Novelty Detection in time-series Data using Ideas from Immunology.
Proceedings of the 5th International Conference on Intelligent Systems, Reno, 1996
M.J. Desforges, P.J. Jacobs and J.E. Cooper. Applications of probability density estimation to the detection of abnormal conditions in engineering. Procs Instn Mech Engrs, vol. 212, pp. 687-
703, Part C, 1998. Desforges et. al., 1998
de Vries, B., and J.C. Principe, The Gamma Model - A New Neural Model for Temporal Process- ing, Neural Networks, vol. 5, no. 4, pp 565-576, 1992. deVries and Principe, 1992 Diepenhorst, M. Nijhuis, J.A.G. Venema, R.S. Spaanenburg, L., Growing Filters for Finite Impulse Response Networks, Proc. IEEE International Conference on
Neural Networks, pp. 854 - 859, vol.2, Perth, 1995. Diepenhorst et al, 1996 Diepenhorst, M., H.M.G Ter Haseborg and P. Wang, Training neural nets for small word width, Proceedings AmiRA’01 (Paderborn, October 2001) pp. 171 - 180, 2001 0, <Year>
Dorf, R., The electical engineering handbook. Editor in chief: R. C. Dorf. ISBN 0 84930185-8.
CRC Press, 1993. Dorf, 1993
Edward, P.J. and A.F. Murray, Towards Optimally Distributed Computing, Neural Computation.
vol. 10, issue 4, pp 987-1005. 1998 0, <Year>
C. Edward, S.K.Spurgeon, R.J. Patton. Sliding mode observers for fault detection and isolation.
Automatica vol. 36. pp. 541-553, 2000. Edward et.al., 2000
EEMUA, Alarms System - a Guide to Design, Management and Procurement, EEMUA publica- tion 191, London UK, 1999
Efron, B. and R.J. Tibshirani. An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability 57. Chapman & Hall ISBN. 0 412 04231 2, 1993.Efron and Tibshirani, 1993 Elman, J.L., "Finding Structure in Time", Cognitive Science, vol. 14, pp. 179-211, 19900, <Year>
Emmerson, M.D. and R.I. Damper. Determining and Improving the Fault Tolerance of Multi- layer Perceptrons in a Pattern Recognition Application. IEEE Transactions on Neural Networks,
vol. 4, no. 5, pp. 788-793, 1993. Emmerson and Damper, 1993
Fahlman, S.E., and C. Lebiere (1990), The Cascade-Correlation Learning Architecture, in:
Advances in Neural Information Processing Systems, Morgan Kaufman, San Mateo, CA, vol. 2,
pp. 524-532, 1990. 0, <Year>
Fayyad, U.M., G. Piatetsky-Shapio, P. Smyth and R. Uthurusamy, eds. Advances in knowledge discovery and data mining. MIT Press. ISBN 0262560976. 1996.
Frank, P.M. , Fault diagnosis in dyanmical systems using analythical and knowledge-based redundancy - a survey and some new results, Automatica, vol. 26, no.3, pp. 459-474,
1990. Frank, 1990
Funahashi, K. and Nakamura, Y. Approximation of Dynamical Systems by Continuous Time Recurrent Neural Networks. Neural Networks, vol. 6, pp. 801-806. Permagon, 1993. 0, <Year>
Gabor, D. W.P.L Wilby, and R. Woodcock. A universal non-linear filter, predictor, and similator which optimizes itself by a learning process. Proceedings of the IEE, London, vol. 108, pp. 422-
435, 1960. 0, <Year>
Gan, C. and K. Danai. Model-based recurrent neural network for modeling nonlinear dynamic systems, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, Volume 30,
Issue 2, 2000, Pages 344-351 Gan and Danai, 2000
German, S., Bienenstock and R. Doursat, Neural networks and the bias-variance dilemma. Neu-
ral Computation, no. 4, pp. 1-58, 1992. 0, <Year>
Gibson, J.D. and J.L. Melsa. Nonparameteric detection with Applications. ISBN 0780311612.
IEEE Press, 1995 0, <Year>
Glass, L. and M.C. Mackey, From clocks to chaos. Princeton University Press, 1988.
Goutte, C., Lag Space Estimation in time-series modeling, in: Proceedings International Confer- ence on Accoustics, Speeech and Signal Processing (ICASSP'97), pp. 3313-3316, 1997Goutte, 1997 Grossberg, S. Adaptive pattern classification and univseral recoding: I. Parallel development and coding of neural detectors. Biological Cybernetics, vol. 23, pp. 121-134. 1976 0, <Year>
Grossberg, S. Adaptive pattern classification and univseral recoding: II. Feedback, expectation, olgaction, illusions. Biological Cybernetics, vol. 23, pp. 187-202. 1976 0, <Year>
Hancock, J.C. and P.A. Wintz Signal detection theory. McGraw-Hill Book company, electronic sciences series, LCCCN 66-19462, 1966. Hancock and Wintz, 1966 Hanson, S.J. and Pratt,L.,Comparing biases for minimal network construction with back-propa- gation, Advances in neural information processing systems 1, pp 177-185, 1989 0, <Year>
Hassabi, B., D.G. Stork and G.J. Wolff. Optimal brain surgeon and general network prunning.
IEEE Conference on Neural Networks, vol. 1, pp. 293-299, 1992 0, <Year>
Haykin,S., Neural Networks, a comprehensive foundation. ISBN 0-02-352761, MacMillan, 1994.
Haykin, S., Neural Networks - A Comprehensive Foundation, second edition. ISBN 0-13-
273350-1. Prentice-Hall, 1999 Haykin, 1999
Hecht-Nielsen, R., Kolmogorov's mapping neural network existence theorem, IEEE International Conference on Neural Networks, pp. 11-14, SOS Printing, San Diego, 1987. 0, <Year>
Henrique, H.M., E.L. Lima and D.E. Seborg. Model structure determination in neural networks.
Chemical Engineering Science. no. 55, pages 5457-5469. Permagon Press,
2000. Henrique et al., 2000
Heskes, T. and W. Wiegerinck. A theoretical comparison of batch-mode, on-line, cyclic and almost cyclic learning. IEEE Transactions on neural networks, vol. 7, no. 4 , pp. 919 -925, July
1996. Heskes, T. and W. Wiegerinck, 1996
Himmelblau, D.M., Fault Detection and Diagnosis in Chemical and Petrochemical Processes.
Chemical Engineering Monographs 8. ISBN 0-444-41747-8, 1978. Himmelblau, 1978 Hof, J. van den, System Theory and System Identification of Compartimental Systems. PhD. The- sis Groningen University, Mathematics and Physics department, november 1996. Hof, 1996 Hopfield J.J., Neural Networks and physical systems with emergent collective computational abilities, Proceedings of the National Academy of Sciences, USA, vol. 79, pp. 2554-2558, 1982.0, <Year>
Hornik, K. , M. Stinchcombe and H. White, Multilayer feedforward network are universal approximators. Neural Networks no 2, 359-366, 1989. Hornik, 1989 Horvitz, E.J. , J. S. Breese, M. Henrion. Belief, Bayesian Belief Networks, Qualitative and prob- abilistic reasoning. Decision Theory in Expert Systems and Articial Intelligence. Journal of Approximate Reasoning, Special Issue on Uncertainty in Artificial Intelligence, pp. 247-302.
Also, Stanford CS Technical Report KSL-88-13, 1988 0, <Year>
Hummels, D.M. et al. Adaptive Detection of Small Sinusoidals Signals in Non-Gaussian Noise Using an RBF Neural Network. IEEE Tr. on Neural Networks, vol. 6, no 1, pp. 214 - 219, 19950, <Year>
Hut, H., Intrusion Detection - Detecting novelties in network activity. Master Thesis Groningen University. Internal Report KPN Research, report nr. 32150. June 2000. 0, <Year>
Isermann, R., Process fault detection based on modeling and estimation methods - a survey.
Automatica vol. 20, no.4, pp. 347-404, 1984. 0, <Year>
Izui, Y. and A. Pentland. Analysis of Neural Networks with Redundancy, Neural Computation,
vol. 2, no.2, pp 226-238, 1995 Izui and Pentland, 1995
Jacobs, R. A. Increased Rates of Convergence Through Learning Rate Adaptation, Neural Net-
works, vol. 1, pp. 295-307, 1988. Jacobs, 1988
Jacobs, R.A., F. Peng and M.A. Tanner, A Bayesian Approach to Model Selection in Hierarchical Mixtures of Experts Architectures, Neural Networks, vol. 10, no. 2, pp. 231 - 241 , 1997Jacobs et al. 1997 Jacobs, R.A., M.I. Jordan, S.J. Nowlan and G.E. Hinton, Adaptive Mixtures of Local Experts, Neural Computation, vol. 3, pp. 79-87, 1991. Jacobs et al., 1991 Ji, C. and D. Psaltis, Networks Synthesis through Data-Driven Growth and Decay, Neural Net- works, vol. 10, no. 6, pp. 1133-1141, 1997. Ji and Psaltis, 1997 Jordan, M.I. (1986), Attractor dynamics and parallelism in a connectionist sequential machine, proceedings 8th Annual Conference of the Cognitive Science Society, Amherst, MA, pp. 531-
546. 0, <Year>
Jordan, M.I., and R.A. Jacobs, Hierarchical mixtures of experts and the EM algorithm , Neural Computation, vol. 6, pp. 181-214, 1994 Jordan and Jacobs, 1994 Jacquier, E., N.G. Polson and P. Rossi. Models and priors for multivariate stochastic volatility.
Centre interuniversitaire de recherche en analyse des organisations. Scientific
Series, no.18, 1995. Jacquier, 1995
Ji, C. and D. Psaltis, Networks Synthesis through Data-Driven Groth and Decay, Neural Net-
works, vol. 10, no. 6, pp. 1133-1141, 1997. Ji, 1997
Jones, D.S., Elementary Information Theory. Oxford applied mathermatics and computing sci- ence series. . ISBN 0 19 859636. Clarendon Press. Oxford, 1979.
Jones, J.G. and M.J. Corbin. Band-limited filter approach to fault detection. Published in Fault diagnosis in dynamical systems - Theory and Applications, chapter 6, pp. 189-252, ISBN 0 13 308263 6, editors: R. Patton, P.M. Frank and R. Clark, Prentice-Hall, New York, 1989.0, <Year>
Kay, S., Selected parts of Fundamentals of statistical signal processing: volume II, detection the-
ory. ISBN: 013504135X Prentice Hall, 1998 0, <Year>
Karakagoglu, A., S. I. Sudharsanan, and Malur K. Sundareshan, Identification and Decentralized Adaptive Control Using Dynamical Neural Networks with Application to Robotic Manipulators.
IEEE Transactions on Neural Networks, vol. 4, no. 6, pp. 919-930, 1993
Kaihansen, L. and C. C. Edwardrasmussen, Pruning from Adaptive Regularization, Neural Com- putation, vol. 6, no. 6, pp. 1223-1232, 1994 Kaihansen and C. C. Edwardrasmussen, 1994 Kehagias, A., and V. Petridis, Predictive Modular Neural Networks for time-series Classification, Neural Networks, vol.10, pp.31-49, 1997. Kehagias, A., and V. Petridis, 1997 Kindermann, L. and T.P. Trappenberg, Modeling time-varying processes by unfolding the time domain, Proc. of the International Joint Conference on Neural Networks, pp. 2600-2603, 19990, <Year>
Kitamura, M. . Fault detection in nuclear reactors with the aid of parametric modeling methods.
Published in Fault diagnosis in dynamical systems - Theory and Applications, chapter 6, pp. 189- 252, ISBN 0 13 308263 6, eds.: R. Patton, P.M. Frank and R. Clark, Prentice-Hall, 1989.0, <Year>
Kohonen, T. Self-organized formation of topologically correct feature maps. Biological Cyber-
netics, vol. 43, pp. 59-69, 1982. 0, <Year>
Kohlmorgen, J., K.R. Mueller and K. Pawelzik. Analysis of Drifting Dynamics with Neural Net- work Hidden Markov Models. Neural Information Processing Systems 10, pp. 735-741,1998.0, <Year>
Koivo, H.N. Artificial neural networks in fault diagnosis and control. Control Engineering prac-
tice, vol. 2. no. 1, pp. 89-101, 1994. Kolvo, 1994
Kramer and Sangiovanni-Vincentelli. Efficient parallel learning algorithms for neural networks.
Advances in Neural information processing systems, ed. Touretzky. pp. 40-49, 1989. 0, <Year>
Kumamaru, K., S. Sagara and T. Sönderström. Some statistical methods for fault diagnosis for dynamical systems. Published in Fault diagnosis in dynamical systems - Theory and Applica-
tions, chapter 6, pp. 189-252, ISBN 0 13 308263 6, editors: R. Patton, P.M. Frank and R. Clark,
Prentice-Hall, New York, 1989. Kamamura, 1989
R.J. Kuo, A Decision Support System for the Stock Market Through Integration of fuzzy neural networks and Fuzzy Delphi. Applied Artificial Intelligence, vol. 12 pp. 501-520,1998. Kuo, 1998 Laar, P. van de, T. Heskes. Pruning Using Parameter and Neuronal Metrics. Neural Computa-
tion. no 11, pp. 977-993, 1999 van de Laar and Heskes, 1999
Lang, K.L. and G.E. Hinton, The development of the time-delay neural network architecture for speech recognition, Tech. Report CMU-CS-88-152, Carnegie-Mellon University, 1988.
Lawrence, S., A.D. Back, A.C. Tsoi, and C. L. Giles, The Gamma MLP - Using Multiple Tempo- ral resolutions for Improved Classification, IEEE Workshop on Neural Networks for Signal Pro- cessing VII, J. Principe, L. Giles, N. Morgan, and E. Wilson (eds.), pp. 362-367, 1997
LeBaron, B. and A.S. Weigend. A bootstrap evaluation of the Effect of Data Splitting on Finan- cial time-series. IEEE Transactions on neural networks no. 9, pp. 213-220, 1998.
LeCun, Y., P. Y. Simard and B. Pearlmutter, Automatic Learning Rate Maximization by On-Line Estimation of the Hessian Eigenvectors, Proc. of the Advances in Neural Information Processing
Systems, vol. 5, pp. 156-163, 1993 Lecun et al., 1993
LeCun, Y., J.S. Denker and S.A. Solla. Optimal Brain Damage. Advances in Neural Information Processing Systems, vol. 2, pp. 598-605. Morgan Kaufmann, 1990
LeCun, Y. Une procudre dápprentissage pour resau a seuil asymtrique. Cognitiva, vol. 85, pp.
599-604,1985 0, <Year>
Lee, T.C., A.M. Peterson, and J.J.C. Tsai (1990), A multilayer Feed-Forward Neural Network with Dynamically adjustable Structures, Proceedings IEEE International Conference on Systems, Man, and Cybernetics, Los Angeles, pp. 367-369, 1990 Lee et al., 1990 Lee, Y. S. Oh and M. Kim, The effect of initial weights on premature saturation in back-propaga- tion learning, Proceedings of the IJCNN Seatle, WA, vol. 1, pp. 765-770, 1991. Lee et. al., 1991 Leshno, M. Ya.Lin, V., Pinkus, A., Schocken, S., Multilayer Feedforward Networks with a poly- nominal Activation Function can approximate any function. Neural Networks, vol. 6, pp 861-
867, 1993. Leshno et al., 1993
Lisboa, P.J.G., Industrial use of safety-related artificial neural networks. ISBN 0 717619710.
Constract Research Report 327/2001. Liverpool John Moores University, Health & Safety Exec-
utive, 2001. Lisboa, 2001
Lippmann, R.P., An introduction to computing with neural nets. IEEE ASSP Magazine, vol. 4,
pp. 4-22. 1987. 0, <Year>
Maas, H. L. J. van der, P. F. M. J. Verschure and P. C. M. Molenaar, A Note on Chaotic Behavior in Simple Neural Networks, Neural Networks, vol. 3, pp. 119-122, 1990.van der Maas et al.1990 Mackey and M.C., Glass, L., Oscillations and chaos in physiological control systems, Science
197, pp. 287-289, 1977 Mackey and Glass, 1977
Magoulas, G. D., M. N. Vrahatis and G. S. Androulakis, Effective Backpropagation Training with Variable Stepsize, Neural Networks, vol. 10, no. 1, pp. 69-82, 1997 Magoulas, 1997 Maier, H. and G.C. Dandy. Neural networks for the prediction and forecasting of water
resources variables: a review of modeling issues and applications. Environmental modeling &
Software no. 15, pp 1-1-124, 2000. Maier and Dandy, 2000
Mao, J. and Jain, A.K., Artificial Neural Networks for Feature extraction and Multivariate data projection, IEEE Transactions on Neural Networks, vol. 6 no. 5, pp. 296-317, March 19950, <Year>
McBride, Neil. Chaos Theory and Information Systems. Choas, Complexity and Information
Systems, Track 4, March 2001. McBride, 2001
Neuman, J., Probabilistic logics and the synthesis of reliable organisms from unreliable compo- nents, in Automata Studies, pp. 43-98. eds.: C.E.Shannon and J. McCarthy, Princeton University
Press, 1958. 0, <Year>
Masters, T. Practical Neural Network Recipies in C++. ISBN: 0124790402, Book News, Inc
1993 0, <Year>
McNames, J., J.A.K. Suykens and J. Vandewalle. Winning entry of the K.U. Leuven time-series prediction competation, International Journal of Bifurcation and Chaos, vol. 9 no. 8, pp. 1485-
1500, 1999. McNames, Suykens and VandeWalle, 1999
Minai, A. J. and R. D. Williams, Perturbation Response in Feed forward Networks, Neural Net- works, vol. 7, no. 5, pp. 783-796, 1994 Minai and Williams, 1994 Minsky, M.L. Theory of neural-analog reinforcement systems and it’s applications to the brain- model problem, Ph.D. Thesis, Princeton University, 1954. 0, <Year>
Minsky, M.L. Steps towards artificial intelligence, Computers and Thought, eds.: Feigenbaum
E.A. and J. Feldman, pp. 406-450, 1961. 0, <Year>
Minsky, M.L., Computation: Finite and Infinite Machines. Englewoods Cliffs, Prentice-Hall,
1967 0, <Year>
Minsky, M.L. and S.A. Papert, Perceptrons, MIT Press. 1969; Also: expanded edition, ISBN :
0262631113, MIT Press, 1988. 0, <Year>
Moddemeijer, R. On Estimation of Entropy and Mutual Information of Continuous Distributions, Signal Processing, 1989, vol. 16, nr. 3, pp. 233-246. Moddemeijer, 1989 Molina, C. M. and M. C. Niranjan, Pruning with Replacement on Limited Resource Allocating Networks by F-Projections, Neural Computation, vol. 8, no. 4, pp. 855-868, 1996.
Moody, J.E., The Effective Number of Parameters: An Analysis of Generalization and Regualar- isation in Nonlinear Learning Systems. Neural Information Processing Systems 4, pp. 847-854,
1992. Morgan Kaufman, 1992. Moody, 1992
Moonen M., De Moor B., Vandenberghe L. and Vandewalle J., On and Off-line Identification of Linear State Space Models, International Journal of Control, Vol. 49, no. 1, pp.219-232, 1989.
Mozer, M.C., Neural Net Architectures for Temporal Sequence Processing, in: time-series Pre- diction: Forecasting the Future and Understanding the Past, A.S. Weigend and N.A. Gershenfeld (eds.), Addison-Wesley, Reading, MA, pp. 243-264, 1994. Mozer, 1994 Mozer, M. C. and P. Smolensky, Skeletonization : A Technique for Trimming the Fat From a Net- work via Relevance Assesment., Proc. of the Advances in Neural Information Processing Sys-
tems, pp. 107-115, vol. 1., 1991 Mozer and Smolensky, 1991
Murata, N.D., K. Müller, A. Ziehe and S. Amari, Adaptive On-line Learning in Changing Envi- ronments, Proc. of the Advances in Neural Information Processing Systems, vol. 9, pp. 599-605,
1996. Murata et al., 1996
Murata, N. D., S. I. Yoshizawa and S., Network Information Criterion - Determining the Number of Hidden Units for an Artificial Neural Network Model, IEEE Transactions on Neural Networks,
vol. 5, no. 6, pp. 865-872, 1994. Murata, 1994
Murata, N. D., S. Yoshiwaza and S. Amari, Learning Curves, Model Selection and Complexity of Neural Networks, Proc. of the Advances in Neural Information Processing Systems, vol. 5, pp.
607-614, 1993.
Nabhan, T. M. J. and A. Y. M. J. Zomaya, Toward Genarating Neural Network Structures for Function Approximation, Neural Networks, vol. 7, no. 1, pp. 89-99, 1994 0, <Year>
Narendra, K.S. and K. Parthasarathy. Identification and Control of Dynamic Systems Using Neu- ral Networks. IEEE Transactions on Neural Networks, vol. 1, no.1, pp. 4-27, 1990. 0, <Year>
National Research Council. IT Roadmap to a Geospatial Future. ISBN 0309087384. National
Academy of Sciences, United States, 2003. 0, <Year>
Olsder, G.J. , Mathematical Systems Theory. ISBN 90 6562 153 9. Delfse UItgevers Maatschap-
pij b.v., 1994. Olsder, 1994
Ochiai, K. A. J. , N. D. M. J. Toda and S. T. M. Usui, Kick-Out Learning Algorithm to Reduce Oscillation of Weights, Neural Networks, vol. 7, no. 5, pp. 797-807, 1994. Ochiai et al., 1994 Orr, G. B. and T. K. Leen, Weight Space Probability Densities in Stochastic Learning: II Tran- sients and Basin Hopping Times, Proc. of the Advances in Neural Information Processing Sys-
tems, vol. 5, pp. 507-514, 1993. Orr and Leen, 1993
Parisi, R. , E.D. Di Claudio, A. Rapagnetta and G. Orlandi, Recursive least squares approach to learning in recurrent neural networks, International Conference on Neural Networks ICNN'96, Washington DC, June 3-6, pp. 1350-1354, 1996. 0, <Year>
Papadimitriou, S., Sun, J. and Christos Faloutsos. Streaming pattern discovery in multiple time- series. Proceedings of the 31st international conference on Very large data bases, pp. 697-708.
Norway, 2005.
Patton, R., P.M. Frank and R. Clark, Fault diagnosis in dynamical systems - Theory and Applica- tions, chapter 6, pp. 189-252, ISBN 0 13 308263 6, Prentice-Hall, New York, 1989
Peretto and J.J. Niez, Stochastic Dynamics of Neural Networks, IEEE Transactions on Systems, Man and Cybernetics, vol. 16, no. 1, pp. 73-83, 1986. Peretto and Niez, 1986 Pham, D.T., Blind separation of instantaneous mixture of sources via the Gaussion mutual infor- mation criterion. Signal Processing 81, pp. 850-870, 2001. 0, <Year>
Pietersma, J., A.J.C. van Gemund, and A. Bos, A Model-based Approach to Sequential Fault Diagnosis. In Proc. IEEE AUTOTESTCON'05, Orlando, pp. 621 - 627, Sept. 2005. 0, <Year>
Ponnapalli, P. V. S. , K. C. Ho and M. Thomson, A Formal Selection and Pruning Algorithm for Feedforward Artificial Neural Network Optimization, IEEE Transactions on Neural Networks,
vol. 10, no. 4, pp. 964-971, 1999. Ponnapalli et al., 1999
Press, W.H. , S.A. Teukolsky, W.T. Vetterling and B.P. Flannery. Numerical Recipies in C. Cam- bridge University Press, ISBN 0 521 43108 5, second edition, 1992. Press et. al., 1992 Principe, J.C., B. de Vries, J.M.. Kuo, and P.G. de Oliveira , Modeling Applications with the Focused Gamma Net, Advances of Neural Information Processing Systems, Morgan Kaufmann Publishers Inc, vol. 4, pp. 143-150, 1992. Principe et al., 1992 Protzel, P. et al., Adaptive Systemidentifikation mit neuronalen Netzen zur Profilsteuerung in Walzwerken. VDI Berichte 1381, VDI Verlag, Düsseldorf, Germany, 1998, pp. 347-359.Protzel, 1998 Protzel, P.,, L. Kindermann, M. Tagscherer, and A. Lewandowski (1998), Adaptive Systemidenti- fikation mit Neuronalen Netzen zur Profilsteuerung in Walzwerken, VDI Berichte 1381, pp. 347-
359, 1998. Protzel, 1998
Qian, N. On the momentum term in gradient descent learning algorithm. Neural Networks 12, pp
145-151, 1999. Qian, 1999
Ranjit Roy. A Primer on the Taguchi Method. ISBN 0442237294, Van Nostrand Reinhold, New
York, 1990. Rall, 1989
Rall, W. , Cable theory for dendritic neurons, in: Methods in Neuronal Modeling, C. Koch and I.
Segev, Eds., MIT Press, Cambridge, MA, 1989 Rall, 1989
Ramamurti, V. and J. Ghosh, Structurally adaptive modular neural networks for non-stationary enviroments, IEEE Transactions on Neural networks, vol. 10, no. 1, pp. 152-160, 1999. 0, <Year>
Rault, A. and C. Baskiotis. Model-based modular diagnosis method with application to jet engine faults. Published in Fault diagnosis in dynamical systems - Theory and Applications, chapter 6, pp. 189-252, ISBN 0 13 308263 6, editors: R. Patton, P.M. Frank and R. Clark, Prentice-Hall,
New York, 1989 Rault and Baskiotis, 1989
Reed, R. D. Pruning Algorithms - A Survey, IEEE Transactions on Neural Networks, vol. 4, no. 5,
pp. 740-747, 1993. Reed, 1993
Rengaswamy, R. and V. Venkatasubrananian. A fast training neural network and it’s updation for incipient fault detection and diagnosis. Computers and chemical engineering 24, pp. 431-437.
Elsevier, 2000. 0, <Year>
Ripley, B. D. Flexible non-linear approaches to classification. In `From Statistics to Neural Net- works. Theory and Pattern Recognition Applications' eds.: V. Cherkassky, J. H. Friedman and
H. Wechsler, Springer, pp. 105-126, 1994 0, <Year>
Roberts, S. and L. Tarassenko, A Probabilistic Resource Allocating Network for Novelty Detec- tion, Neural Computation, vol. 6, no. 2, pp. 270-284, 1994. Roberts and Tarassenko, 1994 Robson, A.J. and F. Fallside (1991), A recurrent error propagation speech recognition system, Computer Speech and Language, vol. 5, pp. 259-274, 1991. Robson and Fallside, 1991 Rochester N., J.H. Holland, L.H. Haibt, and W.L. Duda, 1956. Tests on a cell assembly theory of the action of the brain, using a large digital computer, IEEE Transactions on Information Theory,
vol. IT2, pp. 80-93. 0, <Year>
Rosenblatt, F. The Perceptron: A probabilistic model for information storage and organisation in the brain. Psychological Review, vol. 65, pp. 386-408, 1958. 0, <Year>
Ruck, D.W., K. Rogers, M. Kabrisky, P.S. Maybeck and M.E. Oxley, Comparative Analysis of Backpropagation and the Extended Kalman Filter for Training Multilayer Perceptrons. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14 no.6, pp.686-691,1992.0, <Year>
Rumelhart, D.E., G.E. Hinton and R.J. Williams. Learning representations of backpropagation
errors. Nature, vol 323. pp. 533-536, 1986. 0, <Year>
Rumelhart, D.E. and J.L. McClelland (eds.). Parallel Distributed Processing: explorations in the microstructure of cognition. vol 1, MIT Press, 1986 0, <Year>
Saarinen, S., R. Bramley and G. Cybenko. Ill-conditioning in neural network training problems.
CRSD report 1089. Center for Supercomputing Research and Development, 1991 0, <Year>
Saarinen, S., R. Bramley and G. Cybenko. Ill-conditioning in neural network training problems.
SIAM Journal of Scientific Computing vol. 14 no. 3, pp 693-714, 1993 Saarinen et al, 1993 Salomon, R. and L. J. van Hemmen, Accelerating Backpropagation through Dynamic Self-Adap- tation, Neural Networks, vol. 9, no. 4, pp. 589-601, 1996. Salomon and van Hemmen, 1996 Sandberg, I.W. and L. Xu (1997a), Uniform approximation and gamma networks, Neural Net- works, vol. 10, no. 5, pp. 781-784, 1997. Sandberg and Xu, 1997a Sandberg, I.W., and L. Xu (1997b), Uniform approximation of multidimensional myopic maps, IEEE Transactions on Circuits and Systems - 1: Fundamental Theory and Applications, vol. 44,
no. 6, pp. 477-485, 1997. Sandberg and Xu, 1997b
Sarle, W.S., Neural Networks and Statistical Models. Proceedings of the nineteenth Annual SAS Users Group International Conference, pp. 1538-1550, April 1994. Sarle, 1994 Sbarbaro, D. and Juan P. Segovia and J. Gonzales. Applications of Radial Basis Networks Tech- nology to Process Control. IEEE Transations on Control Systems Technology, vol. 8, no. 1, pp.
14-22, january 2000. Sbarbaro et.al., 2000
Schittenkopf, C., G. Deco and W. Brauer, Two Strategies to Avoid Overfitting in Feed forward Networks, Neural Networks, vol. 10, no. 3, pp. 505-516, 1997
Scott, A.C., Neurophysics, Wiley, New York, 1977. Scott, 1977 Sietsma and R.J.F Dow. Neural Network Pruning - Why and How. Proc. of the IEEE Interna- tional Joint Conference on Neural Networks, pp.325-333, 1989 Sietsma and Dow, 1989 Shamma, S. Spatial and temporal processing in central auditory networks. In Methods in Neural Modeling, eds. C. Kock and I. Sgev, MIT Press, Cmbridge, MA. 1989. Shamma, 1989 Shannon, C. E. A mathematical theory of communication (parts I and II). Bell System Technical Journal, XXVII, pp. 379-423, 1948
Shaw, G.L., and W.A. Little, A statistical theory of short and long term memory, Behavioral Biol-
ogy, vol. 14, pp. 115-133, 1975 Shaw and Little, 1975
Spiekstra, J.S., Novelty Detection in Time Series - Comparison between a Clustering and Pre- dicting Neural Network. Master Thesis, Groningen University dept. of Computing
Science, 2000. Sprent, 1989
Sprent, P., Applied nonparametric statistical methods. ISBN 0 412 30600-X, 1989. Chapman and
Hall, London. Sprent, 1989
Stevenson, M., R. Winter and B. Widrow, Sensitivity of Feedforward Neural Networks to Weight Errors, IEEE Transactions on Neural Networks, vol. 1, no. 10, pp. 71-80, 1990. 0, <Year>
Sum, J., C. Leung, G.H. Young, L.Chan, and W. Kan. An Adaptive Bayesian Pruning for Neural Networks in a Non-Stationary Environment. Neural Computation, no.11, pp. 965-976. MIT 1999.
Sutton, R. S., Adapting bias by gradient descent: An incremental version of delta-bar-delta. In Proceeding of Tenth National Conference on Artificial Intelligence AAAI92, pages 171--176, Menlo Park, CA. AAAI, AAAI Press/The MIT Press, 1992 0, <Year>
Suykens, J., P. Lemmerling, W. Favoreel, B. De Moor, M. Crepel, and P. Briol, modeling the Bel- gian Gas Consumption Using Neural Networks, Neural Processing Letters, 4, pp. 157-166, 1996.
Taylor, O., Self organising maps for data fusion and novelty detection. PhD. Thesis, University of
Sunderland, April 2000. Taylor, 2000
Teng, C. M. and B. W. Wah, Automated Learning for Reducing the Configuration of a Feedfor- ward Neural Network, IEEE Transactions on Neural Networks, vol. 7, no. 5, pp. 1072-1085, 1990.
Leen, T. K. and J. E. Moody. Weight Space Probability Densities in Stochastic Learning : I.
Dynamics and Equilibria. Neural Information Processing Systems 5. pp. 451-458, Morgan Kauf- man. 1993.
Treadgold, N. K. and T.D. Gedeon, Exploring Constructive Cascade Networks, IEEE Transaction on Neural Networks, vol. 10, no. 6, pp. 1335-1350, 1999 Treadgold and Gedeon, 1999 Tresp, R. Neuneier and G. Zimmermann, Early Brain Damage, Proc. of the Advances in Neural Information Processing Systems, vol. 9, pp. 669-675, 1996.
Trunov, A.B. and Marios M. Polycarpou. Automated Fault Diagnosis in Nonlinear Multivariate Systems Using a Learning Methodology. IEEE Transactions on Neural Networks vol. 11, no. 1,
pp. 91-101, 2000. Trunov and Polycarpou, 2000
Tseng, C. and A. Chou. The intelligent on-line monitoring of end milling. International Journal of Machine, Tool and Manufacture 42, pp. pp. 89-97, Pergamon, 2002. Tseng and Chou, 2002 Tzafestas, S., System fault diagnosis using the knowledge-based metholodology. Published in Fault diagnosis in dynamical systems - Theory and Applications, chapter 6, pp. 189-252, ISBN 0 13 308263 6, editors: R. Patton, P.M. Frank and R. Clark, Prentice-Hall, New York, 1989.
Vapnik, V., Estimation of Dependencies Based on Empirical Data. Springer-Verlag, 1982 van Veelen, M., J.A.G. Nijhuis and L. Spaanenburg, Estimation of linear filter banks for multi- varate time-series prediction with temporal principle component analysis, Proceedings of the International Joint Conference On Neural Networks, pp. 2624-2628, Washington DC, 1999.Veelen et al., 1999 van Veelen, M., J. A. G. Nijhuis, and L. Spaanenburg, "Neural Network Approaches to Capture Temporal Information," in ed. Dubois, D. M., Computing Anticipatory Systems, Proceedings of the CASYS '99, AIP-517, American Institute of Physics, ISBN 1-56396-933-5, pp. 361-371,
2000a Veelen et al., 2000a
vanVeelen, M., J.A.G. Nijhuis and L. Spaanenburg. Emergence of Learning Methodology for Abnormality Detection. Proc. of the BNAIC’2000, pp. 283-292, Kaatsheu-
vel, October 2000b. Veelen et al., 2000a
van Veelen, M., J.A.G. Nijhuis and L. Spaanenburg. Process Fault detection through quantitative analysis of learning in neural networks. Proceedings of the ProRISC2000, pp. 557-565, Veld-
hoven, December 2000c. Veelen et al., 2000b
vanderSteen, E.W., L. Spaanenburg, J.A.G. Nijhuis and M. van Veelen, Sampling casts plasticity in adaptive batch control, Proceedings ProRisc ‘01 (Veldhoven, The Netherlands), pp. 646-651,
2001. vanderSteen, 2001
Nijhuis, J. Hofflinger, B. van Schaik, A. Spaanenburg, L., Limits to the fault-tolerance of a feedforward neural network with learning. Fault-Tolerant Computing, 1990. FTCS-20. Digest of Papers., 20th International Symposium, pp. 228-235, 1990. 0, <Year>
Venema, R.S., J. Bron, R.M. Zijlstra, J.A.G. Nijhuis and L. Spaanenburg, Using Neural Networks for Waste-Water Purification, Computer Science for Environmental Protection'98, Networked Structures in Information Technology, the Environment and Business. pp. pp. 317-330. Metropo-
lis-Verlag, Marburg, Germany, 1998 Venema, 1998
Venema, R.S. . Aspects of an integrated neural prediction system. PhD. Thesis Goningen Univer- sity dept. of mathematics and computing science, ISBN 9036710820, 1999. Venema, 1999 Venayagamoorthy, G.K., and R.G. Harley, Experimental studies with a continually online trained artificial neural netowrk controller for a turbogenerator, Proceedings International Joint Confer- ence on Neural Networks, pp. 2158-2163, Washington DC, 1999 Venayagamoorthy, 1999
Venkatasubramanian et al. A review of process fault detection and diagnosis, part I, II and III.
Computers and Chemical Engineering 27, pages 293-346, Elsevier 2003. 0, <Year>
Malsburg, C. von der, Self-organization of orientation sensitive cells in the striate cortex. Kyber-
netik, vol. 14, pp. 85-200. 1973 0, <Year>
Wahlberg, B. and F. Gustafsson. Adaptive Filtering and Change Detection. Handouts of lecture 1, F2E5216/TS1002 Linkopings universitet, 2005 0, <Year>
Waibel, A., T. Hanazawa, G. Hinton, K. Shikano and K. Lang, Phonemic Recognition Using Time Delay Neural Networks, IEEE Transactions on Acoustics, Speech and Signal Processing, Vol. 37,
No. 3, pp. 328-339, 1989. Waibel et al., 1989
Wald, A. Sequential analysis. John Wiley & Sons Inc. Chapman & Hall Ltd. London, 1947Wald, 1946 Hong Wang, Zhen J. Huang and Steve Daley. On the use of adaptive updating rules for actuator and sensor fault diagnosis. Automatica vol.33, no.2, pp. 217-225, 1997. Wang, 1997 Weigend, A.S, time-series Analysis and Prediction Using Gated Experts with Application to Energy Demand Forecasts, Applied Artificial Intelligence, vol 10, pp. 583-624, 1996Weigend, 1996 Welch, Bischop, An introduction to the Kalman Filter. TR 95-041. Department of Computer Sci- ence, University of North Carolina at Chapel Hill, April 2005 0, <Year>
Weng, W. and K. Khorasani, An Adaptive Structure Neural Networks with Application to EEG Automatic Seizure Detection, Neural Networks, vol. 9, no. 7, pp. 1223-1240, 1996. 0, <Year>
Werbos, P.J., Beyond regression: New tools for prediction and analysis in the behavioral scences.
PhD. Thesis, Harvard University, Cambridge, 1974. 0, <Year>
Widrow, B. and M.E. Hoff, Jr. Adaptive Switching Systems, IRE WESCON Convention Record,
pp. 96-104, 1960. 0, <Year>
Widrow, B. Generalization and information storage in networks of adeline ‘neurons’. Self-orga- nizing systems, pp. 435-461. eds.: M.C. Yovitz, G.T. Jacobi, and G.D. Goldstein. Spartan Books,
1962 0, <Year>
Williams, R.J., and D. Zipser,, A Learning algorithm for continually running fully recurrent neu- ral networks, Neural Computation, vol. 1, pp. 270-280, 1989. Williams and Zipser, 1989 Wilsky, A.S. A Survey of design methods for failure detection in dynamic systems. Automatica
vol. 12, pp/ 601-611, 1976. Wilsky, 1976
Wilson, C.L., J.L. Blue and Omid M. Omidvar. Training dynamics and Neural Network Perfor- mance. Neural Networks,m vol. 10, no. 5, pp. 907-923, 1997. Wilson et al., 1997 Wilson, D.J.H., Irwin, G.W., Lightbody, G., RBF principal manifolds for process monitoring, IEEE Transactions on Neural Networks, pp.1424-1434, Nov. 1999. 0, <Year>
Winograd, S. and J.D. Cowan. Reliable Computation in the Presence of Noise. MIT Press, 1963,0, <Year>
Wong, F.S.et al., On-line detection of structural damage using neural networks. Civil Engineer-
ing Systems, 1997 F.S. Wong, 1997
Wong, M. K. Y., Microscopic Equations in Rough Energy Landscape for Neural Networks, Pro- ceedings of the Advances in Neural Information Processing Systems, vol. 9, pp. 302-308, 1996.
Xiao-Hu Yu and Guo-An Chen, Efficient Backpropagion learning using optimal learning rate and momentum, Neural Networks, vol. 10, no. 3, pp 517-527, 1997.
Yen, G.G. and W.Feng. Winner take all experts network for sensor validation. ISA Transactions
40, pp. 99-110, Elsevier, 2001. Yen and Feng, 2001
Youngchoi, J. D. and C. Choi, Sensitivity Analysis of Multilayer Perceptron with Differentiable Activation Functions, IEEE Transactions on Neural Networks, vol. 3, no. 1, pp. 101-
107, 1992. 0, <Year>
Ypma, A., and R.P. Duin, Novelty Detection Using Self-Organizing Maps, Proceedings of the International Conference on Neural Information Processing, pp1322-1325, Springer, 1997.
Zhou, G. Advanced Neural-Network Training Algorithm with Reduced Complextiy Based on Jacobian Deficiency. IEEE Transactions on Neural network, vol. 9, no. 3, pp. pp. 448-453, May
1998. Zhou, 1998
Qian, N. On the momentum term in gradient descent learning algorithms, Neural Networks, Per-
gamon Press. No. 12, pp 145-131, 1999. 0, <Year>
Zegers, P. and M.K. Sundareshan, Trajectory generation and modulation using dynamic neural networks, pp. 520-533. IEEE Transactions on Neural Networks, vol. 14, nr. 3, 2003. 0, <Year>
