Aims of Ph.D thesis

o Identify a suitable deep learning algorithm.

o Configure and if necessary modify the selected deep learning algorithm for signal classification in the ERP domain.

o Verify the proposed approach by designing and implementing a BCI system and test the trained network on the data obtained from a reasonable number of subjects.

o Compare the results of the proposed method with state of the art classification algorithms.

Page 38

References

[1] L. Sörnmo and P. Laguna, Bioelectrical Signal Processing in Cardiac and Neurological Applications, Elsevier, Amsterdam, The Netherlands, 2005.

[2] S. Sanei and J. Chambers, EEG signal processing. Chichester, England ; Hoboken, NJ: John Wiley & Sons, 2007.

[3] Pfurtscheller, G., Flotzinger, D., and Neuper, C., ‘Differentiation between finger, toe and tongue movement in man based on 40 Hz EEG’, Electroencephalogr. Clin. europhysiol., 90, 1994, 456–460.

[4] S.J. Luck. An Introduction to the Event-Related Potential Technique. The MIT Press, Cambridge,, 2005.

[5] G. Pfurtscheller and C. Neuper, "Motor imagery and direct brain-computer communication," Proc. IEEE, vol. 89, pp. 1123-1134, 2001.

[6] J. R. Wolpow, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, pp. 761-791, 2002.

[7] T. Ebrahimi, J.-M. Vesin, and G. Garcfa, "Brain-computer interface in multimedia communication," IEEE Signal Proc. Mag., vol. 20, pp. 14-24, 2003.

[8] J. S. Barlow, "Artefact processing (rejection and minimization) in EEG data processing," in Handbook of Electroencephalography and Clinical Electrophysiology: Clinical Applications of Computer Analysis of EEG and Other Neurophysiological Signals (F. H. Lopes da Silva, W. Storm van Leeuwen, and A. R~mond, eds.), ch. 1, pp. 15-62, Elsevier, 1986.

[9] J. W. Clark, "The origin of biopotentials," in Medical Instrumentation. Application and Design (J. G. Webster, ed.), pp. 121-182, New York: John Wiley & Sons, 1998. [10] P. K. H. Wong, Digital EEG in Clinical Practice. Philadelphia: Lippincott- Raven, 1996.

[11] F. S. Tyner, J. R. Knott, and W. B. Mayer, Fundamentals of EEG Technology. Vol. 1. Basic Concepts and Methods. New York: Raven Press, 1983.

[12] D. P. Burbank and J. G. Webster, "Reducing skin potential motion artifact by skin abrasion," Med. Biol. Eng. ~ Comput., vol. 16, pp. 31-38, 1978.

[13] L. A. Geddes, Electrodes and the Measurement of Bioelectric Events. New York: John Wiley ~z Sons, 1972.

[14] Jung, T. P.,Makeig, S., Humphries, C., Lee, T.W.,McKeown,M. J., Iragui, V., & Sejnowski, T. J. (2000). Removing electroencephalographic artifacts by blind source separation. Psychophysiology, 37, 163–178.

[15] Jung, T. P., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2000). Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clinical Neurophysiology, 111, 1745–1758. [16] Letelier, J. C. and Weber, P. P. (2000). Spike sorting based on discrete wavelet transform coefficients. Journal of Neuroscience Methods, 101(2):93 – 106.

[17] S. Mallat. A wavelet tour of signal processing (Second edition). Academic Press, San Diego, 1999. ISBN 978-0-12-466606-1

[18] P. Soukal. Methods for automatic detection of ERP components, Diploma Thesis, University of West Bohemia, Pilsen, Czech Republic, 2010.

[19] G. Kaiser, A friendly guide to wavelets. Cambridge, MA, USA: Birkhauser Boston Inc., 1994.

[20] C. A. Valens. A Really Friendly Guide to Wavelets. Available on http://www.robots.ox.ac.uk/~parg/mlrg/papers/arfgtw.pdf [cited August 27, 2012]. [21] A. Prochazka, E. Hostalkova. Biomedical signals and image processing using wavelet transform, Automation: professional journal for automation, measurement and computer science engineering, Volume 50, Issue 6, June 2007, pp. 397 – 401.

[22] T. Rondik. Methods of ERP Signal Processing, Diploma Thesis. University of West Bohemia, Pilsen, Czech Republic, 2010.

[23] Vareka, L., Prokop, T., Stebetak, J., Moucek, R.: Guess the number - applying a simple brain-computer interface to school-age children. In: Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS. (2016) 263{270

[24] T. Rondik, P. Mautner. Using ART2 for Clustering of Gabor Atoms Describing ERP P3 Waveforms, Biomedical Engineering and Informatics (BMEI), 2012

[25] P. J. Durka. Matching pursuit, Available on

http://www.scholarpedia.org/article/Matching_pursuit [cited April 22, 2010].

[26] N. E. Huang and et al. The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences[454], 1998.

[27] Norden E. Huang, Zheng Shen, Steven R. Long, Manli C. Wu, Hsing H. Shih, Quanan Zheng, Nai-Chyuan Yen, Chi C. Tung, and Henry H. Liu. The empirical mode

Page 40 decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, 454[1971]:903–995, March 1998.

[28] R. Liu. Empirical mode decomposition: A useful technique for neuroscience?, 2002.

[29] H Liang, S Bresser, and R Desimone. Empirical mode decomposition: a method for analyzing neural data. Neurocomputing, 65:801-807 (2005)

[30] Ciniburk, J. Hilbert-Huang Transform for ERP Detection. Ph.D. thesis, Faculty of Applied Sciences, University of West Bohemia, Univerzitni 22, 306 14 Pilsen (2011) [31] PROKOP, Tomáš; MOUČEK, Roman. P3 Component Detection Using HHT. In:

International Conference on Brain Informatics and Health. Springer International

Publishing, 2014. p. 100-110.

[32] N Huang and Nii O. Attoh-Okine. The Hilbert-Huang Transform in Engineering. CRC Press, 2005.

[33] R. Deering and J. F. Kaiser, “The use of a masking signal to improve empirical mode decomposition,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP ’05) , 2005, vol. 4, pp. 18–23.

[34] Altaf M. U., Gautama T., Tanaka T., Mandic D. P. 2007 Rotation invariant

complex empirical mode decomposition In Proc. IEEE Int. Conf. on Acoustics, Speech, Signal Processing, Honolulu, HI, April 2007 1009–1012

[35] N. Rehman and D. P. Mandic, “Multivariate empirical mode decomposition,” in Proc. Roy. Soc. A, 2010, vol. 466, pp. 1291–1302.

[36] N. Rehman and D. P. Mandic, “Empirical mode decomposition for trivariate signals,” IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1059–1068, Mar. 2010.

[37] N. Rehman and D. P. Mandic “Filterbank property of multivariate EMD” IEEE

Trans. Signal Processing, vol. 59, no. 5, pp. 2421-2426, 2011

[38] SHI, Qiwei, et al. An auditory oddball based brain-computer interface system using multivariate EMD. In: Advanced Intelligent Computing Theories and Applications. With

Aspects of Artificial Intelligence. Springer Berlin Heidelberg, 2010. p. 140-148.

[39] Rilling, G., Flandrin, P., Goncalves, P. & Lilly, J. M. 2007 Bivariate empirical mode decomposition. IEEE Signal Process. Lett. 14, 936–939.

[40] S. Theodoridis and K. Koutroumbas, Pattern Recognition, Third Edition, 3rd ed. Academic Press, Mar. 2006.

[41] F. Lotte, M. Congedo, A. L´ecuyer, F. Lamarche, and B. Arnaldi, “A review of classification algorithms for EEG-based brain-computer interfaces,” Journal of neural engineering, vol. 4, no. 2, Jun. 2007. [Online]. Available:

http://dx.doi.org/10.1088/1741-2560/4/2/R01

[42] K. Fukunaga, Introduction to Statistical Pattern Recognition, Second Edition (Computer Science & Scienti_c Computing), 2nd ed. Academic Press, Oct.1990.

[43] C. Cortes and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, pp. 273–297, 1995. [Online]. Available: http://dx.doi.org/10.1007/BF00994018

[44] S. Theodoridis and K. Koutroumbas, Pattern Recognition, Third Edition, 3rd ed. Academic Press, Mar. 2006.

[45] L. Vařeka, „Methods for Signal Classification and their Application to the Design of Brain-Computer Interfaces“, Diploma Thesis, University of West Bohemia, 2013 [46] Z. Cashero, Comparison of Eeg Preprocessing Methods to Improve the Performance of the P300 Speller. Proquest, Umi Dissertation Publishing, 2012.

[47] L. Fausett, Ed., Fundamentals of neural networks: architectures, algorithms, and applications. Upper Saddle River, NJ, USA: Prentice-Hall, Inc., 1994

[48] F. Lotte, M. Congedo, A. L´ecuyer, F. Lamarche, and B. Arnaldi, “A review of classification algorithms for EEG-based brain-computer interfaces,” Journal of neural engineering, vol. 4, no. 2, Jun. 2007. [Online]. Available:

http://dx.doi.org/10.1088/1741-2560/4/2/R01

[49] BENGIO, Yoshua. Learning deep architectures for AI. Foundations and trends® in

Machine Learning, 2009, 2.1: 1-127.

[50] T. Serre, G. Kreiman, M. Kouh, C. Cadieu, U. Knoblich, and T. Poggio, “A quantitative theory of immediate visual recognition,” Progress in Brain Research, Computational Neuroscience: Theoretical Insights into Brain Function, vol. 165, pp. 33–56, 2007.

[51] G. E. Hinton, S. Osindero, and Y. Teh, “A fast learning algorithm for deep belief nets,” Neural Computation, vol. 18, pp. 1527–1554, 2006.

[52] Y. Freund and D. Haussler, “Unsupervised learning of distributions on Binary vectors using two layer networks,” Technical Report UCSC-CRL-94-25, University of California, Santa Cruz, 1994.

[53] Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, “Greedy layer-wise training of deep networks,” in Advances in Neural Information Processing Systems 19

(NIPS’06), (B. Sch¨olkopf, J. Platt, and T. Hoffman, eds.), pp. 153–160, MIT Press,

Page 42 [54] Y. LeCun, S. Chopra, R. M. Hadsell, M.-A. Ranzato, and F.-J. Huang, “A tutorial on energy-based learning,” in Predicting Structured Data, pp. 191–246, G. Bakir and T. Hofman and B. Scholkopf and A. Smola and B. Taskar: MIT Press, 2006.

[55] Y. LeCun and F. Huang, “Loss functions for discriminative training of energy- based models,” in Proceedings of the Tenth International Workshop on Artificial

Intelligence and Statistics (AISTATS’05), (R. G. Cowell and Z. Ghahramani, eds.),

2005.

[56] M. Ranzato, Y. Boureau, S. Chopra, and Y. LeCun, “A unified energy-based framework for unsupervised learning,” in Proceedings of the Eleventh International

Conference on Artificial Intelligence and Statistics (AISTATS’07), San Juan, Porto Rico:

Omnipress, 2007.

[57] D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, “A learning algorithm for boltzmann machines,” Cognitive Science, vol. 9, pp. 147–169, 1985.

[58] G. E. Hinton and T. J. Sejnowski, “Learning and relearning in Boltzmann machines,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, (D. E. Rumelhart and J. L. McClelland, eds.), pp. 282–317, Cambridge, MA: MIT Press, 1986.

[59] G. E. Hinton, T. J. Sejnowski, and D. H. Ackley, “Boltzmann machines: Constraint satisfaction networks that learn,” Technical Report TR-CMU-CS-84-119, Carnegie- Mellon University, Dept. of Computer Science, 1984.

[60] M. A. Carreira-Perpi˜nan and G. E. Hinton, “On contrastive divergence learning,” in Proceedings of the Tenth International Workshop on Artificial Intelligence and

Statistics (AISTATS’05), (R. G. Cowell and Z. Ghahramani, eds.), pp. 33–40, Society

for Artificial Intelligence and Statistics, 2005.

[61] H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio, “An empirical evaluation of deep architectures on problems with many factors of variation,” in

Proceedings of the Twenty-fourth International Conference on Machine Learning (ICML’07), (Z. Ghahramani, ed.), pp. 473–480, ACM, 2007.

[62] M. Ranzato, C. Poultney, S. Chopra, and Y. LeCun, “Efficient learning of sparse representations with an energy-based model,” in Advances in Neural Information

Processing Systems 19 (NIPS’06), (B. Sch¨olkopf, J. Platt, and T. Hoffman, eds.), pp.

1137–1144, MIT Press, 2007.

[63] P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, “Extracting and composing robust features with denoising autoencoders,” in Proceedings of the Twenty-

fifth International Conference on Machine Learning (ICML’08), (W. W. Cohen, A.

[64] G. E. Hinton and R. Salakhutdinov, “Reducing the dimensionality of data with neural networks,” Science, vol. 313, pp. 504–507, 2006.