[1] Y. B. Ian Goodfellow and A. Courville, “Deep learning.” Book in prepara- tion for MIT Press, 2016.
[2] D. Stutz, “Understanding convolutional neural networks,” 2014.
[3] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,”Nature, vol. 521, no. 7553, pp. 436–444, 2015.
[4] L. lab, “Convolutional neural networks (lenet).” http://deeplearning. net/tutorial/lenet.html. Accessed August 19, 2016.
[5] X. Glorot, A. Bordes, and Y. Bengio, “Deep sparse rectifier neural net- works.,” inAistats, vol. 15, p. 275, 2011.
[6] A. L. Maas, A. Y. Hannun, and A. Y. Ng, “Rectifier nonlinearities improve neural network acoustic models,” inProc. ICML, vol. 30, 2013.
[7] K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpass- ing human-level performance on imagenet classification,” inProceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034, 2015.
[8] I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. C. Courville, and Y. Ben- gio, “Maxout networks.,”ICML (3), vol. 28, pp. 1319–1327, 2013.
[9] X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks.,” inAistats, vol. 9, pp. 249–256, 2010. [10] Y. Bengio, “Practical recommendations for gradient-based training of deep
architectures,” in Neural Networks: Tricks of the Trade, pp. 437–478, Springer, 2012.
[11] N. Srivastava, G. E. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdi- nov, “Dropout: a simple way to prevent neural networks from overfitting.,” Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929–1958, 2014. [12] L. Wan, M. Zeiler, S. Zhang, Y. L. Cun, and R. Fergus, “Regularization of neural networks using dropconnect,” inProceedings of the 30th Interna- tional Conference on Machine Learning (ICML-13), pp. 1058–1066, 2013. [13] X. Fraz˜ao and L. A. Alexandre, “Dropall: Generalization of two convolu-
tional neural network regularization methods,” inInternational Conference Image Analysis and Recognition, pp. 282–289, Springer, 2014.
[14] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in neural information processing systems, pp. 1097–1105, 2012.
[15] S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” arXiv preprint arXiv:1502.03167, 2015.
[16] J. Duchi, E. Hazan, and Y. Singer, “Adaptive subgradient methods for online learning and stochastic optimization,”Journal of Machine Learning Research, vol. 12, no. Jul, pp. 2121–2159, 2011.
[17] D. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
[18] J. Bergstra and Y. Bengio, “Random search for hyper-parameter optimiza- tion,”Journal of Machine Learning Research, vol. 13, no. Feb, pp. 281–305, 2012.
[19] J. S. Bergstra, R. Bardenet, Y. Bengio, and B. K´egl, “Algorithms for hyper- parameter optimization,” in Advances in Neural Information Processing Systems, pp. 2546–2554, 2011.
[20] I. Sutskever, J. Martens, G. E. Dahl, and G. E. Hinton, “On the importance of initialization and momentum in deep learning.,”
[21] Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, “Deepface: Closing the gap to human-level performance in face verification,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1701– 1708, 2014.
[22] F. Schroff, D. Kalenichenko, and J. Philbin, “Facenet: A unified embedding for face recognition and clustering,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823, 2015.
[23] E. Zhou, Z. Cao, and Q. Yin, “Naive-deep face recognition: Touching the limit of lfw benchmark or not?,”arXiv preprint arXiv:1501.04690, 2015. [24] Y. Sun, X. Wang, and X. Tang, “Hybrid deep learning for face verification,”
inProceedings of the IEEE International Conference on Computer Vision, pp. 1489–1496, 2013.
[25] Y. Sun, X. Wang, and X. Tang, “Deep learning face representation from predicting 10,000 classes,” inProceedings of the IEEE Conference on Com- puter Vision and Pattern Recognition, pp. 1891–1898, 2014.
[26] Y. Sun, Y. Chen, X. Wang, and X. Tang, “Deep learning face representa- tion by joint identification-verification,” inAdvances in Neural Information Processing Systems, pp. 1988–1996, 2014.
[27] Y. Sun, X. Wang, and X. Tang, “Deeply learned face representations are sparse, selective, and robust,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2892–2900, 2015.
[28] Y. Sun, D. Liang, X. Wang, and X. Tang, “Deepid3: Face recognition with very deep neural networks,”arXiv preprint arXiv:1502.00873, 2015. [29] G. Hu, Y. Yang, D. Yi, J. Kittler, W. Christmas, S. Li, and T. Hospedales,
“When face recognition meets with deep learning: an evaluation of convo- lutional neural networks for face recognition,” inProceedings of the IEEE International Conference on Computer Vision Workshops, pp. 142–150, 2015.
[30] M. D. Zeiler and R. Fergus, “Visualizing and understanding convolutional networks,” in European Conference on Computer Vision, pp. 818–833, Springer, 2014.
[31] J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson, “Under- standing neural networks through deep visualization,” arXiv preprint arXiv:1506.06579, 2015.
[32] M. Liu, J. Shi, Z. Li, C. Li, J. Zhu, and S. Liu, “Towards better analysis of deep convolutional neural networks,”arXiv preprint arXiv:1604.07043, 2016.
[33] Theano Development Team, “Theano: A Python framework for fast com- putation of mathematical expressions,”arXiv e-prints, vol. abs/1605.02688, May 2016.
[34] D. Zeng, H. Chen, and Q. Zhao, “Towards resolution invariant face recog- nition in uncontrolled scenarios,” inBiometrics (ICB), 2016 International Conference on, pp. 1–8, IEEE, 2016.
[35] R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, “Multi-pie,” Image and Vision Computing, vol. 28, no. 5, pp. 807–813, 2010.
[36] T. Sim, S. Baker, and M. Bsat, “The cmu pose, illumination, and expres- sion (pie) database,” in Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on, pp. 46–51, IEEE, 2002.
[37] N. Gourier and J. Letessier, “The pointing 04 data sets,” in Proceedings of Pointing 2004, ICPR International Workshop on Visual Observation of Deictic Gestures, pp. 1–4, 2004.
[38] “Orl dataset.”http://www.cam-orl.co.uk/.
[39] A. M. Martinez, “The ar face database,” CVC Technical Report, vol. 24, 1998.
[40] “Faces94 dataset.” http://cswww.essex.ac.uk/mv/allfaces/faces94. html.
[41] “Grimace dataset.” http://cswww.essex.ac.uk/mv/allfaces/grimace. zip.
[42] P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the face recognition grand challenge,” in2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 947–954, IEEE, 2005.
[43] P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, “The feret evalua- tion methodology for face-recognition algorithms,”IEEE Transactions on pattern analysis and machine intelligence, vol. 22, no. 10, pp. 1090–1104, 2000.
[44] W. Gao, B. Cao, S. Shan, X. Chen, D. Zhou, X. Zhang, and D. Zhao, “The cas-peal large-scale chinese face database and baseline evaluations,” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 38, no. 1, pp. 149–161, 2008.
[45] S. Milborrow, J. Morkel, and F. Nicolls, “The muct landmarked face database,”Pattern Recognition Association of South Africa, vol. 201, no. 0, 2010.
[46] D. Yi, Z. Lei, S. Liao, and S. Z. Li, “Learning face representation from scratch,”arXiv preprint arXiv:1411.7923, 2014.