G. E. Hinton, S. Osindero, and Y. W. Teh, A fast learning algorithm for deep belief nets, Neural Comput, vol.18, pp.1527-1554, 2006.

G. E. Hinton and R. R. Salakhutdinov, Reducing the dimensionality of data with neural networks, Science, pp.504-507, 2007.

Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, Greedy layer-wise training of deep networks, Proc. NIPS, pp.153-160, 2007.

H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, Proc. ICML, pp.609-616, 2009.

P. Vincent, H. Larochelle, Y. Bengio, and P. A. , Extracting and composing robust features with denoising autoencoders, Proc. ICML, pp.1096-1103, 2008.

Y. Lecun, Y. Bengio, and G. E. Hinton, Deep learning, vol.521, pp.436-444, 2015.

Y. Bengio, Learning deep architectures for AI, Foundat. and Trends Mach. Learn, vol.2, pp.1-127, 2009.

L. Deng and D. Yu, Deep Learning: Methods and Applications, Foundations and Trends® in Signal Processing, vol.7, pp.197-387, 2013.

Y. Bengio, A. Courville, and P. Vincent, Representation learning: A review and new perspectives, IEEE Trans. Pattern Anal. Mach. Intell, vol.35, pp.1798-1828, 2013.

J. Schmidhuber, Deep learning in neural networks: An overview, pp.85-117, 2015.

Y. Lecun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard et al., Backpropagation applied to handwritten zip code recognition, Neural Comput, vol.1, pp.541-551, 1989.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient-based learning applied to document recognition, Proc. IEEE, vol.86, pp.2278-2324, 1998.

O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh et al., ImageNet large scale visual recognition challenge, Int. J. Comput. Vis, vol.115, pp.211-252, 2015.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural network, Proc. NIPS, pp.1097-1105, 2012.

C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed et al., Going deeper with convolutions, Proc. IEEE Conf. CVPR, pp.1-9, 2015.

K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014.

K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, 2015.

E. Learned-miller, G. Huang, A. Roychowdhury, H. Li, and G. Hua, Labeled faces in the wild: A survey, 2015.

Y. Sun, D. Liang, X. Wang, and X. Tang, DeepID3: Face recognition with very deep neural networks, 2015.

F. Schroff, D. Kalenichenko, and J. Philbin, FaceNet: A unified embedding for face recognition and clustering, Computer Vision and Pattern Recognition(CVPR), (IEEE2015), pp.815-823

D. Ciresan, U. Meier, and J. Schmidhuber, Multi-column deep neural networks for image classification, Computer Vision and Pattern Recognition(CVPR), (IEEE2012), pp.3642-3649

S. Zhang, J. Wang, X. Tao, Y. Gong, and N. Zheng, Constructing deep sparse coding network for image classification, Pattern Recognition, vol.64, pp.130-140, 2017.

C. Zu, Z. Wang, D. Zhang, P. Liang, Y. Shi et al., Robust multi-atlas label propagation by deep sparse representation, Pattern Recognition, vol.63, pp.511-517, 2017.

E. Ohn-bar and M. M. Trivedi, Multi-scale volumes for deep object detection and localization, Pattern Recognition, vol.61, pp.557-572, 2017.

A. T. Lopes, E. De-aguiar, A. F. Desouza, and T. Oliveira-santos, Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order, Pattern Recognition, pp.610-628, 2017.

X. Q. Zhou, B. T. Hu, Q. C. Chen, and X. L. Wang, Recurrent convolutional neural network for answer selection in community question answering, Neurocomputing, vol.274, pp.8-18, 2018.

Y. X. Chen, G. Tao, H. M. Ren, X. Y. Lin, and L. M. Zhang, Accurate seat belt detection in road surveillance images based on CNN and SVM, Neurocomputing, vol.274, pp.80-87, 2018.

W. B. Liu, Z. D. Wang, X. H. Liu, N. Y. Zeng, Y. et al., A survey of deep neural network architectures and their applications, Neurocomputing, vol.234, pp.11-26, 2017.

S. Q. Yu, S. Jia, and C. Y. Xu, Convolutional neural networks for hyperspectral image classification, Neurocomputing, vol.219, pp.88-98, 2017.

A. Qayyum, S. M. Anwar, M. Awais, and M. Majid, Medical image retrieval using deep convolutional neural network, vol.266, pp.8-20, 2017.

P. Barros, G. I. Parisi, G. Weber, and S. Wermter, Emotion-modulated attention improves expression recognition: A deep learning model, pp.104-114, 2017.

A. B. Patel, T. Nguyen, and R. G. Baraniuk, A probabilistic theory of deep learning, 2015.

P. Mehta and D. J. Schwab, An exact mapping between the variational renormalization group and deep learning, 2014.

L. P. Kadanov, Statistical Physics: Statics, Dynamics and Renormalization, 2000.

N. Tishb and N. Zaslavsky, Deep learning and the information bottleneck principle, 2015.

G. V. Steeg and A. Galstyan, The information sieve

O. Sigaud and A. Droniou, Towards deep developmental learning, IEEE Trans. Auton. Mental Develop
URL : https://hal.archives-ouvertes.fr/hal-01331799

N. Lei, K. Su, L. Cui, S. Yau, and D. X. Gu, A geometric view of optimal transportation and generative model, 2017.

X. Dong, J. S. Wu, and L. Zhou, How deep learning works-The geometry of deep learning, 2017.

A. Paul and S. Venkatasubramanian, Why does unsupervised deep learning work, A perspective from group theory, 2015.

U. Shaham, A. Cloninger, and R. Coifman, Provable approximation properties for deep neural networks, 2015.
DOI : 10.1016/j.acha.2016.04.003
URL : http://arxiv.org/pdf/1509.07385

F. Anselmi, L. Rosasco, and T. Poggio, On invariance and selectivity in representation learning, 2015.
DOI : 10.1093/imaiai/iaw009
URL : https://academic.oup.com/imaiai/article-pdf/5/2/134/6990886/iaw009.pdf

F. Anselmi, J. Z. Leibo, L. Rosasco, J. Mutch, A. Tacchetti et al., Unsupervised learning of invariant representations in hierarchical architectures, 2013.

S. Mallat, Group invariant scattering, Commun. Pure Appl. Math, vol.65, pp.1331-1398, 2012.
DOI : 10.1002/cpa.21413
URL : http://arxiv.org/pdf/1101.2286

J. Bruna and S. Mallat, Invariant scattering convolution networks, IEEE Trans. Pattern Anal. Mach. Intell, vol.35, pp.1872-1886, 2013.
DOI : 10.1109/tpami.2012.230
URL : http://arxiv.org/pdf/1203.1513

T. Wiatowski and H. Bolcskei, Deep convolutional neural networks based on semi-discrete frames, Proc. IEEE ISIT, pp.1212-1216, 2015.
DOI : 10.1109/isit.2015.7282648
URL : http://arxiv.org/pdf/1504.05487

J. Bruna, S. Chintala, Y. Lecun, S. Piantino, A. Szlam et al., A theoretical argument for complex-valued convolutional networks, 2015.

D. Erhan, Y. Bengio, A. Courville, and P. Vincent, Visualizing higher-layer features of a deep network, 2009.

H. Larochelle, D. Erhan, A. Courville, J. Bergstra, and Y. Bengio, An empirical evaluation of deep architectures on problems with many factors of variation, Proc. ICML, pp.473-480, 2007.

I. J. Goodfellow, Q. V. Le, A. M. Saxe, H. Lee, and A. Y. Ng, Measuring invariances in deep networks, Proc. NIPS, pp.646-654, 2009.

C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan et al., Intriguing properties of neural networks, Computer Science, pp.1-10, 2014.

M. D. Zeiler and R. Fergus, Visualizing and understanding convolutional networks, ECCV, 2014.
DOI : 10.1007/978-3-319-10590-1_53
URL : http://cs.nyu.edu/%7Efergus/papers/zeilerECCV2014.pdf

K. Simonyan, A. Vedaldi, and A. Zisserman, Deep inside convolutional networks: Visualising image classification models and saliency maps, Proc. ICLR, 2014.

R. Girshick, J. Donahue, T. Darrell, and J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, Computer Vision and Pattern Recognition (CVPR), IEEE Conference on, 2014.
DOI : 10.1109/cvpr.2014.81
URL : http://arxiv.org/pdf/1311.2524

A. Mahendran and A. Vedaldi, Understanding deep image representations by inverting them, Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, (IEEE2015), pp.5188-5196
DOI : 10.1109/cvpr.2015.7299155
URL : http://arxiv.org/pdf/1412.0035

T. Chan, K. Jia, S. Gao, J. Lu, Z. Zeng et al., PCANet: A simple deep learning baseline for image classification?, IEEE Trans. Image Process, vol.24, pp.5017-5032, 2015.
DOI : 10.1109/tip.2015.2475625
URL : http://arxiv.org/pdf/1404.3606

Y. Gan, T. Yang, and C. He, A deep graph embedding network model for face recognition, Proc. IEEE ICSP, pp.1268-1271, 2014.
DOI : 10.1109/icosp.2014.7015203
URL : http://arxiv.org/pdf/1409.7313.pdf

D. Wang and X. Tan, Unsupervised feature learning with C-SVDDNet, Pattern Recognition, vol.60, pp.473-485, 2016.
DOI : 10.1016/j.patcog.2016.06.001
URL : http://arxiv.org/pdf/1412.7259

Z. Feng, L. Jin, D. Tao, and S. Huang, DLANet: A manifold-learning-based discriminative feature learning network for scene classification, Neurocomputing, vol.157, pp.11-21, 2015.
DOI : 10.1016/j.neucom.2015.01.043

C. J. Ng and A. B. Teoh, DCTNet: A simple learning-free approach for face recognition, Proceedings of APSIPA Annual Summit and Conference, pp.761-768, 2015.
DOI : 10.1109/apsipa.2015.7415375
URL : http://arxiv.org/pdf/1507.02049

Y. Gan, J. Liu, J. Dong, G. Zhong, and A. Pca, , 2015.

Y. Zhao, R. Wang, W. Wang, and W. Gao, Multi-level modified finite radon transform network for image upsampling, IEEE Trans. Circuits Syst. Video Technol, vol.26, pp.2189-2199, 2015.

Z. Lei, D. Yi, and S. Li, Learning stacked image descriptor for face recognition, IEEE Trans. Circuits Syst. Video Technol, vol.26, pp.1685-1696, 2016.

S. Z. Li, B. Yu, W. Wu, S. Z. Su, and R. R. Ji, Feature learning based on SAE-PCA network for human gesture recognition in RGBD images, Neurocomputing, pp.565-573, 2015.

R. Zeng, J. S. Wu, Z. H. Shao, Y. Chen, B. J. Chen et al., Color image classification via quaternion principal component analysis network, Neurocomputing, vol.216, pp.416-428, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01413815

J. S. Wu, S. J. Qiu, R. Zeng, Y. Y. Kong, L. Senhadji et al., Multilinear principal component analysis network for tensor object classification, IEEE Access, vol.5, pp.3322-3331, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01618929

A. M. Martinez and R. Benavente, The AR face database, CVC Technical Report, 1998.

T. Sim, S. Baker, and M. Bsat, The CMU pose, illumination, and expression (PIE) database, Proc. International Conference on Automatic Face and Gesture Recognition, 2002.

A. Krizhevsky, Learning multiple layers of features from tiny images, pp.1-58, 2009.

R. E. Fan, K. W. Chang, and C. J. Hsieh, LIBLINEAR: A library for large linear classification, The Journal of Machine Learning Research, vol.9, pp.1871-1874, 2008.

N. S. Altman, An introduction to kernel and nearest-neighbor nonparametric regression, The American Statistician, vol.46, pp.175-185, 1992.

D. Cai, X. He, J. Han, and H. J. Zhang, Orthogonal laplacianfaces for face recognition, IEEE Trans. Image Process, vol.15, pp.3608-3614, 2006.

, He is now working in the LIST as a lecturer. His research interest mainly includes deep learning, 2012.

, Shijie Qiu received the B.S. degree in Mathematical Science from Soochow University in 2015. Now she is currently pursuing the M.S. degree in Computer Science, Southeast University. Her research interests lie in deep learning and pattern recognition

, He is currently an Assistant Professor with the College of, respectively, and the Ph.D. degree in imaging and diagnostic radiology from the Chinese University of, 2008.

, Since 2013, she has been a Faculty Member with the Department of, 2013.

, He is currently an associate professor of the, His rece nt work concentrates on medical image reconstruction and analysis, 2001.

, he worked as an assistant professor at the School of Automation, Southeast University. Now he is an associate professor in the School of Automation, 2002.

, He is a Professor and the Head of the INSERM Research Laboratory LTSI. His is also Co-Director of the French-Chinese Laboratory CRIBs "Centre de Recherche en Information Biomédicale Sino-Français, His main research efforts are focused on nonstationary signal processing with particular emphasis on wavelet transforms and time-frequency representations for detection, classification, and interpretation of biosignals

, He is a professor of the LIST Laboratory and the Codirector of the CRIBs. His recent work concentrates on the image analysis, pattern recognition and fast algorithms of digital signal processing, Applied Mathematics from Wuhan University, China, in 1987, and a Ph.D. degree in Numerical Analysis from the University of Rennes 1, 1992.