W. S. Mcculloch and W. Pitts, A Logical Calculus of Ideas Immanent in Nervous Activity, Bulletin of Mathematical Biophysics, vol.5, issue.4, pp.115-133, 1943.

S. Haykin, Neural Networks: A Comprehensive Foundation, 1998.

Y. Bengio, A. Courville, and P. Vincent, Representation learning: a review and new perspectives, IEEE Trans. Pattern Anal. Mach. Intell, vol.35, issue.8, pp.1798-1828, 2013.

Y. Lecun, Y. Bengio, and G. E. Hinton, Deep learning, Nature, vol.521, pp.436-444, 2015.

I. Goodfellow, Y. Bengio, and A. Courville, Deep learning, 2016.

L. Deng and D. Yu, Deep learning: methods and applications, Found Trends Signal Process, vol.7, pp.197-387, 2014.

J. Schmidhuber, Deep learning in neural networks: An overview, Neural Networks, pp.85-117, 2015.

H. Wang, On the origin of deep learning, 2017.

J. Gu, Recent advances in convolutional neural networks, 2015.

Y. Guo, Deep learning for visual understanding: A review, Neurocomputing, vol.187, pp.27-48, 2016.

A. Prieto, B. Prieto, and E. M. Ortigosa, Neural networks: An overview of early research, current frameworks and new challenges, Neurocomputing, vol.214, pp.242-268, 2016.

W. Liu, Z. Wang, X. Liu, N. Zeng, Y. Liu et al., A survey of deep neural network architectures and their applications, Neurocomputing, vol.741, pp.11-26, 2017.

F. Rosenblatt, Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms, 1961.

D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Learning representations by back-propagating errors, Cognitive modeling, 1988.

G. Hinton, S. Osindero, and Y. W. Teh, A fast learning algorithm for deep belief nets, Neural computation, vol.18, issue.7, pp.1527-1554, 2006.

G. E. Hinton and R. R. Salakhutdinov, Reducing the dimensionality of data with neural networks, Science, vol.313, issue.5786, pp.504-507, 2006.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient based learning applied to document recognition, Proc IEEE, vol.86, issue.11, pp.2278-2324, 1998.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural networks, 2012.

C. Szegedy, W. Liu, Y. Jia, and P. Sermanet, Going deeper with convolutions, 2015.

S. Ioffe and C. Szegedy, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, 2015.

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, Rethinking the Inception Architecture for Computer Vision, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.2818-2826, 2016.

C. Szegedy, S. Ioffe, and V. Vanhoucke, Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning, 2016.

K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014.

R. K. Srivastava, K. Greff, and J. Schmidhuber, Training very deep networks, Computer Science, 2015.

K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, Proceedings of CVPR, 2016.

S. Xie, Aggregated residual transformations for deep neural networks, 2016.

G. Huang, Z. Liu, and K. Q. Weinberger, Densely Connected Convolutional Networks, 2016.

G. Larsson, FractalNet: Ultra-Deep Neural Networks without Residuals, 2016.

X. Zhang, Z. Li, C. C. Loy, and D. Lin, Polynet: a pursuit of structural diversity in very deep networks, p.20, 2016.

J. Hu, L. Shen, and G. Sun, Squeeze-and-Excitation Networks, 2017.

Y. Yang, Z. Zhong, and T. Shen, Convolutional Neural Networks with Alternately Updated Clique, 2018.

I. Hubara, Proceedings of NIPS, 2016.

F. N. Iandola, SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size, 2016.

A. G. Howard, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, 2017.

J. L. Elman, Finding Structure in Time, Cognitive Science, vol.14, issue.2, pp.179-211, 1990.

S. Hochreiter and J. Schmidhuber, Long short-term memory, Long Short Term Memory, vol.9, pp.1735-1780, 1997.

A. Graves and J. Schmidhuber, Framewise phoneme classification with bidirectional LSTM and other neural network architectures, Neural Networks, IJCNN, vol.18, issue.5, pp.602-610, 2005.

K. Cho, B. V. Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares et al., Learning phrase representations using rnn encoder-decoder for statistical machine translation, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01433235

W. R. Hamilton, Lectures on quaternions, vol.57, p.7, 2010.

T. A. Ell and S. J. Sangwine, Hypercomplex Fourier transforms of color images, IEEE Trans Image Process, vol.16, issue.1, pp.22-35, 2007.

C. C. Took and D. P. Mandic, The quaternion LMS algorithm for adaptive filtering of hypercomplex processes, IEEE Trans Signal Process, vol.57, pp.1316-1327, 2009.

R. Zeng, J. S. Wu, Z. H. Shao, Y. Chen, B. J. Chen et al., Color image classification via quaternion principal component analysis network, Neurocomputing, vol.216, pp.416-428, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01413815

S. Okubo, Introduction to Octonion and Other Non-Associative Algebras in Physics, 1995.

H. Y. Gao and K. M. Lam, From quaternion to octonion: Feature-based image saliency detection, IEEE International Conference on Acoustics, speech and signal processing, 2014.

?. B?aszczyk and K. M. Snopek, Octonion Fourier transform of real-valued functions of three variables -selected properties and examples, Signal Processing, vol.136, pp.29-37, 2017.

B. Widrow, J. Mccool, and M. Ball, The complex LMS algorithm, Proceedings of the IEEE, vol.63, issue.4, pp.719-720, 1975.

A. Hirose, Complex-Valued Neural Networks: Advances and Applications, 2013.

Q. Song, H. Yan, Z. Zhao, and Y. Liu, Global exponential stability of complex-valued neural networks with both time-varying delays and impulsive effects, Neural Networks, vol.79, pp.108-116, 2016.

P. Arena, L. Fortuna, L. Occhipinti, and M. G. Xinilia, Neural networks for quaternion-valued function approximation, Internationa l symposium on circuits and systems, vol.6, pp.307-310, 1994.

T. Isokawa, T. Kusakabe, N. Matsui, and F. Peper, Quaternion neural network and its application, International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, pp.318-324, 2003.

H. Kusamichi, T. Isokawa, N. Matsui, Y. Ogawa, and K. Maeda, A new scheme for color night vision by quaternion neural network, In: International conference on autonomous robots and agents, pp.101-106, 2004.

C. Jahanchahi, C. Took, and D. Mandic, On HR calculus, quaternion valued stochastic gradient, and adaptive three dimensional wind forecasting, International joint conference on neural networks, pp.1-5, 2010.

T. Isokawa, T. Kusakabe, N. Matsui, and F. Peper, Quaternion Neural Network and Its Application, International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, vol.21, pp.318-324, 2003.

N. Matsui, T. Isokawa, and H. Kusamichi, Quaternion neural network with geometrical operators, Journal of Intelligent & Fuzzy Systems Applications in Engineering & Technology, vol.15, issue.3, pp.149-164, 2004.

C. Popa, Octonion-valued neural networks, Artificial Neural Networks and Machine Learning-ICANN, 2016.

C. Popa, Global Exponential Stability of Neutral-Type Octonion-Valued Neural Networks with Time-Varying Delays, vol.309, pp.177-133, 2018.

C. Popa, Global Exponential Stability of Octonion-Valued Neural Networks with leakage delay and mixed delays, Neural Networks, pp.277-293, 2018.

J. Pearson and D. Bisset, Neural networks in the Clifford domain, International conference on neural networks, vol.3, pp.1465-1469, 1994.

S. Buchholz and G. Sommer, On Clifford neurons and Clifford multi-layer perceptrons, Neural Networks, vol.21, issue.7, pp.925-935, 2008.

Y. Kuroe, S. Tanigawa, and H. Iima, Models of Hopfield-type Clifford neural networks and their energy functions -hyperbolic and dual valued networks, Proc.int.conf.neural Information Processing, vol.7062, pp.560-569, 2011.

D. P. Reichert and T. Serre, Neuronal synchrony in complex-valued deep networks, Proceedings of ICLR, 2014.

R. Haensch and O. Hellwich, Complex-valued convolutional neural networks for object detection in PolSAR data, Proceedings of EUSAR, pp.1-4, 2010.

Z. Zhang, H. Wang, F. Xu, and Y. Q. Jin, Complex-valued convolutional neural network and its application in polarimetric SAR image classification, IEEE Trans Geosci Remote Sens, vol.55, issue.12, pp.7177-7188, 2017.

C. Popa, Complex-valued convolutional neural networks for real-valued image classification, Proceedings of the IJCNN, 2017.

C. Trabelsi, O. Bilaniuk, and Y. Zhang, Deep Complex Networks, 2018.

A. Krizhevsky and H. Geoffrey, Learning multiple layers of features from tiny images, vol.1, 2009.

C. Gaudet and A. Maida, Deep Quaternion Networks, 2018.

T. Parcollet, M. Morchid, and P. M. Bousquet, Quaterion Neural Networks for Spoken Language Understanding, Spoken Language Technology Workshop IEEE, 2017.

T. Parcollet, Y. Zhang, and M. Morchid, Speech Recognition with Quaternion Neural Networks, Conference on Neural Information Processing Systems, 2018.

T. Parcollet, M. Ravanelli, and M. Morchid, Quaternion Recurrent Neural Networks, ICLR, 2019.

T. Parcollet, M. Morchid, and G. Linarès, Bidirectional Quaternion Long-Short Term Memory Recurrent Neural Networks for Speech Recognition, 2018.

T. Parcollet, M. Morchid, and G. Linarès, Quaternion Convolutional Neural Networks for Heterogeneous Image Processing, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02107644

R. Caruana and M. Learning, Autonomous Agents and Multi-Agent Systems, vol.27, issue.1, pp.95-133, 1998.

S. Ruder, An overview of multi-task learning in deep neural networks, 2017.

J. Baxter, A Bayesian/information theoretic model of learning to learn via multiple task sampling, Machine Learning, vol.28, pp.7-39, 1997.

F. Chollet, Xception: Deep learning with depthwise separable convolutions, Proceedings of the IEEE conference on computer vision and pattern recognition, pp.1251-1258, 2017.

X. Glorot and Y. Bengio, Understanding the difficulty of training deep feedforward neural networks, In International conference on artificial intelligence and statistics, 2010.

K. He, X. Zhang, S. Ren, and J. Sun, Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, Proceedings of the IEEE international conference on computer vision, 2015.

K. He and J. Sun, Convolutional neural networks at constrained time cost, Proceedings of the IEEE conference on computer vision and pattern recognition, pp.5353-5360, 2015.

S. Han, J. Pool, and J. Tran, Learning both weights and connections for efficient neural network, Advances in neural information processing systems, pp.1135-1143, 2015.

I. Misra, A. Shrivastava, and A. Gupta, Cross-stitch networks for multi-task learning, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3994-4003, 2016.

S. Ruder12, J. Bingel, and I. Augenstein, Learning what to share between loosely related tasks, 2017.

. Md, R. Zeiler, and . Fergus, Visualizing and understanding convolutional networks, ECCV, pp.818-833, 2014.

Y. Gao, . Ma, and . Zhao, NDDR-CNN: Layerwise feature fusing in multi-task CNNs by neural discriminative dimensionality reduction, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3205-3214, 2019.

, He is now working in the LIST as a lecturer. His research interest mainly includes deep learning, fast algorithms of digital signal processing and its applications. Mr. Wu received the Eiffel doctorate scholarship of excellence (2009) from the French Ministry of Foreign Affairs and also the Chinese government award for outstanding self, 2005, and joint Ph.D. degree with the Laboratory of Image Science and Technology (LIST), 2012.

, 2017. Now she is currently pursuing the M.S. degree in Computer Science and technology, Southeast University. Her research interests lie in deep learning and pattern recognition