Video and audio processing in paediatrics a review

Abstract : Objective - Video and sound acquisition and processing technologies have seen great improvements in recent decades, with many applications in the biomedical area. The aim of this paper is to review the overall state of the art of advances within these topics in paediatrics and to evaluate their potential application for monitoring in the neonatal intensive care unit (NICU). Approach - For this purpose, more than 150 papers dealing with video and audio processing were reviewed. For both topics, clinical applications are described according to the considered cohorts-full-term newborns, infants and toddlers or preterm newborns. Then, processing methods are presented, in terms of data acquisition, feature extraction and characterization. Main results - The paper first focuses on the exploitation of video recordings; these began to be automatically processed in the 2000s and we show that they have mainly been used to characterize infant motion. Other applications, including respiration and heart rate estimation and facial analysis, are also presented. Audio processing is then reviewed, with a focus on the analysis of crying. The first studies in this field focused on induced-pain cries and the newest ones deal with spontaneous cries; the analyses are mainly based on frequency features. Then, some papers dealing with non-cry signals are also discussed. Significance - Finally, we show that even if recent improvements in digital video and signal processing allow for increased automation of processing, the context of the NICU makes a fully automated analysis of long recordings problematic. A few proposals for overcoming some of the limitations are given.
Complete list of metadatas

Cited literature [147 references]  Display  Hide  Download

https://hal-univ-rennes1.archives-ouvertes.fr/hal-01998530
Contributor : Laurent Jonchère <>
Submitted on : Thursday, February 14, 2019 - 10:58:05 AM
Last modification on : Tuesday, June 25, 2019 - 9:18:27 AM
Long-term archiving on : Wednesday, May 15, 2019 - 6:29:18 PM

File

Cabon clean final version.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Sandie Cabon, Fabienne Porée, Antoine Simon, Olivier Rosec, Patrick Pladys, et al.. Video and audio processing in paediatrics a review. Physiological Measurement, IOP Publishing, 2019, 40 (2), pp.02TR02. ⟨10.1088/1361-6579/ab0096⟩. ⟨hal-01998530⟩

Share

Metrics

Record views

115

Files downloads

18