A Multi-center Clinical Trial for Camera-based Infant Sleep and Awake Detection in Neonatal Intensive Care Unit

Yuan Yuya1; Huang Dongmin1; Ren Lirong2; Song Xiaoyan3; Pan Liping4; Lu Hongzhou4; Wang Wenjin1

10.1109/Healthcom56612.2023.10472347

2023-12-17

979-8-3503-3765-5

2023 IEEE International Conference on E-health Networking, Application & Services (Healthcom)

15-17 Dec. 2023

Chongqing, China

Infants need adequate sleep to develop their brain and cardiovascular systems, especially for preterm infants in the Neonatal Intensive Care Unit. Camera-based infant monitoring is an emerging direction of research in video health monitoring. Intuitively, camera can easily identify the sleep-awake stage of infants by detecting the state of eyes, e.g. closed or opening. Thus in this paper, we propose to explore the unique advantage of camera-based facial analysis for sleep-awake detection, as a fundamental step toward infant sleep monitoring. A multi-center clinical trial was conducted to collect infant videos for investigating the feasibility of our proposal. A benchmark including four machine learning methods of SVM, KNN, MLP, and CNN (ResNet18) was set up to classify the sleep/awake stage of infants. To alleviate the overfitting issue caused by over-sampling of a sleeping infant, we propose to integrate ResNet18 with the contrastive learning strategy to strengthen the consistency of facial features learned from different infants. The clinical evaluation shows that all benchmarked methods obtained an accuracy above 75% while the proposed method achieved the best accuracy of 86%. This invokes further explorations of using facial/eye features of infants for sleep-awake staging, towards intelligent contactless sleep analysis of infants in combination with camera-based vital signs monitoring.

第一 ; 共同第一 ; 通讯

1.Department of Biomedical Engineering, Southern University of Science and Technology, China
2.Department of Obstetrics, Baoan Hospital of Traditional Chinese Medicine in Shenzhen, China
3.Neonatal Intensive Care Unit, Nanfang Hospital of Southern Medical University, China
4.Neonatal Intensive Care Unit, The Third People’s Hospital of Shenzhen, China.

Yuan Yuya,Huang Dongmin,Ren Lirong,et al. A Multi-center Clinical Trial for Camera-based Infant Sleep and Awake Detection in Neonatal Intensive Care Unit[C],2023.