FallDeWideo: Vision-Aided Wireless Sensing Dataset for Fall Detection with Commodity Wi-Fi Devices

Cai，Zhijie1,3; Chen，Tingwei1; Zhou，Fujia2,3; Cui，Yuanhao4; Li，Hang3; Li，Xiaoyang3; Zhu，Guangxu3; Shi，Qingjiang2,3

10.1145/3615984.3616501

2023-10-06

ISACom 2023 - Proceedings of the 2023 3rd ACM MobiCom Workshop on Integrated Sensing and Communication Systems

7-12

Falling is one of the most dangerous events for the elderly and one of the most pressing public concern, which calls for an accurate, efficient, ubiquitous, cost-effective and privacy-preserving fall detection system to mitigate the negative consequences. Wi-Fi sensing-based method is considered as a potential technique to meet such needs. Existing solutions simply treat fall detection simply as a binary classification task, which leads to interpretability risks. To address this issue, we present FallDeWideo, the first multi-modal dataset dedicated to fall detection, comprising Wi-Fi CSI data and videos recorded during various kinds of events. We provide benchmark model for this dataset as well. Specifically, we train a CSI-based human pose estimation model (HPE) using video data as the supervision modality. The trained model can estimate human pose solely on Wi-Fi channel state information (CSI), and then detects whether a fall event occurs. This pipeline extracts rich information from CSI data and detects fall with more than just an alarm, but attached with an HPE, which allows more refined management of fall risks. We envision that this dataset will contribute to the wireless sensing research coomunity with respect to healthcare, action recognition, and cross-modal sensing. Codes and link to the dataset is available at https://github.com/shawnnn3di/falldewideo.

activity recognition datasets fall detection multi-modal Wi-Fi sensing

其他

英语

EI

20234615045453

Channel state information ; Cost effectiveness ; Fall detection ; Wireless local area networks (WLAN)

Computer Software, Data Handling and Applications:723 ; Codes and Standards:902.2 ; Industrial Economics:911.2 ; Accidents and Accident Prevention:914.1

2-s2.0-85176111318

Scopus

1.The Chinese University of Hong Kong,Shenzhen,Shenzhen,China
2.Tongji University,Shanghai,China
3.Shenzhen Research Institute of Big Data,Shenzhen,China
4.Southern University of Science and Technology,China

Cai，Zhijie,Chen，Tingwei,Zhou，Fujia,et al. FallDeWideo: Vision-Aided Wireless Sensing Dataset for Fall Detection with Commodity Wi-Fi Devices[C],2023:7-12.