Facial Landmark based BMI Analysis for Pervasive Health Informatics

Yujin Wang1; Zhi Jin2; Jia Huang3; Hongzhou Lu3; Wenjin Wang4

10.1109/EMBC40787.2023.10340239

2023

45th Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society (EMBC)

2375-7477

1558-4615

979-8-3503-2448-8

2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

1-5

24-27 July 2023

Sydney, Australia

345 E 47TH ST, NEW YORK, NY 10017 USA

IEEE

Body Mass Index (BMI), calculated based on the ratio between a person's height and weight, is a widely used metric for body weight or fatness. In this paper, we investigate the potential of face image-based BMI estimation using an RGB camera. We proposed a simple yet highly reproducible image processing framework that converts an input face image into a BMI value or obesity class (underweight, normal and overweight). In this framework, we explored the options of using 2D or 3D facial landmark models, view angle correction in 2D and 3D, different choices for facial feature extraction (landmark distances or coordinates), and different prediction models (regression or classification) based on shallow machine learning techniques. Our framework was thoroughly validated on two public datasets. The insights of this measurement are discussed, as well as the challenges and limitations, to increase the understanding for future improvement of camera-based BMI estimation. The source code of this study is available at https://github.com/hxfj/Facial-Landmark-based-BMI-Analysis.git.

Solid modeling Obesity Three-dimensional displays Source coding Estimation Predictive models Feature extraction

其他

英语

EI ; CPCI-S

National Key R&D Program of China[2022YFC2407800]

Computer Science ; Engineering

Computer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Engineering, Biomedical

WOS:001133788301063

20240215361336

Image processing ; Learning systems ; Medical informatics ; Nutrition

Health Care:461.7 ; Data Processing and Image Processing:723.2 ; Computer Applications:723.5 ; Photographic Equipment:742.2

IEEE

1.School of Intelligent Systems Since and Engineering, Jinan University, China
2.School of Intelligent Systems Engineering, Sun Yat-Sen University, China
3.Intensive Care Unit, The Third People’s Hospital of Shenzhen, China
4.Department of Biomedical Engineering, Southern University of Science and Technology, China

Yujin Wang,Zhi Jin,Jia Huang,et al. Facial Landmark based BMI Analysis for Pervasive Health Informatics[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2023:1-5.