A scalable real-time computer vision system for student posture detection in smart classrooms

Huang, Jiawei; Zhou, Ding

2023-11-01

10.1007/s10639-023-12365-5

EDUCATION AND INFORMATION TECHNOLOGIES   影响因子和分区

1360-2357

1573-7608

Technological advancements have ushered in a new era of global educational development. Artificial Intelligence (AI) holds the potential to enhance teaching effectiveness and foster educational innovation. By utilizing student posture as a proxy, computer vision technology can accurately gauge levels of student engagement. While previous efforts have focused on refining posture classification models, this study uniquely addresses the comprehensive implementation of a real-time posture detection workflow, encompassing software, hardware, and network aspects. The proposed posture detection system leverages surveillance cameras equipped with cutting-edge computer vision technology, specifically employing the Open Visual Inference & Neural Network Optimization (Open VINO) model for precise student posture detection. Data transmission is facilitated using the Message Queuing Telemetry Transport (MQTT) protocol, effectively establishing a seamless posture detection workflow within the classroom setting. To validate the system, video recordings from a real teaching environment (a fifth-grade class in the Chinese compulsory education system) were analyzed, resulting in posture classifications with impressive accuracies of 0.933 for standing, 0.772 for sitting, and 0.959 for hand-raising. Achieving a frame processing time ranging from 109 to 758 milliseconds, the system efficiently delivers real-time posture data to educators. Consequently, the posture detection system developed in this study possesses the capability to intelligently monitor student postures in the classroom, with the potential to enhance teaching quality in smart classrooms.

Smart classroom Student engagement Posture detection Computer vision

SSCI

英语

第一 ; 通讯

Centre for Future Education Research at the Southern University of Science and Technology[FE22Z004]

Education & Educational Research

Education & Educational Research

WOS:001107671900002

SPRINGER

2-s2.0-85177670256

Web of Science

Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen 518055, Peoples R China

Huang, Jiawei,Zhou, Ding. A scalable real-time computer vision system for student posture detection in smart classrooms[J]. EDUCATION AND INFORMATION TECHNOLOGIES,2023,29(1):917-937.

Huang, Jiawei,&Zhou, Ding.(2023).A scalable real-time computer vision system for student posture detection in smart classrooms.EDUCATION AND INFORMATION TECHNOLOGIES,29(1),917-937.

Huang, Jiawei,et al."A scalable real-time computer vision system for student posture detection in smart classrooms".EDUCATION AND INFORMATION TECHNOLOGIES 29.1(2023):917-937.