Gemini: a Real-time Video Analytics System with Dual Computing Resource Control

Rui Lu1; Chuang Hu2; Dan Wang1; Jin Zhang3

10.1109/SEC54971.2022.00020

2022

IEEE/ACM 7th Symposium on Edge Computing (SEC)

978-1-6654-8612-5

2022 IEEE/ACM 7th Symposium on Edge Computing (SEC)

162-174

5-8 Dec. 2022

Seattle, WA, USA

10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA

IEEE COMPUTER SOC

["Edge-side real-time video analytics systems recognize spatial or temporal events (e.g., vehicle counting) in a video stream. To meet the delay requirement, existing systems in smart edge cameras conduct video preprocessing to filter out unnecessary frames and model inference using appropriately selected neural network (NN) models. Video preprocessing is instruction-intensive computing (IIC) and executed by the CPU of the edge camera, and model inference is data-intensive computing (DIC) and executed by the GPU of the edge camera.","In this paper, we show that the analytics accuracy of existing systems can largely vary in fields. The root cause is that video analytics applications have different contents, which result in dynamic IIC and DIC workloads. Unfortunately, intelligent cameras in fields have fixed CPU and GPU resources and cannot effectively adapt to workload dynamics. We develop Gemini, a new real-time video analytics system enhanced by a dualimage FPGA. The newly developed dual-image FPGAs can be pre-configured with two FPGA images with a key advantage of negligible image switching time. We thus pre-configure one CPU image and one GPU image and elastically multiplex the dual CPU-GPU resources in the time dimension. The Gemini system design requires both hardware and software revisions. We overcame a challenge that the application development on different dual-image FPGAs is hardware-dependent. We develop a new abstraction of hardware functions to make the Gemini system hardware-agnostic. It is also a challenge to adapt to the dynamic workloads and optimize video analytics accuracy. We develop a bandit learning approach to capture content dynamics and conduct dual computing resource control. We implement Gemini and show that Gemini can improve the analytics accuracy to 90.35%. We further evaluate Gemini by a case study where we use Gemini to support an intrusion detection application, and Gemini shows consistent high analytics accuracy."]

Visual analytics Computational modeling Heuristic algorithms Graphics processing units Streaming media Cameras Real-time systems

其他

英语

CPCI-S

National Key R&D Program of China["2020YFE0200500","GRF 15210119","15209220","15200321","ITF-ITSP ITS/070/19FP","CRF C5026-18G","C5018-20G","PolyU 1-ZVPZ"]

Computer Science

Computer Science, Hardware & Architecture ; Computer Science, Information Systems ; Computer Science, Theory & Methods

WOS:000918607200013

IEEE

1.The Hong Kong Polytechnic University
2.Wuhan University
3.Southern University of Science and Technology

Rui Lu,Chuang Hu,Dan Wang,et al. Gemini: a Real-time Video Analytics System with Dual Computing Resource Control[C]. 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA:IEEE COMPUTER SOC,2022:162-174.