FlowShader: A generalized framework for GPU-accelerated VNF flow processing

Yi，Xiaodong1; Wang，Junjie1; Duan，Jin GPU2; Bai，Wei3; Wu，Chuan1; Xiong，Yongqiang3; Han，Dongsu4

10.1109/ICNP.2019.8888129

2019-10-01

1092-1648

978-1-7281-2701-9

Proceedings - International Conference on Network Protocols, ICNP

2019-October

1-12

8-10 Oct. 2019

Chicago, IL, United states

10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA

IEEE Computer Society

GPU acceleration has been widely investigated for packet processing in virtual network functions (NFs), but not for L7 flow-processing NFs. In L7 NFs, reassembled TCP messages of the same flow should be processed in order in the same processing thread, and the uneven sizes among flows pose a major challenge for full realization of GPU's parallel computation power.To exploit GPUs for L7 NF processing, this paper presents FlowShader, a GPU acceleration framework to achieve both high generality and throughput even under skewed flow size distributions. We carefully design an efficient scheduling algorithm that fully exploits available GPU and CPU capacities; in particular, we dISPatch large flows which seriously break up the size balance to CPU and the rest of flows to GPU. Furthermore, FlowShader allows similar NF logic (as CPU-based NFs) to run on individual threads in a GPU, which is more generalized and easy to take on as compared to redesigning an NF for operation parallelism on GPU. We implemented a number of L7 flow processing NFs based on FlowShader. Evaluations are conducted under both synthetic and real-world traffic traces and results show that the throughput achieved by FlowShader is up to 6x that of the CPU-only baseline and 3x of the GPU-only design.

Graphics processing units Noise measurement Message systems Throughput Acceleration Parallel processing Central Processing Unit

其他

英语

EI ; CPCI-S

[HKU 17204715]

Telecommunications

Telecommunications

WOS:000556143800069

20194707700470

Computation theory ; Internet protocols ; Program processors ; Scheduling algorithms

Computer Theory, Includes Formal Logic, Automata Theory, Switching Theory, Programming Theory:721.1 ; Computer Software, Data Handling and Applications:723

2-s2.0-85074996569

Scopus

1.University of Hong Kong,Hong Kong
2.Southern University of Science and Technology,China
3.Microsoft Research,
4.Korea Advanced Institute of Science and Technology,South Korea

Yi，Xiaodong,Wang，Junjie,Duan，Jin GPU,et al. FlowShader: A generalized framework for GPU-accelerated VNF flow processing[C]. 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA:IEEE Computer Society,2019:1-12.