TINet: Multi-dimensional Traffic Data Imputation via Transformer Network

Song，Xiaozhuang; Ye，Yongchao; Yu，James J.Q.

10.1007/978-3-030-86362-3_25

2021

0302-9743

1611-3349

LECT NOTES ARTIF INT

12891

306-317

Missing traffic data problem has a significant negative impact for data-driven applications in Intelligent Transportation Systems (ITS). However, existing models mainly focus on the imputation results under Missing Completely At Random (MCAR) task, and there is a considerable difference between MCAR with the situation encountered in real life. Furthermore, some existing state-of-the-art models can be vulnerable when dealing with other imputation tasks like block miss imputation. In this paper, we propose a novel deep learning model TINet for missing traffic data imputation problems. TINet uses the self-attention mechanism to dynamically adjust the weight for each entries in the input data. This architecture effectively avoids the limitation of the Fully Connected Network (FCN). Furthermore, TINet uses multi-dimensional embedding for representing data’s spatial-temporal positional information, which alleviates the computation and memory requirements of attention-based model for multi-dimentional data. We evaluate TINet with other baselines on two real-world datasets. Different from the previous work that only employs MCAR for testing, our experiment also tested the performance of models on the Block Miss At Random (BMAR) tasks. The results show that TINet outperforms baseline imputation models for both MCAR and BMAR tasks with different missing rates.

Attention network Data imputation Data mining

第一

英语

CPCI-S ; EI

Computer Science

Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods

WOS:000711965200025

20213910941674

Deep learning ; Intelligent systems ; Intelligent vehicle highway systems

Highway Systems:406.1 ; Ergonomics and Human Factors Engineering:461.4 ; Data Processing and Image Processing:723.2 ; Artificial Intelligence:723.4 ; Computer Applications:723.5

2-s2.0-85115445948

Scopus

Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation,Department of Computer Science and Engineering,Southern University of Science and Technology,Shenzhen,518055,China

Song，Xiaozhuang,Ye，Yongchao,Yu，James J.Q.. TINet: Multi-dimensional Traffic Data Imputation via Transformer Network[C],2021:306-317.