How Do API selections affect the runtime performance of data analytics tasks?

Tao，Yida1; Tang，Shan1; Liu，Yepang2; Xu，Zhiwu1; Qin，Shengchao3

10.1109/ASE.2019.00067

2019-11-01

1938-4300

978-1-7281-2509-1

Proceedings - 2019 34th IEEE/ACM International Conference on Automated Software Engineering, ASE 2019

665-668

11-15 Nov. 2019

San Diego, CA, United states

1515 BROADWAY, NEW YORK, NY 10036-9998 USA

Institute of Electrical and Electronics Engineers Inc.

As data volume and complexity grow at an unprecedented rate, the performance of data analytics programs is becoming a major concern for developers. We observed that developers sometimes use alternative data analytics APIs to improve program runtime performance while preserving functional equivalence. However, little is known on the characteristics and performance attributes of alternative data analytics APIs. In this paper, we propose a novel approach to extracting alternative implementations that invoke different data analytics APIs to solve the same tasks. A key appeal of our approach is that it exploits the comparative structures in Stack Overflow discussions to discover programming alternatives. We show that our approach is promising, as 86% of the extracted code pairs were validated as true alternative implementations. In over 20% of these pairs, the faster implementation was reported to achieve a 10x or more speedup over its slower alternative. We hope that our study offers a new perspective of API recommendation and motivates future research on optimizing data analytics programs.

API selection Data analytics Performance optimization Stack Overflow

其他

英语

EI ; CPCI-S

National Natural Science Foundation of China[61772347][61972260][61932021][61802164]

Automation & Control Systems ; Computer Science ; Engineering

Automation & Control Systems ; Computer Science, Software Engineering ; Engineering, Electrical & Electronic

WOS:000533303400061

20200608133329

Software engineering

Computer Programming:723.1

2-s2.0-85078873379

Scopus

1.College of Computer Science and Software Engineering,Shenzhen University,Shenzhen,China
2.Department of Computer Science &engineering,Southern University of Science and Technology,Shenzhen,China
3.School of Computing &digital Technologies,Teesside University,United Kingdom

Tao，Yida,Tang，Shan,Liu，Yepang,et al. How Do API selections affect the runtime performance of data analytics tasks?[C]. 1515 BROADWAY, NEW YORK, NY 10036-9998 USA:Institute of Electrical and Electronics Engineers Inc.,2019:665-668.