Beyond Functional Correctness: An Exploratory Study on the Time Efficiency of Programming Assignments

Tao, Yida; Chen, Wenyan; Ye, Qingyang; Zhao, Yao

10.1145/3639474.3640065

2024

ACM/IEEE 44th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)

2024 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: SOFTWARE ENGINEERING EDUCATION AND TRAINING, ICSE-SEET 2024

APR 14-20, 2024

null,Lisbon,PORTUGAL

1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES

ASSOC COMPUTING MACHINERY

["Practical programming assignments are critical parts of programming courses in Computer Science education. Students are expected to translate programming concepts learned from lectures into executable implementations that solve the tasks outlined in the assignments. These implementations are primarily assessed based on their functional correctness, ensuring that students' code produces the expected output when provided with specific inputs.","However, functional correctness is not the only metric that evaluates the quality of programs. Runtime efficiency is a metric that is less frequently evaluated in programming courses, yet it holds significant importance in the context of professional software development. To investigate this gap and its potential ramifications, we conducted a large-scale empirical study on the time efficiency of 250 programming assignments that are evaluated solely on functional correctness. The results demonstrate that students' programming assignments exhibit significant variance in terms of execution time. We further identified 27 recurring inefficient code patterns from these assignments, and observed that most of the inefficient patterns can be optimized by automated tools such as PMD, IntelliJ IDEA and ChatGPT. Our findings provide actionable guidelines for educators to enhance the organization and integration of code performance topics throughout the programming course curriculum."]

Programming Assignment Code Performance Tool Support

第一 ; 通讯

英语

CPCI-S ; EI

National Natural Science Foundation of China[62202213] ; SUSTech Undergraduate Teaching Quality and Education Reform Project[Y01271839]

Computer Science ; Education & Educational Research

Computer Science, Artificial Intelligence ; Computer Science, Software Engineering ; Education, Scientific Disciplines

WOS:001234855400031

Web of Science

Southern Univ Sci & Technol, Shenzhen, Peoples R China

Tao, Yida,Chen, Wenyan,Ye, Qingyang,et al. Beyond Functional Correctness: An Exploratory Study on the Time Efficiency of Programming Assignments[C]. 1601 Broadway, 10th Floor, NEW YORK, NY, UNITED STATES:ASSOC COMPUTING MACHINERY,2024.