Evaluating ChatGPT-4.0's data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R

Huang, Yeen1,7; Wu, Ruipeng2,3,4; He, Juntao5; Xiang, Yingping6

2024

10.7189/jogh.14.04070

JOURNAL OF GLOBAL HEALTH   影响因子和分区

2047-2978

2047-2986

Background OpenAI's Chat Generative Pre -trained Transformer 4.0 (ChatGPT-4), an emerging artificial intelligence (AI) -based large language model (LLM), has been receiving increasing attention from the medical research community for its innovative 'Data Analyst' feature. We aimed to compare the capabilities of ChatGPT-4 against traditional biostatistical software (i.e. SAS, SPSS, R) in statistically analysing epidemiological research data. Methods We used a data set from the China Health and Nutrition Survey, comprising 9317 participants and 29 variables (e.g. gender, age, educational level, marital status, income, occupation, weekly working hours, survival status). Two researchers independently evaluated the data analysis capabilities of GPT-4's 'Data Analyst' feature against SAS, SPSS, and R across three commonly used epidemiological analysis methods: Descriptive statistics, intergroup analysis, and correlation analysis. We used an internally developed evaluation scale to assess and compare the consistency of results, analytical efficiency of coding or operations, user -friendliness, and overall performance between ChatGPT-4, SAS, SPSS, and R. Results In descriptive statistics, ChatGPT-4 showed high consistency of results, greater analytical efficiency of code or operations, and more intuitive user -friendliness compared to SAS, SPSS, and R. In intergroup comparisons and correlational analyses, despite minor discrepancies in statistical outcomes for certain analysis tasks with SAS, SPSS, and R, ChatGPT-4 maintained high analytical efficiency and exceptional user -friendliness. Thus, employing ChatGPT-4 can significantly lower the operational threshold for conducting epidemiological data analysis while maintaining consistency with traditional biostatistical software's outcome, requiring only specific, clear analysis instructions without any additional operations or code writing. Conclusions We found ChatGPT-4 to be a powerful auxiliary tool for statistical analysis in epidemiological research. However, it showed limitations in result consistency and in applying more advanced statistical methods. Therefore, we advocate for the use of ChatGPT-4 in supporting researchers with intermediate experience in data analysis. With AI technologies like LLMs advancing rapidly, their integration with data analysis platforms promises to lower operational barriers, thereby enabling researchers to dedicate greater focus to the nuanced interpretation of analysis results. This development is likely to significantly advance epidemiological and medical research.

SCI ; SSCI

英语

第一 ; 通讯

Shenzhen Science and Technology Program[JCYJ20220531091212028]

Public, Environmental & Occupational Health

Public, Environmental & Occupational Health

WOS:001194538100001

INT SOC GLOBAL HEALTH

Web of Science

1.Southern Univ Sci & Technol, Sch Publ Hlth & Emergency Management, Shenzhen, Guangdong, Peoples R China
2.Xizang Minzu Univ, Sch Med, Key Lab Mol Genet Mech & Intervent Res, High Altitude Dis Tibet Autonomous Reg, Xianyang, Xizang, Peoples R China
3.Xizang Minzu Univ, Sch Med, Key Lab High Altitude Hypoxia Environm & Life Hlth, Xianyang, Xizang, Peoples R China
4.Southeast Univ, Sch Publ Hlth, Dept Nutr & Food Hyg, Key Lab Environm Med & Engn,Minist Educ, Nanjing, Jiangsu, Peoples R China
5.Shenzhen Prevent & Treatment Ctr Occupat Dis, Phys & Chem Testing Inst, Shenzhen, Guangdong, Peoples R China
6.Shenzhen Prevent & Treatment Ctr Occupat Dis, Occupat Hazard Assessment Inst, Shenzhen, Guangdong, Peoples R China
7.Southern Univ Sci & Technol, Sch Publ Hlth & Emergency Management, 1088 Xueyuan Ave, Shenzhen 518055, Peoples R China

Huang, Yeen,Wu, Ruipeng,He, Juntao,et al. Evaluating ChatGPT-4.0's data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R[J]. JOURNAL OF GLOBAL HEALTH,2024,14.

Huang, Yeen,Wu, Ruipeng,He, Juntao,&Xiang, Yingping.(2024).Evaluating ChatGPT-4.0's data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R.JOURNAL OF GLOBAL HEALTH,14.

Huang, Yeen,et al."Evaluating ChatGPT-4.0's data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R".JOURNAL OF GLOBAL HEALTH 14(2024).