Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

Yang, Nan1,2; Liu, Hui2,3; Zhao, Wei4; Pan, Yang5; Lyu, Xiangzheng6; Hao, Xiuyuan7; Liu, Xiaoqing8; Qi, Wen'an9; Chen, Tong10; Wang, Xiaoqin11; Zhang, Boheng12; Zhang, Weishe13; Li, Qiu14; Xu, Dong15; Gao, Xinghua16; Jin, Yinghui17; Sun, Feng18; Meng, Wenbo19; Li, Guobao20; Wu, Qijun21; Chen, Ze1; Wang, Xu22; Estill, Janne1,2; Norris, Susan L.23; Du, Liang24; Chen, Yaolong1,25,26; Wei, Junmin27

2023-06-20

10.1097/CM9.0000000000002713

CHINESE MEDICAL JOURNAL   影响因子和分区

0366-6999

2542-5641

["Background: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability.","Methods: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability.","Results: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's alpha coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min.","Conclusion: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines."]

Practice guideline Evidence-based practice Quality control

SCI

英语

其他

China Scholarship Council[202206180006]

General & Internal Medicine

Medicine, General & Internal

WOS:001048832200007

LIPPINCOTT WILLIAMS & WILKINS

CLINICAL MEDICINE

Web of Science

1.Lanzhou Univ, Sch Basic Med Sci, Evidence Based Med Ctr, 199 Donggang W Rd, Lanzhou 730000, Gansu, Peoples R China
2.Univ Geneva, Inst Global Hlth, CH-1202 Geneva, Switzerland
3.Lanzhou Univ, Sch Publ Hlth, Lanzhou 730000, Gansu, Peoples R China
4.Chinese Med Assoc Publishing House, Editor In Chief Off, Beijing 100052, Peoples R China
5.Chinese Med Assoc Publishing House, Dept Mkt, Beijing 100052, Peoples R China
6.Chinese Med Assoc Publishing House, Editorial Dept, Natl Med Journal China, Beijing 100052, Peoples R China
7.Chinese Med Assoc Publishing House, Editorial Dept, Chinese Med Journal, Beijing 100052, Peoples R China
8.Chinese Acad Med Sci & Peking Union Med Coll, Div Infect Dis, State Key Lab Complex Severe & Rare Dis, Dept Internal Med,Peking Union Med Coll Hosp, Beijing 100730, Peoples R China
9.Chinese Med Assoc Publishing House, Editorial Off Digital Med & Hlth, Beijing 100052, Peoples R China
10.Fudan Univ, Huashan Hosp, Dept Hematol, Shanghai 200040, Peoples R China
11.Fudan Univ, Evidence Based Med Ctr, Shanghai 200032, Peoples R China
12.Fudan Univ, Zhongshan Hosp Xiamen, Xiamen Clin Res Ctr Canc Therapy, Dept Hepat Oncol, Xiamen 361015, Fujian, Peoples R China
13.Cent South Univ, Xiangya Hosp, Dept Obstet, Changsha 410008, Hunan, Peoples R China
14.Chongqing Med Univ, Key Lab Child Dev & Disorders, Chongqing Key Lab Pediat,Natl Clin Res Ctr Child, Dept Nephrol,Childrens Hosp,Minist Educ, Chongqing 400014, Peoples R China
15.Southern Med Univ SMU, SMU Inst Global Hlth SIGHT, Sch Hlth Management & Dermatol Hosp, Guangzhou 510515, Guangdong, Peoples R China
16.China Med Univ, Dept Dermatol, Hosp 1, Shenyang 110001, Liaoning, Peoples R China
17.Wuhan Univ, Ctr Evidence Based & Translat Med, Zhongnan Hosp, Wuhan 430071, Hubei, Peoples R China
18.Peking Univ, Sch Publ Hlth, Beijing 100191, Peoples R China
19.Lanzhou Univ, Dept Gen Surg, Hosp 1, Lanzhou 730000, Gansu, Peoples R China
20.Southern Univ Sci & Technol, Shenzhen Peoples Hosp 3, Affiliated Hosp 2, Dept Lung Dis, Shenzhen 518112, Guangdong, Peoples R China
21.China Med Univ, Dept Clin Epidemiol, Shengjing Hosp, Shenyang 110004, Liaoning, Peoples R China
22.Chongqing Med Univ, Chevidence Lab Child & Adolescent Hlth, Childrens Hosp, Chongqing 400014, Peoples R China
23.Oregon Hlth & Sci Univ, Dept Med Informat & Clin Epidemiol, Portland, OR 97239 USA
24.Sichuan Univ, West China Hosp, Chinese Evidence Based Med Ctr, Chengdu 610041, Sichuan, Peoples R China
25.Lanzhou Univ, Chinese Acad Med Sci, Sch Basic Med Sci, Res Unit Evidence Based Evaluat & Guidelines 2021, Lanzhou 730000, Gansu, Peoples R China
26.Chinese Med Assoc Publishing House, Guidelines & Stand Res Ctr, Beijing 100052, Peoples R China
27.Chinese Med Assoc Publishing House, 69 Dongheyan St, Beijing 100052, Peoples R China

Yang, Nan,Liu, Hui,Zhao, Wei,et al. Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines[J]. CHINESE MEDICAL JOURNAL,2023,136(12).

Yang, Nan.,Liu, Hui.,Zhao, Wei.,Pan, Yang.,Lyu, Xiangzheng.,...&Wei, Junmin.(2023).Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines.CHINESE MEDICAL JOURNAL,136(12).

Yang, Nan,et al."Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines".CHINESE MEDICAL JOURNAL 136.12(2023).