Artikel ; Online: The Composite Quality Score (CQS) as a trial appraisal tool: inter-rater reliability and rating time.
2021 Band 25, Heft 10, Seite(n) 6015–6023
Abstract: Objective: To establish the CQS inter-rater reliability and rating time and to compare both against that of the Jadad scale and Cochrane's Risk of Bias Tool (ROBT).: Material and methods: Four independent raters rated 45 trial reports. The inter- ... ...
Abstract | Objective: To establish the CQS inter-rater reliability and rating time and to compare both against that of the Jadad scale and Cochrane's Risk of Bias Tool (ROBT). Material and methods: Four independent raters rated 45 trial reports. The inter-rater reliability was established by use of the Brennan-Prediger coefficient (BPC). The coefficients were compared using the two-sample z-test. Secondary analysis included comparison of the inter-rater reliability of the randomization component of all tools, as well as of the allocation concealment component of the CQS to that of the ROBT. The mean rating time with standard deviation (SD) for each tool was determined using one-way repeated measures analysis of variance. Post hoc comparisons were made using the Tukey-Kramer adjustment for three pair-wise multiple comparisons. Results: The inter-rater reliability was significantly higher for the CQS (BPC, 95% CI: 0.95, 0.87-1.00) compared to Jadad (0.70, 0.58-0.82) (adjusted p = 0.0005) and most components of ROBT. The mean (SD) time to complete the CQS (4.0 (1.0) min) did not differ significantly from that of the Jadad scale 4.8 (1.1) min (adjusted p = 0.11), but was significantly shorter compared to that of the ROBT 15.3 (5.9) min (adjusted p < 0.0001). Conclusions: The results suggest the CQS to be a very reliable and fast trial appraisal tool. Clinical relevance The higher the inter-rater reliability, the higher the probability that trial results reflect therapeutic truth. The CQS will need to take further bias sources into consideration, in order to increase its utility. |
---|---|
Mesh-Begriff(e) | Humans ; Observer Variation ; Reproducibility of Results |
Sprache | Englisch |
Erscheinungsdatum | 2021-08-11 |
Erscheinungsland | Germany |
Dokumenttyp | Journal Article |
ZDB-ID | 1364490-7 |
ISSN | 1436-3771 ; 1432-6981 |
ISSN (online) | 1436-3771 |
ISSN | 1432-6981 |
DOI | 10.1007/s00784-021-04099-w |
Datenquelle | MEDical Literature Analysis and Retrieval System OnLINE |
Volltext online
Zusatzmaterialien
Kategorien
Verfügbar in ZB MED Köln/Königswinter
Zs.A 4788: Hefte anzeigen | Standort: Je nach Verfügbarkeit (siehe Angabe bei Bestand) bis Jg. 1994: Bestellungen von Artikeln über das Online-Bestellformular Jg. 1995 - 2021: Lesesall (2.OG) ab Jg. 2022: Lesesaal (EG) |
Über subito bestellen
Dieser Service ist kostenpflichtig (siehe Lieferbedingungen von subito). Bestellungen, die einen Artikel nebst Supplementary Material umfassen, werden grundsätzlich wie mehrfache Bestellungen bearbeitet. Gebühren fallen in diesen Fällen für jede einzelne Bestellung an.