Article ; Online: Do entrustment scales make a difference in the inter-rater reliability of the workplace-based assessment?
2022 Volume 27, Issue 1, Page(s) 2053401
Abstract: Background: A workplace-based assessment (WBA) is used to assess learners' competencies in their workplaces. Many workplace assessment tools are available and validated to assess various constructs. The implementation of workplace-based assessment ... ...
| Abstract | Background: A workplace-based assessment (WBA) is used to assess learners' competencies in their workplaces. Many workplace assessment tools are available and validated to assess various constructs. The implementation of workplace-based assessment requires proper training of the staff. Objective: This study aimed to explore the impact of staff training on WBA practices and evaluate the inter-rater reliability of these practices while using entrustment scales, performance descriptors, and personal judgment. Design: A quasi-experimental study, in which the staff members of the orthopedic department were invited to participate in a training program on the use of entrustment scales and assessment descriptors within the WBA tools. As a response to the training, subjective judgment was replaced by entrustment scales and performance descriptors in a trauma course offered by the orthopedic department. The inter-rater reliability of the WBA was evaluated using various rating scales. Results: The entrustment scales had higher inter-rater reliability of the assessment tools than performance descriptors and the personal judgment. Conclusion: The inter-rater reliability was highest when using entrustment scales for WBAs, which could indicate that the entrustment scales achieve good psychometric properties as regards consistency among different raters. Thus, they decrease the confounding effect of differences in assessors. They may also give a clearer image of the actual academic level of the learners. |
|---|---|
| MeSH term(s) | Clinical Competence ; Educational Measurement/methods ; Humans ; Psychometrics ; Reproducibility of Results ; Workplace |
| Language | English |
| Publishing date | 2022-03-29 |
| Publishing country | United States |
| Document type | Journal Article |
| ZDB-ID | 2052877-2 |
| ISSN | 1087-2981 ; 1087-2981 |
| ISSN (online) | 1087-2981 |
| ISSN | 1087-2981 |
| DOI | 10.1080/10872981.2022.2053401 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.