Article ; Online: Clinical relevance of the ROC and free-response paradigms for comparing imaging system efficacies.
Radiation protection dosimetry
2010 Volume 139, Issue 1-3, Page(s) 37–41
Abstract: Observer performance studies are widely used to assess medical imaging systems. Unlike technical/engineering measurements observer performance include the entire imaging chain and the radiologist. However, the widely used receiver operating ... ...
| Abstract | Observer performance studies are widely used to assess medical imaging systems. Unlike technical/engineering measurements observer performance include the entire imaging chain and the radiologist. However, the widely used receiver operating characteristic (ROC) method ignores lesion localisation information. The free-response ROC (FROC) method uses the location information to appropriately reward or penalise correct or incorrect localisations, respectively. This paper describes a method for improving the clinical relevance of FROC studies. The method consists of assigning appropriate risk values to the different lesions that may be present on a single image. A high-risk lesion is one that is critical to detect and act upon, and is assigned a higher risk value than a low-risk lesion, one that is relatively innocuous. Instead of simply counting the number of lesions that are detected, as is done in conventional FROC analysis, a risk-weighted count is used. This has the advantage of rewarding detections of high-risk lesions commensurately more than detections of lower risk lesions. Simulations were used to demonstrate that the new method, termed case-based analysis, results in a higher figure of merit for an expert who detects more high-risk lesions than a naive observer who detects more low-risk lesions, even though both detect the same total number of lesions. Conventional free-response analysis is unable to distinguish between the two types of observers. This paper also comments on the issue of clinical relevance of ROC analysis vs. FROC for tasks that involve lesion localisation. |
|---|---|
| MeSH term(s) | Algorithms ; Image Enhancement/methods ; Image Interpretation, Computer-Assisted/methods ; ROC Curve ; Reproducibility of Results ; Sensitivity and Specificity |
| Language | English |
| Publishing date | 2010-02-05 |
| Publishing country | England |
| Document type | Comparative Study ; Journal Article ; Research Support, N.I.H., Extramural |
| ZDB-ID | 225912-6 |
| ISSN | 1742-3406 ; 0144-8420 |
| ISSN (online) | 1742-3406 |
| ISSN | 0144-8420 |
| DOI | 10.1093/rpd/ncq017 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
In stock of ZB MED Cologne/Königswinter
| Zs.A 2009: Show issues | Location: Je nach Verfügbarkeit (siehe Angabe bei Bestand) bis Jg. 1994: Bestellungen von Artikeln über das Online-Bestellformular Jg. 1995 - 2021: Lesesall (1.OG) ab Jg. 2022: Lesesaal (EG) |
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.