Article ; Online: A reinforcement learning approach for VQA validation: An application to diabetic macular edema grading.
2023 Volume 87, Page(s) 102822
Abstract: Recent advances in machine learning models have greatly increased the performance of automated methods in medical image analysis. However, the internal functioning of such models is largely hidden, which hinders their integration in clinical practice. ... ...
| Abstract | Recent advances in machine learning models have greatly increased the performance of automated methods in medical image analysis. However, the internal functioning of such models is largely hidden, which hinders their integration in clinical practice. Explainability and trust are viewed as important aspects of modern methods, for the latter's widespread use in clinical communities. As such, validation of machine learning models represents an important aspect and yet, most methods are only validated in a limited way. In this work, we focus on providing a richer and more appropriate validation approach for highly powerful Visual Question Answering (VQA) algorithms. To better understand the performance of these methods, which answer arbitrary questions related to images, this work focuses on an automatic visual Turing test (VTT). That is, we propose an automatic adaptive questioning method, that aims to expose the reasoning behavior of a VQA algorithm. Specifically, we introduce a reinforcement learning (RL) agent that observes the history of previously asked questions, and uses it to select the next question to pose. We demonstrate our approach in the context of evaluating algorithms that automatically answer questions related to diabetic macular edema (DME) grading. The experiments show that such an agent has similar behavior to a clinician, whereby asking questions that are relevant to key clinical concepts. |
|---|---|
| MeSH term(s) | Humans ; Diabetic Retinopathy/diagnostic imaging ; Macular Edema/diagnostic imaging ; Algorithms ; Machine Learning ; Diabetes Mellitus |
| Language | English |
| Publishing date | 2023-04-26 |
| Publishing country | Netherlands |
| Document type | Journal Article ; Research Support, Non-U.S. Gov't |
| ZDB-ID | 1356436-5 |
| ISSN | 1361-8423 ; 1361-8431 ; 1361-8415 |
| ISSN (online) | 1361-8423 ; 1361-8431 |
| ISSN | 1361-8415 |
| DOI | 10.1016/j.media.2023.102822 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
Full text online
More links
Kategorien
In stock of ZB MED Cologne/Königswinter
| Zs.A 5206: Show issues | Location: Je nach Verfügbarkeit (siehe Angabe bei Bestand) bis Jg. 1994: Bestellungen von Artikeln über das Online-Bestellformular Jg. 1995 - 2021: Lesesall (2.OG) ab Jg. 2022: Lesesaal (EG) |
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.