Article ; Online: Image based prognosis in head and neck cancer using convolutional neural networks: a case study in reproducibility and optimization.
2023 Volume 13, Issue 1, Page(s) 18176
Abstract: In the past decade, there has been a sharp increase in publications describing applications of convolutional neural networks (CNNs) in medical image analysis. However, recent reviews have warned of the lack of reproducibility of most such studies, which ... ...
| Abstract | In the past decade, there has been a sharp increase in publications describing applications of convolutional neural networks (CNNs) in medical image analysis. However, recent reviews have warned of the lack of reproducibility of most such studies, which has impeded closer examination of the models and, in turn, their implementation in healthcare. On the other hand, the performance of these models is highly dependent on decisions on architecture and image pre-processing. In this work, we assess the reproducibility of three studies that use CNNs for head and neck cancer outcome prediction by attempting to reproduce the published results. In addition, we propose a new network structure and assess the impact of image pre-processing and model selection criteria on performance. We used two publicly available datasets: one with 298 patients for training and validation and another with 137 patients from a different institute for testing. All three studies failed to report elements required to reproduce their results thoroughly, mainly the image pre-processing steps and the random seed. Our model either outperforms or achieves similar performance to the existing models with considerably fewer parameters. We also observed that the pre-processing efforts significantly impact the model's performance and that some model selection criteria may lead to suboptimal models. Although there have been improvements in the reproducibility of deep learning models, our work suggests that wider implementation of reporting standards is required to avoid a reproducibility crisis. |
|---|---|
| MeSH term(s) | Humans ; Reproducibility of Results ; Neural Networks, Computer ; Head and Neck Neoplasms/diagnostic imaging ; Image Processing, Computer-Assisted/methods ; Prognosis |
| Language | English |
| Publishing date | 2023-10-24 |
| Publishing country | England |
| Document type | Journal Article ; Research Support, Non-U.S. Gov't |
| ZDB-ID | 2615211-3 |
| ISSN | 2045-2322 ; 2045-2322 |
| ISSN (online) | 2045-2322 |
| ISSN | 2045-2322 |
| DOI | 10.1038/s41598-023-45486-5 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.