Article ; Online: Impact of possible errors in natural language processing-derived data on downstream epidemiologic analysis.
JAMIA open
2023 Volume 6, Issue 4, Page(s) ooad111
Abstract: Objective: To assess the impact of potential errors in natural language processing (NLP) on the results of epidemiologic studies.: Materials and methods: We utilized data from three outcomes research studies where the primary predictor variable was ... ...
Abstract | Objective: To assess the impact of potential errors in natural language processing (NLP) on the results of epidemiologic studies. Materials and methods: We utilized data from three outcomes research studies where the primary predictor variable was generated using NLP. For each of these studies, Monte Carlo simulations were applied to generate datasets simulating potential errors in NLP-derived variables. We subsequently fit the original regression models to these partially simulated datasets and compared the distribution of coefficient estimates to the original study results. Results: Among the four models evaluated, the mean change in the point estimate of the relationship between the predictor variable and the outcome ranged from -21.9% to 4.12%. In three of the four models, significance of this relationship was not eliminated in a single of the 500 simulations, and in one model it was eliminated in 12% of simulations. Mean changes in the estimates for confounder variables ranged from 0.27% to 2.27% and significance of the relationship was eliminated between 0% and 9.25% of the time. No variables underwent a shift in the direction of its interpretation. Discussion: Impact of simulated NLP errors on the results of epidemiologic studies was modest, with only small changes in effect estimates and no changes in the interpretation of the findings (direction and significance of association with the outcome) for either the NLP-generated variables or other variables in the models. Conclusion: NLP errors are unlikely to affect the results of studies that use NLP as the source of data. |
---|---|
Language | English |
Publishing date | 2023-12-27 |
Publishing country | United States |
Document type | Journal Article |
ISSN | 2574-2531 |
ISSN (online) | 2574-2531 |
DOI | 10.1093/jamiaopen/ooad111 |
Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.
Inter-library loan at ZB MED
Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.