Article ; Online: Self-supervised pseudo-colorizing of masked cells.
2023 Volume 18, Issue 8, Page(s) e0290561
Abstract: Self-supervised learning, which is strikingly referred to as the dark matter of intelligence, is gaining more attention in biomedical applications of deep learning. In this work, we introduce a novel self-supervision objective for the analysis of cells ... ...
| Abstract | Self-supervised learning, which is strikingly referred to as the dark matter of intelligence, is gaining more attention in biomedical applications of deep learning. In this work, we introduce a novel self-supervision objective for the analysis of cells in biomedical microscopy images. We propose training deep learning models to pseudo-colorize masked cells. We use a physics-informed pseudo-spectral colormap that is well suited for colorizing cell topology. Our experiments reveal that approximating semantic segmentation by pseudo-colorization is beneficial for subsequent fine-tuning on cell detection. Inspired by the recent success of masked image modeling, we additionally mask out cell parts and train to reconstruct these parts to further enrich the learned representations. We compare our pre-training method with self-supervised frameworks including contrastive learning (SimCLR), masked autoencoders (MAEs), and edge-based self-supervision. We build upon our previous work and train hybrid models for cell detection, which contain both convolutional and vision transformer modules. Our pre-training method can outperform SimCLR, MAE-like masked image modeling, and edge-based self-supervision when pre-training on a diverse set of six fluorescence microscopy datasets. Code is available at: https://github.com/roydenwa/pseudo-colorize-masked-cells. |
|---|---|
| MeSH term(s) | Humans ; Electric Power Supplies ; Intelligence ; Microscopy, Fluorescence ; Physics ; Self-Management |
| Language | English |
| Publishing date | 2023-08-24 |
| Publishing country | United States |
| Document type | Journal Article |
| ZDB-ID | 2267670-3 |
| ISSN | 1932-6203 ; 1932-6203 |
| ISSN (online) | 1932-6203 |
| ISSN | 1932-6203 |
| DOI | 10.1371/journal.pone.0290561 |
| Database | MEDical Literature Analysis and Retrieval System OnLINE |
More links
Kategorien
Order via subito
This service is chargeable due to the Delivery terms set by subito. Orders including an article and supplementary material will be classified as separate orders. In these cases, fees will be demanded for each order.