3D Mitochondria Instance Segmentation with Spatio-Temporal TransformersVise andre og tillknytning
2023 (engelsk)Inngår i: MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VIII, SPRINGER INTERNATIONAL PUBLISHING AG , 2023, Vol. 14227, s. 613-623Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]
Accurate 3D mitochondria instance segmentation in electron microscopy (EM) is a challenging problem and serves as a prerequisite to empirically analyze their distributions and morphology. Most existing approaches employ 3D convolutions to obtain representative features. However, these convolution-based approaches struggle to effectively capture long-range dependencies in the volume mitochondria data, due to their limited local receptive field. To address this, we propose a hybrid encoder-decoder framework based on a split spatio-temporal attention module that efficiently computes spatial and temporal self-attentions in parallel, which are later fused through a deformable convolution. Further, we introduce a semantic foreground-background adversarial loss during training that aids in delineating the region of mitochondria instances from the background clutter. Our extensive experiments on three benchmarks, Lucchi, MitoEM-R and MitoEM-H, reveal the benefits of the proposed contributions achieving state-of-the-art results on all three datasets. Our code and models are available at https://github.com/ OmkarThawakar/STT- UNET.
sted, utgiver, år, opplag, sider
SPRINGER INTERNATIONAL PUBLISHING AG , 2023. Vol. 14227, s. 613-623
Serie
Lecture Notes in Computer Science, ISSN 0302-9743
Emneord [en]
Electron Microscopy; Mitochondria instance segmentation; Spatio-Temporal Transformer; Hybrid CNN-Transformers
HSV kategori
Identifikatorer
URN: urn:nbn:se:liu:diva-200121DOI: 10.1007/978-3-031-43993-3_59ISI: 001109637500059ISBN: 9783031439926 (tryckt)ISBN: 9783031439933 (digital)OAI: oai:DiVA.org:liu-200121DiVA, id: diva2:1827916
Konferanse
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Vancouver, CANADA, oct 08-12, 2023
2024-01-152024-01-152024-01-15