3D Mitochondria Instance Segmentation with Spatio-Temporal TransformersShow others and affiliations
2023 (English)In: MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VIII, SPRINGER INTERNATIONAL PUBLISHING AG , 2023, Vol. 14227, p. 613-623Conference paper, Published paper (Refereed)
Abstract [en]
Accurate 3D mitochondria instance segmentation in electron microscopy (EM) is a challenging problem and serves as a prerequisite to empirically analyze their distributions and morphology. Most existing approaches employ 3D convolutions to obtain representative features. However, these convolution-based approaches struggle to effectively capture long-range dependencies in the volume mitochondria data, due to their limited local receptive field. To address this, we propose a hybrid encoder-decoder framework based on a split spatio-temporal attention module that efficiently computes spatial and temporal self-attentions in parallel, which are later fused through a deformable convolution. Further, we introduce a semantic foreground-background adversarial loss during training that aids in delineating the region of mitochondria instances from the background clutter. Our extensive experiments on three benchmarks, Lucchi, MitoEM-R and MitoEM-H, reveal the benefits of the proposed contributions achieving state-of-the-art results on all three datasets. Our code and models are available at https://github.com/ OmkarThawakar/STT- UNET.
Place, publisher, year, edition, pages
SPRINGER INTERNATIONAL PUBLISHING AG , 2023. Vol. 14227, p. 613-623
Series
Lecture Notes in Computer Science, ISSN 0302-9743
Keywords [en]
Electron Microscopy; Mitochondria instance segmentation; Spatio-Temporal Transformer; Hybrid CNN-Transformers
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:liu:diva-200121DOI: 10.1007/978-3-031-43993-3_59ISI: 001109637500059ISBN: 9783031439926 (print)ISBN: 9783031439933 (electronic)OAI: oai:DiVA.org:liu-200121DiVA, id: diva2:1827916
Conference
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Vancouver, CANADA, oct 08-12, 2023
2024-01-152024-01-152024-01-15