liu.seSearch for publications in DiVA
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
3D Mitochondria Instance Segmentation with Spatio-Temporal Transformers
MBZUAI, U Arab Emirates.
MBZUAI, U Arab Emirates; Aalto Univ, Finland.
Aalto Univ, Finland.
Weizmann Inst Sci, Israel.
Show others and affiliations
2023 (English)In: MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VIII, SPRINGER INTERNATIONAL PUBLISHING AG , 2023, Vol. 14227, p. 613-623Conference paper, Published paper (Refereed)
Abstract [en]

Accurate 3D mitochondria instance segmentation in electron microscopy (EM) is a challenging problem and serves as a prerequisite to empirically analyze their distributions and morphology. Most existing approaches employ 3D convolutions to obtain representative features. However, these convolution-based approaches struggle to effectively capture long-range dependencies in the volume mitochondria data, due to their limited local receptive field. To address this, we propose a hybrid encoder-decoder framework based on a split spatio-temporal attention module that efficiently computes spatial and temporal self-attentions in parallel, which are later fused through a deformable convolution. Further, we introduce a semantic foreground-background adversarial loss during training that aids in delineating the region of mitochondria instances from the background clutter. Our extensive experiments on three benchmarks, Lucchi, MitoEM-R and MitoEM-H, reveal the benefits of the proposed contributions achieving state-of-the-art results on all three datasets. Our code and models are available at https://github.com/ OmkarThawakar/STT- UNET.

Place, publisher, year, edition, pages
SPRINGER INTERNATIONAL PUBLISHING AG , 2023. Vol. 14227, p. 613-623
Series
Lecture Notes in Computer Science, ISSN 0302-9743
Keywords [en]
Electron Microscopy; Mitochondria instance segmentation; Spatio-Temporal Transformer; Hybrid CNN-Transformers
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:liu:diva-200121DOI: 10.1007/978-3-031-43993-3_59ISI: 001109637500059ISBN: 9783031439926 (print)ISBN: 9783031439933 (electronic)OAI: oai:DiVA.org:liu-200121DiVA, id: diva2:1827916
Conference
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Vancouver, CANADA, oct 08-12, 2023
Available from: 2024-01-15 Created: 2024-01-15 Last updated: 2024-01-15

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Search in DiVA

By author/editor
Khan, Fahad
By organisation
Computer VisionFaculty of Science & Engineering
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 48 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf