Accelerated MRI Reconstruction via Dynamic Deformable Alignment Based TransformerShow others and affiliations
2024 (English)In: MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT I, SPRINGER INTERNATIONAL PUBLISHING AG , 2024, Vol. 14348, p. 104-114Conference paper, Published paper (Refereed)
Abstract [en]
Magnetic resonance imaging (MRI) is a slow diagnostic technique due to its time-consuming acquisition speed. To address this, parallel imaging and compressed sensing methods were developed. Parallel imaging acquires multiple anatomy views simultaneously, while compressed sensing acquires fewer samples than traditional methods. However, reconstructing images from undersampled multi-coil data remains challenging. Existing methods concatenate input slices and adjacent slices along the channel dimension to gather more information for MRI reconstruction. Implicit feature alignment within adjacent slices is crucial for optimal reconstruction performance. Hence, we propose MFormer: an accelerated MRI reconstruction transformer with cascading MFormer blocks containing multi-scale Dynamic Deformable Swin Transformer (DST) modules. Unlike other methods, our DST modules implicitly align adjacent slice features using dynamic deformable convolution and extract local non-local features before merging information. We adapt input variations by aggregating deformable convolution kernel weights and biases through a dynamic weight predictor. Extensive experiments on Stanford2D, Stanford3D, and large-scale FastMRI datasets show the merits of our contributions, achieving state-of-the-art MRI reconstruction performance. Our code and models are available at https://github.com/wafaAlghallabi/MFomer.
Place, publisher, year, edition, pages
SPRINGER INTERNATIONAL PUBLISHING AG , 2024. Vol. 14348, p. 104-114
Series
Lecture Notes in Computer Science, ISSN 0302-9743
Keywords [en]
MRI reconstruction; Alignment; Dynamic convolution
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:liu:diva-199959DOI: 10.1007/978-3-031-45673-2_11ISI: 001109643200011ISBN: 9783031456725 (print)ISBN: 9783031456732 (electronic)OAI: oai:DiVA.org:liu-199959DiVA, id: diva2:1825526
Conference
14th International Workshop on Machine Learning in Medical Imaging (MLMI), Vancouver, CANADA, oct 08, 2023
2024-01-092024-01-092025-02-07