Early fusion of H&E and IHC histology images for pediatric brain tumor classificationShow others and affiliations
2024 (English)In: Proceedings of Machine Learning Research / [ed] Francesco Ciompi, Nadieh Khalili, Linda Studer, Milda Poceviciute, Amjad Khan, Mitko Veta, Yiping Jiao and Neda Haj-Hosseini and Hao Chen and Shan Raza and Fayyaz Minhas and Inti Zlobec and Nikolay Burlutskiy and Veronica Vilaplana and Biagio Brattoli, Henning Muller, Manfredo Atzori, Shan Raza, Fayyaz Minhas, Marrakesh: PMLR , 2024, Vol. 254, p. 192-202Conference paper, Published paper (Refereed)
Abstract [en]
This study explores the application of computational pathology to analyze pediatric brain tumors utilizing hematoxylin and eosin (H&E) and immunohistochemistry (IHC) whole slide images (WSIs). Experiments were conducted on H&E images for predicting tumor diagnosis and fusing them with unregistered IHC images to investigate potential improvements. Patch features were extracted using UNI, a vision transformer (ViT) model trained on H&E data, and whole slide classification was achieved using the attention-based multiple instance learning CLAM framework. In the astrocytoma tumor classification, early fusion of the H&E and IHC significantly improved the differentiation between tumor grades (balanced accuracy: 0.82±0.05vs 0.84 ± 0.05). In the multiclass classification, H&E images alone had a balanced accuracy of 0.79 ± 0.03 without any improvement obtained when fused with IHC. The findings highlight the potential of using multi-stain fusion to advance the diagnosis of pediatric brain tumors, however, further fusion methods should be investigated.
Place, publisher, year, edition, pages
Marrakesh: PMLR , 2024. Vol. 254, p. 192-202
Series
Proceedings of the MICCAI Workshop on Computational Pathology, ISSN 2640-3498 ; 254
Keywords [en]
pediatric brain tumour, immunohistochemistry (IHC), computational pathology, early fusion, foundation model, cancer
National Category
Medical Imaging Cancer and Oncology Pediatrics
Identifiers
URN: urn:nbn:se:liu:diva-208716ISI: 001479306100015OAI: oai:DiVA.org:liu-208716DiVA, id: diva2:1907038
Conference
27th INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION (MICCAI), Computational Pathology with Multimodal Data (COMPAYL) Workshop
Funder
Swedish Childhood Cancer Foundation, MT2021-0011, MT2022-0013Vinnova, AIDA (2022-2222)Linköpings universitet, Joanna Cocozza 2022Linköpings universitet, Cancer Strength Area
Note
Funding Agencies|Swedish Childhood Cancer Foundation [MT2021-0011, MT2022-0013]; Joanna Cocozza's Foundation; Vinnova project via Medtech4Health and Analytic Imaging Diagnostics Arena (1908) [2017-02447, 2222]; Linkoping University's Cancer Strength Area (2022)
2024-10-212024-10-212025-08-28