TY - GEN
T1 - Text-Guided Weakly Supervised Segmentation for COVID-19 Detection in X-ray Images
AU - Marte, Cesar
AU - Xu, Meng
AU - Huang, Kuan
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
PY - 2025
Y1 - 2025
N2 - Conventional image segmentation methods typically require precise pixel-level or bounding box annotations. This study seeks to develop a weakly-supervised framework for COVID-19 X-ray segmentation, utilizing text descriptions as training input. Conventional models, such as DeepLab, rely on detailed pixel-level labels that take time and effort from medical professionals to generate. These labels are sometimes difficult to obtain, particularly during urgent health crises. This research applies a weakly supervised method that uses text descriptions of lesions from X-ray images to generate effective segmentation without pixel-level labels. The proposed method incorporates a classification framework that differentiates between positive and negative text expressions to localize target regions within the chest X-ray images. Text from the same image is treated as positive. In contrast, text from unrelated images acts as negative input, allowing the model to focus on relevant features without relying on explicit pixel-wise labeling. Using this method, labels can be generated more efficiently by leveraging text descriptions of medical images. This approach significantly reduces the workload on healthcare providers and offers a more efficient solution for COVID-19 detection. This study demonstrates the potential of weakly-supervised learning in medical image analysis scenarios where labeled data is scarce. By leveraging deep learning techniques, this research contributes to improving COVID-19 diagnosis efficiency. It highlights the potential of AI in addressing urgent healthcare challenges, potentially speeding up the diagnostic process in critical situations.
AB - Conventional image segmentation methods typically require precise pixel-level or bounding box annotations. This study seeks to develop a weakly-supervised framework for COVID-19 X-ray segmentation, utilizing text descriptions as training input. Conventional models, such as DeepLab, rely on detailed pixel-level labels that take time and effort from medical professionals to generate. These labels are sometimes difficult to obtain, particularly during urgent health crises. This research applies a weakly supervised method that uses text descriptions of lesions from X-ray images to generate effective segmentation without pixel-level labels. The proposed method incorporates a classification framework that differentiates between positive and negative text expressions to localize target regions within the chest X-ray images. Text from the same image is treated as positive. In contrast, text from unrelated images acts as negative input, allowing the model to focus on relevant features without relying on explicit pixel-wise labeling. Using this method, labels can be generated more efficiently by leveraging text descriptions of medical images. This approach significantly reduces the workload on healthcare providers and offers a more efficient solution for COVID-19 detection. This study demonstrates the potential of weakly-supervised learning in medical image analysis scenarios where labeled data is scarce. By leveraging deep learning techniques, this research contributes to improving COVID-19 diagnosis efficiency. It highlights the potential of AI in addressing urgent healthcare challenges, potentially speeding up the diagnostic process in critical situations.
KW - Chest X-ray
KW - Image Segmentation
KW - Multimodality
KW - Text Guidance
KW - Weakly Supervised Learning
UR - https://www.scopus.com/pages/publications/105014334614
U2 - 10.1007/978-3-031-94962-3_18
DO - 10.1007/978-3-031-94962-3_18
M3 - Conference contribution
AN - SCOPUS:105014334614
SN - 9783031949616
T3 - Communications in Computer and Information Science
SP - 202
EP - 211
BT - Computational Science and Computational Intelligence - 11th International Conference, CSCI 2024, Proceedings
A2 - Arabnia, Hamid R.
A2 - Deligiannidis, Leonidas
A2 - Shenavarmasouleh, Farzan
A2 - Amirian, Soheyla
A2 - Ghareh Mohammadi, Farid
PB - Springer Science and Business Media Deutschland GmbH
T2 - 11th International Conference on Computational Science and Computational Intelligence, CSCI 2024
Y2 - 11 December 2024 through 13 December 2024
ER -