Skip to main navigation Skip to search Skip to main content

Integrating GANs, Contrastive Learning, and Transformers for Robust Medical Image Analysis

  • Yang Heng
  • , Fiaz Gul Khan
  • , Ma Yinghua
  • , Ahmad Khan
  • , Farman Ali
  • , Nasrullah Khan
  • , Daehan Kwak
  • COMSATS University Islamabad
  • Sungkyunkwan University
  • Hamad bin Khalifa University

Research output: Contribution to journalArticlepeer-review

Abstract

Despite the widespread success of convolutional neural networks (CNNs) in general computer vision tasks, their application to complex medical image analysis faces persistent challenges. These include limited labeled data availability, which restricts model generalization; class imbalance, where minority classes are underrepresented and lead to biased predictions; and inadequate feature representation, since conventional CNNs often struggle to capture subtle patterns and intricate dependencies characteristic of medical imaging. To address these limitations, we propose CTNGAN—a unified framework that integrates generative modeling with Generative Adversarial Networks (GANs), contrastive learning, and Transformer architectures to enhance the robustness and accuracy of medical image analysis. Each component is designed to tackle a specific challenge: the GAN model mitigates data scarcity and imbalance, contrastive learning strengthens feature robustness against domain shifts, and the Transformer captures long-range spatial patterns. This tripartite integration not only overcomes the limitations of conventional CNNs but also achieves superior generalizability, as demonstrated by classification experiments on benchmark medical imaging datasets, (accuracy: 0.985, F1-score: 0.968, sensitivity: 0.938, specificity: 0.934), which significantly outperform existing methods. The framework's ability to jointly optimize data generation, feature discrimination, and contextual modeling establishes a new paradigm for accurate and reliable medical image diagnosis.

Original languageEnglish
JournalIEEE Journal of Biomedical and Health Informatics
DOIs
StateAccepted/In press - 2025

Keywords

  • Contrastive learning
  • Deep learning
  • Generative adversarial networks
  • Medical image classification
  • Transformers

Fingerprint

Dive into the research topics of 'Integrating GANs, Contrastive Learning, and Transformers for Robust Medical Image Analysis'. Together they form a unique fingerprint.

Cite this