Overview of the ImageCLEFmedical 2026 GANs task: Exploring fingerprint detection, privacy leakage, and synthetic medical image generation

Alexandra-Georgiana Andrei, Mihai Gabriel Constantin, Mihai Dogariu, Dzmitry Karpenka, Yuri Prokopchuk, Ahmedkhan Radzhabov, Dan-Cristian Stanciu, Liviu-Daniel Ştefan, Vassili Kovalev, Henning Müller, Bogdan IonescuarXiv 2026 · arXiv

TL;DR

The 2026 ImageCLEFmedical GANs challenge investigates the "privacy fingerprints" left behind when Generative Adversarial Networks (GANs) create synthetic medical images. The results reveal a stark reality: while detecting specific training samples remains incredibly difficult, internal model states are surprisingly easy to recover, and high-quality synthetic data often inadvertently exposes the anatomical identities of the original patient cohort.

What Problem Does This Paper Address?

Artificial Intelligence in healthcare is hungry for data, but strict privacy regulations like GDPR and HIPAA make sharing real patient records a legal and ethical minefield. Synthetic data—realistic images generated by models like GANs—is often touted as a "privacy-safe" alternative.

However, generative models are known to "memorize" patterns from their training data. If a synthetic lung CT scan looks too much like a real patient's scan, or if the model's internal math can be reversed to reveal training details, the privacy benefit evaporates. This paper summarizes a multi-year effort to quantify these risks through three specific challenges: membership inference (did this image train the model?), latent vector recovery (can we reverse-engineer the model's "DNA"?), and privacy-preserving generation.

Methods

The challenge was divided into three distinct subtasks, each requiring different technical approaches:

  • Subtask 1 (Membership Inference): Participants used a mix of transfer learning (fine-tuning ResNet and EfficientNet backbones), handcrafted statistical features (pixel intensity, texture), and spectral analysis to see if they could distinguish between real images used in training versus those the model had never seen.
  • Subtask 2 (Latent Matching): This was a "white-box" attack. Given a set of synthetic images and their corresponding 128-dimensional latent vectors (the random noise used to seed the generation), teams had to find the exact pairs. The most successful methods used direct image-to-latent regression combined with the Hungarian algorithm for global bipartite matching.
  • Subtask 3 (Privacy-Preserving Generation): Teams built their own generators (like StyleGAN2 or Diffusion models) to produce high-quality CT slices while resisting four types of privacy attacks. Key techniques included DP-SGD (Differentially Private Stochastic Gradient Descent), which adds noise during training to provide mathematical privacy guarantees, and "Supervisor" pipelines that filtered out synthetic images that were too similar to the training set.

Datasets

The benchmark utilized a dataset of axial 2D slices from 3D thoracic CT scans of approximately 8,000 lung tuberculosis patients.

  • Development Set: 10,000 synthetic images and 6,400 annotated real images (half used for training, half not).
  • Test Set: 2,140 real CT images with hidden labels for evaluation.
  • Subtask 2 Specifics: 10,000 image-latent vector pairs generated by a BigGAN-Deep model.

Key Insights and Ideas

  • The "Black Box" is Resilient: Subtask 1 proved to be the hardest. Despite using sophisticated deep learning ensembles, no team performed better than random chance. This suggests that well-regularized GANs do a good job of hiding individual "fingerprints" at the image level.
  • Latent Space is Transparent: In a surprising contrast, Subtask 2 was highly solvable. The mapping from a model's internal latent code to the final image is incredibly stable. If an attacker gets hold of the generated images and knows the model architecture, they can recover the internal "seeds" with near-perfect accuracy.
  • The Privacy-Utility Frontier: There is a fundamental tension between image quality and privacy. Models that produced the most anatomically perfect CT scans almost always leaked the most patient information.
  • Re-Identification vs. Distribution: The researchers noted that "Patient Re-Identification" metrics might be overly sensitive. If a model learns to represent the full anatomical variety of a small patient group perfectly, it will naturally produce images that look like those patients, even if it isn't "memorizing" them in a traditional sense.

Key Results

The quantitative results highlight the varying difficulty of the tasks:

  • Subtask 1: The best Cohen’s $\kappa$ (a measure of agreement) was -0.0243, indicating that teams were essentially guessing. Even the organizing team's baseline only reached an accuracy of 0.4972 (see Table 2).
  • Subtask 2: Team Agentili achieved a perfect matching accuracy of 1.0000, correctly pairing all 10,000 images with their latent vectors (see Table 3).
  • Subtask 3: A clear trade-off was observed. The highest Privacy Preservation Score (PPS) was 0.9086 (by team csmorgan), but it came with a very poor Fréchet Inception Distance (FID) of 3.2358, meaning the images didn't look very realistic. Conversely, the best-looking images (FID 0.2639) had much lower privacy scores.
Table 2 Results of participant submissions for Subtask 1: Detect Training Data Usage. (* task organising team)
Table 3 Results of participant submissions for Subtask 2: Identify Corresponding Latent Vectors.(* task organising team)

Limitations and Future Work

The authors acknowledge that the Patient Re-Identification (Attack 3) metric may conflate "learning the data distribution" with "identity leakage," especially when training on smaller cohorts. Future editions of the task will aim to refine this metric to better distinguish between a well-trained model that covers the population's anatomy and one that is dangerously memorizing specific individuals. Additionally, the failure of membership inference in Subtask 1 suggests that more sensitive detection frameworks are needed to uncover the subtle traces generative models might still be leaving behind.

Summary updated

Abstract

The 2026 ImageCLEFmedical GANs Task Exploring Fingerprint Detection, Privacy Leakage, and Synthetic Medical Image Generation continues to investigate privacy and security concerns around using patient data to generate synthetic medical images, now in its fourth edition. This edition introduces three complementary subtasks: the first extends prior editions by asking participants to detect which real images were used in training a Generative Adversarial Network to produce given synthetic outputs; the second is a novel subtask requiring participants to identify which latent vector produced each synthetic image, probing the faithfulness and reversibility of the latent-to-image mapping; the third asks participants to generate privacy-preserving CT slices, quantifying the trade-off between image fidelity and patient privacy. Ground-truth annotations and benchmark datasets of real and GAN-generated lung CT slices are provided for all subtasks. Evaluation is based on Cohen's Kappa for Subtask 1, matching accuracy for Subtask 2, and a combination of FID and Privacy Preservation Score (PPS) for Subtask 3. Overall, 37 teams registered for the task, with 10 teams submitting runs across subtasks and 6 teams submitting working notes papers. This paper presents an overview of the task setup, datasets, evaluation metrics, and summarises the approaches and results of participating teams.
BibTeX
@misc{andrei2026overview,
  author = {Alexandra-Georgiana Andrei and Mihai Gabriel Constantin and Mihai Dogariu and Dzmitry Karpenka and Yuri Prokopchuk and Ahmedkhan Radzhabov and Dan-Cristian Stanciu and Liviu-Daniel Ştefan and Vassili Kovalev and Henning Müller and Bogdan Ionescu},
  title = {{Overview of the ImageCLEFmedical 2026 GANs task: Exploring fingerprint detection, privacy leakage, and synthetic medical image generation}},
  year = {2026},
  eprint = {2611.09455},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.09455},
}
Figure