Abstract: Task Fingerprinting for Meta Learning in Biomedical Image Analysis

Patrick Godau, Lena Maier-HeinBildverarbeitung für die Medizin 2022 · DOI

Introduction

In Surgical Data Science (SDS), the "data bottleneck" remains a primary obstacle. Annotating thousands of surgical images is prohibitively expensive and requires specialized expertise. Meta-learning offers a potential solution by leveraging experience from previous tasks to accelerate learning on new ones. However, a significant challenge lies in "task discovery": identifying the most relevant previous tasks from a large library to serve as "ancestors" for a new, small dataset. Traditional similarity measures often lack scalability or ignore the critical label information that defines a task's objective.

Methodology

The authors introduce Task Fingerprinting, a method that represents a task (comprising both images and labels) as a fixed-length vector. The primary approach investigated is Fisher Embedding Distance (FED). This method utilizes a "probe network" (e.g., ResNet34) where the final layer is retrained on the target task. The Fisher Information Matrix (FIM) is then calculated to determine which model parameters are most sensitive to the specific task data and labels. The diagonal elements of this matrix constitute the "fingerprint."

Overview of the Task Fingerprinting pipeline, converting labeled image datasets into fixed-length vectors for network analysis.

This approach is highly scalable; once a task's fingerprint is computed, it remains static, allowing for instantaneous comparison against a library of existing tasks using simple distance metrics like cosine distance.

Experimental Results

The study evaluated 26 classification tasks, including 18 biomedical tasks (e.g., laparoscopy, colonoscopy) and 8 non-medical benchmarks (e.g., CIFAR-10, MNIST). A key finding was that incorporating label information via FED significantly outperformed image-only embedding methods like Maximum Mean Discrepancy (MMD) or Kullback-Leibler Divergence (KLD).

Comparison of relative distances across different embedding methods (FED, MMD, KLD, EMD) for various domain relationships.

As shown in the results, FED successfully captured semantic relationships, with distances increasing as domain similarity decreased. "Same domain" tasks were consistently clustered closer together than "Medical vs. Non-Medical" tasks. Furthermore, FED-based task selection showed a positive correlation with actual transfer learning success ($\rho = 0.12$) and helped in predicting optimal neural network architectures for new tasks.

Conclusion

Task Fingerprinting provides a scalable and semantically meaningful way to navigate large task libraries in medical imaging. While currently focused on 2D classification, future work aims to extend this framework to 3D data and complex tasks like semantic segmentation, ultimately moving toward fully automated meta-learning systems for biomedical AI.

Summary updated

BibTeX
@inproceedings{godau2022abstract,
  author = {Patrick Godau and Lena Maier-Hein},
  title = {{Abstract: Task Fingerprinting for Meta Learning in Biomedical Image Analysis}},
  booktitle = {Bildverarbeitung für die Medizin},
  year = {2022},
  doi = {10.1007/978-3-658-36932-3\_55},
}

Loading related content...

Figure