Managing the unknown: a survey on Open Set Recognition and tangential areas

Marcos Barcina-Blanco, Jesus L. Lobo, Pablo García Bringas, Javier Del SerarXiv 2023 · OpenReview

TL;DR

This paper provides a comprehensive survey of Open Set Recognition (OSR), a critical area in AI for building robust models that can identify and handle unknown data during inference. It clarifies OSR's core concepts, explores its connections with related fields like continual learning and novelty detection, and reviews existing methodologies, highlighting open challenges and future research directions for safer AI.

What Problem Does This Paper Address?

In real-world applications, AI models are often deployed in dynamic environments where they encounter data from classes not seen during training. Traditional classification models assume a "closed-set" scenario, where all test data belongs to one of the known classes. When faced with "unknown" classes, these models can misclassify them with high confidence, leading to unreliable and potentially dangerous outcomes. Open Set Recognition (OSR) aims to solve this by enabling models to not only classify known classes accurately but also to detect and reject instances from unknown classes. This survey addresses the need for a unified understanding of OSR, its relationship with other machine learning paradigms, and a clear overview of current research and future opportunities.

Methods

This paper is a survey and does not introduce new methods. Instead, it categorizes and reviews existing OSR approaches. The survey identifies two main categories of OSR methods:

  • Discriminative Approaches: These methods aim to reduce the "open space risk" by modeling known classes into tighter feature spaces. This includes adapting traditional machine learning algorithms (like SVMs) and developing deep learning architectures.
  • Generative Approaches: These methods focus on synthesizing synthetic data samples that represent unknown classes. The model is then trained on both real and synthetic data to improve its ability to distinguish known from unknown.

The paper also discusses hybrid approaches that combine clustering and classification techniques.

Datasets

Not discussed in the paper. The paper focuses on a survey of existing literature and methodologies rather than presenting new experimental results on specific datasets.

Key Insights and Ideas

  • The "Over-Occupied Space" Problem: A central challenge in OSR is that standard classifiers tend to allocate the entire feature space to known classes, leaving no room for unknown classes. This leads to misclassification of unknown instances as known ones, often with high confidence.
  • OSR's Interconnectedness: OSR is not an isolated field. It shares significant overlap and draws from related areas like Continual Learning (CL), Novelty Detection (ND), Out-of-Distribution (OoD) detection, and Uncertainty Estimation (UE). Understanding these connections is crucial for developing more robust OSR systems.
  • The Need for Safe AI: As AI systems become more autonomous and deployed in critical applications, the ability to manage the unknown is paramount for ensuring safety and reliability. OSR is a key component in building such "safe AI."
  • Evolution of OSR: The field has evolved from adapting traditional ML methods to leveraging the power of deep learning, with recent trends focusing on combining clustering and classification for better performance.

Key Results

As this is a survey paper, it does not present new experimental results. Instead, it synthesizes findings from the literature:

  • Discriminative methods have been successful in reducing open space risk by refining feature representations.
  • Generative methods show promise in improving robustness by synthesizing diverse unknown class examples.
  • Hybrid clustering-classification approaches offer a promising direction, particularly in addressing the over-occupied space problem.
  • The paper highlights that despite significant activity, reducing open space risk remains an open problem.

Limitations and Future Work

The paper identifies several challenges and suggests future research directions:

  • Open Space Risk: Reducing the over-occupied space remains a hard task, and current approaches haven't fully addressed it, especially in complex scenarios or when combined with concept evolution and OoD detection.
  • Thresholding: Many OSR methods rely on thresholds, which are difficult to set optimally and can be time-consuming. Developing self-adaptive thresholding mechanisms or alternative approaches is needed.
  • Combining Clustering and Classification: While promising, most existing methods combine these sequentially, limiting their synergy. Future work should focus on truly integrated, simultaneous approaches where both components benefit from each other.
  • Detecting Unknowns Over Time: Current evaluation often treats samples in isolation. Future research should consider the temporal correlation of instances, especially in evolving data streams with intermittently appearing unknown classes.
  • Disentangling Complex Class Distributions: Identifying novel classes becomes challenging when known and unknown classes overlap or when known classes are underpopulated. Developing strategies to handle such complex distributions is crucial.
  • Model Updating: Efficiently updating models with newly discovered unknown classes, especially in time-constrained environments or with scarce data, is a significant challenge. Techniques like incremental learning and active learning could be explored further.

Summary updated

Abstract

In real-world scenarios classification models are often required to perform robustly when predicting samples belonging to classes that have not appeared during its training stage. Open Set Recognition addresses this issue by devising models capable of detecting unknown classes from samples arriving during the testing phase, while maintaining a good level of performance in the classification of samples belonging to known classes. This review comprehensively overviews the recent literature related to Open Set Recognition, identifying common practices, limitations, and connections of this field with other machine learning research areas, such as continual learning, out-of-distribution detection, novelty detection, and uncertainty estimation. Our work also uncovers open problems and suggests several research directions that may motivate and articulate future efforts towards more safe Artificial Intelligence methods.
BibTeX
@misc{barcinablanco2023managing,
  author = {Marcos Barcina-Blanco and Jesus L. Lobo and Pablo García Bringas and Javier Del Ser},
  title = {{Managing the unknown: a survey on Open Set Recognition and tangential areas}},
  year = {2023},
  eprint = {2312.08785},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2312.08785},
}
Figure