RSSL: Implementations of Semi-Supervised Learning Approaches for Classification

Jesse H. Krijthe, Jh KrijtheOpenalex Unknown 2016 · DOI · OpenAlex

Abstract

The RSSL package provides a comprehensive, high-performance library for semi-supervised learning (SSL) in R, bridging the gap between theoretical research and practical data science. By unifying diverse algorithms—from Transductive SVMs to Manifold Regularization—under a common interface, it enables researchers and engineers to leverage unlabeled data to boost classification performance with minimal overhead.

Introduction

In many real-world scenarios, labeled data is expensive or time-consuming to obtain, while unlabeled data is abundant. Semi-supervised learning (SSL) aims to use both to build better classifiers. However, the SSL landscape is fragmented; many state-of-the-art algorithms are implemented in disparate languages or lack a standardized way to be evaluated against one another. RSSL addresses this by providing a "one-stop shop" for SSL, focusing on robust evaluation and a suite of algorithms designed to ensure that adding unlabeled data improves the model rather than degrading it.

Methodological Diversity

The package implements a wide array of SSL paradigms, often porting original research code into a performant R/C++ framework using Rcpp. Key methods include:

  • Constraint-Based Learning: Implicitly Constrained Least Squares (ICLS) and Moment Constrained (MC) classifiers.
  • Large Margin Methods: Transductive SVM (TSVM), S4VM (Safe Semi-supervised SVM), and WellSVM.
  • Manifold and Graph-Based Regularization: Laplacian SVMs and Gaussian Random Fields (GRF).
  • Pessimistic/Robust Estimation: Maximum Contrastive Pessimistic Likelihood (MCPL) estimation.
  • Generative Models: EM-based versions of Linear Discriminant Analysis (LDA) and Nearest Mean Classifiers.

Standardized Interface and Evaluation

A core strength of RSSL is its unified interface. Most classifiers follow a consistent parameter structure, making it easy for users to experiment with different models.

Standardized input parameters for SSL classifiers in RSSL, including labeled (X, y) and unlabeled (X_u) data.

As shown in the documentation snippets, the package standardizes inputs such as labeled data (X), labels (y), and unlabeled data (X_u). Furthermore, advanced parameters for regularization and kernel selection are handled consistently across different algorithm types, allowing for seamless transitions between models.

Additional parameters for regularization, scaling, and kernel-based methods.

Beyond the interface, the package provides LearningCurveSSL and CrossValidationSSL functions. These automate the complex bookkeeping required to track model performance as the ratio of unlabeled to labeled data increases, which is critical for validating the "Do No Harm" principle in SSL.

Results and Accessibility

RSSL serves as a benchmark suite that brings complex algorithms (previously restricted to Matlab or C++) to the R community. Its S4 class structure (BaseClassifier) allows users to swap out standard supervised models for semi-supervised alternatives with minimal code changes. Additionally, built-in plotting utilities like stat_classifier allow for immediate visual inspection of decision boundaries, helping users understand how unlabeled data shifts the model's view of the feature space.

Limitations

While efficient for medium-sized datasets due to RcppArmadillo integration, many implemented methods involve $O(N^2)$ or $O(N^3)$ operations, which may limit scalability for very large datasets. Furthermore, the performance of these models remains sensitive to underlying data assumptions (e.g., the manifold assumption), requiring users to choose algorithms that match their data's geometry.

Summary updated

Abstract

A collection of implementations of semi-supervised classifiers and methods to evaluate their performance. The package includes implementations of, among others, Implicitly Constrained Learning, Moment Constrained Learning, the Transductive SVM, Manifold regularization, Maximum Contrastive Pessimistic Likelihood estimation, S4VM and WellSVM.
BibTeX
@inproceedings{krijthe2016rssl,
  author = {Jesse H. Krijthe and JH Krijthe},
  title = {{RSSL: Implementations of Semi-Supervised Learning Approaches for Classification}},
  booktitle = {Openalex Unknown},
  year = {2016},
  doi = {10.32614/cran.package.rssl},
}
Figure