Antibody selection strategies and their impact in the analysis of malaria multi-sera data

André Fonseca, Mikolaj Spytek, Przemysław Biecek, Clara Cordeiro, Nuno SepúlvedamedRxiv 2022 · DOI

Abstract

The discovery of antibody candidates that explain naturally acquired protection against malaria has been bolstered by the availability of multi-sera data. However, the analysis of such high-throughput data often suffers from noise and reproducibility issues. This study evaluates three feature selection strategies—a simple non-parametric approach, a dichotomization approach, and a hybrid parametric/non-parametric approach—to identify protective antibody responses in a cohort of Kenyan children. Using a Super-Learner ensemble, we demonstrate that refined feature selection significantly outperforms standard "black-box" machine learning models, achieving areas under the ROC curve (AUC) between 0.79 and 0.86, compared to 0.68 for unrefined models.

Introduction

Identifying the specific proteins (antigens) that trigger protective immunity is a central goal of malaria vaccine research. While high-throughput assays provide massive amounts of serological data, the field faces a reproducibility crisis. Genetic diversity in Plasmodium falciparum and the complex life cycle of the parasite mean that different studies often identify different "protective" antibodies.

A significant hurdle lies in the statistical analysis: standard techniques often fail to account for the stochastic nature of antibody responses. In endemic regions, populations are frequently split between "seronegative" individuals (low exposure) and "seropositive" individuals (high exposure). Simply processing raw data through machine learning models like Random Forests often results in mediocre predictive power because the noise of non-protective responses drowns out the signal of truly protective ones.

Methodology: Three Approaches to Feature Selection

The researchers developed and compared three distinct analytical pipelines to determine how features should be included in predictive models:

1. The Simple Approach (Non-parametric)

This baseline method selects antibodies using the non-parametric Mann-Whitney test. It serves as a control to evaluate the benefits of more complex statistical transformations and population-based modeling.

2. The Pragmatic Pipeline (Dichotomization)

This data-driven approach focuses on finding optimal cut-offs. Instead of treating antibody levels as continuous variables, it tests every possible value to find the threshold that maximizes the $\chi^2$ statistic for two-way tables. This effectively separates "protected" and "susceptible" individuals based on the statistically widest gap in antibody levels.

3. The Parametric/Hybrid Pipeline

This mathematically rigorous approach integrates several sophisticated techniques:

  • Box-Cox Transformations: Used to normalize skewed serological data.
  • Finite Mixture Models (FMM): These models assume the data is composed of latent sub-populations (e.g., exposed vs. unexposed). This allows for the definition of biologically meaningful thresholds for immunity rather than using arbitrary averages.
  • Fallback Mechanisms: If parametric assumptions are not met, the pipeline defaults to the Mann-Whitney test to ensure robustness.

Experimental Framework

The study re-analyzed a published dataset of IgG antibody responses against 36 P. falciparum antigens in 121 Kenyan children under the age of 10. These children were monitored over six months to determine clinical malaria status, defined by the presence of fever and high parasite density. The predictive stage utilized a Super-Learner, an ensemble method that pools predictions from multiple classifiers, including Logistic/Probit regressions, penalized regressions (LASSO, Ridge, Elastic-Net), and Random Forests.

Results and Discussion

The analysis revealed that the method of feature selection is more critical than the complexity of the final predictive model.

Predictive Performance

Previous analyses using Random Forest on the full raw dataset achieved an AUC of only 0.68. By using the proposed pipelines to pre-select high-performing antibodies, accuracy improved significantly:

  • Pragmatic/Dichotomization: Achieved a predictive performance of AUC 0.80 (with specific optimized panels reaching 0.86).
  • Parametric/Hybrid: Achieved an AUC of 0.79 (with top panels reaching 0.82).
  • Simple: Achieved an AUC of 0.72.

Key Antigenic Signatures

The Merozoite Surface Protein (MSP) family emerged as a consistent predictor of protection. Specifically, msp2, msp4, msp7, msp10, and pf113 were frequently selected across different pipelines. Interestingly, antigens like msp10 and h103, which are often overlooked in traditional studies, were identified as strong predictors, suggesting they warrant further investigation as vaccine candidates.

The Role of Age

Incorporating age into the models further boosted performance, reaching an AUC of 0.89. In malaria-endemic regions, age serves as a proxy for cumulative exposure, confirming that the statistical pipelines are effectively capturing the acquisition of natural immunity over time.

Conclusion

The study demonstrates that sophisticated feature selection—specifically methods that account for population sub-structures like Finite Mixture Models or optimal dichotomization—can significantly enhance the predictive power of malaria serological data. While the Pragmatic and Parametric pipelines yielded similar overall results, they often selected different antibody panels, suggesting that protection is a multi-faceted signature. The researchers recommend using these strategies in conjunction to provide a more robust analysis of naturally acquired immunity. Future work should focus on validating these pipelines in larger, more diverse cohorts to ensure the generalizability of the identified antibody signatures.

Summary updated

Abstract

Abstract Background Nowadays, the chance of discovering the best antibody candidates for explaining naturally acquired protection to malaria and detecting exposure to malaria parasites has notably increased due to publicly available multi-sera data. The analysis of these data is typically divided into a feature selection phase followed by a predictive one where several models are constructed for the outcome of interest. A key question in the analysis is to determine which and how each feature should be included in the predictive stage. Results To answer this question, we developed three approaches for classifying malaria protected and susceptible groups: (i) a basic and simple approach based on selecting antibodies via the nonparametric Mann-Whitney test; (ii) a dichotomization approach where each antibody was selected according to the optimal cut-off via maximization of the χ 2 statistic for two-way tables; (iii) a hybrid parametric/non-parametric approach that integrates Box-Cox transformation followed by a t-test, together with the use of finite mixture models and the Mann-Whitney test as a last resort. We illustrated the application of these three approaches with published serological data for predicting clinical malaria in 121 Kenyan children. The predictive analysis was based on a Super-Learner where predictions from multiple classifiers were pooled together. Our results led to almost similar areas under the Receiver Operating Characteristic curves of 0.72 (95% CI = [0.61, 0.82]), 0.80 (95% CI = [0.71, 0.90]), 0.79 (95% CI = [0.7, 0.88]) for the simple, dichotomization and hybrid approaches, respectively. Conclusions The three feature selection strategies provided a better predictive performance of the outcome when compared to the previous results solely relying on Random Forests alone (AUC=0.68). Given the similar predictive performance, we recommended the three strategies should be used in conjunction in the same data set and selected according to their complexity.
BibTeX
@misc{fonseca2022antibody,
  author = {André Fonseca and Mikolaj Spytek and Przemysław Biecek and Clara Cordeiro and Nuno Sepúlveda},
  title = {{Antibody selection strategies and their impact in the analysis of malaria multi-sera data}},
  year = {2022},
  doi = {10.1101/2022.10.06.22280719},
  howpublished = {medRxiv},
}
Figure