Learning From Limited Data and Feedback for Cell Culture Process Monitoring: A Comparative Study

Jian Peng, Thanh Tung Khuat, Ellen Otte, Katarzyna Musiał, Bogdan GabryśarXiv 2025 · DOI · arXiv

In the world of biopharmaceutical manufacturing, knowing exactly what’s happening inside a bioreactor in real-time is the difference between a successful batch and a million-dollar loss. However, building the "soft sensors" (machine learning models) required for this monitoring is notoriously difficult due to a lack of data. A new study from researchers at the University of Technology Sydney and CSL Innovation provides a comprehensive roadmap for navigating these challenges.

TL;DR

This paper benchmarks machine learning strategies for real-time cell culture monitoring, specifically addressing the "small data" problem where historical records are sparse and process conditions vary. The authors demonstrate that while simple batch models work for stable processes, adaptive strategies like Just-In-Time Learning (JITL) and Online Learning (OL) are essential for handling "cold-start" scenarios in new experimental setups.

What Problem Does This Paper Address?

Bioprocess monitoring (BPM) involves tracking variables like cell density and nutrient levels. Ideally, we use Raman spectroscopy—a non-destructive laser-based technique—to get real-time snapshots. But there are three major hurdles:

  1. High Dimensionality vs. Low Volume: Raman spectra have thousands of features, but we might only have 14–28 physical "ground truth" samples from a two-week run to train on.
  2. The Cold-Start Problem: Every time a scientist changes the cell line or the "feed" (the nutrient soup), the data distribution shifts. Models trained on old batches often fail on new ones.
  3. Infrequent Feedback: Physical samples are often only taken once or twice a day, meaning the model has very few opportunities to "correct" its predictions during a run.

Methods

The researchers evaluated a pipeline consisting of three main stages:

  • Dimensionality Reduction (DR): Techniques like PCA, Kernel PCA, and Partial Least Squares Regression (PLSR) were used to compress 3,000+ Raman wavenumbers into a manageable set of features.
  • Machine Learning Models: They compared industry standards (SVR, PLSR) against more complex algorithms (XGBoost, Gaussian Processes).
  • Training Strategies: This is the paper's core contribution. They compared:
  • Pre-training: A static model trained on all historical data.
  • Retraining: Updating the model whenever new offline feedback arrives.
  • Just-In-Time Learning (JITL): For every new prediction, the model identifies the 30 most similar historical data points and builds a local, temporary model.
  • Online Learning (OL): The model updates its parameters incrementally as new data arrives without full retraining.

Datasets

The study utilized three distinct datasets to ensure robust results:

  1. IndPenSim (In Silico): A high-volume simulated dataset of penicillin fermentation, used to test model transferability in a controlled environment.
  2. CSL Dataset (Real-world): Data from 34 industrial bioreactor runs with variations in cell lines and media. This included a "validation" set of two runs with entirely new media to simulate a true "cold start."
  3. AstraZeneca Dataset (Public): 106 historical cultures. Unlike the others, this lacked Raman data, allowing the authors to test how well models perform using only "lagged" offline measurements (yesterday's data to predict today's).

Key Insights and Ideas

  • Complexity is a Double-Edged Sword: In high-dimensional Raman tasks, simpler models like Support Vector Regression (SVR) often outperformed complex ones like XGBoost. This is because SVR uses "Structural Risk Minimization," which is specifically designed to prevent overfitting when data is scarce.
  • The "Pocket" Effect: Transferability heatmaps revealed "pockets" of high performance. Models transfer well between batches with the same "meta-features" (like feed media), but performance drops off a cliff when those settings change.
  • JITL is the "Cold-Start" Champion: When faced with a brand-new process (new cell line/media), JITL was the most resilient. By ignoring irrelevant historical data and focusing only on "similar" moments, it adapted much faster than global models.
  • Baselines are Stubborn: For some stable analytes (like Sodium or Calcium), a "Last Value" baseline (predicting that today's value is the same as yesterday's) is surprisingly hard for ML to beat.

Key Results

  • For Homogeneous Data: In the simulated IndPenSim dataset, standard batch retraining was sufficient because the "rules" of the simulation didn't change.
  • For Heterogeneous Data: On the real-world CSL data, Retraining and JITL significantly outperformed static pre-training.
  • The Hybrid Advantage: The results suggest that the best soft sensors aren't just Raman-based; they are hybrids. Integrating Raman signals with lagged offline measurements (feedback from 24 hours ago) drastically improved accuracy.
  • XGBoost’s Niche: While XGBoost struggled with high-dimensional Raman data, it was the top performer on the AstraZeneca dataset, where the input was low-dimensional lagged data.

Limitations and Future Work

The authors acknowledge that their JITL approach used a fixed "k=30" for similarity, which might not be optimal for every analyte. They suggest that future work should focus on Meta-Learning—developing models that can automatically adjust their own hyperparameters based on the specific "meta-features" (media type, control strategy) of a new batch. Additionally, creating more robust similarity measures that can handle noisy Raman spectra remains a priority for making JITL even more effective in industrial settings.

Summary updated

Abstract

In cell culture bioprocessing, real-time batch process monitoring (BPM) refers to the continuous tracking and analysis of key process variables such as viable cell density, nutrient levels, metabolite concentrations, and product titer throughout the duration of a batch run. This enables early detection of deviations and supports timely control actions to ensure optimal cell growth and product quality. BPM plays a critical role in ensuring the quality and regulatory compliance of biopharmaceutical manufacturing processes. However, the development of accurate soft sensors for BPM is hindered by key challenges, including limited historical data, infrequent feedback, heterogeneous process conditions, and high-dimensional sensory inputs. This study presents a comprehensive benchmarking analysis of machine learning (ML) methods designed to address these challenges, with a focus on learning from historical data with limited volume and relevance in the context of bioprocess monitoring. We evaluate multiple ML approaches including feature dimensionality reduction, online learning, and just-in-time learning across three datasets, one in silico dataset and two real-world experimental datasets. Our findings highlight the importance of training strategies in handling limited data and feedback, with batch learning proving effective in homogeneous settings, while just-in-time learning and online learning demonstrate superior adaptability in cold-start scenarios. Additionally, we identify key meta-features, such as feed media composition and process control strategies, that significantly impact model transferability. The results also suggest that integrating Raman-based predictions with lagged offline measurements enhances monitoring accuracy, offering a promising direction for future bioprocess soft sensor development.
BibTeX
@misc{peng2025learning,
  author = {Jian Peng and Thanh Tung Khuat and Ellen Otte and Katarzyna Musiał and Bogdan Gabryś},
  title = {{Learning From Limited Data and Feedback for Cell Culture Process Monitoring: A Comparative Study}},
  year = {2025},
  eprint = {2512.03460},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.03460},
  howpublished = {arXiv},
}
Figure