MouldIt: Data Efficiency of Multi-Task Temporal Representation Learning in Injection Moulding

Abdullah AyadarXiv 2026 · arXiv

TL;DR

The authors introduce MouldIt, a multi-task variational autoencoder (VAE) designed to monitor injection moulding processes. By combining temporal convolutions and attention mechanisms, MouldIt learns to both classify known defects and detect entirely new failure modes, achieving a remarkably low 1.0% sorting loss when using multi-modal sensor data.

What Problem Does This Paper Address?

In smart manufacturing, collecting data on part defects is expensive and time-consuming. Engineers face a "cold start" problem: how much data is actually needed before a deep learning model outperforms classical methods like Random Forests? Furthermore, industrial models must be robust enough to not only recognize known faults but also flag "unknown unknowns"—defects they have never encountered during training.

This paper tackles the challenge of data efficiency and multi-task learning in injection moulding. It explores whether representation learning (models that learn the underlying "language" of the process) can provide better reliability and efficiency than traditional "black-box" classifiers, especially when sensor data is multi-modal (e.g., combining pressure, temperature, and ultrasound).

Methods

The authors propose MouldIt, a novel architecture based on a Variational Autoencoder (VAE).

Overview of the MouldIt workflow, from data synthesis to production metrics.

Key technical components include:

  • Temporal Convolutional Networks (TCN): Used to capture local features within the time-series sensor signals.
  • Temporal Attention (TA): Integrated to model long-range dependencies across the entire moulding cycle.
  • Multi-Task Heads: The model is trained with a joint loss function. It must simultaneously reconstruct the input signals (unsupervised) and classify the part quality (supervised).
  • Novelty Scoring: To detect unknown faults, the authors use a hybrid score that combines the distance in the VAE's latent space with the reconstruction error. If a signal looks "weird" in the latent space or the model fails to reconstruct it accurately, it's flagged as a new type of defect.

Datasets

Because large-scale, labeled industrial datasets are rare, the authors developed a process-informed synthesis method. They started with a single real recording of an "Erlanger Träger" part (a standard test geometry) and synthesized a dataset of up to 16,000 cycles.

  • Modalities: The dataset includes in-mould pressure, temperature, and two ultrasound RMS channels.
  • Faults: They simulated various failure modes such as underpacking, fast gate freeze, machine drift, and inter-sensor inconsistency.
  • Benchmarks: The synthetic data allowed for rigorous testing across nine different dataset sizes (from 50 to 16,000 cycles) to measure exactly when deep learning begins to dominate.

Key Insights and Ideas

  • The Multi-Modal Multiplier: Adding sensors (temperature and ultrasound) doesn't just improve accuracy; it drastically improves data efficiency. With multi-modal data, MouldIt overtakes classical methods at just 2,000 cycles, compared to 4,000 cycles when using pressure data alone.
  • Latent vs. Reconstruction: The paper provides a fascinating "latent analysis." Some faults (like secondary pressure rises) are easily caught by the reconstruction error, while others (like subtle machine drifts) are only visible as shifts in the latent representation.
  • Unified Sorting: Instead of maintaining two separate models—one for classification and one for anomaly detection—MouldIt handles both in a single framework, reducing the engineering overhead for deployment.

Key Results

MouldIt was compared against several baselines, including Random Forests (RF), k-Nearest Neighbors (kNN), and PCA.

Comparison of classification and unknown detection performance across dataset sizes.
  • Sorting Loss: At 16,000 cycles, MouldIt achieved a sorting loss of 1.0 ± 0.3% in the multi-modal setting, significantly better than the best classical alternative (RF + PCA flag at 1.1% or kNN at 5.5%).
  • Classification Accuracy: In the multi-modal setting, MouldIt reached 100% balanced accuracy from 2,000 cycles onward.
  • Unknown Detection: MouldIt achieved an AUROC of 0.937 for unknown detection in the single-modal setting and a perfect 1.000 in the multi-modal setting, effectively flagging all unseen failure modes.

Limitations and Future Work

While the results are promising, the authors note several caveats:

  • Synthetic Reliance: The models were trained and tested on synthetic data derived from a single part and material. Real-world validation on a physical production line is the necessary next step.
  • False Alarm Rate: The study used a 5% false positive rate (FPR) for its alarm threshold. In many high-volume production environments, 5% waste due to false alarms might be considered too high.
  • Cost Weighting: The "sorting loss" metric treats all errors equally. In practice, shipping a faulty part is usually much more expensive than accidentally rejecting a good one. Future work could incorporate cost-sensitive loss functions.
  • Control Potential: The authors suggest that the learned representations could eventually be used for real-time process control, not just passive sorting.

Summary updated

Abstract

Smart industrial solutions that can address multiple tasks require models that understand the underlying processes. We examine representation learning for modeling the injection moulding process as an example of such solutions. We consider its data efficiency and multi-modal benefit compared to classical machine learning alternatives. To this end, we synthesize a process-informed dataset based on a real reference cycle of an Erlanger Träger part. We then introduce MouldIt, a temporal convolution and attention based variational autoencoder that reconstructs in-mould signals, while classifying parts as acceptable or as one of our synthetic failure modes. We evaluate MouldIt on two tasks, known-class classification and unknown-class detection, across nine dataset sizes in single-modal and multi-modal settings. We compare it with an accept-all baseline and the classical methods k-nearest neighbors, logistic regression, random forests, and principal component analysis, which we adapt to support both tasks. MouldIt outperforms classical methods across both tasks from 4000 cycles in the single-modal setting and from 2000 cycles in the multi-modal setting. It achieves part sorting losses of 6.0 $\pm$ 0.7% and 1.0 $\pm$ 0.3% in the single-modal and multi-modal settings respectively, ranking first across all baselines and a combination of principal component analysis and random forests.
BibTeX
@misc{ayad2026mouldit,
  author = {Abdullah Ayad},
  title = {{MouldIt: Data Efficiency of Multi-Task Temporal Representation Learning in Injection Moulding}},
  year = {2026},
  eprint = {2611.13646},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13646},
}
Figure