Multi-Source Consistency Deep Learning for Semi-Supervised Operating Condition Recognition in Sucker-Rod Pumping Wells

Jianguo Yang, Bin Zhou, Muhammad Naveed Tahir, Min Zhang, Zheng Xiao, Xinqian LiuInternational Journal of Advanced Computer Science and Applications 2024 · DOI

TL;DR

Researchers have developed a new deep learning framework that significantly improves how we monitor "sucker-rod" oil pumps by fusing data from multiple sources—specifically dynamometer and electrical power cards. By combining a WideResNet architecture with semi-supervised consistency learning, the model achieves over 94% accuracy even when 90% of the operational data is unlabeled, effectively solving the "data labeling bottleneck" in oilfield maintenance.

What Problem Does This Paper Address?

Sucker-rod pumping wells (the iconic "nodding donkeys" seen in oil fields) are critical for oil production, but they are prone to various mechanical failures like pump leakage, rod cutting, or wax precipitation. Traditionally, engineers recognize these conditions using dynamometer cards (plots of load vs. displacement).

However, relying on a single data source is risky in complex electromechanical systems. While adding electrical power cards helps, existing deep learning models face three major hurdles:

  1. Label Scarcity: Training deep models requires thousands of labeled examples, but labeling oil well data requires expensive expert intervention.
  2. Wasted Data: Massive amounts of unlabeled operational data are generated daily but usually ignored by supervised models.
  3. Poor Fusion: Simply "stacking" different data sources often leads to redundancy or noise rather than better insights.

Methods

The authors propose a model called MAIWRN28-2_CCL, which stands for Multi-source Augmented Interactive WideResNet with Class-aware Contrastive Learning. Its architecture rests on three pillars:

  • Feature Extraction & Interaction: Using a WideResNet28-2 backbone, the model processes dynamometer and electrical cards as high-dimensional binary images. It employs Multi-Head Self-Attention (MHSA) and feedforward networks to capture deep dependencies within each data source.
  • Multi-Source Consistency: To ensure the model doesn't get "confused" by different data types, the authors introduced a consistency constraint loss based on cosine similarity. This forces the final feature representations from both the dynamometer and electrical cards to align in the latent feature space.
  • Semi-Supervised Learning: To utilize unlabeled data, the model uses a "FixMatch" style approach. It applies weak and strong data augmentations (like rotation or scaling) to unlabeled samples. If the model is confident about a weakly augmented sample, it generates a pseudo-label to train against the strongly augmented version. To prevent the model from reinforcing its own mistakes (confirmation bias), they added Class-aware Contrastive Learning (CCL), which pulls samples of the same category together and pushes different categories apart in the feature space.

Datasets

The model was evaluated on a real-world dataset from an oilfield in China characterized by high-pressure, low-permeability reservoirs.

  • Size: 1,650 samples collected over 3 years from 60 wells.
  • Classes: 11 typical operating conditions (e.g., normal, pump leakage, tubing leakage, traveling valve failure).
  • Format: Each sample includes a measured dynamometer card and a measured electrical power card, both treated as binary images.

Key Insights and Ideas

  • Electrical Power > Dynamometer: Surprisingly, the results showed that models trained on electrical power cards alone often outperformed those trained only on dynamometer cards. This suggests that electrical signals may be more resilient to the noise and "damping coefficient" errors common in physical load measurements.
  • The Power of 10%: One of the most striking findings was that the model achieved 94.13% accuracy with only 10% of the data labeled. This is a massive win for practical deployment, where labeling is the primary cost.
  • Consistency is Key: Forcing the two data sources to "agree" via cosine similarity didn't just improve accuracy; it made the model more robust against the "zero division" errors that often plague electrical signal processing.

Key Results

  • Full Supervision: With 100% labeled data, the proposed method reached 98.79% accuracy, outperforming standard ResNet and WideResNet variants.
  • Semi-Supervised Performance: In the 10% labeled scenario, the model outperformed state-of-the-art multi-view graph convolutional networks (IMvGCN) and other contrastive learning methods by roughly 1.5% to 3%.
  • Ablation Success: Removing the attention mechanism or the consistency loss led to a measurable drop in performance, proving that the "fusion" strategy was doing the heavy lifting.

Limitations and Future Work

While the results are impressive, the authors note a few areas for growth:

  • Data Heterogeneity: The current study focuses on two types of image-based data. Future work could explore integrating more diverse sources, such as production statistics (fluid levels, temperature) which are non-image based.
  • Generalization: The model was tested on a specific type of oil reservoir. Testing its "universality" across different geographical regions and pump types remains a necessary next step.
  • Efficiency: As with many attention-based models, there is always a trade-off between model complexity and real-time processing speed at the "edge" (on-site at the well).

Summary updated

Abstract

How making full use of the multiple measured information sources obtained from the sucker-rod pumping wells based on deep learning is crucial for precisely recognizing the operating conditions. However, the existing deep learning-based operating condition recognition technology has the disadvantages of low accuracy and weak practicality owing to the limitations of methods for handling single-source or multi-source data, high demand for sufficient labeled data, and inability to make use of massive unknown operating condition data resources. To solve these problems, here we design a semi-supervised operating condition recognition method based on multi-source consistency deep learning. Specifically, on the basis of the framework of WideResNet28-2 convolutional neural network (CNN), the multi-head self-attention mechanism and feedforward neural network are first used to extract the deeper features of the measured dynamometer cards and the measured electrical power cards, respectively. Then, the consistency constraint loss based on cosine similarity measurement is introduced to ensure the maximum similarity of the final features expressed by different information sources. Next, the optimal global feature representation of multi-source fusion is obtained by learning the weights of the feature representations of different information sources through the adaptive attention mechanism. Finally, the fused multi-source feature combined with the multi-source semi-supervised class-aware contrastive learning is exploited to yield the operating condition recognition model. We test the proposed model with a dataset produced from an oilfield in China with a high-pressure and low permeability thin oil reservoir block. Experiments show that the method proposed can better learn the critical features of multiple measured information sources of oil wells, and further improve the operating condition identification performance by making full use of unknown operating condition data with a small amount of labeled data.
BibTeX
@article{yang2024multi,
  author = {Jianguo Yang and Bin Zhou and Muhammad Naveed Tahir and Min Zhang and Zheng Xiao and Xinqian Liu},
  title = {{Multi-Source Consistency Deep Learning for Semi-Supervised Operating Condition Recognition in Sucker-Rod Pumping Wells}},
  journal = {International Journal of Advanced Computer Science and Applications},
  year = {2024},
  doi = {10.14569/ijacsa.2024.0151251},
}
Figure