Prediction of Coalbed Methane Production Using a Modified Machine Learning Methodology

Hongyang Zhang, Kewen Li, S. Y. Shi, Jifu HeEnergies 2025 · DOI

TL;DR

This paper introduces a novel hybrid machine learning model, LSTM-A, that combines Long Short-Term Memory (LSTM) networks with a Transformer's attention mechanism to predict coalbed methane (CBM) production. The LSTM-A model significantly outperforms traditional methods and standalone LSTM, achieving higher accuracy and longer effective prediction intervals, even with limited training data.

What Problem Does This Paper Address?

Predicting coalbed methane (CBM) production is crucial for efficient resource development, economic evaluation, and optimizing operational strategies. However, existing methods, primarily Decline Curve Analysis (DCA) and traditional numerical simulations, have limitations. DCA models are often too simplistic for complex reservoirs or new wells, while numerical simulations require extensive, high-precision data and numerous parameters that are difficult to obtain in the field. While machine learning (ML) has shown promise, current ML models often require vast amounts of data for training and can only provide accurate forecasts for short periods (e.g., 30 days). This paper aims to bridge this gap by developing a more accurate and robust ML model capable of long-term CBM production forecasting with reduced data requirements.

Methods

The core of this research is the development of a hybrid Long Short-Term Memory-Attention (LSTM-A) model. This model integrates the sequential processing capabilities of LSTMs to capture short- and long-term temporal dependencies with the self-attention mechanism of the Transformer architecture. The attention mechanism allows the model to dynamically weigh the importance of different time steps and features, enabling it to focus on critical patterns in the production data.

The model architecture involves:

  1. LSTM Layers: These layers process the input time-series data to extract temporal features and dependencies.
  2. Fully Connected Layer: This layer transforms the LSTM output dimension to match the Transformer's input requirements.
  3. Transformer Encoder Layers: These layers utilize self-attention to capture global feature relationships and complex dependencies across the entire sequence.
  4. Dropout Layer: Applied to mitigate overfitting.
  5. Final Fully Connected Layer: Maps the Transformer's output to the final prediction.

The model is trained using the Mean Absolute Error (MAE) loss function and optimized with the Adam optimizer. Evaluation metrics include MAE, Root Mean Square Error (RMSE), and R-squared (R²).

Datasets

The study utilizes production data from 21 representative CBM wells in the Yangquan region of Shanxi, China. The dataset covers the period from post-fracturing operations to the end of production. The data was divided into two subsets based on fracturing operations, with 3078 samples from primary fracturing and 3545 from secondary fracturing. After preprocessing and outlier removal, 4512 data points were retained for analysis.

Key Insights and Ideas

  • Synergy of LSTM and Transformer: Combining LSTM's temporal sequence modeling with Transformer's attention mechanism is highly effective for CBM production forecasting, capturing both short-term fluctuations and long-term trends.
  • Attention Mechanism's Power: The self-attention mechanism is crucial for focusing on the most relevant parts of the time series, leading to improved accuracy and a better understanding of production dynamics.
  • Engineering Parameters Over Geological: Incorporating engineering parameters like casing pressure (CP), bottomhole pressure (BHP), water production rate (WPR), and dynamic liquid level (DLL) proved more beneficial than relying solely on geological parameters. These parameters are easier to obtain, less costly, and more directly indicative of production behavior.
  • Robustness with Limited Data: The LSTM-A model demonstrates strong performance even with smaller training datasets, addressing a key limitation of previous ML approaches.
  • Handling Production Volatility: The model shows superior ability to predict fluctuating production patterns, which are common in CBM wells and challenging for traditional methods.

Key Results

  • The LSTM-A model achieved significantly higher prediction accuracy compared to traditional methods (ARPS, Li-Horne, Exponential, Harmonic models) and the standalone LSTM model.
  • For Well 1 (rapid decline), LSTM-A achieved an R² of 0.79, a substantial improvement over LSTM's 0.17.
  • For Well 2 (stable production), LSTM-A achieved an R² of 0.92, indicating excellent alignment with actual data.
  • For Well 3 (fluctuating production), LSTM-A's R² improved from -1.04 (LSTM) to 0.56, demonstrating its capability in handling volatile production.
  • Feature selection analysis showed that using CP and WPR as features yielded the best results.
  • Optimal hyperparameters included a Dropout rate of 0.1-0.2 and a time step of 20.

Limitations and Future Work

  • Volatile Production Data: While improved, the LSTM-A model still faces challenges in predicting highly volatile production data, especially under extreme conditions.
  • Additional Features: Future research could explore incorporating more features, such as climate data, socio-economic factors, or multi-scale geological models, for a more comprehensive assessment.
  • Hybrid Models: Investigating hybrid models that combine strengths from different ML approaches could further enhance predictive capabilities.
  • Online Learning: Developing online learning methods would enable real-time model adjustments, crucial for dynamic forecasting and adapting to evolving reservoir conditions.
  • Interpretability: The "black box" nature of deep learning models remains a challenge. Future work could focus on enhancing model interpretability through techniques like visualization or attention mechanisms to understand the factors driving predictions.
  • Broader Applicability: The proposed method could be expanded to other unconventional energy sources like shale gas and tight gas, given their geological and production similarities.

Summary updated

Abstract

Compared to natural and shale gas, studies on predicting production specific to coalbed methane (CBM) are still relatively limited, and mainly use decline curve methods such as Arps, Stretched Exponential Decline Model, and Duong’s model. In recent years, machine learning (ML) methods applied to CBM production prediction have focused on the significant data characteristics of production, achieving more accurate predictions. However, throughout the application process, these models require a large amount of data for training and can only achieve accurate forecasts over a short period, such as 30 days. This study constructs a hybrid ML model by integrating a long short-term memory (LSTM) network and Transformer architecture. The model is trained using the mean absolute error (MAE) loss function, optimized using the Adam optimizer, and finally evaluated using metrics such as MAE, root mean square error (RMSE), and R squared (R2) scores. The results show that the LSTM-Attention (LSTM-A) hybrid model based on small training datasets can accurately capture the CBM production trend and is superior to traditional methods and the LSTM model regarding prediction accuracy and effective prediction time interval. The methodologies established and the results obtained in this study are of great significance to accurately predict CBM production. It is also helpful to better understand the mechanisms of CBM production.
BibTeX
@inproceedings{zhang2025prediction,
  author = {Hongyang Zhang and Kewen Li and S. Y. Shi and Jifu He},
  title = {{Prediction of Coalbed Methane Production Using a Modified Machine Learning Methodology}},
  booktitle = {Energies},
  year = {2025},
  doi = {10.3390/en18061341},
}
Figure