Pour Point Prediction Method for Mixed Crude Oil Based on Ensemble Machine Learning Models

Jimiao Duan, Zhi Kou, Huishu Liu, Keyu Lin, Sichen He, Shiming ChenProcesses 2024 · DOI

TL;DR

This paper tackles the challenge of predicting the pour point of mixed crude oil, a crucial property for safe and efficient pipeline transport. By comparing six machine learning models, they found XGBoost to be the most accurate, achieving a mean absolute error of just 1.12 °C. Their proposed model is adaptable, handling missing data and using readily available physical properties like density and viscosity, making it practical for real-world engineering scenarios.

What Problem Does This Paper Address?

Transporting crude oil via pipelines is common, but often involves mixing oils from different sources. The "pour point" – the temperature at which oil solidifies – is critical for pipeline operations, affecting temperature control, transportation methods, and overall safety. Currently, pour point is measured manually, which is inefficient and leads to delays. Furthermore, predicting the pour point of mixed crude oil is complex because the relationship between the pour point of individual components and the mixture isn't straightforward and can be influenced by many factors. Existing empirical models have limitations, often requiring specific conditions or detailed component pour point data, which may not always be available. This paper aims to develop a more robust and adaptable method for predicting mixed crude oil pour points, especially in scenarios with limited or missing data.

Methods

The researchers explored six machine learning algorithms: Multiple Linear Regression (MLR), Random Forest (RF), Support Vector Machine (SVR), LightGBM, Backpropagation Neural Network (BPNN), and XGBoost. They compared these models against traditional empirical methods. The core of their approach is an ensemble learning strategy, specifically using XGBoost, which combines multiple decision trees to improve prediction accuracy and stability.

Key methodological innovations include:

  • Flexible Input Parameters: Instead of relying solely on component crude oil pour points, their XGBoost model can effectively use physical properties like density and viscosity, which are often more readily available or measurable in real-time.
  • Handling Missing Data: The study specifically investigates the model's performance when component pour points are missing, a common issue in engineering.
  • Comprehensive Evaluation: They used standard machine learning metrics (MAD, RMSD, R², ADmax) and pour-point specific metrics (Dp) to rigorously assess model performance.
  • Sensitivity Analysis: The paper analyzes how model performance changes with varying data volumes and the presence of missing input parameters.

Datasets

The study utilized a dataset of crude oil properties collected over 10 years from on-site manual sampling tests, comprising 11,140 sample sets. This dataset includes pour point, density, viscosity, and blend ratios of mixed crude oil under various compositions of four component oils. The data was split into an 80% training set (8912 sets) and a 20% testing/validation set (2228 sets).

Key Insights and Ideas

  • XGBoost Reigns Supreme: Among the tested models, XGBoost consistently outperformed others, demonstrating superior predictive accuracy and stability. This is attributed to its robust nonlinear fitting capabilities, resilience to noise, and effective regularization techniques that prevent overfitting.
  • Physical Properties are Powerful Predictors: The ability of the XGBoost model to accurately predict pour points using density and viscosity, in addition to blend ratios, highlights the importance of these physical properties and the power of machine learning to uncover complex relationships.
  • Machine Learning Adapts to Data Scarcity: While empirical models are less sensitive to data volume, machine learning models, particularly XGBoost, become significantly more accurate as data increases. This suggests a transition from empirical to ML-based prediction as data availability grows.
  • Robustness to Missing Data: Even when component pour points are missing, the XGBoost model can still provide reasonably accurate predictions using density and viscosity. This is a critical advantage for real-world applications where complete data is rare.

Key Results

  • XGBoost Achieves High Accuracy: The best-performing XGBoost model achieved a mean absolute deviation (MAD) of 1.12 °C when trained on 8912 data points using pour points, density, viscosity, and blend ratios as inputs.
  • Empirical Models Lag Behind: The best empirical model (Equation (4)) had a MAD of 2.65 °C, significantly higher than XGBoost.
  • Handling Missing Component Pour Points: When component crude oil pour points were missing, the XGBoost model, using only blend ratio, viscosity, and density, achieved a MAD of 1.93 °C.
  • High Prediction Precision: 88.0% of the predictions made by the XGBoost model were within 2 °C of the actual pour point.
  • Data Volume Matters for ML: The study showed that while empirical models are less affected by sample size, XGBoost's performance significantly improves with more training data, becoming superior to empirical models beyond a certain threshold (around 1000 samples).

Limitations and Future Work

  • Model Transferability: The authors acknowledge that machine learning models are trained on specific datasets. Their accuracy needs to be verified when new crude oil varieties are introduced or when the model is transferred to different pipelines with diverse compositions.
  • Data Volume Bottleneck: While machine learning models benefit from more data, the improvement effect of additional input parameters gradually weakens after a certain point. Further improvements might require an order of magnitude increase in data or exploring more advanced feature engineering.
  • Future Work: The study suggests that the methodology investigated holds potential for broader application. Future work could focus on further validating the model's performance across a wider range of crude oil types and pipeline conditions, and exploring more advanced ensemble techniques or deep learning architectures.

Summary updated

Abstract

Pipelines are the most common way to transport crude oil. The crude oil developed from different fields is mixed first and then transported. The pour point of mixed crude oil is very important for pipeline schemes and ensuring the safe, efficient, and flexible operation of the pipeline. An integrated machine learning model based on XGBoost is identified as optimal to predict the pour point of mixed crude oil by comprehensive comparison among six different types of machine learning models: multiple linear regression, random forest, support vector machine, LightGBM, backpropagation neural network, and XGBoost. A mixed crude oil pour point prediction model with strong engineering adaptability is proposed, focusing on enhancing the flexibility of machine learning model inputs (using density and viscosity instead of component crude oil pour points) and addressing challenges such as data volume and input missing in engineering scenarios. With the inputs of pour point Tg, density ρ, viscosity μ, and ratio Xi in component oils, the mean absolute error of the model prediction estimations after training with 8912 data is 1.12 °C, when the pour point Tg of the component crude oil is missing, the mean absolute error is 1.93 °C and the percentage of the predicted absolute error within 2 °C is 88.0%. This study can provide support for the intelligent control of flow properties of pipeline transport mixed oil.
BibTeX
@inproceedings{duan2024pour,
  author = {Jimiao Duan and Zhi Kou and Huishu Liu and Keyu Lin and Sichen He and Shiming Chen},
  title = {{Pour Point Prediction Method for Mixed Crude Oil Based on Ensemble Machine Learning Models}},
  booktitle = {Processes},
  year = {2024},
  doi = {10.3390/pr12091783},
}
Figure