Adaptive Finetuning of 3D CNNs with Interpretation Uncertainty for Seismic Fault Prediction

Ahmad Mustafa, Ghassan AlRegib, Reza Rastegar2023 · DOI

TL;DR

Researchers have developed a method to finetune 3D convolutional neural networks (CNNs) for seismic fault prediction using sparse, uncertain human interpretations. By incorporating "interpretation uncertainty" into the training process, the model learns to bridge the gap between synthetic training data and complex real-world geology, outperforming standard finetuning techniques.

What Problem Does This Paper Address?

In the oil and gas industry, identifying geological faults in 3D seismic volumes is critical for safety and efficiency. While 3D CNNs are great at this, they are data-hungry. To solve this, researchers usually train models on massive amounts of synthetic data.

However, when these models meet the real world, they encounter domain shift: real seismic data has noise, varying frequencies, and complex geometries that synthetic models can't perfectly replicate. To fix this, we need to "finetune" the models on real data. But there are two major roadblocks:

  1. Dimensionality Mismatch: Humans typically annotate 2D slices, but the models operate on 3D chunks.
  2. Label Uncertainty: Human experts aren't perfect. They might miss subtle faults, or they might be unsure exactly where a fault line ends. Standard training treats these "fuzzy" human labels as absolute truth, which can confuse the model.

Methods

The authors utilize a 3D U-Net architecture (an encoder-decoder style network) and propose a two-pronged strategy for adaptive finetuning:

  • Label Uncertainty-aware Sampling: Instead of feeding the network random chunks of the seismic volume (which are mostly "non-fault" space), they use a Poisson distribution centered on the human-labeled pixels. This ensures the model focuses on the most relevant areas while injecting enough randomness to prevent overfitting.
  • Fault Distance-based Weighting: To handle the "fuzziness" of human picks, they don't treat every labeled pixel equally. They apply a weighting mask where the loss contribution is highest at the exact location of the human pick and drops off exponentially as you move away. This effectively tells the model: "Be very sure about the center of this fault, but we're less certain about the exact edges."
  • Masked Loss: To handle the 2D-to-3D mismatch, they calculate the loss across the whole 3D block but "mask out" everything except the specific 2D slice where the human provided labels.

Datasets

The study used three primary data sources:

  1. Synthetic Data: A large variety of generated 3D fault models used for initial pretraining.
  2. F3 Block (Netherlands Offshore): A well-known public seismic dataset. The authors manually annotated major faults in a single inline section for finetuning.
  3. Thebe Gas Field (Australia): A real-world dataset from the Exmouth plateau. This was used to validate the model's performance on complex, deep-section faults.

Key Insights and Ideas

  • Sparse is Enough: You don't need to label an entire 3D volume to improve a model. Finetuning on just a few strategically chosen 2D slices can significantly adapt a 3D model to a new geological domain.
  • Embrace the "Fuzziness": By mathematically modeling human uncertainty (the exponential decay weight), the network becomes more robust. It learns to ignore potential human errors at the "tails" of fault picks, leading to cleaner, more continuous predictions.
  • Generalization through Finetuning: Interestingly, after being finetuned on a few labels, the model often "discovered" faults in the volume that the human interpreter had missed or left unannotated.

Key Results

  • Visual Continuity: The finetuned models produced much more continuous and confident fault picks compared to the "baseline" (pretrained only) models, which often produced fragmented or noisy results on real data.
  • Uncertainty Matters: In a "severe uncertainty" test (where only a tiny fraction of faults were labeled), the proposed uncertainty-aware method significantly outperformed standard finetuning. Standard finetuning tended to treat unlabeled faults as "non-faults," effectively teaching the model to ignore real geological features.
  • Quantitative Improvement: The authors demonstrated that incorporating label confidence allows the network to maximize learning from high-confidence areas while minimizing the "damage" caused by potentially erroneous or incomplete human labels.

Limitations and Future Work

The authors acknowledge a few areas for growth:

  • Non-fault Uncertainty: Currently, the model only accounts for uncertainty in where a fault is. It doesn't yet account for uncertainty in "non-fault" regions (e.g., areas where an interpreter might have missed a fault entirely).
  • Simple Error Model: The current model assumes confidence is always highest at the center of a pick. Future work could explore more complex uncertainty models based on seismic image quality or signal-to-noise ratios.
  • Human-in-the-loop: The paper sets the stage for more robust "human-in-the-loop" systems where AI and geophysicists can collaborate more effectively, acknowledging the strengths and weaknesses of both.

Summary updated

Abstract

3D CNNs can exploit the full extent of spatial information in seismic volumes to predict faults. They require large quantities of training data, but this issue has been mitigated by training such networks with large amounts of synthetic training data to apply afterwards on real datasets. Because of domain shift, pre-trained networks may fail to perform as expected, emphasizing the need to finetune the network with labels obtained on target data of interest. The mismatch in dimensions of network input and interpreter annotations (mostly 2D slices) poses a problem in this respect. In addition, there is a high degree of uncertainty attached to such labels, both on a coarse level as well as on a more fine-grained basis. On an image level, the interpreter may only annotate structures in a small, localized portion of the seismic volume. Furthermore, owing to uncertainty regarding the exact delineation of the endpoints of picked faults, interpreters may only label certain segments on the complete fault line. We propose a method whereby we demonstrate a procedure to finetune the pretrained 3D CNNs with sparse 2D labels on target datasets, resulting in the adaption of their weights to better pick faults in the new domains. Secondly, we devise means to incorporate interpretation uncertainty on labels produced for finetuning to generate better, more reliable fault estimations. We validate our findings on various real datasets and demonstrate improved network performance over the pretrained CNN alone. Additionally, we show that incorporating label uncertainty while finetuning leads to better interpretation performance compared to uncertainty-agnostic finetuning.
BibTeX
@misc{mustafa2023adaptive,
  author = {Ahmad Mustafa and Ghassan AlRegib and Reza Rastegar},
  title = {{Adaptive Finetuning of 3D CNNs with Interpretation Uncertainty for Seismic Fault Prediction}},
  year = {2023},
  doi = {10.31223/x5xm2r},
}
Figure