Learning High-Order Geometric Flow Based on The Level Set Method

Chun Li, Yunyun Yang, Hui Liang, Boying Wu

Abstract

Recently, the development of deep learning (DL) has accomplished significant success in many fields, especially in scientific computational areas. Almost all computational problems and physical phenomena can be described by partial differential equations (PDEs). In this work, we propose a framework for solving high-order geometric flows. Motivated by physics-informed neural networks (PINNs) and the traditional level set method (LSM), we have integrated deep neural networks (DNNs) and LSM to make the proposed method more robust and efficient. To test the sensitivity of the system, we established three sets of initial conditions. Numerical experiments demonstrate the effectiveness and superiority of the proposed models compared to state-of-the-art approaches.

Introduction

Geometric flows are partial differential equations (PDEs) that describe the evolution of surfaces or shapes over time. These equations are fundamental to computer vision, medical imaging, and materials science. However, "high-order" geometric flows—those involving fourth or even sixth-order derivatives—are notoriously difficult to solve numerically.

Traditional methods like Finite Element Methods (FEM) or Finite Difference Methods (FDM) struggle with the "curse of dimensionality" and analytical intractability, often becoming unstable as surface complexity increases. While deep learning has shown promise in solving PDEs, standard neural networks often struggle with the extreme sensitivity and "stiffness" of high-order geometric derivatives. This paper introduces a hybrid framework that combines the Level Set Method (LSM) with Physics-Informed Neural Networks (PINNs) to overcome these challenges.

Methods: LSM-Physics Constrained Learning

The authors propose a framework called LSM-Physics Constrained Learning (PCL). The core innovation lies in the synergy between three components:

  1. Level Set Method (LSM): Instead of tracking a surface directly, LSM represents it implicitly as the zero-contour of a higher-dimensional function. This naturally handles topological changes, such as a drop splitting into two.
  2. Order Reduction: To handle the difficulty of high-order derivatives (like the 6th-order Quasi Xuguo flow), the authors break complex equations into a system of coupled lower-order equations. By introducing intermediate variables for curvature ($\kappa$) and other geometric properties, the task becomes manageable for the neural network.
  3. Physics-Constrained Learning: Using the PINN philosophy, the geometric PDEs are encoded directly into the neural network's loss function. The network is trained to minimize the "residual" (the error) of the physical equations using automatic differentiation (AD).
The proposed LSM-PCL framework (top) and the underlying neural network architecture (bottom).

Experimental Setup

The study relies on synthetic observed data designed to test the model's limits across three distinct initial conditions:

  • Initial Condition 1: A single smooth geometric shape.
  • Initial Condition 2: A complex configuration involving multiple overlapping shapes defined by max functions.
  • Initial Condition 3: A dual-shape setup designed to test interaction between separate geometric entities.

These benchmarks were used to compare the proposed Feed-forward Neural Network (FNN) approach against standard PINNs and the DnCNN (Denoising Convolutional Neural Network) architecture.

Key Results and Insights

The proposed method demonstrated superior accuracy and stability across all tests. In Quasi Xuguo flow simulations, the LSM-PCL approach achieved a training loss of 0.1306, outperforming the standard PINN implementation (0.1574).

Robustness and Stability

When compared to DnCNN, the proposed framework was vastly more stable. For the complex Initial Condition 2, the DnCNN exhibited a massive loss of 57.6121, while the authors' method maintained a low loss of 0.7473. This stability is largely attributed to the order reduction strategy, which "flattens" the optimization landscape.

Qualitative Success

Visualization of the flows shows the model successfully "smoothing" complex, jagged initial shapes into elegant, minimal-energy surfaces over time, accurately capturing the physics of geometric diffusion.

Qualitative comparison of geometric flow evolution between PINNs and the proposed LSM-PCL method across three different initial conditions.

Optimizer Performance

The researchers found that the choice of optimizer is critical for physics-constrained tasks. Adam was significantly more effective, achieving much lower loss values (0.7473) compared to Adadelta (21.8484) for the same problem setup.

Conclusion

This paper demonstrates that deep learning is most effective when it augments, rather than replaces, traditional numerical methods. By integrating LSM with DNNs, the authors provide a mesh-free solver capable of handling high-order geometric PDEs. Future work will focus on extending the LSM-PCL framework to 3D manifolds and applying it to real-world noisy data in medical imaging and video processing.

Summary updated

Abstract

<title>Abstract</title> Recently, the development of deep learning (DL), which has accomplished unbelievable success in many fields, especially in scientific computational fields. And almost all computational problems and physical phenomena can be described by partial differential equations (PDEs). In this work, we proposed two potential high-order geometric flows. Motivation by the physical-information neural networks (PINNs) and the traditional level set method (LSM), we have integrated deep neural networks (DNNs) and LSM to make the proposed method more robust and efficient. Also, to test the sensitivity of the system to different input data, we set up three sets of initial conditions to test the model. Furthermore, numerical experiments on different input data are implemented to demonstrate the effectiveness and superiority of the proposed models compared to the state-of-the-art approach.
BibTeX
@inproceedings{li2022learning,
  author = {Chun Li and Yunyun Yang and Hui Liang and Boying Wu},
  title = {{Learning High-Order Geometric Flow Based on The Level Set Method}},
  booktitle = {Nonlinear},
  year = {2022},
  doi = {10.1007/s11071-021-07043-5},
}
Figure