A Survey On 3D Inner Structure Prediction from its Outer Shape

Mohamed Mejri, Antoine Richard, Cédric PradalierarXiv 2020 · arXiv

In the wood industry, knowing what’s inside a log before you cut it is the difference between high-value lumber and scrap. While X-ray CT scanners provide a "gold standard" view of internal defects like knots, they are prohibitively expensive—often costing upwards of $5 million.

A recent paper titled "A Survey On 3D Inner Structure Prediction from its Outer Shape" by Mejri et al. explores a more cost-effective alternative: using deep learning to predict a tree's internal density based solely on the texture and shape of its bark.

TL;DR

Researchers compared 2D, 3D, and Recurrent (CLSTM) neural network architectures to predict the internal density of logs from their external bark shape. Surprisingly, simpler 2D encoder-decoder models (like SegNet and U-Net) outperformed more complex 3D and sequence-based models, offering a robust and computationally efficient path toward non-invasive wood quality assessment.

What Problem Does This Paper Address?

The internal structure of a tree, particularly the distribution of knots, determines its commercial value. Studies suggest that sawing a log based on its internal density rather than just its external shape can increase recovery value by 13%.

However, there is a catch: internal knots are formed by living branches, and their growth often leaves subtle but detectable signatures on the bark's roughness and shape. The challenge is mapping these external "surface signals" to a full 3D internal density map without the need for multi-million dollar CT hardware.

Methods

The authors framed this as a pixel-wise (or voxel-wise) regression problem, testing three main categories of architectures:

  1. 2D Encoder-Decoders: Models like SegNet, U-Net, and DeepLabV3+ were used to predict 2D density slices from corresponding surface sections. The authors modified these standard segmentation models for regression by using L2 (mean-squared error) loss and replacing standard ReLU activations with Parametric-ReLU (P-ReLU) to improve fitting.
  2. 3D Encoder-Decoders: Models like 3D-U-Net, 3D-SegNet, and VoxResNet attempted to process the log as a complete volumetric structure.
  3. Convolutional LSTM (CLSTM): These models aimed to capture the longitudinal correlation between successive cross-sections of the log, essentially treating the log as a sequence of images.
Fig. 2. Different steps for 2D prediction and 3D reconstruction

Datasets

Because large-scale datasets of real CT-scanned logs are rare and expensive to produce, the researchers generated a synthetic dataset of 1800 logs.

  • Surface Modeling: The tree surface was modeled using polar coordinates, with texture and shape represented by high and low-frequency cosines.
  • Internal Modeling: Branches (high-density regions) were modeled using combinations of square root and linear functions.
  • Diversity: The dataset included logs with varying numbers of branches (from 2 to 7) to test model scalability.
Fig. 3. From left to right: surface with a branch, surface without branch, longitudinal section of a log, cross section of a log

Key Insights and Ideas

  • Simplicity Wins: Despite the 3D nature of the problem, 2D models achieved the lowest Root Mean Squared Error (RMSE). The authors attribute this to the fact that 2D models are simpler and more robust against overfitting, especially on synthetic data.
  • The Power of Skip-Connections: As the complexity of the log increased (more branches), U-Net began to outperform SegNet. This highlights the importance of skip-connections in recovering fine-grained spatial information lost during the encoding process.
  • Bidirectionality Matters in CLSTMs: For sequence-based models, a bidirectional approach (looking both "up" and "down" the log) significantly improved results over unidirectional models, confirming that knots have a spatial correlation that spans in both directions.
  • Parameter Efficiency: 3D models like 3D-SegNet required a staggering 144 million parameters, whereas 2D-SegNet achieved better results with only 34 million parameters.

Key Results

Quantitatively, the 2D models were the clear winners across all test cases. For a log with 2 branches, SegNet achieved an RMSE of $1.27 \times 10^{-2}$, compared to $2.39 \times 10^{-2}$ for 3D-SegNet and $2.93 \times 10^{-2}$ for CLSTM-SegNet.

Qualitatively, visual assessments using 3D rendering software (Paraview) showed that 2D models produced iso-surfaces that more closely matched the ground truth than their 3D counterparts.

Visual comparison of 3D reconstructions. The 2D U-Net (middle) shows a much tighter fit between the predicted (red) and ground truth (green) volumes compared to the 3D-U-Net (left).

Limitations and Future Work

The primary limitation is the reliance on synthetic data. In the real world, the relationship between bark roughness and internal knots is far more stochastic and "noisy" than a Gaussian-modeled synthetic log.

The authors suggest that future work should focus on:

  1. Real-world Datasets: Training on actual CT-scanned trees where defect distributions are less correlated to the surface.
  2. Hybrid Approaches: Integrating the longitudinal correlation strengths of recurrent networks into the high-performing 2D architectures.

For engineers in the field, this research suggests that we don't necessarily need the most complex 3D architectures to solve volumetric problems; sometimes, a well-tuned 2D approach is both more accurate and easier to deploy.

Summary updated

Abstract

The analysis of the internal structure of trees is highly important for both forest experts, biological scientists, and the wood industry. Traditionally, CT-scanners are considered as the most efficient way to get an accurate inner representation of the tree. However, this method requires an important investment and reduces the cost-effectiveness of this operation. Our goal is to design neural-network-based methods to predict the internal density of the tree from its external bark shape. This paper compares different image-to-image(2D), volume-to-volume(3D) and Convolutional Long Short Term Memory based neural network architectures in the context of the prediction of the defect distribution inside trees from their external bark shape. Those models are trained on a synthetic dataset of 1800 CT-scanned look-like volumetric structures of the internal density of the trees and their corresponding external surface.
BibTeX
@misc{mejri2020survey,
  author = {Mohamed Mejri and Antoine Richard and Cédric Pradalier},
  title = {{A Survey On 3D Inner Structure Prediction from its Outer Shape}},
  year = {2020},
  eprint = {2002.04571},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2002.04571},
}

Loading related content...

Figure