Mixup-Based Neural Network for Image Restoration and Structure Prediction From SEM Images

Junho Park, Yubin Cho, Yeieun Hwang, Ami Ma, QHwan Kim, Kyu-Baik Chang, Jaehoon Jeong, Suk-Ju KangIEEE Trans. Instrumentation & Measurement 2024 · DOI · OpenReview

Abstract

Scanning electron microscopy (SEM) has been widely used for the semiconductor industry since it provides high-resolution (HR) details of the semiconductor. However, there is a gap in research for various tasks (i.e., image restoration (IR) and structure prediction) in SEM datasets collected under various conditions. Therefore, we introduce a new SEM dataset with diverse characteristics such as energy, noise, current with various levels for IR, and structure prediction. Furthermore, we propose a new deep-learning-based method for this dataset. The method consists of two stages: IR stage and structure prediction stage. In the IR stage, we design the transformer-based architecture to use pixel information widely. In the structure prediction stage, we introduce a novel training algorithm, SEMixup, and a novel CNN-based network, SEM structure prediction network (SEM-SPNet). Specifically, SEMixup overcomes the generalization and robustness of SEM-SPNet by implicitly interpolating a pair of samples and their labels. Experiments demonstrate that our method achieves state-of-the-art results across all dataset conditions. This work expands the possibilities of SEM image analysis using deep learning, contributing to the semiconductor industry.
BibTeX
@article{park2024mixup,
  author = {Junho Park and Yubin Cho and Yeieun Hwang and Ami Ma and QHwan Kim and Kyu-Baik Chang and Jaehoon Jeong and Suk-Ju Kang},
  title = {{Mixup-Based Neural Network for Image Restoration and Structure Prediction From SEM Images}},
  journal = {IEEE Trans. Instrumentation \& Measurement},
  year = {2024},
  doi = {10.1109/tim.2024.3366569},
}

Loading related content...

Figure