Se-ResNet+SVM model: an effective method of searching for hot subdwarfs from LAMOST

Cheng Zhongding, Kong xiaoming, Tianmin Wu, Yude Bu, Lei Zhenxin, Yatao Zhang, Yi Zhenping, Meng LiuarXiv 2022 · DOI · arXiv

TL;DR

Researchers have developed a hybrid "Se-ResNet+SVM" model that combines deep learning feature extraction with classical machine learning to identify rare hot subdwarf stars in the massive LAMOST spectral database. By fusing automated abstract features with domain-specific "experience features," the team discovered 176 new hot subdwarfs with high precision, providing a vital new dataset for studying stellar evolution.

What Problem Does This Paper Address?

Hot subdwarfs are small, hot stars in the late stages of their lives, often found at the "blue end" of the horizontal branch in an H-R diagram. They are crucial for understanding how stars evolve and how galaxies produce ultraviolet radiation. However, finding them is like looking for a needle in a haystack.

The primary challenge is spectral mimicry: the light signatures (spectra) of hot subdwarfs look remarkably similar to more common main-sequence B-type stars and Blue Horizontal Branch (BHB) stars. Traditional methods, like manual visual inspection or simple color-cutting, are too slow and imprecise for the millions of spectra generated by modern surveys like LAMOST (Large Sky Area Multi-Object Fiber Spectroscopic Telescope).

Methods

The authors propose a two-stage hybrid model called Se-ResNet+SVM.

  1. Feature Extraction (Se-ResNet): They use a 1D Squeeze-and-Excitation Residual Network. While a standard ResNet helps avoid the "vanishing gradient" problem in deep networks, the Squeeze-and-Excitation (SE) block adds a layer of "attention." It allows the model to weight different feature channels based on their importance, effectively telling the network which parts of the spectrum to focus on.
  2. Feature Fusion: This is the "secret sauce." The authors don't just rely on the machine's abstract features. They manually select three specific wavelength bands (4,000–5,000Å, 5,350–5,450Å, and 6,500–6,640Å) known by astronomers to contain critical helium absorption lines. These "experience features" are fused with the deep learning features into a single hybrid vector.
  3. Classification (SVM): This hybrid vector is fed into a Support Vector Machine. SVMs are particularly robust when dealing with the relatively small labeled datasets common in astrophysics.
  4. Two-Stage Filtering: To minimize "false positives" from similar-looking stars, they first run a binary classifier (Hot Subdwarf vs. Not), followed by a four-class classifier to specifically distinguish between hot subdwarfs, A-type, B-type, and BHB stars.

Datasets

The study utilizes data from LAMOST DR8 (Data Release 8), which contains over 10 million low-resolution spectra.

  • Positive Samples: 2,422 spectra of known hot subdwarfs obtained by cross-matching LAMOST data with existing catalogs (e.g., Geier 2020, Luo et al. 2021).
  • Negative Samples: 12,116 spectra including O-type stars, BHB stars, A/B-type stars, galaxies, and quasars (QSOs).
  • Evaluation: The models were tested on a 7:3 training/test split.

Key Insights and Ideas

  • Domain Knowledge Matters: The paper demonstrates that "black box" deep learning performs significantly better when augmented with human expertise. Fusing "experience features" (specific helium lines) with abstract neural network features boosted the F1 score from ~89-93% to over 96%.
  • The Power of Attention: The Squeeze-and-Excitation mechanism is particularly well-suited for spectroscopy. By learning the "importance" of different spectral channels, the model mimics an astronomer focusing on specific absorption lines while ignoring noise in the continuum.
  • Hierarchical Filtering: The two-stage approach (Binary $\rightarrow$ Four-class) is a clever way to handle high-volume data. The binary model acts as a wide net, while the four-class model acts as a fine filter to remove the "mimic" stars that usually cause high contamination rates.

Key Results

  • High Accuracy: The binary classification model achieved an F1 score of 96.17% and a precision of 97.32% on the test set.
  • Discovery: Applying the model to 333,534 previously unclassified non-FGK type spectra in LAMOST DR8, the team identified 176 new hot subdwarfs after manual verification.
  • Precision Gains: While the binary model alone had a precision of 67.94% on new candidates, the two-stage process (with a high threshold of 0.9) pushed the precision to 87.60%.
  • Parameter Estimation: Beyond just finding the stars, a modified Se-ResNet regression model successfully estimated atmospheric parameters ($T_{eff}$, $\log g$, and $[He/H]$) with a Mean Absolute Error of only 1212.65 K for temperature.

Limitations and Future Work

The authors note that while the four-class model significantly improves precision, it comes at the cost of recall. In other words, to be very sure the stars they find are hot subdwarfs, they likely miss some genuine ones (the "threshold" trade-off).

Future work could involve applying this hybrid architecture to even larger datasets from upcoming sky surveys or refining the regression models to handle even lower signal-to-noise ratio (SNR) spectra, which remain a challenge for current deep learning approaches.

Summary updated

Abstract

In this paper, we apply the feature-integration idea to fuse the abstract features extracted by Se-ResNet with experience features into hybrid features and input the hybrid features to the Support Vector Machine (SVM) to classify Hot subdwarfs. Based on this idea, we construct a Se-ResNet+SVM model, including a binary classification model and a four-class classification model. The four-class classification model can further screen the hot subdwarf candidates obtained by the binary classification model. The F1 values derived by the binary and the four-class classification model on the test set are 96.17% and 95.64%, respectively. Then, we use the binary classification model to classify 333,534 nonFGK type spectra in the low-resolution spectra of LAMOST DR8 and obtain a catalog of 3,266 hot subdwarf candidates, of which 1223 are newly-determined. Subsequently, the four-class classification model further filtered the 3,266 candidates, 409 and 296 are newly-determined respectively when the thresholds were set at 0.5 and 0.9. Through manual inspection, The true number of hot subdwarfs in the three newly-determined canditates are 176, 63, and 41, the corresponding precision of the classification model in the three cases are 67.94%, 84.88%, and 87.60%, respectively. Finally, we train a Se-ResNet regression model with MAE values of 1212.65 K for Teff, 0.32 dex for log g and 0.24 for [He/H], and predict the atmospheric parameters of these 176 hot subdwarf stars. This provides a certain amount of samples to help for future studies of hot subdwarfs.
BibTeX
@misc{zhongding2022se,
  author = {Cheng Zhongding and Kong xiaoming and Tianmin Wu and Yude Bu and Lei Zhenxin and Yatao Zhang and Yi Zhenping and Meng Liu},
  title = {{Se-ResNet+SVM model: an effective method of searching for hot subdwarfs from LAMOST}},
  year = {2022},
  eprint = {2212.10372},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2212.10372},
}
Figure