Adaptive Detection of Fast-moving Celestial Objects Using a Mixture-of-experts and Physical-inspired Neural Network

Peng Jia, Ge Li, Bing‐Ming Cheng, Yushan Li, Rongyu SunThe Astronomical Journal 2025 · DOI

TL;DR

This paper introduces a novel deep learning approach for detecting fast-moving celestial objects (FMCBs) in astronomical images. By integrating physical properties of the telescope and observation mode into neural networks, and combining multiple specialized networks using a "mixture of experts" strategy, the method achieves superior detection accuracy across diverse observational conditions without requiring retraining.

What Problem Does This Paper Address?

Detecting fast-moving celestial objects (FMCBs) like asteroids, comets, and space debris is crucial for planetary defense, scientific understanding, and space situational awareness. Traditional methods, such as image differencing, struggle with the increasing volume and diversity of data from modern telescopes, especially space-based ones with varying observational modes. Existing deep learning approaches often rely heavily on image morphology and require extensive retraining when observational conditions change (e.g., different telescopes, exposure times, or tracking modes). This paper aims to develop a more robust and adaptive detection system that can handle these variations without constant re-training.

Methods

The core of the proposed solution is a Physical-Inspired Neural Network (PiNN). This PiNN integrates physical information, specifically the telescope's Point Spread Function (PSF) and the observation mode (e.g., sidereal tracking, object tracking, intersection mode), directly into the neural network architecture. This allows the network to understand how celestial objects should appear under specific conditions, rather than just learning from visual patterns.

To further enhance robustness and handle the diverse nature of FMCBs (from point-like to streaked), the authors employ a Mixture of Experts (MoE) framework. This involves training multiple specialized "expert" neural networks, each with different strengths (e.g., one based on YOLO, another on CenterNet, both adapted with the PiNN concept). A gating network then dynamically selects and combines the outputs of these experts based on the input image characteristics, creating a comprehensive detection system.

Key novelties include:

  • Physical-Inspired Neural Networks (PiNNs): Incorporating PSF and observation mode as prior information.
  • Contrastive Learning for Negative Samples: Using the PSF convolved with motion vectors as negative samples during training to help filter out stationary stars.
  • Mixture of Experts (MoE): Combining multiple specialized PiNNs for broader coverage of FMCB types and observational conditions.

Datasets

The authors primarily use simulated observational data generated using the Skymaker software. This allows for controlled generation of images across three distinct observation modes (Sidereal, Tracking, and Intersection) with varying parameters like sky background, object velocity, and PSF.

They also evaluate their method on a real observation dataset collected from two different telescopes using Tracking and Sidereal modes.

Key Insights and Ideas

  • Physics-Informed AI is Key: Integrating physical properties (PSF, observation mode) into deep learning models significantly improves their ability to detect celestial objects, especially under challenging conditions. This moves beyond purely data-driven pattern recognition.
  • One Size Doesn't Fit All: Different neural network architectures excel at detecting different types of FMCBs or under specific observational conditions. A Mixture of Experts approach effectively leverages these diverse strengths.
  • Adaptability Without Retraining: The PiNN approach allows the model to adapt to new observational conditions or telescope configurations without requiring extensive re-training, a major bottleneck for current methods.
  • Stars as "Negative Examples": Using the expected appearance of stars (PSF convolved with motion vectors) as negative samples during training is an effective way to teach the model to distinguish FMCBs from background stars.

Key Results

The proposed MoE model consistently outperforms baseline methods (YOLOX, CenterNet) and individual expert networks (Expert1, Expert2) across various simulated and real-world scenarios.

  • Simulated Data (Validation Set): Achieved a mean Average Precision (mAP) of 99.26%, precision of 98.50%, and recall of 98.57%.
  • Simulated Data (Test A - Varying Sky Background): Achieved an mAP of 96.52%, precision of 94.54%, and recall of 96.13%.
  • Simulated Data (Test B - Intersection Mode): Achieved an mAP of 97.96%, precision of 93.96%, and recall of 95.56%.
  • Real Observation Data: Achieved an mAP of 91.20%, precision of 90.96%, and recall of 90.46%.

Notably, the MoE model showed strong performance even in the challenging "intersection mode" and maintained high recall rates under varying sky backgrounds, where CenterNet struggled significantly.

Limitations and Future Work

  • Constrained Observational Scenarios: The current methodology's observational scenarios are somewhat constrained. Future work will incorporate more realistic noise sources like cosmic rays.
  • Limited Number of Experts: The MoE currently uses only two experts. The authors plan to expand this by incorporating additional FMCB detection neural networks to further enhance versatility and accuracy.
  • Real-World Data Challenges: Future work will address challenges in real-world data such as uneven quality, large volumes, high labeling costs, class imbalance, and tool limitations. This may involve combining citizen science labeling platforms with semi-supervised learning.
  • Post-Detection Tracking: The current algorithm focuses on detection. Future work will explore using adjacent images to track rapidly moving celestial objects for enhanced efficiency.

Summary updated

Abstract

Abstract Fast-moving celestial objects are characterized by velocities across the celestial sphere that significantly differ from the motions of background stars. In observational images, these objects exhibit distinct shapes, contrasting with the typical appearances of stars. Depending on the observational method employed, these celestial entities may be designated as near-Earth objects or asteroids. Historically, fast-moving celestial objects have been observed using ground-based telescopes, where the relative stability of stars and Earth facilitated effective image differencing techniques alongside traditional fast-moving celestial object detection and classification algorithms. However, the growing prevalence of space-based telescopes, along with their diverse observational modes, produces images with different properties, rendering conventional methods less effective. This paper presents a novel algorithm for detecting fast-moving celestial objects within star fields. Our approach enhances state-of-the-art fast-moving celestial object detection neural networks by transforming them into physical-inspired neural networks. These neural networks leverage the point-spread function of the telescope and the specific observational mode as prior information; they can directly identify fast-moving celestial objects within star fields without requiring additional training, thereby addressing the limitations of traditional techniques. Additionally, all neural networks are integrated using the mixture-of-experts technique, forming a comprehensive fast-moving celestial object detection algorithm. We have evaluated our algorithm using simulated observational data that mimic various observations carried out by space-based telescope scenarios and real observation images. Results demonstrate that our method effectively detects fast-moving celestial objects across different observational modes and telescope configurations.
BibTeX
@article{jia2025adaptive,
  author = {Peng Jia and Ge Li and Bing‐Ming Cheng and Yushan Li and Rongyu Sun},
  title = {{Adaptive Detection of Fast-moving Celestial Objects Using a Mixture-of-experts and Physical-inspired Neural Network}},
  journal = {The Astronomical Journal},
  year = {2025},
  doi = {10.3847/1538-3881/adc4dc},
}
Figure