Catalog-based detection of unrecognized blends in deep optical ground based catalogs

Shuang Liang, Prakruth Adari, Anja von der LindenarXiv 2025 · DOI · arXiv

TL;DR

Astronomers use machine learning to identify "unrecognized blends"—multiple galaxies mistakenly detected as a single object in deep ground-based images. By analyzing only catalog-level data like colors, magnitude, and size, the researchers could identify up to 80% of these problematic sources, providing a vital tool for cleaning data for upcoming massive surveys like the Vera C. Rubin Observatory’s LSST.

What Problem Does This Paper Address?

In deep space imaging, galaxies often overlap from our perspective. While many of these "blends" can be separated by smart software, a significant fraction (15%–30%) are "unrecognized"—they are so closely packed that ground-based telescopes, limited by atmospheric blurring (the Point Spread Function), see them as a single, slightly weird-looking object.

These unrecognized blends are a nightmare for precision cosmology. They bias measurements of galaxy shapes (essential for weak lensing studies) and distort "photometric redshifts" (estimating distance based on color). If we can't tell one galaxy is actually two, our maps of the universe’s expansion and dark matter distribution will be fundamentally flawed.

Methods

The authors investigated whether machine learning could spot these blends using only "catalog-level" information—simple numbers like brightness in different filters (colors), total magnitude, and the physical size of the detection—rather than processing raw, heavy image pixels.

They compared several algorithms:

  • Random Forest (RF) & k-Nearest Neighbors (k-NN): Supervised learners trained to distinguish "pure" sources from blends.
  • Self-Organizing Maps (SOM): An unsupervised technique that clusters similar objects. The authors used two strategies here: identifying "blending cells" (clusters with high blend concentrations) and a "distance cut" (flagging objects that don't fit well into any standard galaxy cluster).
  • Anomaly Detection: Algorithms like Local Outlier Factor (LOF) and Isolation Forest, which assume blends will look like "weird" outliers compared to the general galaxy population.

Datasets

The study relied on the COSMOS field, a famous patch of sky with a unique advantage:

  1. Ground-based data: 9-band photometry ($uBVri^+z^{++}YJH$) and size measurements from telescopes like Subaru, mimicking what the LSST will see.
  2. Space-based "Truth": High-resolution Hubble Space Telescope (HST) imaging of the same area. Because Hubble is above the atmosphere, it can easily resolve the individual galaxies that ground-based telescopes blur together.

By matching the two, the authors created a "labeled" dataset where they knew exactly which ground-based detections were actually unrecognized blends. They also utilized spectroscopic redshifts (spec-z) to evaluate how blending affects distance estimates.

Key Insights and Ideas

  • Size is the Secret Sauce: Including the "flux radius" (a measure of size) significantly improved detection rates. Blends tend to look slightly more bloated than single galaxies of the same brightness.
  • NIR is Optional: Interestingly, adding Near-Infrared (NIR) bands didn't help much. This is great news for the Rubin Observatory, which primarily operates in optical bands.
  • Strong vs. Weak Blends: The algorithms are much better at finding "strong blends" (where the two galaxies have similar brightness) than "weak blends" (where one galaxy is much fainter than the other). Fortunately, strong blends cause the most measurement bias.
  • Blends $\neq$ Redshift Outliers: While unrecognized blends often result in bad redshift estimates, they aren't the only cause. The authors found that algorithms optimized to find blends weren't necessarily the best at finding redshift outliers, suggesting these are two overlapping but distinct problems.

Key Results

  • Blend Prevalence: About 17% of objects in the deep COSMOS catalog are unrecognized blends.
  • Performance: Random Forest and k-Nearest Neighbors were the top performers.
  • The Trade-off: At a "Cost" of rejecting 10% of the total galaxy sample (including some good ones), the methods could catch about 33% of all unrecognized blends. If a researcher is willing to throw away 50% of their data to get a ultra-pure sample, they can catch over 80% of the blends.
  • Purity Boost: Using these methods can significantly reduce the "catastrophic outlier" rate in photometric redshift estimates, leading to more reliable cosmological constraints.

Limitations and Future Work

The primary limitation is the "precision-recall" trade-off: to catch more blends, you inevitably throw away many perfectly good, single galaxies. This reduces the statistical power of a survey.

Future work involves integrating these catalog-based flags into complex cosmological pipelines to see exactly how much they improve our understanding of Dark Energy. The authors also suggest that as we get more data from the James Webb Space Telescope (JWST) and the Roman Space Telescope, we will have even better "truth" sets to train these models for the next generation of sky surveys.

Summary updated

Abstract

In deep, ground-based imaging, about 15%-30% of object detections are expected to correspond to two or more true objects - these are called ``unrecognized blends''. We use Machine Learning algorithms to detect unrecognized blends in deep ground-based photometry using only catalog-level information: colors, magnitude, and size. We compare the performance of Self Organizing Map, Random Forest, k-Nearest Neighbors, and Anomaly Detection algorithms. We test all algorithms on 9-band ($uBVri^{+}z^{++}YJH$) and 1-size (flux_radius in $\textit{i}$-band) measurements of the ground-based COSMOS catalog, and use COSMOS HST data as the truth for unrecognized blend. We find that 17% of objects in the ground-based COSMOS catalog are unrecognized blends. We show that some unrecognized blends can be identified as such using only catalog-level information; but not all blends can be easily identified. Nonetheless, our methods can be used to improve sample purity, and can identify approximately 30% to 80% of unrecognized blends while rejecting 10% to 50% of all detected galaxies (blended or unblended). The results are similar when only optical bands ($uBVri^{+}z^{++}$) and the size information is available. We also investigate the ability of these algorithms to remove photo-z outliers (identified with spectroscopic redshifts), and find that algorithms targeting color outliers perform better than algorithms targeting unrecognized blends. Our method can offer a cleaner galaxy sample with lower blending rates for future cosmological surveys such as the Legacy Survey of Space and Time (LSST), and can potentially improve the accuracy on cosmological parameter constraints at a moderate cost of precision.
BibTeX
@misc{liang2025catalog,
  author = {Shuang Liang and Prakruth Adari and Anja von der Linden},
  title = {{Catalog-based detection of unrecognized blends in deep optical ground based catalogs}},
  year = {2025},
  eprint = {2503.16680},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2503.16680},
  howpublished = {arXiv},
}

Loading related content...

Figure