Segmentation-Guided Direct Capacity Estimation of Rooftop Photovoltaics from Aerial Imagery

Guibin Chen, Emma Fan, Yuzhang LinarXiv 2026 · arXiv

TL;DR

The "Direct Head" architecture improves rooftop solar capacity estimation by decoupling it from the rigid "Area $\times$ Power Density" formula. By using a U-Net to generate a soft mask that guides feature extraction—rather than algebraically defining the output—the model reduces capacity estimation error by up to 20% compared to traditional area-based methods.

What Problem Does This Paper Address?

To manage the power grid effectively, distribution planners need to know exactly how much solar photovoltaic (PV) capacity is installed on individual rooftops. Unfortunately, official records are often incomplete, outdated, or lack precise geolocation.

While high-resolution aerial imagery offers a solution, current AI models typically follow a two-step "physical proxy" approach: they segment the PV panels to find their area ($A$) and multiply it by a power density constant ($\rho$). This $C = A\rho$ assumption is often too restrictive. Top-down images can miss tilted surfaces or occluded modules, and simple area measurements can't account for differences in module efficiency, inverter sizing, or "noise" in official registries. The authors argue that while segmentation is a great guide, it shouldn't be the sole mathematical determinant of capacity.

Methods

The authors propose Direct Head, a segmentation-guided architecture that treats capacity estimation as a direct regression task rather than a geometric calculation.

  1. Backbone: A standard four-stage U-Net produces a "soft mask" (probability map) of where it thinks PV panels are located.
  2. Mask-Guided Pooling: Instead of just calculating the area from the mask, the model uses the soft mask to "pool" features from the U-Net’s bottleneck layer. This ensures the model focuses its "attention" on the pixels representing the solar arrays while ignoring the background.
  3. The Direct Head: A compact Multi-Layer Perceptron (MLP) receives three inputs: the pooled PV-region features, a log-transformed area estimate, and a scale-normalized occupancy cue.
  4. Non-negative Output: The final layer uses a softplus activation to ensure the predicted capacity is always positive without imposing an arbitrary upper limit.
Fig. 1. Direct Head inference architecture. A U-Net supplies a PV soft mask and bottleneck features. The mask guides feature pooling and area descriptors, while installed capacity is predicted directly. Training losses are defined in (4).

The training objective is a multi-task loss that combines segmentation (to keep the model spatially grounded), area supervision (to encourage a meaningful scale descriptor), and capacity regression (the primary goal).

Datasets

The study utilizes the BDAPPV (PV Database for Deep Learning), which contains 7,590 French rooftop PV installations. Each entry includes RGB aerial imagery (0.20 m/pixel resolution), crowd-annotated segmentation masks, and verified nameplate capacities ranging from 0.12 to 258.3 kWp.

The authors evaluated the model using two protocols:

  • Original Split: A standard random shuffle.
  • Department-based Holdout: A more challenging "regional transfer" test where entire French administrative departments are held out, ensuring the model is tested on geographic regions it has never seen during training.

Key Insights and Ideas

  • "Guide, Don't Determine": The core "aha" moment is that segmentation provides vital spatial evidence, but forcing the final answer to be a product of area and density discards useful visual information (like texture or panel type) that might hint at higher efficiency or specific hardware.
  • Decoupling Accuracy: The paper demonstrates that the best segmentation (highest IoU) does not always lead to the best capacity estimate. As shown in Figure 2, a model might have a "messy" mask but still extract enough feature information to predict capacity accurately.
  • Asymmetric Information Flow: By allowing capacity gradients to flow back into the shared encoder, the capacity objective can actually help refine the segmentation representation, even if the final capacity isn't calculated directly from the mask.

Key Results

Direct Head consistently outperformed both classical baselines and parameter-matched neural models that enforced the $C = A\rho$ constraint.

  • Error Reduction: Compared to an area-density neural model, Direct Head reduced Mean Absolute Error (MAE) by 8.7% on the original split and 12.5% on the regional holdout.
  • Relative Accuracy: It improved the symmetric Mean Absolute Percentage Error (sMAPE) by 14.0% and 20.7% respectively.
  • Robustness: The model maintained its lead across both evaluation protocols, suggesting it generalizes well to different geographic regions with varying rooftop styles.
Formal test performance table

Limitations and Future Work

While the results are promising, the authors note several areas for further research:

  • Temporal and Provider Variance: The model needs to be validated across different imagery providers and different years to account for changes in image quality and solar technology.
  • Uncertainty Quantification: Future versions could benefit from predicting a confidence interval rather than just a single scalar value.
  • Downstream Impact: The ultimate test will be integrating these estimates into actual electrical feeder models to see how much they improve grid hosting-capacity analyses.

Summary updated

Abstract

Distribution planners need installation-level inventories of rooftop photovoltaic (PV) capacity, but interconnection records may be incomplete or spatially aggregated. Conventional image-based estimators segment PV arrays, convert the mask to physical area, and multiply by an estimated power density, coupling capacity prediction to mask-derived area. We propose Direct Head, a segmentation-guided architecture that retains U-Net segmentation and soft-mask pooling while directly regressing nonnegative capacity from PV-region features and area descriptors. We evaluate three independent runs on 7,590 French rooftop installations under the original split and a department-based holdout. Relative to a parameter-matched area-density neural model, Direct Head reduces mean absolute error by 8.7% and 12.5%, and symmetric mean absolute percentage error by 14.0% and 20.7%, respectively. Comparisons with conventional estimators, controlled architecture variants, auxiliary-loss ablations, and representative cases show that segmentation provides useful spatial evidence without requiring capacity to be determined by an area-density product.
BibTeX
@misc{chen2026segmentation,
  author = {Guibin Chen and Emma Fan and Yuzhang Lin},
  title = {{Segmentation-Guided Direct Capacity Estimation of Rooftop Photovoltaics from Aerial Imagery}},
  year = {2026},
  eprint = {2611.22076},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.22076},
}
Figure