Which Instrument Drifts Can Fourier Calibration Undo?

Satellite images are measurements, not photographs. As an instrument ages, its detectors lose sensitivity, its optics blur, stray light leaks in, and neighbouring sensors disagree about what a given patch of desert looks like. Calibration scientists spend decades tracking these effects against stable ground targets. Segmentation models, meanwhile, are trained and tested as if pixel values were fixed. This note proposes two things. The first is a stress test that degrades standard land-cover benchmarks with physically parameterized instrument faults, sized to magnitudes the calibration literature actually reports. The second is a test-time correction that exploits a simple fact. The most common instrument faults (gain drift, offset, and optical blur) change only the magnitude of an image's Fourier transform, the decomposition of an image into waves of different spatial frequency. They leave the phase, the wave alignment that encodes edges and object layout, nearly untouched.

The claim is not that "Fourier style transfer helps remote sensing." FDA-style methods already treat low-frequency magnitude as generic "style." The claim is sharper and falsifiable. A phase-preserving correction should recover segmentation accuracy under frequency-dependent faults such as blur, haze, and stray light, where per-band normalization cannot help. It should add nothing over per-band normalization for pure gain and offset changes. It should provably fail on faults that alter phase or mix spectral bands, such as detector striping and mismatched band response curves. The contribution is to map which drifts are correctable in which representation, and to supply a correction whose parameters are physically meaningful. The recovered gains and blur widths can be checked against the injected values, so the method doubles as an image-only drift estimator.

Why this intersection, and what is already done

Three lines of work established that the magnitude of the Fourier transform (the amplitude spectrum) carries domain appearance while the phase carries structure. FDA swaps a low-frequency amplitude window from a target image into source images and reaches 50.45 mIoU on GTA5→Cityscapes. Phase Consistent Ecological Domain Adaptation adds a loss that penalizes phase changes during translation. Test-time Fourier Style Calibration (TF-Cal) interpolates shallow-layer feature amplitudes toward a source prototype at inference and lifts Dice on an unseen MRI scanner from 0.183 to 0.736. These papers supply the method. All three treat amplitude as an unstructured statistical object: a window size $\beta$ in FDA, a linear blend in TF-Cal. None is tied to the way an instrument actually forms an image. TF-Cal also constrains the design, because it reports that calibrating deeper layers hurts. We therefore work at the input, per spectral band, where the physics is cleanest.

Two remote-sensing papers motivate the gap. FCAN splits deep features into low- and high-frequency branches with pooling modules and reports 94.76% average accuracy on NWPU-RESISC45↔NaSC-TG2 cross-sensor classification. It works on whole scenes rather than per-pixel labels, and it models sensor differences as uncalibrated RGB shifts. CrossEarth builds a 32-scenario domain-generalization benchmark for segmentation and injects Million-AID styles into a DINOv2 backbone. It is the strongest existing generalizer, but its shifts are defined by dataset identity (region, platform, climate), not by instrument parameters. Nobody can currently ask how it behaves at 3% gain loss plus a 20% wider blur.

The calibration literature constrains the magnitudes. The Libyan Desert TOA reflectance model reaches roughly 0.8% RMSE for MODIS and documents residual errors at wide view angles and during dust events. Northwest China PICS characterization reports cross-calibration relative biases below 5%. The Metis in-flight calibrations illustrate that throughput must be re-measured after launch. These figures anchor the severity grid. They keep us from stress-testing at unrealistic distortions, the failure that the evaluation-scope direction warns against.

Core Claim

A single band of a simple imaging model gives

$$Y_b(f) = g_b\, H_b(f)\, X_b(f) + o_b\,\delta(f) + N_b(f),$$

where $X_b$ is the Fourier transform of the true scene in band $b$ and $f$ is spatial frequency. The other terms describe the instrument: $g_b$ is the radiometric gain, $H_b$ is the optical transfer function (the frequency response of the blur), $o_b$ is an additive offset that appears only at zero frequency $\delta(f)$, and $N_b$ is detector noise. Suppose the blur is symmetric, so $H_b$ is real and non-negative. Then wherever signal dominates noise, gain, offset and blur change only the amplitude of $Y_b$, and the phase is untouched.

Stray light and haze add slowly varying radiance. That changes low-frequency amplitude and, to a lesser degree, low-frequency phase. Detector striping adds energy along specific frequency lines with its own phase. Band-response mismatch mixes information across wavelengths and cannot be expressed per band at all. The model therefore predicts a ranking of how correctable each fault is, and the experiments test that ranking.

The correction, which we call radial instrument calibration, stores one quantity per band from the source training set: the average radially binned log-amplitude profile $\bar{a}_b(r)$ over frequency radius $r$. At test time it computes the same profile $a_b(r)$ for the incoming image. It then fits a gain and a parametric blur, $\hat{g}_b\,\hat{H}_b(r) = \exp(a_b(r) - \bar{a}_b(r))$, with $\hat{H}_b(r)=\exp(-(r/r_c)^2)$ and $\hat{H}_b(0)=1$. The fit uses only mid-frequency bins, where scene content dominates both the zero-frequency term and noise. The method then divides the amplitude by a Wiener-regularized version of the fitted transfer function. Wiener regularization shrinks the correction at frequencies where the noise estimate dominates. The method resets the zero-frequency term to the source mean, keeps the phase exactly, and inverts the transform.

The fit has three parameters per band and needs no training, no target set, and no window size. Its outputs $\hat{g}_b$ and $\hat{r}_c$ are readable estimates of drift.

Research Program

We build the instrument-fault stress test on top of three benchmarks. The first is LoveDA, for dense segmentation and its rural↔urban splits. The second is the Potsdam→Vaihingen and aerial→satellite scenarios of the RSDG benchmark, run through the CrossEarth codebase. The third is EuroSAT, because its 13 Sentinel-2 bands let us simulate band-specific drift and band-response mismatch.

The faults are:

  • per-band gain drift within ±5%, the bias range the PICS papers report;
  • offset;
  • Gaussian blur widening;
  • low-frequency stray-light fields;
  • a haze term;
  • periodic detector striping;
  • synthetic response mismatch, formed by mixing adjacent Sentinel-2 bands with weights that emulate a neighbouring sensor's band shapes.

Each fault is also applied along a monotone "mission time" trajectory, so that non-linear aging, which the calibration literature flags as unsolved, appears as a curve rather than a single point.

The analysis has three layers. The first measures accuracy loss per fault and severity for a fixed segmenter; this alone tests the evaluation-scope concern. The second measures how much each correction recovers, per fault. The third regresses recovered $\hat{g}_b$ and $\hat{r}_c$ against the injected values, to see whether segmentation-oriented correction yields usable drift estimates. Real cross-sensor transfers (Potsdam→Vaihingen, aerial→satellite, and NWPU-RESISC45→NaSC-TG2 using FCAN's category protocol) check that conclusions drawn from synthetic faults carry over to real instrument differences, where nothing is known about the true parameters.

Baselines

The naive reference is the source-trained segmenter applied unchanged. We use HRNet on LoveDA, whose paper reports 49.79% test mIoU without multi-scale augmentation, and the CrossEarth DINOv2 model on RSDG scenarios. Every correction is a preprocessing step in front of these same frozen weights, so compute and data are identical by construction.

The simplest serious competitor is per-image, per-band standardization, together with its stronger form, histogram matching of each band to the source band distribution. It exactly cancels gain and offset. On those faults we expect a tie, and we will report a tie as a tie. Radial calibration counts as beating it only if it recovers significantly more mIoU on blur, stray-light and haze faults, averaged over three seeds of fault sampling.

FDA is run with its $\beta$ tuned on a held-out fault severity, not on test severities, with one randomly drawn target image as the amplitude donor. TF-Cal is run at its recommended shallow layer with its source prototype recomputed on our training sets. Both get the same tuning budget: a grid of eight settings chosen on validation.

CrossEarth is the strongest existing method for this question because it was built for remote-sensing domain generalization. The file gives only its relative gain of +7.2% mIoU over Rein on Potsdam→Vaihingen. No absolute Potsdam→Vaihingen mIoU was found on Lacuna, so we rerun the released code to obtain one. Adding radial calibration in front of CrossEarth tests whether the correction is complementary or redundant. For the real cross-sensor classification check, the target to beat is FCAN's reported 94.76% average cross-sensor accuracy. For segmentation self-training, the reference is CBST at 41.32% mIoU on LoveDA rural→urban.

Two ablations isolate the key ingredient. Gain-only radial calibration, with no blur term, should equal standardization; if it does not, the gain story is wrong. A phase-perturbing variant jitters phase by the amount FDA's window edges introduce, to test whether phase preservation is what matters. The oracle inverse, given the true injected parameters, bounds how much any per-band amplitude method could recover.

Why not just…?

Why not just histogram-match each band? For gain and offset it is optimal and cheaper, and the stress test is designed to show exactly that. Histogram matching acts on the distribution of pixel values and ignores where the values sit in space. It therefore cannot tell a blurred field boundary from a sharp one with the same histogram, which leaves blur and stray light untouched. If standardization matches radial calibration on the blur and haze cells of the grid, the Fourier ingredient is unnecessary, and we will say so.

Why not just train with physically simulated faults, or rely on a foundation model like CrossEarth? This is the real threat. Augmenting training with the same fault generator may make the segmenter invariant, and a large DINOv2 backbone may already be. We run augmentation-trained HRNet and CrossEarth on the full grid. The deciding evidence is whether test-time correction still adds mIoU on top of them at severities outside the augmentation range, and on real sensor pairs whose faults we did not simulate. If it adds nothing, the contribution shrinks to the benchmark and the drift-estimation result. AST's finding in Amplitude Spectrum Transformation that style leaks into deep layers of large networks suggests it will add something, but that evidence comes from driving scenes, not satellites.

Why not just run full radiometric and atmospheric correction first? Vicarious calibration and radiative transfer fix gain and atmosphere when accurate aerosol, ozone and water-vapour inputs exist. The Libyan Desert model shows residual errors precisely under wide angles and dust. Level-1 archives such as the Sentinel-2 data behind EuroSAT are distributed without full atmospheric correction, and on-orbit blur changes are generally not corrected in standard products. Physical correction and our method target overlapping but different faults. We will treat "physically corrected input" as a condition where metadata allows, and check whether radial calibration still helps residual blur after it.

Decisive Checks

The idea stands if three results hold. First, over standardization and FDA, radial calibration gains mainly on blur, stray-light and haze faults, and gains nothing on gain and offset. Second, all phase-preserving methods fail comparably on striping and band-mismatch faults, confirming the predicted boundary. Third, recovered $\hat{g}_b$ and $\hat{r}_c$ correlate strongly with the injected values along the aging trajectories, and the real Potsdam→Vaihingen and aerial→satellite transfers show improvement over CrossEarth alone.

The idea is wrong if standardization ties everywhere or if simulation-augmented training erases every gain. Either result would still be informative for a field that currently has no instrument-parameterized evaluation.