Spend the Bits Where the Tiny Objects Are: Rate-Utility Region Coding for Aerial Detection

Yanliang Qi, Jiacheng Ding, Cong Guo, Peihua MaiarXiv 2026 · arXiv

TL;DR

Researchers have developed Rate-Utility Region Coding (RUO), a training-free method for compressing aerial imagery that prioritizes "tiny" objects. By treating region selection as a mathematical optimization problem—balancing the probability of a correct detection against the byte cost—RUO achieves the same detection accuracy as standard methods while using 42.4% fewer bits.

What Problem Does This Paper Address?

Aerial imagery from drones often contains hundreds of tiny objects (like cars or pedestrians) that are only a few pixels wide. When bandwidth is limited, we have to compress these images. Standard codecs like JPEG or AVIF often "smear" these tiny details, making them invisible to AI detectors.

A common fix is Region-of-Interest (ROI) coding, where the system only sends high-quality crops of areas where it thinks objects exist. However, standard ROI coding uses a simple confidence threshold. Because tiny objects provide very little visual evidence, they often get low confidence scores and are discarded by the sender before they even reach the receiver. As shown in Figure 1, a hard threshold can completely miss clusters of tiny objects that a more nuanced approach would catch.

Figure 1. Threshold-based region-of-interest (ROI) coding selects regions by confidence τ; RUO weighs utility u against byte cost c under one multiplier λ. It therefore also sends small low-confidence regions, so the zoom finds 2 of 4 tiny objects where threshold coding finds none. Grey marks untransmitted regions, and outlines mark matched objects. The frame was chosen by tiny-object count; its margin is not typical.

Methods

The authors propose RUO, which moves away from "Is this score high enough?" to "Is the potential detection worth the bits?"

  1. Candidate Proposal: A "frozen" (unmodified) detector on the drone identifies potential regions.
  2. Utility Calibration: Raw detection scores are notoriously unreliable. RUO uses a calibration table to convert these scores into a "utility" value ($u$): the actual probability that a detection is correct, adjusted for the size of the object.
  3. Cost Measurement: The system measures the actual byte cost ($c$) of sending each region at two different quality levels (low and high).
  4. Lagrangian Optimization: Instead of a threshold, RUO uses a single multiplier ($\lambda$) shared across all images. It solves a "multiple-choice knapsack problem" for every region: should we drop it, send it at low quality, or send it at high quality to maximize $u - \lambda c$?
  5. Standard Pipeline: RUO uses standard codecs (like AVIF) and requires no retraining of the detector or the compressor.
Figure 2. RUO workflow with frozen sender E and receiver D: calibrated utility and measured byte costs guide a shared-λ choice of drop, low or high quality; selected regions are decoded for de- tection.

Datasets

The method was evaluated on two major aerial detection benchmarks:

  • VisDrone-DET: A large-scale dataset of 1,610 test images featuring dense urban scenes with many tiny objects.
  • UAVDT: A drone-based vehicle detection dataset used to test how well the method generalizes to different environments.

Key Insights and Ideas

  • Selection is the Bottleneck: The authors discovered that for tiny objects, the biggest source of error isn't compression artifacts—it's the fact that threshold-based systems choose not to send the regions containing them in the first place.
  • The "Shared $\lambda$" Strategy: By using one multiplier across an entire stream of images rather than a fixed bit-budget per image, RUO can "save" bits on sparse images and "spend" them on complex, object-heavy frames.
  • Calibration Matters: A score of 0.3 for a large truck means something very different than 0.3 for a tiny pedestrian. By calibrating utility based on area, RUO makes much smarter "spending" decisions.

Key Results

RUO significantly outperforms both standard codecs and state-of-the-art "learned" (neural network-based) codecs for tiny object detection:

  • Bit Savings: On VisDrone, RUO uses 42.4% fewer bits than a tuned threshold-based ROI coder to achieve the same Average Precision (AP) for tiny objects.
  • Comparison to Standards: It is vastly more efficient than full-frame AVIF (77.3% fewer bits) and HEVC.
  • Speed: Because it uses standard codecs and simple math, decoding takes only a few milliseconds, whereas many learned codecs are significantly slower and more memory-intensive.
Figure 4. Rate-accuracy curves. RUO (green line) stays higher (better accuracy) at lower bitrates compared to AVIF, JPEG, and threshold-based ROI.

Limitations and Future Work

The primary "catch" is that RUO is specialized. While it excels at tiny objects, it actually needs 25.4% more bits than standard ROI coding to maintain accuracy on large objects. This is because the optimization logic prioritizes the "utility-per-bit" of small regions, sometimes dropping large, high-confidence regions because they are "expensive" to encode.

Future work could involve:

  • Developing a more complex utility function that balances tiny and large objects more effectively.
  • Integrating a "base layer" (a very low-resolution version of the whole frame) to provide context for large objects while RUO handles the tiny details.

Summary updated

Abstract

Bandwidth-limited aerial cameras must compress their images before a remote detector can find the many tiny objects in them. Threshold-based region-of-interest (ROI) coding sends only confidently detected regions, and because tiny objects provide limited visual evidence and often score low, it can discard the regions that contain them. We propose rate-utility region coding (RUO), which sends a region when its expected detection utility justifies its measured byte cost, choosing to drop it or to send it at low or high quality with one multiplier shared across images. RUO trains no model, uses a standard image codec and decodes in a few milliseconds. On all 1,610 VisDrone-DET test-dev images, RUO uses 42.4% fewer bits than a tuned threshold-based ROI coder, averaged over their shared tiny-object average precision (AP) range. RUO also needs fewer bits for tiny objects than the AV1 Image File Format (AVIF), High Efficiency Video Coding (HEVC) and three published learned codecs, and its advantage over threshold-based ROI coding persists when the sender and receiver use different detectors. For AP over all object sizes RUO needs 25.4% more bits than the tuned ROI coder, because its allocation drops large regions first at low rates, so it suits tasks that target tiny objects. We plan to release the code.
BibTeX
@misc{qi2026spend,
  author = {Yanliang Qi and Jiacheng Ding and Cong Guo and Peihua Mai},
  title = {{Spend the Bits Where the Tiny Objects Are: Rate-Utility Region Coding for Aerial Detection}},
  year = {2026},
  eprint = {2611.01573},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.01573},
}
Figure