Measuring Robustness and Efficiency in a Connectome-Constrained Fly Visual System Model: Linking an Adversarial and a Perceptual Illusion

Alexandre Garcia-Duran, Alejandro Rodriguez-Garcia, Manuel Molano-Mazón, Alexandre Hyafil, Srikanth Ramaswamy, Janne K. Lappalainen

TL;DR

This paper introduces FlyNet, a model of the fruit fly visual system constrained by its actual biological "wiring diagram" (connectome). The researchers found that while brain-like wiring makes the model incredibly efficient—using up to five orders of magnitude less compute than standard AI—it doesn't grant "super-robustness"; instead, it inherits specific biological vulnerabilities like the reverse-phi illusion, which the authors show is computationally identical to a targeted adversarial attack.

What Problem Does This Paper Address?

Artificial Neural Networks (ANNs) are notoriously power-hungry and fragile, often failing when faced with "adversarial" pixels that wouldn't fool a toddler. In contrast, biological systems like the fruit fly (Drosophila) perform complex tasks like collision avoidance with extreme energy efficiency and reliability in nature.

The authors ask: Does "brain-like" wiring actually provide better robustness, or is it just about efficiency? To answer this, they bridge the gap between neuroscience and AI by testing a connectome-constrained model against state-of-the-art computer vision architectures on a common task.

Methods

The researchers developed a differentiable 3D rendering pipeline (based on PyTorch3D) to simulate a "looming" task: an object (sphere or cube) flies toward the observer, who must decide if it will hit or miss.

Figure 1: Fully differentiable 3D geometric framework for motion-based collision detection. (a) Processing differentiable pipeline. (b) Geometric setup of looming stimuli, parameterized by polar coordinates (R, θ, z0). Bottom: example rendering in the image frame Ft and corresponding fly visual input Vt. (c) Generated dataset: example trajectories, shapes and textures. Examples of hit and miss trajectories in 3D space and their temporal distance profiles.

The star of the show is FlyNet, a model with 45,669 neurons where the connections are fixed by real biological data. Unlike standard ANNs with millions of trainable weights, FlyNet has only 734 free parameters (mostly biophysical constants like time constants). They compared FlyNet against:

  • vCNN/gCNN: Standard and global-pooling convolutional networks.
  • RAFT: A high-performance recurrent model for optical flow.
  • CTRNN/sCTRNN: Continuous-time recurrent networks with and without biological wiring constraints.

Datasets

  • Sintel: A standard optical flow dataset used for pre-training the models.
  • Looming Collision Dataset: A newly introduced benchmark featuring 3D trajectories, various shapes, and textures (Black, White, Checkerboard, etc.) designed to test motion-based decision-making.

Key Insights and Ideas

  • Efficiency over Robustness: The "brain-like" wiring of FlyNet didn't make it more robust than unconstrained models. In fact, unconstrained recurrent models (CTRNNs) were often more robust. This suggests that the fly's specific wiring is an evolutionarily optimized solution for efficiency (low edge count) rather than universal adversarial defense.
  • Adversarial Attacks = Perceptual Illusions: This is the "aha" moment. The authors found that gradient-based adversarial attacks on FlyNet produced textures that exploit the same circuit vulnerability as the reverse-phi illusion (a phenomenon where flipping contrast makes motion look reversed).
  • The Motion Code "Bug": By using "counterfactual restoration"—finding the nearest "good" texture to an adversarial one—they proved that FlyNet doesn't fail because the adversarial textures look "weird" or "unfamiliar." It fails because the textures specifically invert the Hassenstein-Reichardt correlation, a fundamental motion statistic that both flies and FlyNet rely on.
FlyNet is robust to natural noise like flicker but highly sensitive to adversarial textures and the reverse-phi illusion.

Key Results

  • Extreme Efficiency: FlyNet achieves high accuracy on common video corruptions (like fog or motion jitter) while using five orders of magnitude fewer FLOPs than RAFT.
  • LERS Score: The authors proposed the Log-Efficiency Robustness Score (LERS) to normalize robustness by the "cost" of compute. FlyNet and its sparse cousin (sCTRNN) dominated this metric, proving they provide the most "bang for your buck" in terms of robustness per unit of energy.
  • Circuit Vulnerability: They demonstrated that optimizing the input motion statistic alone, without even looking at the network's weights, was enough to induce classification failure. This attributes both adversarial attacks and biological illusions to the same underlying circuit mechanism.

Limitations and Future Work

  • Simplified Biology: FlyNet currently lacks downstream looming-selective neurons (like LPLC2) and biological features like spiking, synaptic plasticity, or stochastic noise.
  • Task Specificity: The results are currently limited to a binary collision detection task. Whether these efficiency gains hold for more complex tasks like navigation or object tracking remains to be seen.
  • Future Direction: The authors suggest that connectome-constrained models can serve as a "testbed" for generating new hypotheses about biological illusions that can then be tested in real-world experiments with flies.

Summary updated

Abstract

Biological visual systems compute reliably under tight metabolic and wiring constraints, whereas artificial vision systems consume far more energy and can be sensitive to adversarial perturbations. Whether networks with brain-like wiring are more robust at lower computational cost is unclear. We address this by benchmarking a task-optimized, continuous-time recurrent neural network of the fly visual system constrained by its synaptic connectome (FlyNet) against artificial neural networks. We compare it against CNNs, RAFT, and continuous-time recurrent neural networks without detailed connectome constraints (sCTRNN, CTRNN) on a collision-detection task within a differentiable 3D rendering pipeline. FlyNet is adversarially vulnerable but, relative to its compute, more robust to common video corruptions than RAFT, while using up to five orders of magnitude fewer FLOPs. The CTRNNs remain more robust than FlyNet across almost all tested perturbations, suggesting that connectome constraints benefit efficiency, through their low edge count, over robustness. Recurrence improves robustness to white-box attacks in RAFT and temporal context improves robustness to common corruptions. FlyNet's position and velocity representations degrade under adversarial textures but recover under counterfactual textures that restore correct classification while staying equally far from training, ruling out unfamiliar textures as the cause of failure. The reverse-phi illusion similarly disrupts these representations and inverts the same low-level motion statistic as the adversarial textures. Optimizing this input statistic alone, without access to the network, suffices to induce classification failure, attributing both perturbations to the same circuit vulnerability. Connectome-constrained models can thus surface adversarial failure mechanisms as testable hypotheses about biological perceptual vulnerabilities.
BibTeX
@misc{garciaduran2026measuring,
  author = {Alexandre Garcia-Duran and Alejandro Rodriguez-Garcia and Manuel Molano-Mazón and Alexandre Hyafil and Srikanth Ramaswamy and Janne K. Lappalainen},
  title = {{Measuring Robustness and Efficiency in a Connectome-Constrained Fly Visual System Model: Linking an Adversarial and a Perceptual Illusion}},
  year = {2026},
  eprint = {2611.14498},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14498},
}
Figure