Crisis Governance at the Joints. Mapping the Ethical and Societal Territory of Crisis Management Technologies: The Case of Human-Swarm Teaming

Anthony LongoarXiv 2026 · arXiv

This research report, authored by Dr. Anthony Longo as part of the STEADFAST project, explores the ethical and societal implications of Human-Swarm Teaming (HST) in crisis management. As we move toward disaster response systems where drone swarms sense and act faster than humans can think, the paper argues that our current ethical frameworks are insufficient.

TL;DR

The paper introduces the "3i" framework—Interface, Infrastructure, and Imaginary—to show that the toughest ethical problems in autonomous systems don't live in one place; they emerge at the "joints" where these levels meet. It argues that "meaningful human control" is a property of the entire sociotechnical system, not just a checkbox for a human operator.

What Problem Does This Paper Address?

As AI-driven technologies like drone swarms are integrated into first-responder and military operations, we face a "responsibility gap." When a swarm makes a split-second triage decision that leads to a tragic outcome, who is responsible? The engineer? The commanding officer? The operator?

Traditional ethics often focuses on the micro-level (is the operator "in control"?) or the macro-level (does this violate human rights?). This paper addresses the gap in between. It tackles the "moral crumple zone"—the phenomenon where the human operator nearest the system absorbs all the blame for failures actually produced by a complex, opaque technological architecture. The author argues that we cannot solve these issues one level at a time because design choices at the interface level inevitably "harden" into organizational routines and societal assumptions.

Methods

The paper employs a critical, narrative review of literature spanning the philosophy of technology, AI ethics, moral psychology, and security studies. Its core contribution is the "3i" Framework, which categorizes the ethical territory into three levels:

  1. The Interface (Micro): The concrete interaction between humans and swarms (e.g., what the operator sees on a dashboard).
  2. The Infrastructure (Meso): The organizational ecosystem (e.g., protocols, training, and how blame is distributed).
  3. The Imaginary (Macro): The legal and societal assumptions about what a "crisis" is and what interventions are justified.

Crucially, the paper identifies four translations that link these levels, shown in Figure 1:

  • Habits harden: Interface routines become organizational rules.
  • Routines become stories: Infrastructure informs societal narratives.
  • Principles become procedures: Macro-level ethics turn into checklists.
  • Procedures become prompts: Rules reappear as buttons or thresholds on a screen.
Figure 1. The three levels of the framework (the Interface, the Infrastructure and the Imaginary) and the four translations between them. Many ethical problems arise at the joints between levels.

Datasets

The paper is a qualitative research report and literature review; it does not utilize or introduce new empirical datasets.

Key Insights and Ideas

  • The Interface is not a window: Technologies "co-constitute" moral perception. If an interface highlights thermal signatures but smooths over uncertainty scores, it defines what the operator can care about. This is termed the evidential ecology.
  • From Control to "Response-Ability": Instead of asking if a human is "in control" (which is often impossible in high-speed swarms), we should ask if the system sustains the human's capacity to respond to moral reasons.
  • The Moral Crumple Zone: Without explicit role-based accountability, blame tends to land on the operator, even if they were just "rubber-stamping" an algorithmic suggestion they didn't have the data to contest.
  • Visibility vs. Care: Faster technological detection does not equal more just governance. If "being visible to the system" becomes the only way to be "eligible for rescue," then needs that are hard to measure (like emotional distress or marginalized groups under debris) drop out of the picture.
  • Dual-use is a Design Question: Capabilities like "vulnerability assessment" can easily migrate from humanitarian aid to military targeting. Purpose limitation must be built into the architecture from day one.

Key Results

The paper provides a roadmap for different stakeholders (see Figure 3) and identifies specific "responsibility gaps" (Culpability, Moral, Public, and Active).

Who this report is for

One of the most significant qualitative findings is the breakdown of Meaningful Human Control (MHC) into two necessary conditions:

  1. Tracking: The system must respond to human moral reasons and environmental facts.
  2. Tracing: System actions must be linkable to a human's moral and technical understanding.

The report also provides a detailed table of typical questions and examples for each level of the framework to guide future research and development (see Figure 4).

Level, What it covers, Typical questions, and Examples

Limitations and Future Work

The author acknowledges that this is a narrative review rather than a systematic one, focusing primarily on civil disaster response while the boundary with military use remains intentionally blurry.

Future directions include: * Developing concrete metrics to distinguish "meaningful" control from "procedural" control. * Designing contestability mechanisms that allow operators (and affected communities) to challenge algorithmic outputs in real-time. * Investigating how a "shared operational picture" created by fused machine data might inadvertently narrow the pluralistic judgment of different emergency agencies.

Summary updated

Abstract

Crisis and disaster governance increasingly relies on technologies that sense, classify and act faster than humans can. Drone swarms coordinated with human operators, known as human-swarm teaming, provide a productive case to review the field of crisis governance. They promise better situational awareness in disaster response, but they also raise questions about human control, responsibility, surveillance, triage, dual use and public legitimacy. This report maps the ethical and societal territory that HST opens up. It unpacks this territory with a 3i-framework, the Interface, where operators and swarms work together, the Infrastructure, where organisations distribute tasks, decisions and blame, and the Imaginary, where law, policy and shared societal assumptions define what a crisis is and which interventions it justifies. The central claim is that these concerns cannot be addressed one level at a time. Many of the most pressing problems, such as responsibility gaps and the erosion of meaningful human control, arise at the joints between levels, through four translations, habits harden, routines become stories, principles become procedures, and procedures become prompts. Drawing on a critical review of literature across philosophy of technology, political theory, moral psychology, philosophy of mind, AI ethics, and critical disaster and security studies, the report develops this framework, illustrates it with two worked examples, and derives design and governance implications and a set of questions for developers, emergency organisations and policymakers.
BibTeX
@misc{longo2026crisis,
  author = {Anthony Longo},
  title = {{Crisis Governance at the Joints. Mapping the Ethical and Societal Territory of Crisis Management Technologies: The Case of Human-Swarm Teaming}},
  year = {2026},
  eprint = {2611.25202},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.25202},
}
Figure