Collectionless Artificial Intelligence

Marco Gori, Stefano MelacciarXiv 2023 · DOI · arXiv

Introduction

Modern Artificial Intelligence, particularly Deep Learning, is currently dependent on "Big Data." This reliance on massive, static data collections creates several systemic issues. Centralization of power occurs because only a few massive corporations and governments can afford the infrastructure to collect, store, and process gargantuan datasets. Privacy risks are inherent when personal sensor data (cameras, microphones) is stored for training. Furthermore, training Large Language Models (LLMs) is energy-intensive due to the iterative processing of static collections. Biologically, this diverges from how animals learn—not by "downloading" a shuffled database, but through continuous, temporal interaction with their environment. This paper proposes "Collectionless AI," a paradigm shift that decouples intelligence from data accumulation by enforcing a strict "no-storage" rule.

The Collectionless Principle

The core of this framework is the Collectionless Principle, defined by three fundamental "Rules of the Game":

  1. Data Collections are Banned: Agents access data only as sequential, one-way streams. They cannot store these streams for offline training or re-shuffling.
  2. No Sensor Storage: Agents must process information at the moment of acquisition; they cannot record temporal information from sensors for subsequent usage.
  3. No Internal Sequence Storage: The restriction extends to internal states; an agent cannot store a history of its own internal representations to simulate a memory of raw data.
Comparison of Current AI vs. Collectionless AI paradigms, highlighting differences in data handling and user benefits.

Technically, this imposes an O(1) space complexity for buffering sensorial data. The memory used to hold incoming data must remain constant, regardless of the learning duration. Agents are expected to develop "self-organized memorization skills" at an abstract level, such as updating neural weights, rather than relying on a database.

Evaluation and Benchmarking

As a position paper, it moves away from standard static benchmarks like ImageNet or COCO. Instead, it proposes a new approach to evaluation:

  • "En Plein Air" Evaluation: Inspired by Impressionist painters, the authors suggest evaluating agents in the wild, observing their behavior and progress in real-time rather than on a fixed test set.
  • Signal Generation by Target Emulation: A proposed task where an agent must learn to mimic a complex signal (like music or a wave) from a live stream without storing the history of that signal.
  • Extreme Collectionless Signal Generation (ECSG): A benchmark where the buffer size is exactly one sample ($n=1$), forcing the model to update its internal state instantaneously.

Conceptual Pillars

Collectionless AI redefines the roles of environment, time, and learning to align more closely with natural intelligence.

Key features and their specific roles within the Collectionless AI framework.
  • Time as the Protagonist: In standard ML, time is often discarded through shuffling. In Collectionless AI, the temporal order of data is the primary source of information, mirroring how humans perceive the world.
  • The "Trump Card": While the renunciation of memory seems like a handicap, it forces the development of models that are naturally better at personal interaction, customizability, and causal reasoning.
  • Unification of AI: This approach bridges the gap between Symbolic AI (traditionally collectionless and logic-based) and Sub-symbolic AI (neural networks), placing them under the same umbrella.
  • Geopolitical Impact: By moving computation to "thin clients" (edge devices) that don't need to communicate with a central cloud, the concentration of power in large data silos is naturally reduced.

Conclusion and Future Outlook

The paper formalizes the collectionless protocol, demonstrating that tasks like autonomous signal generation and unsupervised optical flow can be mathematically formulated within these constraints. By design, privacy, control, and customizability are integrated into the architecture rather than being added as afterthoughts.

However, the authors acknowledge the "Slowdown Challenge": learning in a truly online, lifelong manner is significantly slower than the high-speed batch processing used today. Furthermore, the computational complexity of organizing information dynamically without a buffer remains a significant research hurdle. Transitioning the AI community from static datasets to "en plein air" evaluation requires a total overhaul of measurement standards. Ultimately, Collectionless AI calls for a return to the roots of intelligence—interaction with a changing world in real-time.

Summary updated

Abstract

By and large, the professional handling of huge data collections is regarded as a fundamental ingredient of the progress of machine learning and of its spectacular results in related disciplines, with a growing agreement on risks connected to the centralization of such data collections. This paper sustains the position that the time has come for thinking of new learning protocols where machines conquer cognitive skills in a truly human-like context centered on environmental interactions. This comes with specific restrictions on the learning protocol according to the collectionless principle, which states that, at each time instant, data acquired from the environment is processed with the purpose of contributing to update the current internal representation of the environment, and that the agent is not given the privilege of recording the temporal stream. Basically, there is neither permission to store the temporal information coming from the sensors, thus promoting the development of self-organized memorization skills at a more abstract level, instead of relying on bare storage to simulate learning dynamics that are typical of offline learning algorithms. This purposely extreme position is intended to stimulate the development of machines that learn to dynamically organize the information by following human-based schemes. The proposition of this challenge suggests developing new foundations on computational processes of learning and reasoning that might open the doors to a truly orthogonal competitive track on AI technologies that avoid data accumulation by design, thus offering a framework which is better suited concerning privacy issues, control and customizability. Finally, pushing towards massively distributed computation, the collectionless approach to AI will likely reduce the concentration of power in companies and governments, thus better facing geopolitical issues.
BibTeX
@misc{gori2023collectionless,
  author = {Marco Gori and Stefano Melacci},
  title = {{Collectionless Artificial Intelligence}},
  year = {2023},
  eprint = {2309.06938},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2309.06938},
}
Figure