Hybrid Active Inference

André Ofner, Sebastian StoberarXiv 2018 · arXiv

Abstract

This paper introduces a theoretical framework for Hybrid Active Inference, a paradigm where artificial agents and human brains are integrated into a single cognitive system. By applying the Free Energy Principle, the framework treats human neural signals as sensory data for the artificial agent to predict and "explain away." This hierarchical coupling aims to bridge the information gap between human and machine, potentially accelerating the development of grounded artificial intelligence while enhancing human cognitive capabilities through shared embodiment and bi-directional feedback.

Introduction

Despite the rapid advancement of deep learning, artificial agents frequently struggle with generalization and the exhibition of human-like behavior in complex, open-ended environments. Current Brain-Computer Interfaces (BCIs) typically operate as "shallow" systems, treating neural activity as a simple command stream or a data source for classification. This approach fails to address the fundamental "information gap" between the human brain's internal models and the machine's processing logic.

To overcome these limitations, the authors propose a unified cognitive system where the machine does not merely observe the human but actively adapts its internal generative models to match and augment human cognition. This "hybrid cognition" seeks to create a seamless integration where both entities operate under a shared objective of minimizing variational free energy.

The Hybrid Active Inference Framework

The proposed framework is rooted in Active Inference, a neuroscientific theory derived from the Free Energy Principle. In this view, cognition is an ongoing process of minimizing "surprise" (or variational free energy) by updating an internal generative model of the world.

Hierarchical Integration and Shared Embodiment

The core of the hybrid system lies in its hierarchical structure. The artificial agent is designed to integrate with the human's existing cognitive hierarchy. Rather than just processing external environmental data (exteroception), the machine treats the human's internal brain states as a secondary sensory modality.

Schematic representation of the Hybrid Active Inference framework.

As illustrated in the framework diagram, the system establishes a bi-directional flow between human and artificial components. Key features include:

  • Shared Embodiment: The human and machine are conceptualized as sharing a single "body" and environment. Human actions and perceptions are treated as the machine’s own, facilitating a unified latent space.
  • Generative Modeling: The framework utilizes Variational Auto-Encoders (VAEs) and Deep Predictive Coding (e.g., the PredNet architecture) to learn shared representations. By minimizing prediction errors across multi-modal sensory data (audio, visual) and neurophysiological data (EEG, fMRI), the machine learns to mirror the latent space of human thought.
  • Bi-directional Feedback: A closed-loop system is formed where the machine’s predictions inform its actions, which in turn provide feedback to the human, allowing both systems to co-evolve their internal models.

Key Insights

The Hybrid Active Inference approach introduces several radical shifts in how we conceptualize AI development:

  • Brain Signals as Sensory Input: By treating neural signals as another modality to be "explained away," the machine naturally aligns its internal logic with human cognitive processes.
  • Self-Supervision via the Human: The machine can achieve high-level "self-supervision" by minimizing surprise regarding human brain activity, effectively "borrowing" the human's grounded understanding of the world.
  • Grounded Cognition: Access to the human's hierarchy of representations allows the machine to bypass the need to learn everything from scratch. It leverages representations already grounded by human experience.
  • Emergent Autonomy: Once the machine successfully mirrors human processes (such as motor control), it can potentially offload these tasks and build higher-level autonomous capabilities upon this foundation.

Discussion and Future Work

While the theoretical framework is robust, several challenges remain for practical implementation. Non-invasive signals like EEG are inherently noisy, necessitating multi-modal integration to refine predictions. Furthermore, integrating "efference copies"—the brain's internal signals of intended movement—requires high-resolution sensors or invasive interfaces.

The qualitative result of this work is the definition of a Hybrid Active Inference Agent, characterized by internal coupling through shared embodiment and the use of active inference as a primary processing mechanism. Future research will focus on validating these hierarchical models using established fMRI and EEG datasets and developing stable probabilistic deep learning architectures to bridge the implementation gap.

Summary updated

Abstract

We describe a framework of hybrid cognition by formulating a hybrid cognitive agent that performs hierarchical active inference across a human and a machine part. We suggest that, in addition to enhancing human cognitive functions with an intelligent and adaptive interface, integrated cognitive processing could accelerate emergent properties within artificial intelligence. To establish this, a machine learning part learns to integrate into human cognition by explaining away multi-modal sensory measurements from the environment and physiology simultaneously with the brain signal. With ongoing training, the amount of predictable brain signal increases. This lends the agent the ability to self-supervise on increasingly high levels of cognitive processing in order to further minimize surprise in predicting the brain signal. Furthermore, with increasing level of integration, the access to sensory information about environment and physiology is substituted with access to their representation in the brain. While integrating into a joint embodiment of human and machine, human action and perception are treated as the machine's own. The framework can be implemented with invasive as well as non-invasive sensors for environment, body and brain interfacing. Online and offline training with different machine learning approaches are thinkable. Building on previous research on shared representation learning, we suggest a first implementation leading towards hybrid active inference with non-invasive brain interfacing and state of the art probabilistic deep learning methods. We further discuss how implementation might have effect on the meta-cognitive abilities of the described agent and suggest that with adequate implementation the machine part can continue to execute and build upon the learned cognitive processes autonomously.
BibTeX
@misc{ofner2018hybrid,
  author = {André Ofner and Sebastian Stober},
  title = {{Hybrid Active Inference}},
  year = {2018},
  eprint = {1810.02647},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1810.02647},
}
Figure