General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Open Challenges and Implications

Isaac Triguero, Daniel Molina, Javier Poyatos, Javier Del Ser, Francisco HerreraarXiv 2023 · DOI · OpenReview

TL;DR

This paper tackles the ambiguity surrounding "General Purpose Artificial Intelligence Systems" (GPAIS) by proposing a new, nuanced definition and a comprehensive taxonomy of approaches to build them. It aims to foster collaboration and guide responsible development by clarifying the properties, capabilities, and challenges of these increasingly prevalent AI systems.

What Problem Does This Paper Address?

The field of AI is rapidly advancing, with systems like ChatGPT demonstrating capabilities that blur the lines between specialized and general intelligence. However, the term "General Purpose Artificial Intelligence Systems" (GPAIS) is often used loosely, sometimes interchangeably with Artificial General Intelligence (AGI), which is a much more ambitious, human-level goal. This lack of a clear definition and categorization makes it difficult to understand the current state of GPAIS, compare different approaches, and address the associated risks and societal implications. This paper aims to bridge this gap by providing a structured framework for understanding and developing GPAIS.

Methods

The authors propose a new definition for GPAIS that emphasizes their ability to perform a range of distinct tasks, with varying degrees of autonomy and ability. They introduce a distinction between "closed-world GPAIS" (trained for a fixed set of tasks) and "open-world GPAIS" (capable of adapting to new, unforeseen tasks). A key contribution is a multidimensional taxonomy of approaches to building GPAIS, categorizing them into two main branches:

  • AI-powered AI: This involves using AI techniques to design or enhance other AI algorithms. Examples include hyper-parameter optimization, automated algorithm selection, and algorithm construction.
  • Single-model: This approach relies on a single AI model trained on vast amounts of data or multiple tasks to achieve generalization. This includes multi-task learning and foundation models.

The paper also delves into specific trending topics like Generative AI (GenAI) and multi-modality, aligning them with the proposed taxonomy.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • GPAIS is a spectrum, not a binary: The authors argue that GPAIS exist on a continuum of generality, with different levels of autonomy and ability, rather than being a single, monolithic concept.
  • Open-world vs. Closed-world is crucial: This distinction is key to understanding how GPAIS will handle novel situations and is a critical factor in their potential for generalization and adaptability.
  • Foundation models are a subset, not the entirety, of GPAIS: While foundation models are powerful GPAIS, the authors emphasize that other approaches, like AutoML-zero, also contribute to general-purpose AI without necessarily following the pre-training/fine-tuning paradigm.
  • AI empowering AI is a significant trend: The idea of using AI to design, optimize, or enrich other AI systems is presented as a powerful avenue for developing more capable GPAIS.
  • Hallucinations and emergent abilities are key challenges for open-world GPAIS: The paper highlights that while these systems can exhibit surprising capabilities, they can also produce incorrect or nonsensical outputs, raising concerns about trust and reliability.

Key Results

The paper does not present empirical results from experiments. Instead, its key "results" are conceptual:

  • A refined definition of GPAIS that differentiates them from narrow AI and AGI.
  • A taxonomy that categorizes various approaches to building GPAIS, providing a structured overview of the research landscape.
  • A framework for understanding the properties and characteristics of GPAIS, particularly the distinction between closed-world and open-world systems.
  • A discussion of current trends like GenAI and multi-modality within the GPAIS context.
  • An analysis of the societal implications and the urgent need for regulation and governance of GPAIS.

Limitations and Future Work

The authors acknowledge that their proposed taxonomy is not intended to create strict separations, and that categories can overlap. They also note that while foundation models are powerful, they are not necessarily advanced GPAIS on their own and would benefit from hybridization with other approaches like active learning.

Future work suggested includes:

  • Further research into emergent abilities and controlling hallucinations in open-world GPAIS.
  • Developing more sustainable approaches to training GPAIS to reduce their environmental impact.
  • Improving evaluation metrics for GPAIS, especially in open-world settings.
  • Establishing robust regulatory frameworks and governance mechanisms for the responsible development and deployment of GPAIS.
  • Exploring the integration of multi-modality to create more cohesive representations of concepts.

Summary updated

Abstract

Most applications of Artificial Intelligence (AI) are designed for a confined and specific task. However, there are many scenarios that call for a more general AI, capable of solving a wide array of tasks without being specifically designed for them. The term General-Purpose Artificial Intelligence Systems (GPAIS) has been defined to refer to these AI systems. To date, the possibility of an Artificial General Intelligence, powerful enough to perform any intellectual task as if it were human, or even improve it, has remained an aspiration, fiction, and considered a risk for our society. Whilst we might still be far from achieving that, GPAIS is a reality and sitting at the forefront of AI research. This work discusses existing definitions for GPAIS and proposes a new definition that allows for a gradual differentiation among types of GPAIS according to their properties and limitations. We distinguish between closed-world and open-world GPAIS, characterising their degree of autonomy and ability based on several factors such as adaptation to new tasks, competence in domains not intentionally trained for, ability to learn from few data, or proactive acknowledgment of their own limitations. We propose a taxonomy of approaches to realise GPAIS, describing research trends such as the use of AI techniques to improve another AI (AI-powered AI) or (single) foundation models. As a prime example, we delve into GenAI, aligning them with the concepts presented in the taxonomy. We explore multi-modality, which involves fusing various types of data sources to expand the capabilities of GPAIS. Through the proposed definition and taxonomy, our aim is to facilitate research collaboration across different areas that are tackling general purpose tasks, as they share many common aspects. Finally, we discuss the state of GPAIS, prospects, societal implications, and the need for regulation and governance.
BibTeX
@misc{triguero2023general,
  author = {Isaac Triguero and Daniel Molina and Javier Poyatos and Javier Del Ser and Francisco Herrera},
  title = {{General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Open Challenges and Implications}},
  year = {2023},
  eprint = {2307.14283},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2307.14283},
}
Figure