Towards AI-$45^{\circ}$ Law: A Roadmap to Trustworthy AGI

Chao Yang, Chaochao Lu, Yingchun Wang, Bowen Zhou

TL;DR

This paper proposes the "AI-45° Law" as a guiding principle for developing trustworthy Artificial General Intelligence (AGI), advocating for a balanced progression of AI capability and safety. They introduce the "Causal Ladder of Trustworthy AGI," a three-layer framework (Approximate Alignment, Intervenable, Reflectable) to systematically address AI safety challenges, and define five levels of AGI trustworthiness.

What Problem Does This Paper Address?

The rapid advancement of AI capabilities, particularly in areas like large language models (LLMs), has outpaced the development of robust safety measures. This creates a critical imbalance, leading to powerful but potentially fragile AI systems that could exhibit harmful behaviors or operate in ways misaligned with human values. Current AI safety approaches are often reactive, domain-specific, and lack a unified framework, making it difficult to comprehensively address the broad spectrum of potential risks, including existential threats. The paper aims to bridge this gap by proposing a proactive, structured approach to building trustworthy AGI.

Methods

The core of the paper's methodology lies in two main contributions:

  • The AI-45° Law: This principle suggests that AI capability and safety should ideally progress in parallel, visualized as a 45° line in a capability-safety coordinate system. Deviations from this line, particularly safety lagging behind capability, are highlighted as problematic. The paper also defines "Red Lines" (existential risks) and "Yellow Lines" (early warning indicators) within this framework.
  • The Causal Ladder of Trustworthy AGI: Inspired by Judea Pearl's "Ladder of Causation," this is a three-layer technical framework designed to guide the development of trustworthy AGI.
  • Approximate Alignment Layer: Focuses on aligning AI models with human values at a conceptual and encoding level. This corresponds to the "association" level of causation, answering "What is it?". Techniques include supervised fine-tuning and machine unlearning.
  • Intervenable Layer: Addresses safety verification and intervention during model inference, aiming for transparency and interpretability. This corresponds to the "intervention" level, answering "What will happen if X is intervened on?". Methods include feedback-based alignment and reinforcement learning.
  • Reflectable Layer: Introduces a reflective reasoning framework for self-evaluation and adaptation, corresponding to the "counterfactual" level, answering "What would have happened if a different choice had been made?". Techniques include value reflection and counterfactual interpretability.

The paper also defines five levels of AGI trustworthiness (Perception, Reasoning, Decision-making, Autonomy, Collaboration) that build upon these layers.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • The AI-45° Law is a crucial conceptual shift: Moving from a reactive "build-then-fix" approach to a proactive "build-safely-and-capably-together" mindset is essential for AGI development.
  • The Causal Ladder provides a much-needed taxonomy: By mapping AI safety and trustworthiness research onto a hierarchical structure inspired by causality, the paper offers a clear way to organize and understand progress in the field.
  • Trustworthiness is multi-faceted: The five defined levels of trustworthiness (Perception to Collaboration) highlight that building safe AGI requires addressing distinct but interconnected capabilities.
  • The Reflectable Layer is key for advanced AGI: While Approximate Alignment and Intervenable layers are crucial for current AI, the Reflectable Layer is presented as a necessary component for truly trustworthy, self-aware, and adaptable future AGI.
  • "Crippled AI" is an apt description: The paper effectively captures the current state where AI capabilities are far ahead of safety, leading to powerful but potentially brittle systems.

Key Results

This paper is a position paper and a framework proposal, rather than an empirical study with quantitative results. Its key contributions are conceptual and structural:

  • A proposed guiding principle (AI-45° Law): Advocates for synchronized progress in AI capability and safety.
  • A novel technical framework (Causal Ladder): Organizes AI safety research into three progressive layers (Approximate Alignment, Intervenable, Reflectable).
  • A five-level taxonomy of AGI trustworthiness: Perception, Reasoning, Decision-making, Autonomy, and Collaboration.
  • Identification of "Red Lines" and "Yellow Lines": Conceptual tools for understanding and mitigating catastrophic risks and early warning signals.
  • Discussion of governance measures: Outlines potential strategies for managing AI development responsibly.

Limitations and Future Work

The authors acknowledge that this is a position paper and a proposed framework. Future work will focus on:

  • Empirically validating the proposed framework: Testing its applicability across different domains and AI architectures.
  • Refining methodologies within each layer of the Causal Ladder: Further developing the technical approaches for each stage of trustworthiness.
  • Integrating ethical considerations more deeply: Ensuring that ethical principles are not just an add-on but are woven into the fabric of the framework.
  • Fostering collaboration: Encouraging dialogue and cooperation among researchers, policymakers, and industry stakeholders.
  • Ensuring adaptability: Developing mechanisms for the framework to remain relevant in the face of rapidly evolving AI technologies.

Summary updated

Abstract

Ensuring Artificial General Intelligence (AGI) reliably avoids harmful behaviors is a critical challenge, especially for systems with high autonomy or in safety-critical domains. Despite various safety assurance proposals and extreme risk warnings, comprehensive guidelines balancing AI safety and capability remain lacking. In this position paper, we propose the \textit{AI-\textbf{$45^{\circ}$} Law} as a guiding principle for a balanced roadmap toward trustworthy AGI, and introduce the \textit{Causal Ladder of Trustworthy AGI} as a practical framework. This framework provides a systematic taxonomy and hierarchical structure for current AI capability and safety research, inspired by Judea Pearl's ``Ladder of Causation''. The Causal Ladder comprises three core layers: the Approximate Alignment Layer, the Intervenable Layer, and the Reflectable Layer. These layers address the key challenges of safety and trustworthiness in AGI and contemporary AI systems. Building upon this framework, we define five levels of trustworthy AGI: perception, reasoning, decision-making, autonomy, and collaboration trustworthiness. These levels represent distinct yet progressive aspects of trustworthy AGI. Finally, we present a series of potential governance measures to support the development of trustworthy AGI.\footnote{In this paper, trustworthiness is generally considered a broad form of safety, and no explicit distinction is made between the two. However, in some contexts, safety and trustworthiness are treated as distinct: safety involves assurance of correct behavior, while trustworthiness refers to user confidence in the system's decision-making. In such cases, different terms or both may be used depending on the context.
BibTeX
@misc{yang2024towards,
  author = {Chao Yang and Chaochao Lu and Yingchun Wang and Bowen Zhou},
  title = {{Towards AI-$45^\{\textbackslash\{\}circ\}$ Law: A Roadmap to Trustworthy AGI}},
  year = {2024},
  eprint = {2412.14186},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2412.14186},
}
Figure