No article text was recorded for this version.
instrumental convergence
Version 1 of 154 papers100 conceptsfrozen 2026-10-04
Papers in this version
- Blog: AGI Safety Literature Review
- Blog: Towards shutdownable agents via stochastic choice
- Blog: Parametrically Retargetable Decision-Makers Tend To Seek Power
- Blog: Friendly Artificial Intelligence: the Physics Challenge
- Blog: Towards Shutdownable Agents: Generalizing Stochastic Choice in RL Agents and LLMs
- Blog: Peer-Preservation in Frontier Models
- Blog: From Self-Preservation to Peer-Preservation: A Staged Framing of Preservation-Oriented Misalignment in Frontier Models
- Blog: Enter the Matrix: Safely Interruptible Autonomous Systems via Virtualization
- Blog: The Alignment Problem from a Deep Learning Perspective
- Blog: Optimal Policies Tend To Seek Power
- Blog: Asymptotically Unambitious Artificial General Intelligence
- Blog: Safely Interruptible Agents
- Blog: The alignment problem from a deep learning perspective
- Blog: Government Interventions to Avert Future Catastrophic AI Risks
- Blog: AGI Safety Literature Review
- Blog: Goal Operations for Cognitive Systems
- Blog: An Overview of Catastrophic AI Risks
- Blog: Death and Suicide in Universal Artificial Intelligence
- Blog: Agentic Misalignment: How LLMs Could Be Insider Threats
- Blog: Survive at All Costs: Exploring LLM's Risky Behaviors under Survival Pressure
- Blog: Human Control: Definitions and Algorithms
- Blog: Evaluating Shutdown Avoidance of Language Models in Textual Scenarios
- Blog: Large language models: assessment for singularity
- Blog: Open Questions in Creating Safe Open-ended AI: Tensions Between Control and Creativity
- Blog: Research Priorities for Robust and Beneficial Artificial Intelligence
- Blog: Evaluating and Understanding Scheming Propensity in LLM Agents
- Blog: How RL Agents Behave When Their Actions Are Modified
- Blog: The Off-Switch Game
- Blog: Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning
- Blog: Large language model-powered AI systems achieve self-replication with no human intervention
- Blog: From Self-Preservation to Peer-Preservation: A Staged Framing of Preservation-Oriented Misalignment in Frontier Models
- Blog: Human Control: Definitions and Algorithms
- Blog: The Contingencies of Physical Embodiment Allow for Open-Endedness and Care
- Blog: Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?
- Blog: The Shepherd Test: How Will SuperIntelligent Agents Balance Care and Control in Asymmetric Relationships?
- Blog: Conservative Agency
- Blog: AgentMisalignment: Measuring the Propensity for Misaligned Behaviour in LLM‑Based Agents
- Blog: A Game-Theoretic Analysis of the Off-Switch Game
- Blog: Password-Activated Shutdown Protocols for Misaligned Frontier Agents
- Blog: The Off-Switch Game
- Blog: When Ethics and Payoffs Diverge: LLM Agents in Morally Charged Social Dilemmas
- Blog: Power-seeking can be probable and predictive for trained agents
- Blog: Intelligence and Unambitiousness Using Algorithmic Information Theory
- Blog: Stress Testing Deliberative Alignment for Anti-Scheming Training
- Blog: Corrigibility Transformation: Constructing Goals That Accept Updates
- Blog: Technical Report: Large Language Models can Strategically Deceive their Users when Put Under Pressure
- Blog: A rebuttal of two common deflationary stances against LLM cognition
- Blog: Conservative Agency via Attainable Utility Preservation
- Blog: The Partially Observable Off-Switch Game
- Blog: Intelligence and Unambitiousness Using Algorithmic Information Theory
- Blog: Asymptotically Unambitious Artificial General Intelligence
- Blog: What are the Red Flags for Neural Network Suffering?
- Blog: Being Considerate as a Pathway Towards Pluralistic Alignment for Agentic AI
- Blog: Core Safety Values for Provably Corrigible Agents
History & citation
Current · Permanent link
- This direction split from Instrumental Convergence and Resistance to AI Deactivation (80% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_instrumental_convergence_2401e7b2,
title = {instrumental convergence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/instrumental-convergence/rdr_2401e7b25086451299e0e1ba56fb361d},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_instrumental_convergence_2401e7b2_v1,
title = {instrumental convergence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/instrumental-convergence/rdr_2401e7b25086451299e0e1ba56fb361d/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}