Modeling the Economic Impacts of AI Openness Regulation

Tori Qiu, Benjamin Laufer, Jon Kleinberg, Hoda Heidari

Introduction: The Regulatory Tug-of-War

Governments worldwide are increasingly using "open-source" exemptions to encourage transparency in artificial intelligence. The EU AI Act, for instance, offers legal leniency to foundation models that meet specific openness criteria. However, defining "open-source" for Large Language Models (LLMs) is complex, representing a spectrum from merely releasing "open weights" (like Meta's Llama) to providing fully open training data and code.

This paper tackles a fundamental tension in AI governance: if a regulator sets an openness threshold too high or the non-compliance penalty too low, developers of frontier models may simply choose to remain "closed," absorbing regulatory fines as a standard business expense. Conversely, a threshold set too low might fail to provide the economic transparency necessary for a healthy, innovative ecosystem. The authors seek to identify the regulatory "sweet spot" that genuinely incentivizes openness without stifling technological advancement.

A Game-Theoretic Approach to AI Development

To understand these dynamics, the researchers developed a three-stage sequential game involving two primary actors:

  1. The Generalist (G): The creator of a foundation model (e.g., Meta, OpenAI) who must decide the level of openness ($\omega$) for their release.
  2. The Specialist (D): A downstream entity that adopts the generalist's model and fine-tunes it for a specific domain or commercial task.

The strategic interaction unfolds in three stages:

  • Stage 1: The Generalist and Specialist bargain over how to share future revenue generated by the fine-tuned model.
  • Stage 2: The Generalist chooses an openness level. They must weigh the reputational gains and reduced hosting costs of open-sourcing against the loss of direct licensing revenue and potential regulatory penalties for remaining closed.
  • Stage 3: The Specialist decides how much to invest in fine-tuning, a decision heavily influenced by the model's openness, which dictates their technical adaptation costs.

By solving for the Subgame Perfect Equilibrium, the authors provide closed-form mathematical expressions predicting how these players will behave under various regulatory "thresholds" (the definition of open-source) and "penalties" (the cost of non-compliance).

Empirical Reality: The Performance-Openness Tradeoff

While primarily a theoretical framework, the authors validate their model using empirical data from real-world LLM releases, utilizing Chatbot Arena ELO scores and MMLU benchmarks to represent model performance.

Empirical tradeoff between model performance and openness.

The data reveals a clear empirical frontier: higher-performing models tend to be more closed. Developers of "weaker" or catching-up models often use openness strategically to gain market share and build reputation. In contrast, developers of "frontier" models typically keep core components closed to maximize direct monetization and protect their competitive advantage.

Key Insights: Indifference Curves and Economic Impacts

The theoretical model yields several counterintuitive insights about how regulation shapes the AI market:

The Indifference Curve: The paper identifies a mathematical boundary in the space of regulatory penalties and openness thresholds. If a regulation's parameters fall below this curve, the Generalist will choose to stay closed and pay the fine. If the parameters sit above the curve, the Generalist complies and opens the model. Crucially, this curve shifts based on the model's initial baseline performance ($\alpha_0$).

Indifference curves showing how the boundary between compliance and abstention shifts with model performance.

Pareto Improvements: Surprisingly, regulation can sometimes make everyone better off. For models with lower initial performance, a regulatory mandate acts as a "commitment mechanism." It assures the downstream Specialist that the model will remain accessible, encouraging greater investment in fine-tuning and ultimately growing the total economic pie for both parties.

Deadweight Loss vs. Utility Transfer: If a regulator imposes a massive penalty on a highly capable model that still refuses to open up, it creates "deadweight loss"—the developer loses money to the fine, but the broader ecosystem gains no additional transparency. In many other scenarios, regulation doesn't necessarily create new value but simply transfers utility from the Generalist (the large tech firm) to the Specialist (the downstream innovator).

Conclusion and Future Directions

The authors conclude that for high-performing models, increasing the threshold (making the definition of open-source stricter) is often a more effective regulatory lever than simply increasing the financial penalty.

While this framework provides a strong theoretical foundation for AI governance, it has limitations. It currently models a two-player scenario, whereas the real world features multiple generalists competing (which might naturally drive openness). Furthermore, the model focuses purely on economics, intentionally omitting the "dual-use" or safety risks that might actually lead regulators to discourage openness for extremely powerful models. Future work could expand this by modeling multi-agent competition and breaking down the one-dimensional openness score into separate vectors for data, weights, and code.

Summary updated

Abstract

Regulatory frameworks, such as the EU AI Act, encourage openness of general-purpose AI models by offering legal exemptions for "open-source" models. Despite this legislative attention on openness, the definition of open-source foundation models remains ambiguous. This paper presents a stylized model of the regulator's choice of an open-source definition in order to evaluate which standards will establish appropriate economic incentives for developers. In particular, we model the strategic interactions among the creator of the general-purpose model (the generalist) and the entity that fine-tunes the general-purpose model to a specialized domain or task (the specialist), in response to the regulator. Our results characterize market equilibria -- specifically, upstream model release decisions and downstream fine-tuning efforts -- under various openness policies and present an optimal range of open-source thresholds as a function of model performance. Overall, we identify a curve defined by initial model performance which determines whether increasing the regulatory penalty vs. increasing the open-source threshold will meaningfully alter the generalist's model release strategy. Our model provides a theoretical foundation for AI governance decisions around openness and enables evaluation and refinement of practical open-source policies.
BibTeX
@inproceedings{qiu2025modeling,
  author = {Tori Qiu and Benjamin Laufer and Jon Kleinberg and Hoda Heidari},
  title = {{Modeling the Economic Impacts of AI Openness Regulation}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=iSDKE8vec6},
}
Figure