Algorithmic Social Intervention

Bryan Wilder

Abstract

Social and behavioral interventions are critical for addressing societal challenges such as homelessness, disease, and poverty. However, these interventions often face limited resources and data. This research introduces "algorithmic social intervention" as a unified framework to enhance the targeting and delivery of these programs using AI and optimization. By focusing on decision-making under uncertainty, this work develops robust algorithms for influence maximization and submodular optimization. Applications in public health, specifically HIV prevention for homeless youth and tuberculosis control, demonstrate that these algorithmic approaches significantly outperform traditional heuristics in real-world settings.

Introduction: A Unified Framework

Algorithmic social intervention bridges the gap between theoretical algorithm design and the practical complexities of field deployments. The research trajectory follows a structured path from initial information gathering to the evaluation of field impact, ensuring that technical innovations are grounded in real-world needs.

The research roadmap for Algorithmic Social Intervention, spanning from information gathering to field evaluation.

The Challenge: Uncertainty and Resource Constraints

Governments and NGOs frequently deploy interventions under two major constraints: limited resources (budgetary and personnel) and limited data (incomplete knowledge of social networks or disease dynamics). Traditional AI models often assume a perfect "map" of the system, which is rarely available in the field. For example, in HIV prevention for homeless youth, social workers train "peer leaders" to spread awareness. However, mapping the entire social network of these youth is labor-intensive and often impossible.

Methodological Innovations

To address these challenges, several novel algorithmic families were developed:

Robust Influence Maximization

These algorithms handle uncertainty in how information spreads. DOSIM uses a game-theoretic approach, treating unknown spread probabilities as an adversary to find strategies that perform well even in worst-case scenarios. CHANGE is a "field-ready" evolution of this concept, designed to be computationally efficient and practical for use on standard laptops.

The architecture of the CHANGE agent, designed for field-ready social network intervention.

Exploratory Influence Maximization

The ARISEN algorithm identifies influential nodes without requiring a full graph. By exploiting the modular "community structure" of social networks and using random walks to estimate community sizes, it can find optimal "seeds" for information spread by querying only a tiny fraction of the population.

Robust Submodular Optimization

Many social problems exhibit diminishing returns, modeled as submodular functions. EQUATOR handles cases with multiple possible objective functions, scaling to large problems where previous methods failed. RASCAL focuses on risk-aversion, optimizing for the "Conditional Value at Risk" (CVaR) to prevent catastrophic failures in intervention outcomes.

Key Insights and Results

  • Community Structure as a Proxy: You don't need a full map to find leaders. Estimating community sizes via random walks is sufficient to identify high-impact individuals.
  • Robustness over Accuracy: Planning for the worst-case scenario (robust optimization) leads to more stable real-world outcomes than relying on "best guess" models.
  • The "Laptop Test": Practical utility requires efficiency. The CHANGE algorithm runs in minutes on a standard laptop, making it accessible to social workers in the field.

Field Impact

  • HIV Prevention: In pilot tests with homeless youth in Los Angeles, AI-based algorithms (CHANGE, DOSIM) reached 70-80% of the target population with health information, compared to only 27% reached by traditional status-quo methods (e.g., degree centrality).
  • Data Efficiency: CHANGE achieved these results while surveying only 18% of the social network.
  • Disease Control: Simulations for Tuberculosis in India suggested that the DOMO algorithm could avert over 8,000 cases per year compared to current policies.
  • Computational Speed: EQUATOR solved robust optimization problems with 1,000 variables in under 40 seconds, whereas previous state-of-the-art methods timed out after 10 hours.

Future Directions

Future work aims to integrate multi-fidelity optimization, using simple surrogate models to guide complex simulations, and distributionally robust optimization to refine uncertainty models using available data samples. Additionally, accounting for the complexity of human behavioral responses to interventions remains a critical open challenge for the field.

Summary updated

Abstract

Social and behavioral interventions are a critical tool for governments and communities to tackle deep-rooted societal challenges such as homelessness, disease, and poverty. However, real-world interventions are almost always plagued by limited resources and limited data, which creates a computational challenge: how can we use algorithmic techniques to enhance the targeting and delivery of social and behavioral interventions? The goal of my thesis is to provide a unified study of such questions, collectively considered under the name "algorithmic social intervention". This proposal introduces algorithmic social intervention as a distinct area with characteristic technical challenges, presents my published research in the context of these challenges, and outlines open problems for future work. A common technical theme is decision making under uncertainty: how can we find actions which will impact a social system in desirable ways under limitations of knowledge and resources? The primary application area for my work thus far is public health, e.g. HIV or tuberculosis prevention. For instance, I have developed a series of algorithms which optimize social network interventions for HIV prevention. Two of these algorithms have been pilot-tested in collaboration with LA-area service providers for homeless youth, with preliminary results showing substantial improvement over status-quo approaches. My work also spans other topics in infectious disease prevention and underlying algorithmic questions in robust and risk-aware submodular optimization.
BibTeX
@inproceedings{wilder2018algorithmic,
  author = {Bryan Wilder},
  title = {{Algorithmic Social Intervention}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2018},
  url = {https://openreview.net/forum?id=rJ-qYQzuWH},
}
Figure