User-Centric Democratization towards Social Value Aligned Medical AI Services

Zhaonian Zhang, Richard JiangIJCAI 2023 · OpenReview

TL;DR

This paper introduces u-DemAI, a novel framework for "Democratic AI" that empowers non-technical users to actively shape AI services, particularly in healthcare. By integrating user feedback into an evolutionary optimization process, u-DemAI aims to align AI with human values, improve performance, and reduce bias, as demonstrated in a medical brain age estimation task.

What Problem Does This Paper Address?

The rapid advancement and integration of AI into various aspects of our lives, especially in critical domains like healthcare, raise significant concerns about control, bias, and alignment with human values. While "Democratic AI" (DemAI) aims to address this by involving the public, there's a risk that non-expert input could undermine carefully designed AI systems. Furthermore, the field of DemAI lacks a clear, mathematically defined framework and a widely accepted model for implementation. This paper tackles these challenges by proposing a concrete, user-centric framework for DemAI that can be applied to real-world services, ensuring that AI development is guided by societal values and benefits a broader population.

Methods

The core of this paper is the User-Centric Evolutionary Democratic AI (u-DemAI) framework. It's built upon the concept of Democratic AI (DemAI), which is defined as an AI implementation that involves relevant people in optimizing AI services to promote social values.

Key methodological components include:

  • User-in-the-Loop Iteration: u-DemAI integrates user feedback directly into the AI service's optimization process. Users can express preferences for various social values (e.g., fairness across different demographics) through a combined measure F.
  • Evolutionary Optimization (PSO-inspired): The framework borrows concepts from Particle Swarm Optimization (PSO) to emulate an evolutionary democratic model. This involves updating weights of individual AI services based on user preferences and the collective "best" performance, ensuring convergence towards optimal social values.
  • Community-Based Customization: u-DemAI allows for the creation of specialized services tailored to different user communities (e.g., age groups). This enables the AI to adapt its predictions and behavior to the specific needs and values of each group.
  • Mathematical Formalization: The paper provides a mathematical definition of DemAI and its evolutionary process, offering a rigorous foundation for its implementation and analysis.

Datasets

The paper uses a publicly available dataset for its case study:

  • [Cole et al., 2017] Dataset: This dataset comprises 2641 healthy individuals' brain sMRI data, along with their age and gender. The age range is from 16 to 90 years, with an average age of 35.8 years. The dataset is split into 75% for training and 25% for testing the AI services.

Key Insights and Ideas

  • Democratizing AI is not just about access, but about co-creation: The paper moves beyond simply making AI accessible to actively involving users in the design and optimization process, emphasizing that this co-creation is key to aligning AI with social values.
  • User feedback can actively improve AI performance and fairness: The u-DemAI framework demonstrates that by incorporating non-expert user preferences, AI models can achieve better accuracy and significantly reduce biases that might be present in expert-designed systems.
  • Evolutionary computation provides a natural fit for democratic AI: The use of PSO-inspired mechanisms offers a robust and mathematically sound way to achieve convergence towards desired social values through collective user input.
  • AI services can be dynamically adapted to specific communities: The ability to create community-specific u-DemAI services highlights the potential for highly personalized and context-aware AI applications, especially in sensitive areas like healthcare.

Key Results

The u-DemAI framework was applied to a medical AI service for brain age estimation. The results showed:

  • Improved Fairness and Reduced Ageism: u-DemAI significantly reduced ageism compared to individual AI services and even expert-designed ensemble models. The Pearson coefficient for brain age gap vs. true age was as low as 0.01, indicating excellent fairness.
  • Enhanced Accuracy: u-DemAI achieved the best prediction accuracy with a Mean Absolute Error (MAE) of 2.99, outperforming individual services and expert ensembles.
  • Effective Weight Adaptation: The framework successfully adjusted the weights of individual AI services based on user preferences for different age groups, leading to better overall performance for each group.
  • Convergence: The evolutionary process demonstrated convergence within a reasonable number of iterations (around 36-45), indicating the stability and reliability of the u-DemAI optimization.

Limitations and Future Work

  • Security of Cloud-Based Platforms: The paper acknowledges that the implementation of democratic AI, especially when involving cloud-based platforms, necessitates further study into security aspects.
  • Mathematical Proof of Convergence: While the paper presents mathematical interpretation and proof of convergence, further rigorous mathematical analysis of the democratic process is suggested.
  • Generalizability to Other Domains: While the case study in brain age estimation is compelling, the paper implies that the u-DemAI framework has the potential to be applied to a wider range of AI services and domains. Future work could explore these applications.

Summary updated

Abstract

Democratic AI, aiming at developing AI systems aligned with human values, holds promise for making AI services accessible to people. However, concerns have been raised regarding the participation of non-technical individuals, potentially undermining the carefully designed values of AI systems by experts. In this paper, we investigate Democratic AI, define it mathematically, and propose a user-centric evolutionary democratic AI (u-DemAI) framework. This framework maximizes the social values of cloud-based AI services by incorporating user feedback and emulating human behavior in a community via a user-in-the-loop iteration. We apply our framework to a medical AI service for brain age estimation and demonstrate that non-expert users can consistently contribute to improving AI systems through a natural democratic process. The u-DemAI framework presents a mathematical interpretation of Democracy for AI, conceptualizing it as a natural computing process. Our experiments successfully show that involving non-tech individuals can help improve performance and simultaneously mitigate bias in AI models developed by AI experts, showcasing the potential for Democratic AI to benefit end users and regain control over AI services that shape various aspects of our lives, including our health.
BibTeX
@inproceedings{zhang2023user,
  author = {Zhaonian Zhang and Richard Jiang},
  title = {{User-Centric Democratization towards Social Value Aligned Medical AI Services}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2023},
  url = {https://openreview.net/forum?id=bKqjRri87v},
}
Figure