Traffic Light Coding System for Engaging With <scp>AI</scp> in Surgery

Payal Mukherjee, Amin Beheshti, Shivani Angelique Kumar, Gordon G. Wallace, Neil D. Merrett, Jonathan R. Clark, Simon Kos, Ellen Rawstron, Jian Yang, Stuart M. Grieve, Amith Shetty, Susanne SingerANZ 2025 · DOI

TL;DR

This paper proposes a "traffic light" risk stratification system to help surgeons navigate the increasing integration of AI in healthcare. It aims to provide a clear framework for understanding AI applications, their potential benefits, and associated risks, ultimately fostering safer and more trustworthy adoption of AI in surgical practice.

What Problem Does This Paper Address?

The rapid proliferation of Artificial Intelligence (AI) in healthcare, accelerated by global events like the COVID-19 pandemic, presents both immense opportunities and significant challenges. While AI promises to enhance efficiency, precision, and patient outcomes, its complex nature and evolving applications outpace existing regulatory and governance frameworks. Surgeons, as frontline practitioners, need a practical and accessible way to understand the diverse types of AI systems, their specific uses in surgery, and the associated risks. Without this understanding, there's a risk of misapplication, erosion of patient trust, and potential medicolegal liabilities. The paper addresses the critical need for a structured approach to evaluating and integrating AI in a way that maximizes benefits while mitigating harm.

Methods

The paper's core contribution is the proposal of a "traffic light coding system" for categorizing AI applications based on their risk level. This system is inspired by standard risk assessment matrices used in healthcare, which often employ qualitative (e.g., high, medium, low) or quantitative measures, frequently visualized with traffic light colors. The authors categorize AI applications into three levels:

  • Green (Low-Risk): Primarily business or administrative applications, not directly involved in therapy or clinical decision-making. Examples include AI for resource planning or generating consulting letters.
  • Amber (Medium-Risk): Applications that begin to integrate into clinical care but have very low risk of harm. This includes AI for prolonging device battery life or assisting in research. Clinical decision support software that doesn't directly process medical images or replace clinical judgment also falls here.
  • Red (High-Risk): Applications that play a more direct role in clinical care, carrying higher regulatory burdens. These are more likely to be encountered in the operating theatre.

The paper also discusses the regulatory landscape in Australia, referencing the Therapeutic Goods Act 1989 and the Privacy Act 1988, and emphasizes the importance of understanding these frameworks for safe AI adoption.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • AI is not monolithic: The paper effectively breaks down AI into distinct categories (Analytical, Cognitive, Generative, Humanoid, Agentic), highlighting that different types of AI have different capabilities and implications.
  • Risk stratification is crucial: The "traffic light" system offers a much-needed intuitive framework for surgeons to quickly assess the potential risks associated with various AI tools, moving beyond a general understanding of AI to practical application.
  • Regulation lags behind innovation: The paper underscores the challenge of regulating rapidly evolving AI technologies, particularly software-based applications, and the need for clinicians to be proactive in understanding their responsibilities.
  • Trust is paramount: The authors repeatedly emphasize that maintaining patient trust is essential for the successful integration of AI, and this requires transparency, ethical considerations, and robust data governance.
  • Surgeons are key stakeholders: The paper positions surgeons not just as users but as critical leaders in the responsible implementation of AI within their teams and institutions.

Key Results

The paper does not present quantitative results from experiments or trials. Instead, its key "results" are conceptual:

  • A proposed traffic light coding system for categorizing AI applications by risk (Green, Amber, Red).
  • An overview of the Australian regulatory landscape for AI in healthcare, including the Therapeutic Goods Act 1989 and the Privacy Act 1988.
  • Identification of key challenges in AI integration, such as data governance, intellectual property, credentialing, and the need for continuous professional development for clinicians.
  • A call for interdisciplinary collaboration and a strategic approach to AI adoption in healthcare.

Limitations and Future Work

The authors acknowledge that the proposed traffic light system is a conceptual framework and requires further development and validation. They highlight that:

  • Functionality creep can blur the lines between risk categories, requiring ongoing vigilance.
  • The regulatory framework is still adapting, and clinicians need to stay informed.
  • Data governance and security are costly but essential for maintaining trust.
  • There is a need for national and system-wide collaboration to achieve cost-effectiveness and thorough regulatory analysis.

Future work would likely involve refining the traffic light system with more specific criteria, developing educational resources for surgeons, and advocating for clearer regulatory guidelines and robust data governance policies. The paper implicitly suggests that further research into the practical implementation and impact of this risk stratification system in clinical settings would be valuable.

Summary updated

Abstract

Artificial Intelligence (AI) is generally defined as the development of computer systems or machines that can perform tasks typically requiring human intelligence and is increasingly being used in modern healthcare. While, various AI systems have existed for decades, its scale in healthcare has been escalated by global crises such as the COVID-19 pandemic and military conflicts, which has demanded rapid implementation of health system processes that improve efficiency in resource constrained environments. As AI-enabled technologies gain prominence, it is vital for surgeons to understand the various types of AI systems and their applications in medical practice.
BibTeX
@inproceedings{mukherjee2025traffic,
  author = {Payal Mukherjee and Amin Beheshti and Shivani Angelique Kumar and Gordon G. Wallace and Neil D. Merrett and Jonathan R. Clark and Simon Kos and Ellen Rawstron and Jian Yang and Stuart M. Grieve and Amith Shetty and Susanne Singer},
  title = {{Traffic Light Coding System for Engaging With <scp>AI</scp> in Surgery}},
  booktitle = {ANZ},
  year = {2025},
  doi = {10.1111/ans.70172},
}
Figure