aiSTROM-A Roadmap for Developing a Successful AI Strategy

Dorien Herremans

Abstract

A total of 34% of AI research and development projects fail or are abandoned, according to a recent survey by Rackspace Technology of 1,870 companies. We propose a new strategic framework, aiSTROM, that empowers managers to create a successful AI strategy based on a thorough literature review. This provides a unique and integrated approach that guides managers and lead developers through the various challenges in the implementation process. In the aiSTROM framework, we start by identifying the top n potential projects (typically 3-5). For each of those, seven areas of focus are thoroughly analysed. These areas include creating a data strategy that takes into account unique cross-departmental machine learning data requirements, security, and legal requirements. aiSTROM then guides managers to think about how to put together an interdisciplinary artificial intelligence (AI) implementation team given the scarcity of AI talent. Once an AI team strategy has been established, it needs to be positioned within the organization, either cross-departmental or as a separate division. Other considerations include AI as a service (AIaas), or outsourcing development. Looking at new technologies, we have to consider challenges such as bias, legality of black-box-models, and keeping humans in the loop. Next, like any project, we need value-based key performance indicators (KPIs) to track and validate the progress. Depending on the company's risk-strategy, a SWOT analysis (strengths, weaknesses, opportunities, and threats) can help further classify the shortlisted projects. Finally, we should make sure that our strategy includes continuous education of employees to enable a culture of adoption. This unique and comprehensive framework offers a valuable, literature supported, tool for managers and lead developers.

Introduction

Despite the significant hype surrounding artificial intelligence, a staggering 85% of AI projects fail to deliver their intended business value. We are currently in an "AI Spring," yet the path to production remains treacherous. Traditional software development follows relatively deterministic paths, but AI introduces a level of stochasticity (randomness) and data dependency that most corporate strategies are ill-equipped to handle.

Organizations frequently jump on the AI bandwagon without a clear plan for how to position their AI teams, how to measure success beyond simple accuracy, or how to manage the cultural shift required for employees to adopt these new tools. To address this, the aiSTROM (Strategic ROadMap) framework was developed to bridge the gap between technical possibility and business reality, moving beyond a "plug-and-play" mindset to address the unique multidisciplinary challenges of AI.

The aiSTROM Framework

The aiSTROM framework is a perspective-based structured framework for decision-making, synthesized from a decade of experience and a broad literature review. It is organized into eight critical pillars:

The aiSTROM Strategic Roadmap, detailing the eight pillars of AI implementation.
  1. Identify Opportunities: Narrowing down a "top $n$" list (typically 3-5) of high-impact problem statements with clear goal descriptions.
  2. Data Strategy: Addressing the "garbage in, garbage out" problem by focusing on data sources, legal/privacy compliance (e.g., GDPR/PDPA), and storage.
  3. The AI Team: Developing strategies for hiring, up-skilling existing staff, or "acquihiring" to overcome the global scarcity of AI talent.
  4. AI in the Company: Deciding how to position the team—centralized vs. decentralized, AI as a Service (AIaaS), or in-house vs. outsourced development.
  5. Technologies: Navigating the trade-offs between state-of-the-art "black-box" models and Explainable AI (XAI), while keeping humans in the loop.
  6. KPIs: Quantifying value by moving beyond technical metrics (like F1-score) to value-based metrics that capture business impact.
  7. Risk Level: Weighing risks (stochasticity, bias, security) against benefits using tools like SWOT analysis.
  8. Cultural Shift: Enabling adoption through Centres of Excellence and fostering a culture of continuous education.

Strategic Considerations for AI Success

AI is fundamentally different from traditional software. Because AI model performance can vary based on unseen data, the paper advocates for a "portfolio approach" similar to venture capital—investing in multiple projects to mitigate the risk of individual failures.

A crucial realization for managers is the explainability trade-off. In sectors like banking or healthcare, the most accurate model (e.g., a deep neural network) might be legally unusable if it cannot explain why a specific decision was made. Furthermore, the framework encourages "augmenting" humans rather than viewing AI as a total replacement, using AI to empower professionals to work faster and more creatively.

Industry Context and Results

While aiSTROM is a qualitative roadmap, it is grounded in significant industry data:

  • 72% of business leaders believe AI will offer a future business advantage.
  • 31% of failed projects are attributed to a poorly conceived strategy.
  • Successful companies currently prioritize Profit Margins (52%) and Revenue Growth (51%) as KPIs, but there is a growing need for value-based KPIs like "time to insight."

Conclusion

The aiSTROM framework offers a valuable tool for managers and lead developers to navigate the complexities of AI implementation. While currently theoretical, it provides a necessary structure for organizations to move from experimentation to sustainable value creation. Future work will involve validating the framework in real-world corporate environments and updating the roadmap to address emerging risks associated with generative AI and Large Language Models (LLMs), such as hallucinations and prompt injection.

Summary updated

Abstract

A total of 34% of AI research and development projects fail or are abandoned, according to a recent survey by Rackspace Technology of 1,870 companies. In this perspective paper, a new STrategic ROadMap, aiSTROM, is presented that empowers managers to create an AI strategy. A comprehensive approach is provided that guides managers and lead developers through the various challenges in the implementation process. In the aiSTROM framework, the top $n$ potential projects (typically 3-5) are first identified. For each of those, seven areas of focus are thoroughly analysed. These areas include creating a data strategy that takes into account unique cross-departmental machine learning data requirements, security, and legal requirements. aiSTROM then guides managers to think about how to put together an interdisciplinary artificial intelligence (AI) implementation team given the scarcity of AI talent. Once an AI team strategy has been established, it needs to be positioned within the organization, either cross-departmental or as a separate division. Other considerations include AI as a service (AIaas) and outsourcing development. Looking at new technologies, one has to consider challenges such as bias, the legality of black-box models, and keeping humans in the loop. Next, like any project, value-based key performance indicators (KPIs) need to be defined to track and validate the progress. Depending on the company’s risk strategy, a SWOT analysis (strengths, weaknesses, opportunities, and threats) can help further classify the shortlisted projects. Finally, one should make sure that the strategy includes continuous education of employees to enable a culture of adoption. This unique and comprehensive framework offers a practical tool for managers and lead developers.
BibTeX
@inproceedings{herremans2021aistrom,
  author = {Dorien Herremans},
  title = {{aiSTROM-A Roadmap for Developing a Successful AI Strategy}},
  booktitle = {IEEE Access},
  year = {2021},
  doi = {10.1109/access.2021.3127548},
}
Figure