Robust System for Identifying Procurement Fraud

Amit Dhurandhar, Rajesh Kumar Ravi, Bruce Graves, Gopikrishnan Maniachari, Markus Ettl

Presented at AAAI 2015 by researchers from IBM, this paper details a multi-modal analytical system designed to address the multi-billion dollar challenge of procurement fraud. By integrating traditional business rules with social network analysis and a novel online learning framework, the system significantly outperforms legacy tools in identifying high-risk vendors and employees.

The Complexity of Procurement Fraud

Procurement fraud—the manipulation of purchasing processes for personal gain—is a massive drain on corporate resources, with companies losing an average of 5% of their revenue annually. The challenge in detection is rooted in three primary factors: a significant detection lag (averaging 18 months), the inefficiency of traditional audits (which catch only 3% of fraud), and the inherent complexity of collusion between employees and vendors.

Figure 1: Taxonomy of procurement fraud, illustrating the various channels of vendor and employee misconduct.

As shown in the fraud taxonomy, misconduct can range from simple fraudulent invoicing to complex bid-rigging and kickback schemes. Existing tools often fail because they rely on static, manually tuned rules that cannot adapt to these evolving tactics or provide the interpretability required by human investigators.

System Architecture and Methodology

The proposed system moves beyond simple "red flag" rules by employing a multi-layered analytical approach. The architecture ingests structured transactional data, unstructured text (such as emails and comments), and external risk indicators like corruption indices.

Figure 2: The multi-modal analytics flow, integrating text analytics, social network analysis, and online probabilistic learning.

Key components of this flow include:

  • Social Network Analysis (SNA): To detect collusion, the system builds a social graph using email frequency and shared personal information. It uses a modified shortest-path algorithm to calculate a "collusion confidence" score.
  • Anomalous Event Identification: The system monitors over 100 event types, from statistical tests like Benford’s Law to text-mined indicators such as work starting before a purchase order is finalized.
  • Online Probabilistic Learning: This is the system's core innovation. Because labeled fraud data is rare, the system uses a principled update rule to adjust risk-indicator weights based on real-time feedback from investigators. By using a convex upper bound for the loss function, the authors ensure the model remains interpretable, keeping weights normalized between 0 and 1.

Key Insights and Results

The researchers identified that collusion is the primary driver of high-impact fraud, yet it is the most frequently missed by standard tools. To address privacy concerns during analysis, the system utilizes an "HR Firewall," where sensitive employee data is matched against vendor accounts behind a protected corporate firewall, returning only a risk status rather than raw data.

Evaluated using a year of IBM’s internal procurement data—comprising millions of invoices and 35,000 vendors—the system demonstrated substantial improvements over existing methods:

  • 80% Efficiency Boost: Investigators were significantly more effective at identifying high-risk entities.
  • Higher Precision: The system's "Top 20" weekly risk list contained 80% more true positives than previous state-of-the-art methods.
  • Long-term Detection: The tool successfully flagged fraudulent activities that had evaded traditional audits for over 15 years.

Future Directions

While highly effective, the system's performance depends on access to social and private data, which may be restricted in regions with strict privacy laws. Future work involves addressing this "cold start" problem for new clients through extrapolated scoring and adapting the architecture to other high-stakes domains like healthcare and insurance fraud.

Summary updated

Abstract

An accredited biennial 2012 study by the Association of Certified Fraud Examiners claims that on average 5% of a company's revenue is lost because of unchecked fraud every year. The reason for such heavy losses are that it takes around 18 months for a fraud to be caught and audits catch only 3% of the actual fraud. This begs the need for better tools and processes to be able to quickly and cheaply identify potential malefactors. In this paper, we describe a robust tool to identify procurement related fraud/risk, though the general design and the analytical components could be adapted to detecting fraud in other domains. Besides analyzing standard transactional data, our solution analyzes multiple public and private data sources leading to wider coverage of fraud types than what generally exists in the marketplace. Moreover, our approach is more principled in the sense that the learning component, which is based on investigation feedback has formal guarantees. Though such a tool is ever evolving, an initial deployment of this tool over the past 6 months has found many interesting cases from compliance risk and fraud point of view, increasing the number of true positives found by over 80% compared with other state-of-the-art tools that the domain experts were previously using.
BibTeX
@inproceedings{dhurandhar2015robust,
  author = {Amit Dhurandhar and Rajesh Kumar Ravi and Bruce Graves and Gopikrishnan Maniachari and Markus Ettl},
  title = {{Robust System for Identifying Procurement Fraud}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2015},
  doi = {10.1609/aaai.v29i2.19045},
}
Figure