Multiple Inputs Neural Networks for Medicare fraud Detection

Mansour Zoubeirou A. Mayaki, Michel RiveillarXiv 2022 · OpenReview

TL;DR

This paper introduces a novel deep learning architecture, MINN-AE, for detecting Medicare fraud by leveraging multiple data sources and an LSTM autoencoder to capture provider behavior. The proposed model significantly outperforms baseline methods, demonstrating improved robustness to imbalanced datasets and better fraud detection capabilities.

What Problem Does This Paper Address?

Medicare fraud is a substantial financial drain, costing billions annually in Europe and the US, which ultimately leads to higher insurance premiums for everyone. Detecting this fraud is challenging due to several factors: the data is highly imbalanced (fraudulent cases are rare), and it's complex, involving various data sources like claims and provider information. Traditional rule-based systems are difficult to maintain, and existing machine learning approaches often struggle with the inherent class imbalance and the need to integrate diverse data types effectively.

Methods

The core of this work is the MINN-AE (Multiple Inputs Neural Network - Autoencoder) architecture. It's a multi-input deep neural network designed to handle different data modalities separately before combining them.

  • Two Input Streams:
    • Claims Data: Processed through a standard Multi-Layer Perceptron (MLP).
  • Provider Data: Processed through a Long-Short Term Memory (LSTM) autoencoder. This component is crucial; it learns to represent a provider's historical behavior over time by compressing it into a latent vector. This autoencoder is trained independently first, and its learned latent representation is then fed into the main model.
  • Concatenation and Classification: The output from the MLP (claims data) and the latent vector from the LSTM autoencoder (provider behavior) are concatenated. This combined representation is then passed through further hidden layers and an output layer for final fraud classification.

This architecture allows the model to learn from claims details and provider behavior distinctly, with the LSTM autoencoder acting as a powerful feature extractor and dimensionality reducer for the provider data, capturing temporal patterns.

Datasets

The study utilizes publicly available Medicare data from the Centers for Medicare and Medicaid Services (CMS) for the period 2017-2019. This data includes:

  • Inpatient Data: Information on patients admitted to hospitals.
  • Outpatient Data: Information on patients who visited hospitals without being admitted.
  • Beneficiary Details Data: Information about the insured individuals.

Additionally, the Office of Inspector General's list of excluded individuals and entities (LEIE) was used to identify healthcare providers excluded for fraudulent activities. The combined dataset exhibits "big data" properties, being high-dimensional and mixed-type. The fraud rate in the preprocessed dataset was reported as 0.5%.

Key Insights and Ideas

  • Provider Behavior is Key: The study highlights that simply looking at individual claims isn't enough. A provider's historical behavior, captured by the LSTM autoencoder, is a strong indicator of potential fraud.
  • Separating Data Modalities Works: Treating claims data and provider data as separate input streams, rather than immediately mixing them, improves the model's ability to learn from each source effectively.
  • LSTM Autoencoders for Temporal Feature Extraction: Using an LSTM autoencoder to learn a compact representation of provider behavior over time is a powerful technique for fraud detection, especially in time-series-like data.
  • Clustering for Interpretability: The latent features learned by the autoencoder naturally cluster providers into homogeneous groups, offering some interpretability and suggesting that similar provider behaviors can be grouped, aiding in fraud identification.
  • Robustness to Imbalance: The MINN-AE model, particularly due to the learned latent features, shows improved robustness to the highly imbalanced nature of Medicare fraud data.

Key Results

The MINN-AE model achieved the highest Area Under the Precision-Recall Curve (AUC-PRC) of 0.745, significantly outperforming all other tested classifiers, including baseline neural networks and state-of-the-art methods like logistic regression, random forest, and XGBoost. The second-best classifier achieved an AUC-PRC of 0.616. While some baseline neural networks performed well on AUC-ROC, MINN-AE demonstrated superior precision and G-mean scores, indicating better overall performance, especially in identifying true positives. The execution time for MINN-AE was 10 minutes, which is competitive with other deep learning models.

Limitations and Future Work

  • Assumption of Provider Fraud: The study assumes that if a provider is flagged as fraudulent, all their claims are also fraudulent. While this is a reasonable simplification for practical purposes, it might overlook scenarios where a provider commits isolated fraudulent acts.
  • Future Work: The authors suggest exploring data sampling techniques (like oversampling or undersampling) or algorithm-level methods to further combat class imbalance. They also plan to investigate the multiple-input models with these techniques.

Summary updated

Abstract

Medicare fraud results in considerable losses for governments and insurance companies and results in higher premiums from clients. Medicare fraud costs around 13 billion euros in Europe and between 21 billion and 71 billion US dollars per year in the United States. This study aims to use artificial neural network based classifiers to predict medicare fraud. The main difficulty using machine learning techniques in fraud detection or more generally anomaly detection is that the data sets are highly imbalanced. To detect medicare frauds, we propose a multiple inputs deep neural network based classifier with a Long-short Term Memory (LSTM) autoencoder component. This architecture makes it possible to take into account many sources of data without mixing them and makes the classification task easier for the final model. The latent features extracted from the LSTM autoencoder have a strong discriminating power and separate the providers into homogeneous clusters. We use the data sets from the Centers for Medicaid and Medicare Services (CMS) of the US federal government. The CMS provides publicly available data that brings together all of the cost price requests sent by American hospitals to medicare companies. Our results show that although baseline artificial neural network give good performances, they are outperformed by our multiple inputs neural networks. We have shown that using a LSTM autoencoder to embed the provider behavior gives better results and makes the classifiers more robust to class imbalance.
BibTeX
@misc{mayaki2022multiple,
  author = {Mansour Zoubeirou A. Mayaki and Michel Riveill},
  title = {{Multiple Inputs Neural Networks for Medicare fraud Detection}},
  year = {2022},
  eprint = {2203.05842},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2203.05842},
}
Figure