Health Information Exchange Readiness for Demonstrating Return on Investment and Quality of Care.

Anjum Khurshid, Mark L. Diana, Rahul JainPubMed 2015

TL;DR

This study surveyed operational Health Information Exchanges (HIEs) to assess their readiness in demonstrating Return on Investment (ROI) and improvements in the quality of care. The findings reveal a significant gap: while most HIEs believe they are delivering value, very few are actively using metrics to quantify this impact, raising concerns about their long-term sustainability, especially with the winding down of HITECH funding.

What Problem Does This Paper Address?

The widespread adoption of Health Information Exchanges (HIEs) in the US, spurred by initiatives like the HITECH Act, has led to significant investments in health IT infrastructure. The underlying assumption is that these HIEs will improve healthcare quality and efficiency, leading to a positive Return on Investment (ROI). However, a critical challenge has been the difficulty in measuring and demonstrating this value. Healthcare organizations and policymakers need concrete evidence to justify continued investment and support for HIEs. This paper addresses the question of how effectively operational HIEs are currently measuring and reporting on their ROI and impact on quality of care, highlighting a potential disconnect between perceived value and demonstrable outcomes.

Methods

The researchers developed a survey instrument to gather data from operational community HIEs. This instrument was built upon a prior study's foundation and enhanced with insights from the Greater New Orleans Health Information Exchange (GNOHIE) and academic consultations. The survey comprised 47 questions, divided into two sections: one focusing on organizational demographics and characteristics, and the other on sustainability, quality of care, and the use of ROI metrics. The survey was administered via the Qualtrics online platform. The study identified prospective respondents from published lists of HIEs and used a multi-stage contact process involving phone calls and emails to ensure a representative sample.

Datasets

Not discussed in the paper. The study utilized a survey instrument administered to operational Health Information Exchanges (HIEs).

Key Insights and Ideas

  • Perception vs. Reality Gap: There's a strong belief among HIE respondents that they are achieving a positive ROI and improving care quality. However, this belief is not consistently backed by robust data collection and reporting.
  • Metrics are Underutilized: A significant finding is the low adoption of specific metrics for calculating ROI. While many HIEs believe in their value, only a minority are actively using quantifiable measures to prove it.
  • Quality Measurement Lag: Similarly, while HIEs are generally seen as improving care quality, a large percentage of respondents are not using data to measure the quality performance of participating providers or delivering reports on quality measures.
  • Sustainability Concerns: The lack of demonstrable ROI and quality improvements, coupled with the end of HITECH funding, poses a serious threat to the long-term sustainability of many HIEs. This could lead to eroding community support and difficulties in generating revenue.
  • Shared Infrastructure Dilemma: The study raises questions about whether the concept of a shared community infrastructure for health information exchange is an outdated or impractical solution, especially given the slow progress in demonstrating its value.

Key Results

  • Response Rate: A 60 percent response rate was achieved from operational HIEs.
  • ROI Belief: Two-thirds (66%) of respondents agreed that their HIEs demonstrated a positive ROI.
  • ROI Metrics Usage: Generally, one-fourth or fewer respondents reported using metrics to calculate ROI. The most common metrics used were labor savings (27%), improved communication/coordination (27%), and reduced duplication of tests/procedures (24%).
  • Quality of Care Belief: The majority of respondents (64%) agreed that community HIEs improve the quality of care. However, 36% were unsure and awaiting further evidence.
  • Provider Quality Measurement: A substantial majority (73%) indicated that data were not being used to measure the quality performance of participating providers.
  • Quality Reporting: Most respondents (76%) indicated that they did not deliver reports on quality measures.
  • HIE Budgets: Most HIEs had annual operating budgets between $1,000,001 and $5,000,000 (46%).
  • Patient/Customer Reach: Most HIEs served between 100,001 and over 1,000,000 patients or customers annually.

Limitations and Future Work

The authors acknowledge several limitations:

  • Nonresponse Bias: Despite a 60% response rate, the possibility of nonresponse bias remains, meaning the surveyed HIEs might not perfectly represent all operational HIEs.
  • Variation in Knowledge: The potential variation in the knowledge of individuals completing the survey could influence the responses.
  • Timing of Measurement: The questions about ROI and quality impact might have been asked too early in the lifecycle of these projects, as it takes time to develop the evidence.

The study's findings suggest that future work should focus on developing and implementing standardized metrics for measuring ROI and quality improvements in HIEs. The paper also implicitly calls for a re-evaluation of the sustainability models for HIEs and a clearer understanding of how to demonstrate their value to policymakers and healthcare organizations, especially in the post-HITECH funding era. The authors suggest that determining whether current investments in HIEs should be considered a sunk cost or warrant renewed support is a critical question for the future.

Summary updated

Abstract

OBJECTIVE: To study the extent to which community health information exchanges (HIEs) deliver and measure return on investment (ROI) and improvements in the quality of care. MATERIALS AND METHODS: We surveyed operational HIEs for their characteristics, information domains, impact on quality of care, and ROI. RESULTS: A 60 percent response rate was achieved. Two-thirds of respondents agreed that community HIEs demonstrated a positive ROI, while one-third had no opinion or disagreed. One-fourth or fewer respondents reported using various metrics to calculate ROI. Most respondents agreed that HIEs improve the quality of care, though several were not sure and were awaiting further evidence. Most respondents indicated that they did not deliver reports on quality measures (76 percent) and that data were not being used to measure quality performance of participating providers (73 percent). DISCUSSION: Respondents from most HIEs believe that the HIEs are demonstrating a positive ROI; however, a minority of them indicated they had used or will use specific metrics to calculate ROI. HIE representatives overwhelmingly reported that they believe the HIE activities improve the quality of healthcare delivered, but only a few are using data to evaluate provider performance or generate reports on quality measures. CONCLUSION: This study demonstrates the challenge faced by policy makers and healthcare organizations that are investing millions of dollars in HIEs that are believed to improve health outcomes and increase efficiency, but still need more time to develop the evidence to confirm that belief. Our study shows that calculating ROI for HIEs or their impact on quality of care remains a secondary priority for most HIEs. This finding raises serious questions for the sustained support of HIEs, both financially and as a policy lever, given the end of Health Information Technology for Economic and Clinical Health (HITECH) Act funding.
BibTeX
@inproceedings{khurshid2015health,
  author = {Anjum Khurshid and Mark L. Diana and Rahul Jain},
  title = {{Health Information Exchange Readiness for Demonstrating Return on Investment and Quality of Care.}},
  booktitle = {PubMed},
  year = {2015},
}
Figure