The effect of nursing participation in the design of a critical care information system: a case study in a Chinese hospital

Yanhong Qin, Ranyun Zhou, Qiong Wu, Xiaodi Huang, Xinli Chen, Weiwei Wang, Xun Wang, Hua Xu, Jing Zheng, Siyu Qian, Changqing Bai, Ping YuBMC Medical Informatics Decis. Mak 2017 · OpenReview

TL;DR

This paper details the development and impact of a participatory-designed Intensive Care Information System (ICIS) in a Chinese hospital. By actively involving nurses in the design process, the study found significant improvements in documentation quality and efficiency, reduced medication errors, and increased direct patient care time, ultimately leading to better overall nursing performance and patient outcomes.

What Problem Does This Paper Address?

The paper addresses the challenge of developing and implementing effective Intensive Care Information Systems (ICIS) in healthcare settings. While ICIS are crucial for modern intensive care units (ICUs) to manage complex patient data and improve care, there's a knowledge gap regarding their development, usage, and impact, particularly in non-Western contexts like China. Existing HIT projects often fail due to a "design and reality gap," where systems aren't tailored to user needs. This study aims to bridge this gap by exploring how a user-centered, participatory design approach can lead to a successful ICIS implementation in a Chinese ICU, improving nursing processes and patient outcomes.

Methods

The study employed a descriptive case study approach in a 14-bed Respiratory ICU in Beijing. The core methodology was participatory design, where ICU nurses, the hospital's IT department, and a software company collaboratively researched, designed, and developed the ICIS. This involved:

  • Collaborative Development: Nurses provided domain knowledge, while IT and software engineers brought technical expertise.
  • Ethnographic Techniques: Engineers observed nursing work, reviewed documents, and interviewed nurses to understand workflows and tacit knowledge.
  • Prototyping: An iterative prototyping process was used, with early prototypes being abandoned when they didn't meet user expectations, highlighting the importance of user feedback.
  • Focus Group Discussions: To gather subjective perceptions of nurses regarding the ICIS.
  • Quantitative Comparison: Nursing documentation time and quality were compared before and after ICIS implementation.
  • Performance Data Analysis: Annual nursing performance data (including ward management, routine practices, infection rates, and mortality) were extracted and analyzed.

Datasets

The study did not introduce new benchmarks or datasets. Instead, it utilized:

  • Pre- and Post-Implementation Data: Documentation time and quality metrics were collected before (May-September 2013) and after (March-August 2014) the ICIS implementation.
  • Annual Nursing Performance Data: Collected by the hospital for six areas: ward management, routine practice, disinfection and isolation, nursing documentation, infection rate, and mortality rate, spanning from 2012 (pre-ICIS) to 2014 (post-ICIS).
  • Qualitative Data: From focus group discussions with nurses.

Key Insights and Ideas

  • Participatory Design is Key: The study strongly emphasizes that actively involving end-users (nurses) in the design and development process is crucial for creating a useful and accepted ICIS. This approach fosters a better fit with actual work processes and reduces resistance to technology adoption.
  • Beyond Simple Digitization: The initial prototype failed because it was seen as a mere replication of paper records. The successful iteration focused on automating information flow and output, demonstrating that effective ICIS go beyond digitizing existing processes.
  • Nurses Gain Time for Patient Care: A significant outcome was the reduction in documentation time, allowing nurses to dedicate more time to direct patient care activities like hygiene, skin care, teaching, and comforting.
  • Multifaceted Improvements: The ICIS didn't just improve documentation; it positively impacted medication administration accuracy, reduced errors, and contributed to better overall hospital performance metrics.

Key Results

  • Documentation Quality & Efficiency:
    • Wrong data rate decreased from 7.5% (paper) to 1.6% (electronic).
  • Missing data rate dropped from 18.5% to 3.7%.
  • Calculation error rate reduced from 16.8% to 2.8%.
  • Electronic records were fully legible, unlike paper records which had 110 illegible data items corrected.
  • Time Allocation:
    • Nursing documentation time per 12-hour shift reduced from 3.80 hours to 2.05 hours.
  • Direct patient care time increased by 1.75 hours per 24-hour period.
  • Nursing Performance:
    • Scores for ward management improved from 94.5 (2012) to 99.8 (2014).
  • Routine nursing practices scores increased from 99 to 99.8.
  • Disinfection and isolation scores rose from 94.1 to 99.8.
  • Nursing documentation scores improved to 99.96.
  • Infection rates dropped from 29.3 (2012) to 16.1 (2014).
  • Mortality rates decreased from 12.6 (2012) to 8.5 (2014).
  • Medication Administration: Accuracy and efficiency were improved through automated barcode technology and standardized processes, reducing transcription errors.

Limitations and Future Work

  • Single ICU Study: The study was conducted in only one ICU, limiting the generalizability of findings to other settings.
  • Medication Error Rate: The study did not directly measure medication error rates before and after implementation, which would have provided more direct evidence of a key potential benefit.
  • Attribution of Improvement: The overall improvement in nursing care quality cannot be solely attributed to the ICIS, as factors like team building and individual nursing expertise also play a role.

The authors suggest future research should focus on:

  • Understanding how the ICIS can be enhanced to support decision-making for both intensivists and nurses.
  • Investigating how to continuously build up ICIS to better support decision-making in critical care.
  • Exploring the impact of ICIS on the decision-making processes of ICU nurses and intensivists.

Summary updated

Abstract

Background Intensive care information systems (ICIS) are continuously evolving to meet the ever changing information needs of intensive care units (ICUs), providing the backbone for a safe, intelligent and efficient patient care environment. Although beneficial for the international advancement in building smart environments to transform ICU services, knowledge about the contemporary development of ICIS worldwide, their usage and impacts is limited. This study aimed to fill this knowledge gap by researching the development and implementation of an ICIS in a Chinese hospital, nurses’ use of the system, and the impact of system use on critical care nursing processes and outcomes. Methods This descriptive case study was conducted in a 14-bed Respiratory ICU in a tertiary hospital in Beijing. Participative design was the method used for ICU nurses, hospital IT department and a software company to collaboratively research and develop the ICIS. Focus group discussions were conducted to understand the subjective perceptions of the nurses toward the ICIS. Nursing documentation time and quality were compared before and after system implementation. ICU nursing performance was extracted from the annual nursing performance data collected by the hospital. Results A participative design process was followed by the nurses in the ICU, the hospital IT staff and the software engineers in the company to develop and implement a highly useful ICIS. Nursing documentation was fully digitized and was significantly improved in quality and efficiency. The wrong data, missing data items and calculation errors were significantly reduced. Nurses spent more time on direct patient care after the introduction of the ICIS. The accuracy and efficiency of medication administration was also improved. The outcome was improvement in ward nursing performance as measured by ward management, routine nursing practices, disinfection and isolation, infection rate and mortality rate. Conclusions Nurses in this ICU unit in China actively participated in the ICIS development and fully used the system to document care. Introduction of the ICIS led to significant improvement in quality and efficiency in nursing documentation, medication order transcription and administration. It allowed nurses to spend more time with patients to improve quality of care. These led to improvement in overall nursing performance. Further study should investigate how the ICIS system contributes to the improvement in decision making of ICU nurses and intensivists.
BibTeX
@inproceedings{qin2017effect,
  author = {Yanhong Qin and Ranyun Zhou and Qiong Wu and Xiaodi Huang and Xinli Chen and Weiwei Wang and Xun Wang and Hua Xu and Jing Zheng and Siyu Qian and Changqing Bai and Ping Yu},
  title = {{The effect of nursing participation in the design of a critical care information system: a case study in a Chinese hospital}},
  booktitle = {BMC Medical Informatics Decis. Mak},
  year = {2017},
  url = {https://openreview.net/forum?id=eJC0NPge_Jk},
}
Figure