Construction and application of service quality evaluation system in the preclinical research on cardiovascular implant devices

Yongchun Cui, Fuliang Luo, Boqing Yang, Bin Li, Qi Zhang, Gopika Das, Guangxin Yue, Jiajie Li, Yue Tang, Xin WangBMC Medical Informatics Decis. Mak 2019 · DOI

Cardiovascular implant devices (CVIDs), such as coronary stents and heart valves, are classified as high-risk (Class III) medical devices. Their development is characterized by extreme technical complexity, long timelines, and high costs. Consequently, a specialized service industry has emerged to handle the preclinical development and evaluation of these devices. However, because this is a relatively new industry, there has been no standardized way to evaluate the quality of these services. This paper, published in BMC Medical Informatics and Decision Making, presents a structured approach to quantifying service quality in this niche but high-stakes field.

The Two-Level Evaluation System

To address the lack of formal indicators, the researchers developed a multi-tiered evaluation system. Through literature reviews and consultations with a Decision-Making Group (DMG), the authors identified 4 primary indicators and 15 sub-indicators. This framework allows service demanders (manufacturers) to objectively select suppliers and provides service providers with a roadmap for improvement.

Figure 1: The two-level evaluation system, showing the hierarchy of primary and secondary indicators.

Methodology: Fuzzy Analytical Hierarchy Process

The core methodology employed was the Fuzzy Analytical Hierarchy Process (FAHP). While the standard Analytic Hierarchy Process (AHP) helps prioritize factors, the "Fuzzy" extension better accounts for the ambiguity and subjectivity inherent in human expert judgment.

The study relied on a panel of ten high-level specialists—including PhDs and senior professors—to perform pairwise comparisons of the indicators. These comparisons were converted into fuzzy numbers to calculate final weights. The demographic profile of these experts, characterized by significant work experience and high professional titles, ensured the reliability of the weighting data.

Table 1: Demographic characteristics of the expert panel responders.

Key Insights and Results

Professionalism is Paramount

The model assigned "Professionalism" a weight of 0.6457, dwarfing the other primary indicators: Security (0.1193), Functionality (0.0958), and Stability (0.0596). In this industry, the technical expertise of the staff and the quality of the facilities are the primary drivers of value. The five most important granular factors identified were:

  1. Personnel’s technical ability
  2. Facility and equipment attractiveness
  3. Data auditability
  4. Confidentiality capability
  5. Professional service procedures

Quantifying "Soft" Factors

The paper demonstrates how intangible factors like "Brand Image" and "Service Procedures" can be broken down into measurable ratios, such as the proportion of qualified technical personnel or the achievement of ISO certifications.

Validation and Case Study

The system was applied to the "FW lab" (Animal Experimental Center, Fuwai Hospital) to test its practical validity. Based on 30 valid questionnaires from a diverse group of customers (clinical doctors, researchers, and corporate R&D staff), the system produced an Actual Effective Value (AEV) of 0.9076. According to the authors' 5-level star grading system, this earned the lab a Five-Star rating, aligning with its actual market position as a top-tier facility in China with over 60% market share.

Limitations and Future Directions

The authors acknowledge that the expert pool was limited to major Chinese hubs (Beijing, Shanghai, and Tianjin). Future research should include a more geographically diverse range of experts to determine if weights shift in different international contexts. Additionally, as CVID technology evolves, the indicators themselves must be updated to reflect new technical requirements and regulatory standards.

Summary updated

BibTeX
@article{cui2019construction,
  author = {Yongchun Cui and Fuliang Luo and Boqing Yang and Bin Li and Qi Zhang and Gopika Das and Guangxin Yue and Jiajie Li and Yue Tang and Xin Wang},
  title = {{Construction and application of service quality evaluation system in the preclinical research on cardiovascular implant devices}},
  journal = {BMC Medical Informatics Decis. Mak.},
  year = {2019},
  doi = {10.1186/s12911-019-0773-4},
}
Figure