Evaluating R&D and Transformation Functional Platforms’ Operational Performance Using a Data Envelopment Analysis Model: A Comparative Study

Yuhong Cao, Jianxin You, Yongjiang Shi, Wei HuSustainability 2019 · DOI

TL;DR

This paper evaluates the operational performance of R&D and transformation functional platforms across 30 Chinese provinces using Data Envelopment Analysis (DEA). It identifies key performance drivers, regional imbalances, and provides targeted improvement strategies, highlighting that while many platforms show strong transformation capabilities, there's a need to enhance R&D, market share, and new technology value-addition.

What Problem Does This Paper Address?

R&D and transformation functional platforms are crucial for high-tech industry innovation, acting as hubs for R&D, technology transfer, and service innovation. Despite their growing importance and significant investment, their operational performance and efficiency across different regions are not well understood. Existing research often lacks comparative analysis and quantitative evaluation, leading to less targeted policy recommendations. This paper aims to fill this gap by providing a comprehensive, data-driven evaluation of these platforms at a provincial level in China, identifying specific areas for improvement and regional disparities.

Methods

The study employs a multi-stage methodology:

  1. Data Envelopment Analysis (DEA): Specifically, the BCC (Banker, Charnes, and Cooper) model is used. This radial model with variable returns to scale is chosen because it can evaluate the relative efficiency of homogeneous decision-making units (DMUs) – in this case, provincial R&D platforms – using multiple inputs and outputs without pre-specifying production functions. The BCC model decomposes overall efficiency into pure technical efficiency and scale efficiency.
  2. K-means Clustering: After calculating the 2018 efficiency scores (pure technical efficiency and scale efficiency), the K-means clustering algorithm is applied to group provinces into categories based on their performance. This helps in identifying distinct performance profiles.
  3. Input-Output Adjustment Analysis: Based on the DEA results, slack variables are calculated to identify redundancies in inputs (e.g., researchers, institutions, R&D funds) and deficits in outputs (e.g., technological achievements, market share, patents) for inefficient platforms. This provides specific, quantitative targets for improvement.

Datasets

The study utilizes data from China's S&T statistical yearbooks for 2016, 2017, and 2018, along with annual statistical reports from provincial and municipal S&T infrastructure platform centers. The analysis covers 30 Chinese provinces due to data availability.

Key Insights and Ideas

  • Regional Imbalance is Significant: The efficiency of R&D and transformation platforms varies dramatically across provinces, indicating a substantial regional imbalance in their development and operational effectiveness.
  • DEA as a Powerful Diagnostic Tool: The application of DEA effectively quantifies efficiency, allowing for a nuanced understanding of where platforms excel (e.g., strong transformation capabilities) and where they fall short (e.g., R&D capacity, market share).
  • Clustering Reveals Performance Archetypes: K-means clustering successfully categorizes provinces into distinct groups, revealing patterns like "high operating efficiency," "inefficient scale," "low operating efficiency," and "inefficient configuration," which are crucial for tailored policy interventions.
  • Input Redundancy vs. Output Deficit: The analysis highlights that some platforms suffer from redundant inputs (e.g., excess researchers or R&D funds without commensurate output), while others struggle with insufficient output generation, pointing to different root causes of inefficiency.

Key Results

  • Overall Efficiency: The average overall efficiency of R&D and transformation functional platforms across the 30 provinces was 0.784 in 2018, with a standard deviation of 0.178, indicating considerable variation.
  • DEA Effectiveness: In 2018, 14 provinces had DEA-effective platforms, while the remaining 16 were ineffective. Provinces like Anhui, Henan, and Hubei saw their platform efficiency decline from effective to ineffective.
  • Clustering Outcomes:
    • Category I (High Efficiency): 18 provinces (60%) showed high pure technical and scale efficiency, with many achieving full efficiency (TE=1). These provinces have optimized resource utilization.
  • Category II (Inefficient Scale): 3 provinces (10%) had lower scale efficiency than pure technical efficiency, suggesting they should expand their scale to achieve better efficiency.
  • Category III (Low Operating Efficiency): 3 provinces (10%) exhibited low levels of both pure technical and scale efficiency, requiring improvements in both scale and input resource allocation.
  • Category IV (Inefficient Configuration): 6 provinces (20%) had significantly lower pure technical efficiency than scale efficiency, indicating a need to strengthen technological improvement and optimize input resource allocation for better efficiency.
  • Input Adjustments: For inefficient provinces, the analysis identified specific input adjustments needed. For example, Anhui and Jilin showed negative values for researchers, R&D institutions, and R&D investment, indicating redundancy in these inputs.

Limitations and Future Work

  • Data Limitations: The study acknowledges that relying solely on statistical data may not fully capture the complex and diverse realities of R&D and transformation functional platforms.
  • Generalizability: Further research is needed to generalize beyond the specific performance indicators used in this study.
  • Qualitative Aspects: The current analysis is primarily quantitative. Future work could incorporate qualitative assessments to provide a more holistic evaluation.
  • Policy Specificity: While the study provides targeted suggestions, the authors emphasize the need for detailed, region-specific policy development based on these findings.
  • Dynamic Analysis: While data from 2016-2018 was used, a more extensive time-series analysis could reveal longer-term trends and the impact of policy interventions.

Summary updated

Abstract

The purpose of this paper is to provide a contribution to the development of R&D and transformation functional platforms by identifying key performance influencing factors in the use of data envelopment analysis (DEA) to analyze platform operation performance status and reasons. The DEA method is undertaken to calculate the comprehensive efficiency, pure technical efficiency and scale efficiency of R&D and transformation functional platforms in China’s 30 provinces within the period 2016–2018. Based on the 2018 pure technical efficiency and scale efficiency calculations, the K-means clustering method was used to classify the R&D and transformation functional platforms of 30 provinces. Finally, according to the clustering results, the corresponding clustering improvement scheme is given. The operational level of R&D and transformation functional platforms in many provinces of China still needs to be improved: the R&D and transformation capabilities are weak, the market share of leading products is low, the ability of new technology value-added is insufficient, and the development of R&D and transformation functional platforms has regional imbalance. This study is based solely on statistical data, these data alone obviously cannot fully describe and evaluate the real state of R&D and transformation functional platform due to the complexity and diversity of platforms. Further research is needed to generalize beyond the performance indicators constructed in this paper. For the problems of low overall operation efficiency, unbalanced regional development, redundancy of input resources and lack of professional management personnel in the operation of R&D and transformation functional platforms, policy suggestions can be put forward according to clustering results and input and output adjustment values calculated based on relaxation variables. The study presenting a methodology for analyzing R&D and transformation functional platforms’ operation performance, and the conclusions will provide reference for the development of platforms and high-tech industries.
BibTeX
@inproceedings{cao2019evaluating,
  author = {Yuhong Cao and Jianxin You and Yongjiang Shi and Wei Hu},
  title = {{Evaluating R\&D and Transformation Functional Platforms’ Operational Performance Using a Data Envelopment Analysis Model: A Comparative Study}},
  booktitle = {Sustainability},
  year = {2019},
  doi = {10.3390/su11185023},
}
Figure