The Study on Relation between Implementation of Six Sigma Quality Management and Financial Performance using Propensity Score Matching

Byounghwa Park, Taeyoung Park, Minjae ParkJournal of the Korean Society for Quality Management 2016 · DOI

Abstract

Purpose: The purpose of this paper is to study whether the adoption of Six Sigma quality management by a firm positively affects its financial performance. The correlation between the duration of Six Sigma implementation period and the financial status of the firm is investigated as well.

Methods: We conduct the analysis using data from Manufacturing Industry Productivity Panel Survey 2013 provided by Korea Productivity Center and Ministry of Trade, Industry and Energy. Propensity score matching is used to reduce sample selection bias of observational study. Furthermore, we use multiple linear regression in order to study the relationship between the implementation of Six Sigma quality management and financial performance. The return on assets and ratio of net income to net sales are considered as dependent variable and implementation of Six Sigma as independent variable.

Results: The indication of this analysis is that implementation of Six Sigma quality management does not significantly enhance financial status. The firms that adopted Six Sigma quality management were categorized into three groups according to the implementation period. Comparison of each group with the firms that do not adopt Six Sigma quality management does not show statistically significant enhancement of financial status.

Conclusion: In conclusion, both adoption and duration of six sigma quality management do not affect financial performance significantly.

Introduction

For decades, Six Sigma has been touted as a revolutionary methodology for reducing defects and increasing profitability. However, academic research on its effectiveness has been a mixed bag: some studies show massive gains, while others point to high-profile failures (like the struggles of Motorola and IBM).

A major flaw in previous research is sample selection bias. Companies that choose to implement Six Sigma aren't a random sample; they tend to be larger, have more resources, or be older than those that don't. If a Six Sigma company is more profitable, is it because of the methodology, or simply because they were already a large, successful firm? This paper attempts to solve this "apples-to-oranges" comparison problem to find the "true" effect of Six Sigma.

Research Methodology

The researchers employed a two-step statistical approach to isolate the impact of Six Sigma quality management:

  1. Propensity Score Matching (PSM): This is the core of the paper's methodology. Instead of comparing all adopters to all non-adopters, the study used PSM to find "twins." For every company that used Six Sigma, they found a company that didn't use it but was nearly identical in terms of scale, assets, debt, and age. This creates a synthetic control group, mimicking a randomized controlled trial.
  2. Multiple Linear Regression: Once the groups were matched, they ran regressions to see if Six Sigma implementation (the independent variable) predicted financial performance (the dependent variables), while also controlling for factors like market competition and leverage ratios.
Conceptual framework of the research model showing independent, dependent, and matching variables.

Data and Variables

The study utilized the Manufacturing Industry Productivity Panel Survey 2013, provided by the Korea Productivity Center and the Ministry of Trade, Industry and Energy.

  • Initial Sample: 601 firms.
  • Final Analyzed Sample: 593 firms (after removing entries with missing data).
  • Breakdown: 158 firms had implemented Six Sigma, while 435 had not.

As shown in the research framework, the dependent variables for financial performance were Return on Assets (ROA) and the Ratio of Net Income to Net Sales. Independent variables included Six Sigma implementation, leverage ratios, and market competition levels. Matching variables used to ensure comparability included the scale of the firm, total assets, total debts, and the age of the firm.

Key Results and Analysis

  • The "Selection Bias" Reality Check: Before matching, the Six Sigma companies looked significantly different from the non-adopters (they were generally larger and older). After PSM matching, these differences disappeared, allowing for a much fairer comparison.
  • No Significant Impact on Financials: The implementation of Six Sigma had a regression coefficient of 0.0034 for Return on Assets (ROA), with a p-value of 0.806. In statistics, a p-value that high means the result is essentially indistinguishable from zero. Similarly, for the ratio of net income to net sales, the effect was statistically insignificant (p-value of 0.235).
  • Duration Doesn't Guarantee Success: The authors categorized firms by how long they had been using Six Sigma (1–5 years, 6–10 years, and over 10 years). Even the "veteran" Six Sigma firms—those with over a decade of experience—did not show statistically significant financial superiority over their matched peers.
  • Debt is a Bigger Factor: Interestingly, the "Leverage Ratio" (the amount of debt a company carries) was a much stronger and more consistent predictor of financial performance (specifically ROA) than whether or not the company used Six Sigma.

Conclusion and Limitations

In conclusion, both adoption and duration of Six Sigma quality management do not affect financial performance significantly. While Six Sigma may offer "soft" benefits like improved corporate culture, employee morale, or long-term customer loyalty, these do not translate directly into the "hard" financial metrics of ROA or net income.

The authors acknowledge several limitations. The data is limited to the manufacturing sector; results might differ in service industries or tech. Furthermore, the study suggests that a company's ability to adapt to market competition and manage its debt levels might be more critical to financial health than specific quality management tools. Future research could look at how Six Sigma interacts with modern frameworks like Industry 4.0 or Lean manufacturing to see if synergistic effects exist that weren't captured here.

Summary updated

Abstract

Purpose:The purpose of this paper is to study whether the adoption of Six Sigma quality management by a firm positively affects its financial performance. The correlation between the duration of Six Sigma implementation period and the financial status of the firm is investigated as well.Methods:We conduct the analysis using data from Manufacturing Industry Productivity Panel Survey 2013 provided by Korea Productivity Center and Ministry of Trade, Industry and Energy. Propensity score matching is used to reduce sample selection bias of observational study. Furthermore, we use multiple linear regression in order to study the relationship between the implementation of Six Sigma quality management and financial performance. The return on assets and ratio of net income to net sales are considered as dependent variable and implementation of Six Sigma as independent variable.Results:The indication of this analysis is that implementation of Six Sigma quality management does not significantly enhance financial status. The firms that adopted Six Sigma quality management were categorized into three groups according to the implementation period. Comparison of each group with the firms that do not adopt Six Sigma quality management does not show statistically significant enhancement of financial status.Conclusion:In conclusion, both adoption and duration of six sigma quality management do not affect financial performance significantly.
BibTeX
@article{park2016study,
  author = {Byounghwa Park and Taeyoung Park and Minjae Park},
  title = {{The Study on Relation between Implementation of Six Sigma Quality Management and Financial Performance using Propensity Score Matching}},
  journal = {Journal of the Korean Society for Quality Management},
  year = {2016},
  doi = {10.7469/jksqm.2016.44.2.341},
}
Figure