Integrating Text-Mining and Balanced Scorecard Techniques to Investigate the Association between CEO Message of Homepage Words and Financial Status: Emphasis on Hospitals

Hyung Jong Na, Kun Chang Lee, Seong Tae KimHealthcare 2021 · DOI

TL;DR

This study explores how the language used in hospital CEO messages on their websites correlates with financial performance. By combining text-mining with the balanced scorecard framework, researchers found that specific word choices can indeed predict financial indicators like liquidity and reserves, offering a novel way to assess hospital health beyond traditional financial statements.

What Problem Does This Paper Address?

Hospitals, especially in countries like Korea, operate under a public good mandate, often facing financial challenges due to high costs and regulatory limitations. This creates a delicate balancing act: they need to demonstrate public value without necessarily revealing financial weaknesses. CEOs, therefore, have an incentive to strategically use their website's introductory messages (like the "CEO Greeting" or "About Us" section) to shape public perception. This paper addresses the question of whether the qualitative information presented in these CEO messages can serve as a meaningful indicator of a hospital's underlying financial status, a connection that has been underexplored.

Methods

The researchers employed a two-pronged approach:

  1. Text Mining: They used a text-mining technique to extract keywords from the "About Us" or "CEO Greeting" sections of 65 Korean hospital websites. Specifically, they calculated the Term Frequency-Inverse Document Frequency (TF-IDF) for each word. TF-IDF is a standard metric that highlights words that are frequent within a specific document (hospital's message) but relatively rare across a larger corpus (all hospital messages), thus indicating their importance and distinctiveness in that particular context. They focused on nouns to ensure lexical meaning.
  2. Balanced Scorecard Framework: The extracted keywords were then categorized using a modified balanced scorecard framework. Instead of the traditional four perspectives (finance, customer, internal process, learning & growth), this study adapted it for non-profit hospitals by replacing "finance" with "public" (PB). The remaining perspectives were "patient" (PT), "internal process" (IP), and "learning & growth" (LG). Words that didn't fit into these categories were classified as "neutral" (NT) and excluded from the main analysis.

Finally, a t-test was used to compare the mean TF-IDF scores for words within each perspective between "high" and "low" groups of hospitals, defined by their financial ratios. This allowed them to assess if the frequency of certain types of words was significantly associated with specific financial outcomes.

Datasets

The study utilized data from 65 senior public general hospitals in Korea, designated as such by the Ministry of Health and Welfare as of 2018.

  • Text Data: Introductory text from the "About Us" or "CEO Greeting" sections of these hospitals' websites.
  • Financial Data: Financial statements were collected from the Hospital Accounting Standard System provided by the Korean Health Industry Development Institute.

The paper does not introduce a new benchmark dataset but rather uses publicly available website text and financial data from a specific set of hospitals.

Key Insights and Ideas

  • CEO Messages as Financial Proxies: The core idea is that the language used by hospital CEOs isn't just fluff; it can be a quantifiable indicator of financial health. This opens up new avenues for analyzing organizational performance beyond traditional financial metrics.
  • Strategic Language Use: Hospitals with different financial profiles seem to strategically emphasize certain aspects in their CEO messages. For instance, those with lower financial liquidity might focus more on "public value" to deflect attention from financial concerns.
  • Balanced Scorecard Adaptation: Modifying the balanced scorecard for non-profit hospitals by prioritizing "public" over "financial" is a crucial adaptation that reflects the unique operational context of healthcare institutions.
  • Text Mining for Qualitative Insights: The study demonstrates the power of text mining to extract meaningful, quantifiable insights from unstructured qualitative data, bridging the gap between text and numbers.

Key Results

The study found several significant associations:

  • Public Perspective (PB): Hospitals using more "public-related" words showed significantly higher liquidity (current ratio). This suggests that emphasizing public value might be a strategy for hospitals with strong liquid assets.
  • Patient Perspective (PT): A higher emphasis on "patient-related" words was significantly associated with a higher accumulating reserves for proper business purposes ratio. This implies that hospitals planning for future investment might highlight patient satisfaction.
  • Internal Process Perspective (IP): Interestingly, a higher use of "internal process" words was negatively associated with hospital size. This suggests that smaller hospitals might use language emphasizing operational efficiency to compensate for their size.
  • Learning & Growth Perspective (LG): Hospitals using more "learning and growth" words showed significantly lower ratios for debt ratio, fixed-asset turnover ratio, asset turnover ratio, and accumulating reserves for proper business purposes. This indicates that hospitals facing financial challenges (e.g., low leverage, inefficient asset use) might focus on future growth narratives.

Limitations and Future Work

  • Sample Size: The authors acknowledge that the sample size of 65 hospitals is relatively small, which may limit the generalizability of the findings.
  • Hospital Type: The study focused only on senior general hospitals, meaning the results might differ for other types of healthcare facilities.
  • Future Work: The authors suggest that future research could expand the analysis to include smaller hospitals and explore the relationship between CEO messages and financial performance in greater detail. They also highlight the need for further research into the text-mining methodology within the hospital management domain and emphasize the importance of qualitative data disclosure online.

Summary updated

Abstract

(1) Background: The Chief Executive Officer's (CEO's) message on a hospital's homepage on the Internet contains various components, such as the hospital's future vision, promises to customers, availability of upgraded services and public activities. This statement usually includes non-financial information as well as financial information about the corporate entity owning/operating the hospital. In addition, it provides useful information about not only the company's goals and vision, but also firm performance targets and strategies for the future. This study aims to investigate associations between the CEO's message and the financial status of the institution. We used the balanced scorecard framework to analyze what content on the hospital's homepage is related to the hospital's various financial ratios. (2) Methods: We adopted a text-mining method to extract significantly repeated keywords from the CEO's message on the hospital's website. Then, we classified these keywords using a balanced scorecard approach. To examine the relationship between keywords in the CEO's message and the hospital's financial ratios, a <i>t</i>-test was conducted for the difference in the term frequency divided by inverse document frequency (TF-IDF) mean of the home page contents and its relationship with the views of the balanced scorecard framework. (3) Results: According to our empirical results on 65 samples collected from local hospitals, there are some significant relationships between the qualitative content of the hospital's homepage and the quantitative financial ratios that indicate profitability, activity, leverage, liquidity, and accumulating reserves for proper business purposes. (4) Conclusions: The introduction section of a homepage is the part most accessible to customers, containing the aims and ideals of the hospital and reflecting the institution's values and visions. In addition, in the coverage of financial status, the organization can either emphasize financial strength or focus on other areas to divert attention from any weakness shown in the financial information. This study reminds us of the importance of the hospital website's disclosure, and what can be inferred from the financial status of the hospital. It also highlights the need for reconciliation and harmony between the quantitative data, financial statements, and qualitative data in the CEO's message. (5) Implications: To the best of our knowledge, this paper is the first research attempting to investigate the relationship between text on the hospital's homepage and the hospital's financial ratios using text-mining techniques and the balanced scorecard framework. Hospitals play a crucial role in a country's welfare and healthcare industry. Nevertheless, in many countries, hospital organizations tend to remain a source of critical fiscal deficits due to ineffective and sloppy management. We expect that the result of this paper can provide hospital managers with useful information to address that situation.
BibTeX
@inproceedings{na2021integrating,
  author = {Hyung Jong Na and Kun Chang Lee and Seong Tae Kim},
  title = {{Integrating Text-Mining and Balanced Scorecard Techniques to Investigate the Association between CEO Message of Homepage Words and Financial Status: Emphasis on Hospitals}},
  booktitle = {Healthcare},
  year = {2021},
  doi = {10.3390/healthcare9040408},
}
Figure