Analyzing Empowerment Processes Among Cancer Patients in an Online Community: A Text Mining Approach

Suzan Verberne, Anika Batenburg, Remco Sanders, Mies van Eenbergen, Enny Das, Mattijs S LambooijJMIR Cancer 2018 · OpenReview

TL;DR

This paper introduces a novel text-mining approach to automatically identify and analyze "empowerment processes" within online cancer patient communities. By combining custom-trained text classifiers with the Linguistic Inquiry and Word Count (LIWC) tool, the study quantifies how patients engage in behaviors like sharing personal stories, asking questions, and offering support, and links these to psychological states and user activity levels.

What Problem Does This Paper Address?

Online support groups are recognized as valuable resources for cancer patients, helping them gain a sense of empowerment. However, previous research has largely relied on qualitative methods or questionnaires, which are time-consuming and limited in scale. This study addresses the challenge of systematically analyzing large volumes of unsolicited online communication to understand the dynamics of empowerment processes. The goal is to move beyond small-scale qualitative insights and leverage automated text analysis to uncover broader patterns and relationships within these digital communities.

Methods

The researchers employed a two-pronged automated text analysis strategy. First, they developed and trained binary text classifiers to identify five specific "empowerment constructs" within forum posts: narrative, question, informational support, emotional support, and external source reference. This involved manually labeling a subset of posts and then using this labeled data to train classifiers (specifically, linear Support Vector Classification - SVC) to automatically label the entire corpus. Second, they utilized the Dutch version of the Linguistic Inquiry and Word Count (LIWC) tool to identify psychological processes and linguistic patterns within the same posts. LIWC categorizes words based on their association with various psychological states (e.g., positive emotions, anxiety) and linguistic features (e.g., pronouns, verb tenses). The study then investigated the relationships between these automatically identified empowerment constructs, LIWC categories, and user activity metrics.

Datasets

The study utilized a dataset of 5,534 messages from 1,708 threads posted by 2,071 unique users on the Dutch online community Kanker.nl. This forum is a general cancer patient forum, representing over 15 different cancer types. A subsample of 2,051 posts was manually annotated for training and evaluating the text classifiers. No new benchmarks were introduced, but the study applied existing text mining techniques to a novel domain and set of constructs.

Key Insights and Ideas

  • Automated analysis is feasible for complex social constructs: The study demonstrates that "empowerment processes," which are nuanced social and psychological phenomena, can be reliably identified and quantified in online text using automated methods. This opens doors for analyzing other complex social interactions in digital spaces.
  • Narratives are central to online empowerment: Sharing personal stories (narratives) emerged as the most frequent empowerment construct, highlighting its fundamental role in how patients connect, process their experiences, and relate to others.
  • Active users drive support and information sharing: Users who participate more actively (more posts, more contacts) are more likely to provide informational and emotional support and direct others to external resources, suggesting a progression from personal sharing to community contribution.
  • Linguistic cues reveal psychological states: Specific linguistic patterns, such as the use of assent words ("ok," "yes") and expressions of feelings, are significantly associated with providing emotional support, indicating that psychological states can be inferred from language use.
  • Cancer type differences are subtle: While most empowerment patterns were similar across different cancer types, lung cancer patients were observed to ask more questions and provide less emotional support, potentially linked to their poorer prognosis.

Key Results

The automatic labeling of empowerment constructs achieved an average precision of 85.6%, deemed sufficient for corpus-wide analysis. Narratives were the most prevalent construct (62.94%), followed by informational support (27.49%) and questions (23.83%). Users with more posts were more likely to provide informational and emotional support (Kendall τ > 0.2) and less likely to share narratives (Kendall τ = -0.297). Linguistic analysis revealed that words expressing assent and emotional processes were significant positive predictors of emotional support. Differences in empowerment patterns across cancer types were generally small, with lung cancer patients showing a slight tendency to ask more questions and provide less emotional support.

Limitations and Future Work

The study acknowledges several limitations. Firstly, the data only includes posts from active participants, potentially excluding "lurkers" who may also benefit from online communities. Secondly, the analysis is limited to a single general cancer forum, and findings might differ in specialized forums or for other diseases. Thirdly, the text classification method requires manual annotation for training, meaning it's not fully unsupervised. Finally, LIWC's reliance on word occurrences means it can miss nuances of context, negations, and ambiguous words.

Future work could involve applying these methods to other health conditions, exploring the relationship between empowerment processes and outcomes more deeply, and refining text classification models with larger datasets or more advanced techniques to capture contextual meaning. The authors recommend further use of text mining for analyzing unsolicited online data from patients, as it offers valuable insights into empowerment, language use, and psychological processes.

Summary updated

Abstract

Background: Peer-to-peer online support groups and the discussion forums in these groups can help patients by providing opportunities for increasing their empowerment. Most previous research on online empowerment and online social support uses qualitative methods or questionnaires to gain insight into the dynamics of online empowerment processes.Objective: The overall goal of this study was to analyze the presence of the empowerment processes in the online peer-to-peer communication of people affected by cancer, using text mining techniques. Use of these relatively new methods enables us to study social processes such as empowerment on a large scale and with unsolicited data.Methods: The sample consisted of 5534 messages in 1708 threads, written by 2071 users of a forum for cancer patients and their relatives. We labeled the posts in our sample with 2 types of labels: labels referring to empowerment processes and labels denoting psychological processes. The latter were identified using the Linguistic Inquiry and Word Count (LIWC) method. Both groups of labels were automatically assigned to posts. Automatic labeling of the empowerment processes was done by text classifiers trained on a manually labeled subsample. For the automatic labeling of the LIWC categories, we used the Dutch version of the LIWC consisting of a total of 66 word categories that are assigned to text based on occurrences of words in the text. After the automatic labeling with both types of labels, we investigated (1) the relationship between empowerment processes and the intensity of online participation, (2) the relationship between empowerment processes and the LIWC categories, and (3) the differences between patients with different types of cancer.Results: The precision of the automatic labeling was 85.6%, which we considered to be sufficient for automatically labeling the complete corpus and doing further analyses on the labeled data. Overall, 62.94% (3482/5532) of the messages contained a narrative, 23.83% (1318/5532) a question, and 27.49% (1521/5532) informational support. Emotional support and references to external sources were less frequent. Users with more posts more often referred to an external source and more often provided informational support and emotional support (Kendall τ>0.2; P<.001) and less often shared narratives (Kendall τ=−0.297; P<.001). A number of LIWC categories are significant predictors for the empowerment processes: words expressing assent (ok and yes) and emotional processes (expressions of feelings) are significant positive predictors for emotional support (P=.002). The differences between patients with different types of cancer are small.Conclusions: Empowerment processes are associated with the intensity of online use. The relationship between linguistic analyses and empowerment processes indicates that empowerment processes can be identified from the occurrences of specific linguistic cues denoting psychological processes.JMIR Cancer 2019;5(1):e9887doi:10.2196/cancer.9887
BibTeX
@inproceedings{verberne2018analyzing,
  author = {Suzan Verberne and Anika Batenburg and Remco Sanders and Mies van Eenbergen and Enny Das and Mattijs S Lambooij},
  title = {{Analyzing Empowerment Processes Among Cancer Patients in an Online Community: A Text Mining Approach}},
  booktitle = {JMIR Cancer},
  year = {2018},
  url = {https://openreview.net/forum?id=DFNwVPw7Nw},
}
Figure