Disentangled and Robust Representation Learning for Bragging Classification in Social Media

Xiang Li, Yucheng Zhou

TL;DR

Social media "bragging" is hard to classify because the data is incredibly imbalanced—most people aren't bragging most of the time. This paper introduces a novel framework that creates synthetic training data by "disentangling" the bragging style from the actual content of a post and mixing them together, using an adversarial strategy to ensure these new samples remain realistic.

What Problem Does This Paper Address?

Bragging (or self-promotion) classification is a niche but vital area of computational linguistics. It helps researchers understand social dynamics, personality traits, and even economic status. However, the field faces a massive hurdle: data imbalance.

In the primary large-scale dataset for this task, "non-bragging" posts outnumber specific bragging types (like "Achievement" or "Affiliation") by nearly 50 to 1. Traditional ways to fix this involve injecting external knowledge—like emotion lexicons or word clusters—but these often introduce "noise" that confuses the model. The authors set out to find a way to improve classification performance using only the data at hand, without relying on flawed external dictionaries.

Methods

The authors propose a two-pronged approach: Disentangle-based Feature Augmentation (DFA) and a Domain-aware Adversarial Strategy (DAS).

  1. Disentanglement: The model takes a text representation (from a pre-trained BERTweet encoder) and splits it into two distinct vectors:
  2. Content Feature ($h_c$): The "what" of the post (e.g., talking about a daughter or a memory).
  3. Bragging-type Feature ($h_t$): The "how" of the brag (the linguistic markers of self-promotion).
  4. Augmentation by "Mixing": To create more training data for rare classes, the model takes the content from one post and pairs it with the bragging-type from another. This creates a synthetic feature ($h^{ji}$) that represents a new, valid example of bragging.
  5. Adversarial Learning: Synthetic data can sometimes look "weird" to a model (domain discrepancy). To fix this, the authors added a Discriminator. While the encoder tries to create augmented features that look "real," the discriminator tries to catch them. This "cat-and-mouse" game forces the model to generate robust, realistic representations that follow the same distribution as real social media posts.

Datasets

The study uses the first large-scale bragging dataset, collected by Jin et al. (2022).

  • Source: Twitter (via the Premium Search API).
  • Size: 3,382 training samples and 3,314 test samples.
  • Categories: Six bragging types (Achievement, Action, Feeling, Trait, Possession, Affiliation) and one Not Bragging type.
  • Imbalance: Non-bragging has 2,838 examples, while some bragging types have as few as 58.

Key Insights and Ideas

  • Internal vs. External Knowledge: The most significant "aha" moment is that the model performs better by mining its own latent information than by using external lexicons (like LIWC or NRC). This suggests that the "signal" for bragging is already present in the text representations; it just needs to be isolated.
  • Bragging as a "Wrapper": The success of the disentanglement method implies that bragging is often a linguistic "wrapper" applied to neutral content. By separating the two, the model learns the essence of what makes a post a "brag" regardless of the topic.
  • Adversarial Stability: The inclusion of the adversarial strategy (DAS) was crucial. Without it, the synthetic features were too "noisy," actually hurting the model's ability to generalize to real-world data.

Key Results

The proposed model achieved State-of-the-Art (SOTA) results across the board:

  • Multi-class Classification: Achieved a Macro F1 score of 39.86, significantly outperforming the previous best of 35.59 (BERTweet-Clusters).
  • Binary Classification (Brag vs. Not Brag): Achieved an F1 of 73.07, compared to 71.44 for standard BERTweet.
  • Ablation Success: Removing the adversarial strategy (DAS) dropped the F1 score by about 1 point, while removing both the augmentation and the adversarial strategy caused a massive 5-point drop, proving that the "mix-and-match" feature augmentation is the heavy lifter.

Limitations and Future Work

While the paper demonstrates a clear leap forward, a few areas remain open for exploration:

  • The "Black Box" of Disentanglement: While the t-SNE visualizations show better clustering, the paper doesn't deeply explore exactly what linguistic features the "bragging-type" vector is capturing (e.g., is it focusing on first-person pronouns, superlatives, or specific verbs?).
  • Low Absolute F1: A Macro F1 of ~40% for multi-class classification highlights just how difficult this task remains. The model still struggles with the extreme nuance of human self-presentation.
  • Generalization: The study is limited to English Twitter data. Future work could test if these "bragging-type" features translate across different languages or more formal platforms like LinkedIn.

Summary updated

Abstract

Researching bragging behavior on social media arouses interest of computational (socio) linguists. However, existing bragging classification datasets suffer from a serious data imbalance issue. Because labeling a data-balance dataset is expensive, most methods introduce external knowledge to improve model learning. Nevertheless, such methods inevitably introduce noise and non-relevance information from external knowledge. To overcome the drawback, we propose a novel bragging classification method with disentangle-based representation augmentation and domain-aware adversarial strategy. Specifically, model learns to disentangle and reconstruct representation and generate augmented features via disentangle-based representation augmentation. Moreover, domain-aware adversarial strategy aims to constrain domain of augmented features to improve their robustness. Experimental results demonstrate that our method achieves state-of-the-art performance compared to other methods.
BibTeX
@inproceedings{li2023disentangled,
  author = {Xiang Li and Yucheng Zhou},
  title = {{Disentangled and Robust Representation Learning for Bragging Classification in Social Media}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2023},
  doi = {10.1109/icassp49357.2023.10096519},
}
Figure