TalkDown: A Corpus for Condescension Detection in Context

Zijian Wang, Christopher Potts

Abstract

Condescending language use is caustic; it can bring dialogues to an end and bifurcate communities. Thus, systems for condescension detection could have a large positive impact. A challenge here is that condescension is often impossible to detect from isolated utterances, as it depends on the discourse and social context. To address this, we present TalkDown, a new labeled dataset of condescending linguistic acts in context. We show that extending a language-only model with representations of the discourse improves performance, and we motivate techniques for dealing with the low rates of condescension overall. We also use our model to estimate condescension rates in various online communities and relate these differences to differing community norms.

Introduction

Detecting condescension in digital discourse is a significant challenge for natural language processing. Unlike overt toxicity or hate speech, condescension is often subtle, relying on pragmatic presuppositions and social status imbalances rather than explicit profanity. An utterance that appears helpful in one context can be deeply patronizing in another. This research introduces TALKDOWN, a context-aware dataset designed to bridge the gap in automated condescension detection.

The TALKDOWN Corpus

To capture the nuances of condescending behavior, the authors developed a novel mining strategy on Reddit. They identified "Comment-Reply" pairs where the replier explicitly accused the original commenter of being condescending. To ensure high-quality data, they focused on instances where the reply directly quoted a specific span of text from the original comment, providing a clear anchor for the condescending act.

An example of the TalkDown data structure, showing the context, the quoted condescending span, and the explicit accusation in the reply.

The resulting corpus includes nearly 5,000 manually annotated instances. The authors created both a balanced version and an imbalanced version (1:20 ratio) to reflect the actual rarity of condescension in natural online interactions. This allows for more robust testing of how models handle the "needle in a haystack" nature of social signals in the wild.

Modeling the Nuance of Context

The researchers fine-tuned BERT models to evaluate the importance of conversational context. They compared three configurations: using only the quoted span, using only the preceding context, and using both.

The results confirmed that while the quoted text contains the strongest signal, incorporating the surrounding context provides a significant performance boost—approximately 3–4% in macro-F1. The BERT Large model achieved a macro-F1 of 0.684 on the imbalanced dataset. This highlights that condescension is a relational linguistic act; the "what" is often defined by the "where" and "when" of the conversation.

Community Norms and Condescension Rates

A key contribution of this work is the application of the trained model to analyze the "health" of various online communities. By deploying the model across different subreddits, the authors observed how moderation and community norms shape behavior.

Condescension rates across various subreddits over time, highlighting how community norms influence conversational tone.

Subreddits with strict rules for respectful engagement, such as r/AskWomen, exhibited significantly lower condescension rates compared to r/AskMen. Similarly, supportive spaces like r/stopdrinking (3.8%) and r/pokemon (4.3%) had much lower rates than r/politics (7.5%) or r/funny (9.2%). The high rate in r/funny suggests a potential area for future work: distinguishing between genuine condescension and the ironic or sarcastic tones common in humor-focused groups.

Conclusion

The TALKDOWN corpus provides a vital resource for studying subtle social dynamics in text. By demonstrating that context is essential for detection, this research paves the way for more sophisticated moderation tools and educational aids that can help maintain productive, respectful online discourse. Future work will focus on refining these models to better handle irony and exploring the intersection of condescension with broader social variables like gender and socioeconomic status.

Summary updated

Abstract

Condescending language use is caustic; it can bring dialogues to an end and bifurcate communities. Thus, systems for condescension detection could have a large positive impact. A challenge here is that condescension is often impossible to detect from isolated utterances, as it depends on the discourse and social context. To address this, we present TalkDown, a new labeled dataset of condescending linguistic acts in context. We show that extending a language-only model with representations of the discourse improves performance, and we motivate techniques for dealing with the low rates of condescension overall. We also use our model to estimate condescension rates in various online communities and relate these differences to differing community norms.
BibTeX
@inproceedings{wang2019talkdown,
  author = {Zijian Wang and Christopher Potts},
  title = {{TalkDown: A Corpus for Condescension Detection in Context}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2019},
  doi = {10.18653/v1/d19-1385},
}
Figure