Proceedings of the Fourth Workshop on Natural Language Processing and Computational Social Science

David Bamman, Dirk Hovy, David Jurgens, Brendan O’Connor, Svitlana Volkova, Natalie G. Ahn, Νικόλαος Αλέτρας, Kristen Altenburger, Vijjini Rao, Alexandra Balahur, Timothy Baldwin, Alon Bartal, Eric B. Bell, Laura Biester, Michael Bloodgood, C. Brew, Julian Brooke, Aron Culotta, Steve Deneefe, Matthew J. Denny, A. Seza Doğruöz, Jonathan Dunn, Valery Dzutsati, Jacob Eisenstein, Jason Eisner, Micha Elsner, Alex Fine, Tommaso Fornaciari, K. B. Fraser, Julio Cesar de Almeida Freitas, Juri Ganitkevitch, Dan Goldwasser, Yvette Graham, Andrew Halterman, Oul Han, Marti A. Hearst, Michael Heilman, Loring J. Ingraham, Molly Ireland, Anders Kristen, J Esposito Kenneth, J. Doody Brendan, Kennedy Sunghwan, M.m. Kim, Vivek Kulkarni, Jonathan Kummerfeld, Alessandro Lenci, Mingyang Li, Nikola Ljubešić, Josephine Lukito, Teresa Lynn, Elijah Mayfield, Diana Maynard, Paul Mclachlan, Julia Mendelsohn, Ben J. Miller, David Mimno, Shubhanshu Mishra, Aida Mostafazadeh Davani, Dong Nguyen, Pierre Nugues, Stephan Oepen, Miles Osborne, Sebastian Padó, Shriphani Palakodety, Ted Pedersen, Viktor Pekar, Barbara Plank, Massimo Poesio, Thierry Poibeau, Daniel Preoţiuc-Pietro, Afshin Rahimi, Sravana Reddy, Ellen Riloff, Anthony E. Rios, Carolyn Penstein Rosé, Alla Rozovskaya, Derek Ruths, Asad Sayeed, Natalie Schluter, Djamé Seddah, Felix Soldner, Vivek Srikumar, Ian Stewart, Oren Tsur, Lyle Ungar, Esther van den Berg, Zijian Wang, S. Wurstner White, Steven James Wilson, Wei Xu, Michael Yeomans, Sophie Zhai, Elizabeth Bruch, Jesse Shapiro, Kristin Althenburger, Jason Facebook, Glen Google, Emre Qntfy, CoppersmithOpenalex Unknown 2020 · DOI · OpenAlex

Abstract

Recognizing the growing community of Computational Social Science (CSS) researchers outside of the traditional NLP sphere, as well as new researchers entering the intersection of these fields, the Fourth NLP+CSS Workshop introduced a novel mentoring program. This initiative connected volunteers from the Program Committee to authors seeking additional guidance, fostering a more inclusive interdisciplinary environment. The 2020 proceedings reflect a significant maturation of the field, moving beyond basic sentiment analysis to address complex societal issues through the integration of large-scale language models and sociolinguistic theory.

Introduction: Bridging the "Two Cultures"

Computational Social Science has long navigated a "two-cultures" divide. Social scientists often possess deep theoretical frameworks and critical questions but may lack the computational tools to process massive, unstructured datasets. Conversely, NLP researchers possess powerful algorithms but may lack the social context required to interpret results in a meaningful way.

The Fourth NLP+CSS Workshop aims to bridge this gap. The 2020 proceedings specifically address the urgent need for computational tools to understand human behavior during global crises—most notably the COVID-19 pandemic—while detecting systemic biases in digital information and providing scalable methods for mental health support and public policy analysis.

Methodological Innovations

As a collection of 23 archival papers, the workshop showcases a diverse methodological toolkit that blends cutting-edge machine learning with traditional qualitative analysis. Key approaches include:

  • Transformer-based Models: Researchers utilized BERT and its variants for tasks such as "Text Zoning" (classifying specific sections of documents like job advertisements) and qualitative content analysis in counseling contexts.
  • Diachronic Word Embeddings: By analyzing temporal shifts in vector space, researchers tracked how public perceptions of figures in the news evolve over time.
  • Topic Modeling (LDA): Specifically, the use of Dynamic Content-Specific LDA allowed for the tracking of evolving public concerns throughout the stages of the pandemic.
  • Anomaly Detection: Language models were applied to identify outliers in highly structured professional environments, such as parole hearings.
  • Bias Auditing: New quantitative frameworks were introduced to measure gender and political bias within narrative tropes and Wikipedia articles.

Data Diversity: From Social Media to Administrative Records

The research presented relies on a sophisticated mix of massive public datasets and specialized, sensitive corpora:

  • Social Media: Twitter was used to track "worry" and COVID-19 concerns, while Reddit provided insights into substance use recovery forums.
  • Digital Archives: Researchers analyzed Wikipedia for gender bias and 19th-century abolitionist newspapers for historical sociolinguistic trends.
  • Administrative and Professional Records: The proceedings include analyses of parole hearing transcripts, social worker reports, and multilingual job advertisements (German, French, and English).
  • News Media: Large-scale news crawls were utilized to map local coverage and detect patterns of political "unfairness."

Key Insights and Ideas

NLP as a Public Health Tool

Several papers demonstrate that NLP can act as a real-time "sensor" for population-level mental health. By tracking symptoms of anxiety and depression through social media, researchers can identify trends more rapidly than traditional surveys allow.

The "Pandemic Effect" on Language

Research indicates that COVID-19 did not merely change the topics of conversation; it altered the nature of communication itself. The pandemic affected linguistic diversity and the "emotion dynamics" of online interactions, reflecting the profound psychological impact of the global crisis.

The Evolution of Bias

While platforms like Wikipedia are actively working to reduce overt gender bias, findings suggest that bias is shifting into more subtle "narrative tropes" or diachronic shifts in word associations. These subtle forms of bias require increasingly sophisticated detection methods.

The Importance of Context

The workshop emphasized that "socially-aware" language technologies must account for the identity and status of the speaker—such as veteran status or foreigner-directed speech—to be truly effective and ethical.

Results and Community Growth

The workshop received a record 61 submissions, reflecting the rapid expansion of the NLP+CSS community. Key performance benchmarks were established, including the successful application of BERT for extracting precise locations from local news and identifying "positional claims" across various political text types. Furthermore, the new mentoring program successfully increased participation from authors outside the traditional computer science sphere, enriching the interdisciplinary dialogue.

Limitations and Future Directions

As the field progresses, several challenges remain:

  • The Virtual Shift: The transition to a virtual format due to the pandemic, while increasing accessibility, altered the nature of the dialogue between researchers.
  • Interpretability vs. Performance: There is a recurring need for "interpretable" classifiers, particularly in sensitive areas like abusive content detection, where understanding the reasoning behind a model's flag is as critical as the classification itself.
  • Global Generalizability: Much of the current research remains English-centric. Future work must expand these CSS techniques to low-resource languages and diverse cultural contexts.
  • Ethical Constraints: Researchers must continue to navigate the fine line between utilizing social media for the public good (e.g., suicide risk detection) and respecting the privacy and anonymity of users.

Summary updated

Abstract

Recognizing the growing community of CSS researchers outside of NLP, as well as new researchers starting out in NLP+CSS, we introduced a new mentoring program that connected volunteers from our Program Committee to authors wanting additional guidance.We are especially grateful for their time and guidance.
BibTeX
@inproceedings{bamman2020proceedings,
  author = {David Bamman and Dirk Hovy and David Jurgens and Brendan O’Connor and Svitlana Volkova and Natalie G. Ahn and Νικόλαος Αλέτρας and Kristen Altenburger and Vijjini Rao and Alexandra Balahur and Timothy Baldwin and Alon Bartal and Eric B. Bell and Laura Biester and Michael Bloodgood and C. Brew and Julian Brooke and Aron Culotta and Steve Deneefe and Matthew J. Denny and A. Seza Doğruöz and Jonathan Dunn and Valery Dzutsati and Jacob Eisenstein and Jason Eisner and Micha Elsner and Alex Fine and Tommaso Fornaciari and K. B. Fraser and Julio Cesar de Almeida Freitas and Juri Ganitkevitch and Dan Goldwasser and Yvette Graham and Andrew Halterman and Oul Han and Marti A. Hearst and Michael Heilman and Loring J. Ingraham and Molly Ireland and Anders Kristen and J Esposito Kenneth and J. Doody Brendan and Kennedy Sunghwan and M.M. Kim and Vivek Kulkarni and Jonathan Kummerfeld and Alessandro Lenci and Mingyang Li and Nikola Ljubešić and Josephine Lukito and Teresa Lynn and Elijah Mayfield and Diana Maynard and Paul Mclachlan and Julia Mendelsohn and Ben J. Miller and David Mimno and Shubhanshu Mishra and Aida Mostafazadeh Davani and Dong Nguyen and Pierre Nugues and Stephan Oepen and Miles Osborne and Sebastian Padó and Shriphani Palakodety and Ted Pedersen and Viktor Pekar and Barbara Plank and Massimo Poesio and Thierry Poibeau and Daniel Preoţiuc-Pietro and Afshin Rahimi and Sravana Reddy and Ellen Riloff and Anthony E. Rios and Carolyn Penstein Rosé and Alla Rozovskaya and Derek Ruths and Asad Sayeed and Natalie Schluter and Djamé Seddah and Felix Soldner and Vivek Srikumar and Ian Stewart and Oren Tsur and Lyle Ungar and Esther van den Berg and Zijian Wang and S. Wurstner White and Steven James Wilson and Wei Xu and Michael Yeomans and Sophie Zhai and Elizabeth Bruch and Jesse Shapiro and Kristin Althenburger and Jason Facebook and Glen Google and Emre Qntfy and Coppersmith and Carolyn Rose},
  title = {{Proceedings of the Fourth Workshop on Natural Language Processing and Computational Social Science}},
  booktitle = {Openalex Unknown},
  year = {2020},
  doi = {10.18653/v1/2020.nlpcss-1},
}
Figure