Abstract
Identifying individuals impacted by gang violence is a critical step for community-based intervention and trauma support. This research presents a machine learning framework for classifying Twitter users in Chicago who are "impacted" by violence—specifically friends and family of deceased gang-affiliated youth. The study investigates the performance of several architectures, including XGBoost and Logistic Regression, while critically examining the "lexical bias" inherent in these models. Results indicate that standard NLP features often misidentify African American English (AAE) as a marker of gang involvement, necessitating a cautious, ethics-first approach to automated social work.
Introduction
In urban centers like Chicago, the first line of defense against escalating violence often consists of community organizations, mediators, and street-level workers. These groups aim to provide timely intervention to individuals in the "periphery" of gang activity—those experiencing the profound grief and trauma that often precedes further violence. However, the scale of social media makes manual monitoring impossible. While previous automated efforts have focused on "criminality" markers like weapons or gang-specific hashtags, this research shifts the focus toward identifying those impacted by violence to facilitate care.
Methods
The researchers framed the identification problem as a binary classification task (Impacted vs. Not Impacted). They evaluated several machine learning architectures, including Naive Bayes, Random Forest, XGBoost, and Binary Logistic Regression. The feature set was multi-modal, incorporating:
- Linguistic Features: TF-IDF vectors at the word and bi-gram levels, alongside Part-of-Speech (POS) tagging proportions.
- Social Media Metadata: Frequency counts of hashtags and the top 10 most used emojis from 2015 (see Figure 5).
- Psychological Markers: Proportions of emotion-related words (e.g., anger, sadness, trust) derived from the NRC Emotion Lexicon.
- Bias Evaluation: A "bucketed" frequency analysis designed to detect if predictive features were disproportionately associated with African American English (AAE).
Datasets
The study utilized two primary data sources for training and evaluation:
- Positive Class (Impacted): Approximately 4,300 tweets from two deceased gang-affiliated teenagers (Gakirah Barnes and Lamanta Reese) and their immediate social circles.
- Negative Class (Random): Approximately 48,000 random tweets collected via the Twitter API using a geographic bounding box centered on Chicago (see Figure 1).
- Dialect Evaluation Set: To test for lexical bias, a separate corpus of 1.1 million tweets was used, machine-labeled with a high probability (>0.8) of being written in AAE.
Results and Discussion
The machine learning models significantly outperformed rule-based baselines. A simple keyword-based baseline for "Aggression/Loss" achieved only 8% precision, whereas the ML models reached much higher thresholds.
- XGBoost demonstrated the highest precision (up to 97% in out-of-network tests) but suffered from low recall (17-24%), potentially missing many individuals in need.
- Binary Logistic Regression emerged as a more balanced performer, maintaining 84% precision with a much higher recall of 42%.
A central finding of the study was the "Dialect Trap." Many of the most predictive features for the "Impacted" class were slang terms like "finna," "dat," or "dis." These are standard features of AAE rather than specific indicators of gang involvement or trauma. This lexical bias suggests that models might flag users based on their linguistic identity rather than their actual risk or need for intervention.
Conclusion
This work highlights the potential and the pitfalls of using "big data" for social work. While automated tools can help community organizations scale their outreach, the risk of algorithmic discrimination remains high. Future work must move beyond word-level emotion lexicons to capture the contextual nuances of emojis and sarcasm. Furthermore, incorporating geographic context and refining dialect-aware models will be essential for creating ethical, effective intervention tools.
Summary updated