From Individuals to Crowds: Dual-Level Public Response Prediction in Social Media

Jinghui Zhang, Kaiyang Wan, Longwei Xu, Ao Li, Zongfang Liu, Xiuying Chen

Introduction

Predicting public reaction to news events is a foundational challenge for crisis management, policy-making, and the social sciences. Despite the advancement of Large Language Models (LLMs), current systems often struggle with a dual-level challenge: they either produce generic, "safe" responses that lack individual personality (the Generic Response Trap) or they fail to bridge the gap between individual text generation and collective sentiment trends (the Sentiment Silo).

To address these issues, this research introduces SocialAlign, a novel framework designed to bridge the gap between individual social media behavior and collective public opinion. By integrating a specialized "Analyze-Compose" architecture with multi-dimensional user personas, SocialAlign predicts both personalized micro-level comments and macro-level group sentiment distributions with state-of-the-art accuracy.

The SocialAlign Framework

SocialAlign operates through a three-stage pipeline designed to mimic the cognitive processes of social media users.

1. Multi-Dimensional Persona Construction

Rather than relying solely on a user's recent post history, SocialAlign utilizes GPT-4 to distill historical data into a five-dimensional persona. This persona captures:

  • Interests: Core topics the user engages with.
  • Language Style: Specific linguistic quirks and vocabulary.
  • Emotional Tone: The typical sentiment profile of the user.
  • Personality Traits: Behavioral characteristics.
  • Values: Underlying beliefs that drive opinions.

2. SocialLLM and PAC-LoRA

The technical core of the framework is the Personalized Analyze-Compose LoRA (PAC-LoRA). While standard Low-Rank Adaptation (LoRA) uses a single set of weights for fine-tuning, PAC-LoRA employs a Mixture-of-Experts (MoE) approach. It utilizes "Analyzing Experts" to deconstruct news content and "Writing Experts" to mimic specific user reasoning and linguistic styles. A gating mechanism dynamically selects the most relevant experts based on the news topic and the specific user persona, allowing the model to simulate the human process of first deconstructing information and then formulating a response.

3. Macro-Level Alignment

To move from the individual to the crowd, SocialAlign aggregates predicted individual responses to forecast the overall "mood" of a population. The model uses Jensen-Shannon (JS) divergence to ensure that the predicted distribution of sentiments (e.g., the ratio of anger to support) aligns with real-world social media trends.

The SentiWeibo Dataset

To train and validate the framework, the researchers curated SentiWeibo, a large-scale dataset from the Chinese platform Weibo. The dataset includes:

  • 476,605 user posts across 7,837 hashtagged events.
  • 53 distinct topics, ranging from finance to entertainment.
  • Authentic historical interactions and official sentiment distributions provided by the platform.

To ensure the model's generalizability, the authors also evaluated SocialAlign on the LaMP (Language Model Personalization) benchmark, demonstrating its effectiveness beyond the Weibo ecosystem.

Key Insights and Results

SocialAlign consistently outperformed strong baselines across both micro and macro metrics:

  • Micro-level Accuracy: On the SentiWeibo dataset, the model achieved a Sentiment Accuracy of 48.2% on financial topics, significantly outperforming vanilla LoRA (44.4%) and standard Llama-based models (24.0%).
  • Macro-level Alignment: The model showed superior alignment with real-world trends. In the "Financial Scams" category, its JS Divergence was 17.5, compared to 22.8 for standard LoRA (where lower scores indicate better alignment).
  • Linguistic Authenticity: Human evaluations revealed that SocialAlign's responses were rated significantly higher for "Language Style" and "Persona Dynamics." Unlike vanilla LLMs, which are often perceived as "too polite" or overly formal, SocialAlign successfully captured the sarcasm, skepticism, and slang typical of real social media discourse.

An ablation study further revealed that while distilled personas are highly effective for guidance, the inclusion of raw historical behavioral data remains crucial, as it contains nuances that summarization cannot yet fully capture.

Limitations and Future Directions

While SocialAlign represents a significant advancement in social media prediction, several avenues for future research remain:

  • Cross-Platform Expansion: The current study focuses on Weibo and the Chinese language; future work should explore multilingual contexts like X (formerly Twitter) or Reddit.
  • Multimodality: As social media becomes increasingly visual, incorporating images and videos into persona modeling and response generation is essential.
  • Temporal Dynamics: Future iterations could model how user personas evolve over time rather than treating them as static snapshots, further improving long-term prediction accuracy.

Conclusion

SocialAlign demonstrates that by combining personalized cognitive modeling with macro-level distribution alignment, AI can more accurately reflect the complexities of public discourse. This dual-level approach provides a powerful tool for understanding how individual voices aggregate into the collective "mood" of the crowd.

Summary updated

Abstract

Public response prediction is critical for understanding how individuals or groups might react to specific events, policies, or social phenomena, making it highly valuable for crisis management, policy-making, and social media analysis. However, existing works face notable limitations. First, they lack micro-level personalization, producing generic responses that ignore individual user preferences. Moreover, they overlook macro-level sentiment distribution and only deal with individual-level sentiment, constraining them from analyzing broader societal trends and group sentiment dynamics. To address these challenges, we propose SocialAlign, a unified framework that predicts real-world responses at both micro and macro levels in social contexts. At the micro level, SocialAlign employs SocialLLM with an articulate Personalized Analyze-Compose LoRA (PAC-LoRA) structure, which deploys specialized expert modules for content analysis and response generation across diverse topics and user profiles, enabling the generation of personalized comments with corresponding sentiments. At the macro level, it models group sentiment distributions and aligns predictions with real-world sentiment trends derived from social media data. To evaluate SocialAlign in real-world scenarios, we introduce SentiWeibo, a large-scale dataset curated from authentic social interactions on the Weibo platform. Experimental results on our SentiWeibo and related LaMP benchmark demonstrate that SocialAlign surpasses strong baselines, showing improved accuracy, interpretability, and generalization in public response prediction. We hope our work inspires further research in public response prediction and computational social science: https://github.com/Znull-1220/SocialAlign.
BibTeX
@misc{zhang2025from,
  author = {Jinghui Zhang and Kaiyang Wan and Longwei Xu and Ao Li and Zongfang Liu and Xiuying Chen},
  title = {{From Individuals to Crowds: Dual-Level Public Response Prediction in Social Media}},
  year = {2025},
  eprint = {2508.00497},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.00497},
}
Figure