ExBigBang: A Dynamic Approach for Explainable Persona Classification through Contextualized Hybrid Transformer Analysis

Saleh Afzoon, Amin Beheshti, Nabi Rezvani, Farshad Khunjush, Usman Naseem, John McMahon, Zahra Fathollahi, Mahdieh Labani, Wathiq Mansoor, Xuyun ZhangarXiv 2025 · DOI · OpenReview

Introduction

In user-centric design, a "persona" represents a profile of a specific user segment sharing similar behaviors and needs. While vital for personalization, traditional persona creation is a manual and unscalable process. Modern machine learning attempts to automate this, yet faces two significant hurdles: the contextual gap between textual data and behavioral metadata, and the "black box" problem of deep learning models. Designers and clinicians require not just a classification, but an explanation of why a user belongs to a specific persona.

To address these challenges, we present ExBigBang (Explainable BigBang), a hybrid transformer-based framework that fuses textual analysis with contextual metadata while leveraging Explainable AI (XAI) for transparent decision-making.

The ExBigBang Framework

The ExBigBang architecture is built upon a hybrid transformer model designed to process disparate data types simultaneously.

The ExBigBang hybrid transformer architecture, featuring a BERT textual encoder and a contextual feature embedding stream fused via an attention-based combiner.

As shown in the architecture diagram, the model employs a pre-trained BERT encoder for textual data and a dense network for tabular contextual features. These streams are integrated using a custom attention-based multimodal combiner, allowing the model to dynamically weight the importance of text versus metadata for each specific classification.

Contextual Feature Engineering

The framework incorporates three primary types of contextual features:

  1. Temporal Features: Capturing behavioral patterns over time (e.g., late-night activity ratios).
  2. Profiling Features: Aggregated metrics such as average sentiment over a user's history.
  3. Knowledge-based Features: Domain-specific lexicons, particularly useful for specialized fields like mental health.

Dynamic Feature Evolution and Cyclical Profiling

A core innovation of ExBigBang is its dynamic, cyclical approach to feature enrichment, termed the "BigBang" process.

The BigBang process: a cyclical refinement loop where raw features are engineered and transformed into persona-based features over time.

Unlike static models, ExBigBang utilizes a loop where initial user data informs a profile, which then guides classification. These resulting persona insights are fed back into the profile, reflecting evolving user behaviors across timestamps ($T_1$ to $T_m$). This process increases the dimensionality and richness of the features, moving from raw data to sophisticated persona-based representations.

Experimental Evaluation

The model was evaluated using the Twitter Sentiment140 dataset, filtered to include users with at least 10 tweets to ensure sufficient context. The final dataset comprised approximately 470,000 tweets from 27,000 users, with the task of inferring depressive states as a proxy for complex persona classification.

Key Results

ExBigBang significantly outperformed traditional machine learning and standard deep learning baselines, achieving an F1-score of 0.84.

Model Accuracy Precision Recall F1-Score
ExBigBang (Hybrid Transformer) 0.91 0.80 0.87 0.84
BiLSTM-Att + Learned Emb 0.80 0.80 0.79 0.79
XGBoost (Text-Tabular) 0.76 0.76 0.79 0.78
SVM (Text-Tabular) 0.73 0.72 0.80 0.75

The integration of SHAP (SHapley Additive exPlanations) allowed for the identification of key influential features, such as avg_top_sent (average sentiment of core vocabulary) and night_ratio (longitudinal temporal behavior), proving that aggregated context is often more reliable than individual data points.

Conclusion

ExBigBang demonstrates that a hybrid, attention-based approach to fusing text and metadata provides superior accuracy and transparency in persona classification. While computationally intensive, the framework's ability to provide explainable insights makes it a powerful tool for designers and researchers. Future work will explore multimodal data integration and the use of Knowledge Graphs to further deepen contextual understanding.

Summary updated

Abstract

In user-centric design, persona development plays a vital role in understanding user behaviour, capturing needs, segmenting audiences, and guiding design decisions. However, the growing complexity of user interactions calls for a more contextualized approach to ensure designs align with real user needs. While earlier studies have advanced persona classification by modelling user behaviour, capturing contextual information, especially by integrating textual and tabular data, remains a key challenge. These models also often lack explainability, leaving their predictions difficult to interpret or justify. To address these limitations, we present ExBigBang (Explainable BigBang), a hybrid text-tabular approach that uses transformer-based architectures to model rich contextual features for persona classification. ExBigBang incorporates metadata, domain knowledge, and user profiling to embed deeper context into predictions. Through a cyclical process of user profiling and classification, our approach dynamically updates to reflect evolving user behaviours. Experiments on a benchmark persona classification dataset demonstrate the robustness of our model. An ablation study confirms the benefits of combining text and tabular data, while Explainable AI techniques shed light on the rationale behind the model's predictions.
BibTeX
@misc{afzoon2025exbigbang,
  author = {Saleh Afzoon and Amin Beheshti and Nabi Rezvani and Farshad Khunjush and Usman Naseem and John McMahon and Zahra Fathollahi and Mahdieh Labani and Wathiq Mansoor and Xuyun Zhang},
  title = {{ExBigBang: A Dynamic Approach for Explainable Persona Classification through Contextualized Hybrid Transformer Analysis}},
  year = {2025},
  eprint = {2508.15364},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.15364},
}
Figure