Introduction
Expert finding is a critical task for Community-Based Question Answering (CQA) platforms like Quora and Stack Overflow. Effectively routing new questions to qualified experts and identifying high-quality answers improves user engagement and platform utility. However, traditional expert finding methods face three primary challenges:
- Data Sparsity: Most questions receive few answers, making it difficult to build comprehensive user profiles based solely on answering history.
- Semantic Representation: "Bag-of-words" models often fail to capture the sequential intent and context of questions.
- Vote Bias: Absolute vote counts are frequently influenced by question popularity rather than answer quality.
To address these issues, this paper proposes Ranking Metric Network Learning (RMNL), a framework that integrates deep learning with social network analysis to match experts with relevant questions.
The RMNL Framework
The RMNL framework approaches expert finding as a graph-based embedding problem, combining semantic understanding with structural network information.
Heterogeneous CQA Network
The model constructs a graph incorporating multiple node types and relations. Beyond standard question-answer pairs, it includes relative quality ranks (capturing that User A’s answer was preferred over User B’s for a specific question) and social relations. By integrating external social signals, such as "following" relationships from Twitter, the model can bridge gaps in activity data.
Q-LSTM and Random-Walk Learning
To capture semantic nuances, the framework employs Q-LSTM (Question-Long Short-Term Memory). Unlike traditional models, LSTMs process questions sequentially, preserving the semantic meaning derived from word order.
To learn from the network structure, RMNL utilizes Random-Walk Learning. By performing random walks across the heterogeneous graph, the model leverages social homophily—the tendency for connected individuals to share expertise—to infer expertise even in the absence of direct answering history.
Ranking Metric Loss
The model is optimized using a triplet loss function. This "Ranking Metric Loss" aims to minimize the distance between a question's embedding and its high-quality experts while maximizing the distance to lower-quality users.
Experimental Setup
The researchers evaluated RMNL using a large-scale real-world dataset from Quora, comprising 444,138 questions, 95,915 users, and 887,771 answers. Social relationships were extracted by mapping Quora users to their corresponding Twitter accounts, providing a robust social layer for the network.
Experimental Results
RMNL was compared against several state-of-the-art baselines, including AuthorityRank and DeepWalk. The framework consistently outperformed these methods across multiple metrics:
- nDCG (Ranking Quality): RMNL achieved 0.741, surpassing the best baseline (GRMC-AGM at 0.734).
- Precision@1: RMNL reached 0.540, a significant improvement over the 0.512 achieved by competing methods.
- Accuracy: RMNL attained 0.641, compared to the 0.55–0.61 range of other models.
The results indicate that supervised information regarding relative answer quality is significantly more valuable for expert finding than unsupervised network structure alone. Furthermore, the length of sampled paths in the random walk process impacts performance, with optimal results typically found at moderate path lengths (e.g., length 5).
Conclusion and Future Work
RMNL demonstrates the power of combining sequential semantic modeling with heterogeneous network embeddings for expert finding. By leveraging social ties and relative ranking, it effectively mitigates data sparsity and vote bias.
Future research may address the model's dependency on cross-platform social data and the computational overhead of training LSTMs on massive graphs. Additionally, incorporating temporal dynamics to model evolving user expertise presents a promising direction for further development.
Summary updated