Prioritizing App User Reviews Based on Multidimensional Factors: An Integrated BERTopic–SnowNLP Framework for Supporting Developer Decisions
Lists
Only you see this
Abstract
With the rapid development of the internet, the model of app updating and maintenance is shifting from enterprise-driven approaches to collaborative mechanisms powered by real-time user feedback. However, developers face challenges in handling massive, heterogeneous user reviews with dynamic demands. This article aims to address the challenge that existing research lacks a multidimensional evaluation system for prioritizing user reviews—which leads to developers’ difficulty in allocating resources appropriately and responding to critical user needs promptly—and further seeks to provide a quantifiable decision-support tool for targeted app version optimization. This article proposes user review-based prioritization method (URPM), a novel approach that employs multidimensional evaluation to prioritize user reviews for app version optimization. The URPM framework operates in three stages: 1) quantifying user attention by clustering reviews and calculating topic proportions using the BERTopic model; 2) computing review sentiment scores using the SnowNLP tool; and 3) ranking reviews via a priority scoring function that integrates user attention, sentiment, timeliness, and ratings. Experimental results on eight music apps show that URPM achieves strong alignment between its generated high-priority reviews and actual developer update logs, with an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> score of 0.625–0.702, NDCG@10 of 0.76–0.86, and NDCG@20 of 0.72–0.86. Comparative experiments on the QQ Music, NetEase Cloud Music, and KuGou Music datasets further demonstrate that URPM outperforms the second-best baseline across all three datasets, improving the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> score by 43.0%, 45.3%, and 38.2%, respectively. In addition, cross-domain validation confirms the robustness of URPM, yielding <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> scores of 0.655–0.717, NDCG@10 of up to 0.86, and NDCG@20 of up to 0.84.
BibTeX
@article{zhao2025prioritizing,
author = {Jianli Zhao and Zheng Zhang and Juan Feng and Ao Li},
title = {{Prioritizing App User Reviews Based on Multidimensional Factors: An Integrated BERTopic–SnowNLP Framework for Supporting Developer Decisions}},
journal = {IEEE Transactions on Computational Social Systems},
year = {2025},
doi = {10.1109/tcss.2025.3627971},
}Loading related content...