Prioritizing App User Reviews Based on Multidimensional Factors: An Integrated BERTopic–SnowNLP Framework for Supporting Developer Decisions

Jianli Zhao, Zheng Zhang, Juan Feng, Ao LiIEEE Transactions on Computational Social Systems 2025 · DOI

Abstract

With the rapid development of the internet, the model of app updating and maintenance is shifting from enterprise-driven approaches to collaborative mechanisms powered by real-time user feedback. However, developers face challenges in handling massive, heterogeneous user reviews with dynamic demands. This article aims to address the challenge that existing research lacks a multidimensional evaluation system for prioritizing user reviews—which leads to developers’ difficulty in allocating resources appropriately and responding to critical user needs promptly—and further seeks to provide a quantifiable decision-support tool for targeted app version optimization. This article proposes user review-based prioritization method (URPM), a novel approach that employs multidimensional evaluation to prioritize user reviews for app version optimization. The URPM framework operates in three stages: 1) quantifying user attention by clustering reviews and calculating topic proportions using the BERTopic model; 2) computing review sentiment scores using the SnowNLP tool; and 3) ranking reviews via a priority scoring function that integrates user attention, sentiment, timeliness, and ratings. Experimental results on eight music apps show that URPM achieves strong alignment between its generated high-priority reviews and actual developer update logs, with an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> score of 0.625–0.702, NDCG@10 of 0.76–0.86, and NDCG@20 of 0.72–0.86. Comparative experiments on the QQ Music, NetEase Cloud Music, and KuGou Music datasets further demonstrate that URPM outperforms the second-best baseline across all three datasets, improving the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> score by 43.0%, 45.3%, and 38.2%, respectively. In addition, cross-domain validation confirms the robustness of URPM, yielding <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{\text{hybrid}}$</tex-math> </inline-formula> scores of 0.655–0.717, NDCG@10 of up to 0.86, and NDCG@20 of up to 0.84.
BibTeX
@article{zhao2025prioritizing,
  author = {Jianli Zhao and Zheng Zhang and Juan Feng and Ao Li},
  title = {{Prioritizing App User Reviews Based on Multidimensional Factors: An Integrated BERTopic–SnowNLP Framework for Supporting Developer Decisions}},
  journal = {IEEE Transactions on Computational Social Systems},
  year = {2025},
  doi = {10.1109/tcss.2025.3627971},
}

Loading related content...

Figure