Review System Design and Sales: How Interface Visibility Moderates the Effect of Platform-Generated Default Reviews

Yi-Jen Lu, Peng Zou, Di Huo, Yu Chen, Wen J. LiJournal of Theoretical and Applied Electronic Commerce Research 2026 · DOI

TL;DR

This study reveals that platform-generated "default reviews" (automated, low-content ratings) negatively impact product sales when they are prominently displayed. However, when platforms redesign their interfaces to de-emphasize these default reviews, their negative effect on sales is significantly weakened, and overall sales can even increase.

What Problem Does This Paper Address?

In the world of e-commerce, online reviews are crucial for consumers making purchasing decisions. While much research focuses on the impact of genuine, user-generated reviews (their valence and volume), less attention has been paid to "default reviews." These are automatically generated by platforms when users don't leave feedback, often consisting of just a star rating and generic text. The problem is that these default reviews, while not intentionally deceptive like fake reviews, can still inflate the perceived reputation of a product without providing meaningful diagnostic information. This can lead to consumer skepticism and potentially distort market outcomes. The authors investigate how the prevalence of these default reviews affects sales and, crucially, whether the visibility of these reviews in the user interface plays a moderating role.

Methods

The researchers employed a quasi-experimental design using data from Taobao, a major Chinese e-commerce platform. They collected product snapshots from two distinct periods: one before a significant interface redesign that de-emphasized default reviews, and one after the redesign was largely implemented. This "pre-post" window design allowed them to compare products under different interface regimes.

They used regression analysis, specifically an interaction model, to test their hypotheses. This model allowed them to:

  1. Assess the relationship between the "default review ratio" (the proportion of default reviews to total reviews) and product sales in the pre-redesign period.
  2. Determine if this relationship weakened in the post-redesign period, indicating moderation by interface visibility.
  3. Examine if overall sales levels were higher in the post-redesign period, controlling for other factors.

To ensure the robustness of their findings, they conducted several checks, including using bootstrap standard errors, adding more control variables, allowing for category-specific shifts, and testing alternative operationalizations of default reviews.

Datasets

The study utilized a dataset of 1994 product snapshots from Taobao.com.

  • Pre-redesign window: January–April 2025 (983 observations)
  • Post-redesign window: December 2025–January 2026 (1011 observations)

The data included platform-displayed sales, current price, total review count, and default review counts/ratios, all scraped using Python.

Key Insights and Ideas

  • Default reviews aren't neutral: Contrary to a potential assumption of neutrality, the study shows that the presence and visibility of default reviews can significantly impact market outcomes.
  • Visibility is key: The interface design, specifically how prominently default reviews are displayed, is a critical factor in determining their influence on sales. Hiding or de-emphasizing them can mitigate their negative effects.
  • Interface governance matters: Platforms have a powerful lever in "interface governance" – how they design the user experience – to shape the impact of review signals and potentially improve the informational environment for consumers.
  • Beyond content: This research highlights that the structure and presentation of information, not just its content, can drive consumer behavior and market performance.

Key Results

  • H1 (Default review ratio negatively associated with sales): In the pre-redesign period, a higher default review ratio was significantly associated with lower log sales (β₁ = -2.582, p < 0.01).
  • H2 (Weaker association post-redesign): The negative association between default review ratio and sales was significantly weaker after the redesign. The interaction term (post × default_ratio) was positive and significant (β₃ = 1.046, p < 0.01), implying an attenuated negative relationship. The implied slope in the post-redesign period was -1.536.
  • H3 (Higher sales post-redesign): Conditional sales levels were significantly higher in the post-redesign period (β₂ = 1.447, p < 0.01), suggesting a positive shift in baseline sales after the interface change.

Limitations and Future Work

  • Gradual Rollout: The interface redesign was gradual, not a single sharp cutoff. This means the study uses a pre-post window design, which can't fully isolate the redesign from other simultaneous platform changes. Future work could use higher-frequency panel data or quasi-experimental variations in rollout timing.
  • Product-Snapshot Data: The data consists of snapshots, not a longitudinal panel of identical products over time. This limits the ability to control for unobserved time-invariant product heterogeneity. Future research could collect longitudinal data for stronger fixed-effects designs.
  • Scale Dependence: The moderation effect might vary with outcome scaling and functional-form assumptions. Future work could explore scale-dependent effects across different product categories, price tiers, or demand distributions.
  • Market Specificity: The study focuses on Chinese e-commerce. Comparative studies across platforms with different default feedback rules or disclosure standards would improve external validity.

Summary updated

Abstract

Platform-generated default reviews are widespread in e-commerce, yet they are underexamined as a review system design feature. Using 1994 Taobao product snapshots from two windows (January–April 2025, n = 983; December 2025–January 2026, n = 1011) surrounding a gradual interface redesign that folded default reviews from the default view, this study examines how the default review ratio relates to sales and whether reduced visibility moderates the association. Regression results show that higher default review ratios are associated with lower log sales prior to the redesign, while the negative association attenuates once default reviews are de-emphasised; conditional sales levels are also higher post-redesign. Because the rollout was gradual and the data are repeated cross-sectional snapshots, estimates are interpreted as differences in conditional associations across regimes. These patterns are robust to alternative specifications, additional controls, category-specific post shifts, and winsorization. Overall, the market impact of platform-generated review signals depends on interface visibility, highlighting an actionable governance lever for review system design.
BibTeX
@article{lu2026review,
  author = {Yi-Jen Lu and Peng Zou and Di Huo and Yu Chen and Wen J. Li},
  title = {{Review System Design and Sales: How Interface Visibility Moderates the Effect of Platform-Generated Default Reviews}},
  journal = {Journal of Theoretical and Applied Electronic Commerce Research},
  year = {2026},
  doi = {10.3390/jtaer21030089},
}
Figure