Analyzing Social Book Reading Behavior on Goodreads and how it predicts Amazon Best Sellers

Suman Kalyan Maity, Abhishek Panigrahi, Animesh MukherjeearXiv 2018 · arXiv

Introduction

Predicting a book's commercial success is a notoriously difficult task. Traditionally, publishers and researchers have relied on intrinsic factors, such as prose quality and genre, or basic extrinsic metrics like the final number of reviews or average star ratings. However, these "lagging indicators" often fail to capture the real-time "buzz" or the specific collective behaviors that propel a book to the top of the charts.

This study addresses a critical gap in cross-platform analysis: how social behavior on a dedicated reading platform (Goodreads) translates to retail success on Amazon. By focusing on "leading indicators"—data available within the first 15 to 30 days of a book's publication—researchers developed a model that predicts whether a book will become an Amazon Best Seller (ABS) with nearly 89% accuracy.

Methodology

The researchers utilized a cross-platform approach, linking Goodreads entities (books, authors, shelves, and user status updates) with Amazon Best Seller lists from 1995 to 2016. The study employed a massive, custom-crawled dataset including information on over 550,000 books and 330,000 authors.

To ensure the model was not simply identifying "popular" books, the researchers compared ABS books against two "close competitor" groups:

  1. HRHR (Highly Rated, High Reviews): Books with an average rating > 4 and > 900 reviews that never became best sellers.
  2. GCAN (Goodreads Choice Awards Nominees): Critically acclaimed books nominated for awards that did not reach ABS status.

Key technical components included Feature Engineering (e.g., Rating Entropy and Shelf Diversity), Novelty Metrics (using RAKE and KL divergence to quantify content uniqueness), and a novel Status Update Analysis that tracked "micro-reading" behavior—how frequently users post progress updates while reading.

Key Insights and Results

The paper's most significant finding is that the "reading process" trumps the "review." Engagement during the act of reading—captured via status updates—is a far better predictor of a hit than the opinion formed after finishing it.

Distributions of rating metrics for Amazon Best Sellers (ABS) vs. Others.

As illustrated in Figure 1, best sellers tend to receive more diverse ratings (higher entropy) and a significantly higher volume of reviews. This suggests that commercial success is signaled not just by high ratings, but by a broad spectrum of opinions from a wide audience. Furthermore, best sellers exhibited higher "Shelf Diversity," appearing in a wider array of user-defined categories, indicating a more "viral" and broad appeal compared to niche critical favorites.

Comparison of book categories between Amazon Best Sellers and other popular books.

Genre also played a major role in distinguishing commercial success. As shown in Figure 2, approximately 57.7% of Amazon Best Sellers were Non-fiction, whereas the general popular pool on Goodreads leans more heavily toward Fiction.

Overall, the model achieved an average accuracy of 88.72% in predicting best-seller status within one month of publication, outperforming traditional metrics by 16.4%. Even with only 15 days of data, the model maintained a high accuracy of ~86.67%.

Conclusion

This research highlights the power of social reading data in forecasting commercial outcomes. By shifting focus from post-hoc reviews to real-time reading dynamics, the study provides a robust framework for early prediction. Future work aims to explore the temporal interactions between different social entities on these platforms to further refine business policies for both social networks and retailers.

Summary updated

Abstract

A book's success/popularity depends on various parameters - extrinsic and intrinsic. In this paper, we study how the book reading characteristics might influence the popularity of a book. Towards this objective, we perform a cross-platform study of Goodreads entities and attempt to establish the connection between various Goodreads entities and the popular books ("Amazon best sellers"). We analyze the collective reading behavior on Goodreads platform and quantify various characteristic features of the Goodreads entities to identify differences between these Amazon best sellers (ABS) and the other non-best selling books. We then develop a prediction model using the characteristic features to predict if a book shall become a best seller after one month (15 days) since its publication. On a balanced set, we are able to achieve a very high average accuracy of 88.72% (85.66%) for the prediction where the other competitive class contains books which are randomly selected from the Goodreads dataset. Our method primarily based on features derived from user posts and genre related characteristic properties achieves an improvement of 16.4% over the traditional popularity factors (ratings, reviews) based baseline methods. We also evaluate our model with two more competitive set of books a) that are both highly rated and have received a large number of reviews (but are not best sellers) (HRHR) and b) Goodreads Choice Awards Nominated books which are non-best sellers (GCAN). We are able to achieve quite good results with very high average accuracy of 87.1% and as well a high ROC for ABS vs GCAN. For ABS vs HRHR, our model yields a high average accuracy of 86.22%.
BibTeX
@misc{maity2018analyzing,
  author = {Suman Kalyan Maity and Abhishek Panigrahi and Animesh Mukherjee},
  title = {{Analyzing Social Book Reading Behavior on Goodreads and how it predicts Amazon Best Sellers}},
  year = {2018},
  eprint = {1809.07354},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1809.07354},
}
Figure