Prices and Price Dispersion on the Web: Evidence from the Online Book Industry

Karen Clay, Ramayya Krishnan, Eric WolffJournal of Industrial Economics 2001 · DOI

Introduction

In the late 1990s, the rapid ascent of e-commerce led many economists to predict the end of traditional retail friction. The hypothesis was straightforward: because the Internet lowered search costs through comparison-shopping engines, retailers would be forced into a "race to the bottom." This state of near-perfect information was expected to trigger intense Bertrand competition, eventually driving prices down to marginal costs and eliminating price dispersion—a phenomenon known as the "Law of One Price."

This paper investigates these predictions by analyzing 25 weeks of online book pricing data from August 1999 to January 2000. Contrary to the "frictionless commerce" theory, the study finds that significant price dispersion persisted and that branding allowed certain firms to maintain price premiums even in a highly transparent market.

Methodology and Data Collection

To capture the dynamics of the early online book market, the researchers employed automated agents, or "spiders," to crawl the websites of 32 United States-based online bookstores and two major comparison-shopping engines (DealTime and PriceScan) every week for six months.

The dataset comprised 399 books categorized into five distinct groups:

  • New York Times bestsellers.
  • Former NYT bestsellers.
  • Amazon computer bestsellers.
  • Former computer bestsellers.
  • A control group of random books in print.

The study utilized fixed-effects regressions to examine how price and price dispersion (measured by standard deviation) were influenced by book characteristics and market structure. To ensure comparability across different titles, the authors used "normalized prices"—the retail price divided by the publisher’s suggested list price.

Key Findings: The Persistence of Dispersion

The study’s most striking finding was that the predicted convergence of prices did not occur. Instead, several key patterns emerged regarding how firms competed online.

The Bestseller Paradox

While NYT bestsellers featured the lowest average prices (discounted approximately 31% off list), they exhibited the highest levels of price dispersion. This paradox is explained by the heterogeneous behavior of firms. While the "Big Three" (Amazon, Barnes & Noble, and Borders) and aggressive discounters engaged in fierce price wars over high-volume titles, many smaller "fringe" retailers often listed these same books at full list price. These smaller stores were likely not attempting to compete for price-sensitive bestseller shoppers, focusing instead on niche selection or serving as online extensions of physical storefronts.

Amazon as a Market Anchor

Amazon.com occupied a unique position as the industry's focal point. The data revealed that roughly 47% of competitors' prices were within $0.10 of Amazon’s price. Many smaller retailers strategically undercut Amazon by just a few cents to secure the top spot on comparison-shopping engines that sorted results by price. Despite this, Amazon was able to command a price premium of 3-5% over lesser-known retailers, suggesting that consumers valued brand trust, reliability, and site interface over absolute lowest cost.

Competitive Structure and Advertising

The research confirmed that market structure significantly influenced pricing. The addition of a "same-type" competitor (e.g., another major national brand) lowered prices by approximately 6.5%, whereas the entry of a "fringe" competitor resulted in a smaller 5.5% reduction. Furthermore, items that were more widely advertised or occupied "bestseller" status generally saw lower prices, holding the competitive structure constant.

Strategic Differentiation

The evidence suggests that rather than becoming commodities, online bookstores successfully differentiated themselves along several dimensions:

  1. Selection: Some firms carried over 90% of the sampled titles, positioning themselves as one-stop shops.
  2. Branding: Established players leveraged their reputation to maintain higher margins.
  3. Price: A subset of "fringe" stores focused exclusively on being the low-cost leader for specific segments.

The authors estimated that net margins for the major players on non-bestseller categories remained in the 7-18% range. This indicates that online bookselling was not the "profitless wasteland" many had predicted, provided firms could differentiate their offerings.

Conclusion

The study concludes that while the Internet increased price transparency, it did not eliminate the importance of traditional retail strengths like branding and product variety. Price dispersion remained a stable feature of the market, driven by firm heterogeneity and consumer willingness to pay for non-price attributes. While the data was limited by the lack of sales volume weighting and the specific context of the dot-com era, it provided an early and essential correction to the myth of frictionless commerce.

Summary updated

Abstract

Using data collected between August, 1999, and January, 2000, covering 399 books, we examine pricing by thirty‐two online United States‐based bookstores. At the aggregate level, we find that both advertising and competitive structure had the predicted effects. More competition led to lower prices and to lower price dispersion. Holding competitive structure constant, more widely advertised items also had lower prices. At the firm level, we observe considerable heterogeneity in behavior. Firms had differentiated (or attempted to differentiate) on dimensions such as brand, price, and selection.
BibTeX
@article{clay2001prices,
  author = {Karen Clay and Ramayya Krishnan and Eric Wolff},
  title = {{Prices and Price Dispersion on the Web: Evidence from the Online Book Industry}},
  journal = {Journal of Industrial Economics},
  year = {2001},
  doi = {10.1111/1467-6451.00161},
}
Figure