Comprehensive evaluation method of live streaming business model in online marketing environment

Miaomiao Zhang, Pianpian Zhao, Pei WangInt. J. Web Based Communities 2024 · DOI

Introduction: The Shift to Live E-commerce

Live streaming has fundamentally transformed the e-commerce landscape, evolving from static product listings to dynamic, real-time interactions led by influential "anchors." This shift has introduced a new paradigm of "passionate consumption," where limited-time offers and real-time engagement drive sales. However, evaluating the success of these business models remains complex. Traditional e-commerce metrics often fail to capture the nuances of live shopping, such as audience stickiness and real-time conversion triggers. This paper addresses this gap by proposing a standardized, comprehensive evaluation system that assesses the holistic health of live streaming operations beyond simple sales figures.

Methodology: A Hybrid Quantitative Approach

To create a robust evaluation tool, the researchers developed a hybrid model that balances expert intuition with objective data analysis. The framework utilizes two primary mathematical techniques:

  • Analytic Hierarchy Process (AHP): This method structures the evaluation into a hierarchical system consisting of a Target layer (overall business model effect), a Criterion layer (four major categories), and an Indicator layer (20 specific metrics).
  • Entropy Weight Method: To minimize subjective bias, the entropy method calculates the weights of the 20 indicators. This approach assigns higher importance to metrics that exhibit greater variation across datasets, ensuring the model reflects the most informative data points.

Finally, a comprehensive scoring model aggregates these weighted metrics into a performance score, ranging from "poor" to "excellent."

The Evaluation Framework

The study identifies four critical pillars for evaluating live streaming success: Economic Effectiveness, Marketing Effectiveness, Market Competition, and Consumer Impact. Within these pillars, 20 distinct indicators provide a granular view of performance.

Table 1: Detailed breakdown of the evaluation indicators.

Quantitative analysis revealed that marketing costs, ROI, product volume, and conversion rates are the most significant drivers of success. Interestingly, the entropy method showed that economic and marketing effectiveness (weights of 1.26 and 1.03, respectively) currently carry more weight than consumer impact (0.82), reflecting the industry's immediate focus on bottom-line results.

Empirical Results and Platform Analysis

The model was validated using 50.0 GB of operational data from 10 leading live broadcast platforms during a major e-commerce shopping festival in October 2022.

  • Platform Rankings: Platforms T1 and D1 achieved "Excellent" ratings with scores of 8.34 and 8.22. The remaining platforms were rated as "Good," with scores between 7.48 and 7.96.
  • Festival Synergy: Performance scores peaked on October 25th, highlighting how high-pressure shopping festivals amplify the effectiveness of real-time interaction and "snapping up" mechanics.
  • User Validation: A survey of 200 users corroborated the model's findings, with high satisfaction reported in broadcast atmosphere and commodity pricing.

The model demonstrated high accuracy, with an error rate of less than 20% compared to actual results, making it suitable for practical industrial application.

Conclusion and Future Directions

This research provides a data-driven roadmap for brands to optimize their real-time sales strategies in a crowded digital marketplace. While the current framework focuses on the Chinese market during peak traffic periods, future work could expand the timeframe to account for seasonal fluctuations and incorporate advanced Natural Language Processing (NLP) to analyze real-time chat logs for deeper consumer sentiment insights. Testing the model's validity in international markets will also be crucial as live streaming e-commerce continues to grow globally.

Summary updated

BibTeX
@article{zhang2024comprehensive,
  author = {Miaomiao Zhang and Pianpian Zhao and Pei Wang},
  title = {{Comprehensive evaluation method of live streaming business model in online marketing environment}},
  journal = {Int. J. Web Based Communities},
  year = {2024},
  doi = {10.1504/ijwbc.2024.142482},
}
Figure