Measuring Ecosystem Complexity - Decision-Making Based on Complementarity Graphs

Xiang Liu, Aniruddha Sengupta, Dachuan XuProceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences 2023 · DOI

TL;DR

This paper introduces a novel framework for mapping the hidden "connective tissue" of digital platform ecosystems. By shifting the focus from actors to functional modules and using web-scraped "proxies" to bypass proprietary data walls, the authors provide a way to visualize and measure how different services (like Alexa skills) actually complement each other to create value.

What Problem Does This Paper Address?

Modern digital platforms—think Amazon Alexa, Google Assistant, or Apple’s App Store—have evolved into "composite architectures." They aren't just single-service apps anymore; they are massive ecosystems where thousands of independent modules (skills, apps, devices) interact.

Traditional "ecosystem intelligence" models these as simple networks where nodes are people/companies and edges are "network effects" (more users = more value). However, the authors argue this is too simplistic. It fails to capture how specific functions interact. Furthermore, platform owners (like Amazon) keep the most valuable data—usage patterns, cross-service interactions, and detailed analytics—behind a "competitive wall," leaving third-party developers and researchers in the dark.

Methods

The authors propose a two-pronged approach to crack the code of ecosystem complexity:

  1. Complementarity Graphs: Instead of mapping actors, they map functional modules. They define edges based on the "Complementarities Framework" (Jacobides et al., 2018), categorizing relationships into four types:
  2. Unique vs. Supermodular: Does a module gain value just by being in the ecosystem (Unique), or does its presence specifically boost the value of another module (Supermodular)?
  3. Production vs. Consumption: Does the synergy happen during the creation phase or when the end-user actually uses the services together?
  4. Proxy-based Data Collection Pipeline: Since internal usage data is secret, the authors developed a pipeline to scrape public data and use it as "proxies" for hidden variables:
  5. Module Ratings/Reviews serve as a proxy for value creation.
  6. Co-activations (the "Customers also used..." lists) serve as a proxy for joint consumption.
  7. Publisher Info serves as a proxy for production synergies.

Finally, they aggregate these graphs into Category-oriented Complementarity Maps—essentially heatmaps that show which categories (e.g., "Smart Home" vs. "Music") have the strongest synergies.

Datasets

The researchers evaluated their approach using the Amazon Alexa Skill ecosystem.

  • Source: Scraped from the Amazon Alexa website in April and May 2021.
  • Scope: Over 100,000 types of devices and thousands of skills.
  • Structure: They linked two primary CSV files (skill descriptions and user reviews) using the ASIN (Amazon Standard Identification Number) as a primary key.

Key Insights and Ideas

  • Asymmetry is Key: Complementarities aren't always mutual. Module A might significantly boost the value of Module B, but not vice versa. The directed edges in their graphs capture this nuance.
  • The Power of Proxies: You don't need "God-view" access to a platform's database to understand its health. Publicly available social signals (reviews, co-occurrence lists) are surprisingly effective at revealing the underlying economic structure of the ecosystem.
  • Heterogeneity Matters: The Alexa ecosystem is highly uneven. Some categories are "hotspots" of synergy, while others are "trouble spots" that struggle to integrate with the wider platform.
  • Predictive Potential: These maps can help developers predict the success of a yet-to-be-designed module by looking at how its intended category currently interacts with others.

Key Results

The authors successfully generated heatmaps for the Alexa ecosystem (Figures 5 and 6 in the paper).

  • Unique Complementarities: They found that unique complementarities (value gained from the platform's core) are distributed unevenly across the 22 Alexa functional categories.
  • Supermodular Synergies: The maps identified specific "power couples" in categories. For instance, they could quantitatively show how "Smart Home" skills act as a force multiplier for other categories compared to more isolated categories like "Trivia & Games."
  • Decision Support: The resulting "Complementarity Maps" provide a visual dashboard for platform providers to identify which module categories they should incentivize to drive the most ecosystem growth.

Limitations and Future Work

  • Rating Bias: The authors acknowledge that user ratings and reviews (their primary proxies) are subject to inherent biases and may not always reflect objective quality.
  • Sample Size: While they scraped a massive amount of data, some niche categories had fewer co-activations, leading to missing values in the maps.
  • Automation: The current process involves manual analysis in Jupyter notebooks. Future work aims to create a real-time, automated dashboard that can track ecosystem shifts over time.
  • Generalizability: While tested on Alexa, the authors believe this framework needs to be applied to other "hybrid" platforms (like industrial IoT or healthcare ecosystems) to prove its universal utility.

Summary updated

Abstract

Platforms feature increasingly complex architectures with regard to interconnecting with other digital platforms as well as with a variety of devices and services. This development also impacts the structure of digital platform ecosystems and forces providers of these services, devices, and services to incorporate this complexity in their decision-making. To contribute to the existing body of knowledge on measuring ecosystem complexity, the present research proposes two key artefacts based on ecosystem intelligence: On the one hand, complementarity graphs represent ecosystems with an ecosystem's functional modules as vertices and complementarities as edges. The nodes carry information about the category membership of the module. On the other hand, a process is suggested that can collect important information for ecosystem intelligence using proxies and web scraping. Our approach allows replacing data, which today is largely unavailable due to competitive reasons. We demonstrated the use of the artefacts in category-oriented complementarity maps that aggregate the information from complementarity graphs and support decision-making. They show which combination of module categories creates strong and weak complementarities. The paper evaluates complementarity maps and the data collection process by creating category-oriented complementarity graphs on the Alexa skill ecosystem and concludes with a call to pursue more research based on functional ecosystem intelligence.
BibTeX
@inproceedings{liu2023measuring,
  author = {Xiang Liu and Aniruddha Sengupta and Dachuan Xu},
  title = {{Measuring Ecosystem Complexity - Decision-Making Based on Complementarity Graphs}},
  booktitle = {Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences},
  year = {2023},
  doi = {10.24251/hicss.2023.426},
}

Loading related content...

Figure