TL;DR
This paper introduces a first-of-its-kind dataset and metadata schema for nearly 60 Open Access (OA) dashboards used to monitor scholarly communication. By systematically mapping these tools, the authors provide a vital resource for researchers and policymakers to understand how Open Science progress is tracked, while also launching a participatory process to keep this "map" updated.
What Problem Does This Paper Address?
As Open Access mandates from funders (like the NIH or the European Commission) become the norm, research institutions and countries need ways to track their progress. This has led to a "Cambrian explosion" of digital dashboards—tools that visualize the proportion of OA publications relative to total output.
However, this landscape is highly fragmented. Until now, there was no central directory or standardized way to describe these dashboards. We didn't know which data sources they relied on, what types of research outputs they tracked (just papers, or software too?), or whether the dashboards themselves were built on open-source principles. This lack of transparency makes it difficult for institutions to choose the right tools or for researchers to study the "meta-science" of OA monitoring.
Methods
The authors employed a systematic, four-stage approach:
- Data Search: A comprehensive web search (using engines like DuckDuckGo and Google) conducted between late 2024 and mid-2025 to identify active and accessible dashboards.
- Schema Development: They designed a custom metadata schema featuring 13 distinct properties (e.g., operator type, geographic scope, data sources, and licenses). This schema was built with reference to established standards like the
re3dataregistry. - Curation & Indexing: Each identified dashboard was manually annotated. To ensure data quality, they used a two-step review process where a second individual independently verified entries, with a third person acting as an adjudicator for discrepancies.
- Technical Validation: The final dataset was proofread by an external reviewer to ensure consistency and accuracy.
Datasets
The primary output is the "Mapping the Landscape of Open Access Dashboards" dataset (Schneider et al., 2025).
- Scope: 58 unique dashboards.
- Availability: Hosted as a persistent version on Zenodo (DOI: 10.5281/zenodo.15593821) and as an interactive/editable version on the project's website and Nextcloud instance to encourage community contributions.
- Comparison: Unlike existing collections like the CHORUS or OpenAIRE monitor (which are subsets), this dataset aggregates dashboards across institutional, national, and international levels into a single interoperable format.
Key Insights and Ideas
- The European Dominance: A striking finding is that OA monitoring is currently a predominantly European phenomenon. Out of the 58 dashboards, only 14 exclusively cover non-European countries—and all of those belong to a single collection (CHORUS).
- Beyond the PDF: While every dashboard in the set tracks textual publications, more than half (34 out of 58) have expanded to track "non-traditional" scientific outputs, such as research data and software.
- The "Operator" Mix: Dashboards aren't just library tools. They are operated by a diverse mix of Research Performing Organizations (RPOs), Research Funding Organizations (RFOs), and international consortia.
- Transparency Gaps: The authors highlight the importance of tracking both the software license of the dashboard and the data license of the underlying information. This distinction is crucial for institutions that want to ensure they aren't "locked in" to proprietary monitoring infrastructures.
Key Results
- Quantities: The study identified 11 institutional, 29 national, and 18 international dashboards.
- Standardization: The paper successfully established a 13-property metadata schema that allows for the first side-by-side comparison of OA monitoring tools.
- Infrastructure: The project launched a participatory "living dataset" model, moving away from static papers toward a community-maintained resource.
Limitations and Future Work
The authors acknowledge several limitations:
- Temporal Snapshot: The dataset reflects the landscape as of May 2025. Because the web is ephemeral, some links may break, and new tools will emerge.
- Accessibility Barriers: Several dashboards (particularly within the OpenAIRE collection) were excluded because they were not publicly accessible or were empty at the time of the survey.
- Granularity of Indicators: Future iterations of the schema could be expanded to include more specific "flavors" of Open Access (e.g., distinguishing between Gold, Green, and Hybrid OA) or more detailed technical information about API availability.
- Global Reach: There is a clear need to identify and include more dashboards from the Global South to move beyond the current Euro-centric view of the landscape.
Summary updated