This paper explores using Wikibase—the software behind Wikidata—as a "linked data" layer to connect disparate biological and archival databases. By creating a unified network for the Sherwin Carlquist collection, researchers successfully linked thousands of plant specimens to their original field notes and photographs, overcoming the technical silos that usually keep these valuable records apart.
What Problem Does This Paper Address?
In the world of natural history, a physical specimen (like a pressed plant) is only part of the story. To truly understand a species, researchers need the "Extended Specimen Network" (ESN): the field notes, photographs, and publications associated with that specific plant.
The challenge is that this data is rarely in one place. For the legacy of botanist Sherwin Carlquist, physical specimens are housed at the California Botanic Garden, while his archival field notes and photos are at the Botanical Research Institute of Texas. These institutions use different digital platforms (Symbiota for specimens and the Portal to Texas History for archives) that don't "talk" to each other well. Existing metadata standards like Dublin Core are often too generic—using broad terms like "references" instead of specific links—making it nearly impossible to perform complex searches across institutions.
Methods
The authors didn't try to replace existing databases. Instead, they built a Wikibase instance to act as a complementary semantic layer. Wikibase allows for "Linked Data," where every entity (a person, a plant, a notebook) has a unique identifier and defined relationships to other entities.
The technical workflow involved:
Data Aggregation: Using Python modules like Sickle to pull archival records via OAI-PMH and scripts to tap into the Biodiversity Heritage Library (BHL) API.
Data Cleaning: Utilizing OpenRefine to standardize and clean the messy, multi-source data.
Knowledge Graph Construction: Using the WikibaseIntegrator Python library to programmatically create properties and items in Wikibase, and the QuickStatements tool for bulk uploads.
Querying: Implementing SPARQL (a semantic query language) to allow for complex, cross-platform data retrieval.
Datasets
The project integrated data from several primary sources:
Consortium of California Herbaria (CCH2): Provided data for approximately 9,000 botanical specimens.
Portal to Texas History (PTH): Provided metadata for 26 field notebooks and roughly 100,000 field photographs.
Biodiversity Heritage Library (BHL): Used to retrieve and link publication data.
Wikidata/Wikipedia: Used to pull biographical data for Sherwin Carlquist himself.
Key Insights and Ideas
Semantic Richness Matters: Traditional databases often use "flat" metadata. Wikibase allows for "rich" relationships—instead of just saying two items are related, you can specify that "Specimen A was described in Field Notebook B on Page 5."
The "Enhancement Layer" Strategy: One of the most important takeaways is that Wikibase doesn't need to replace legacy systems. It functions best as a "glue" layer that sits on top of them, providing the connectivity that specialized portals lack.
Bidirectional Linking: By maintaining links back to the original source platforms, the authors created a network where a researcher starting at a photo in Texas can easily find the corresponding physical specimen in California.
Breaking the Silo: This approach demonstrates that "Linked Open Data" (LOD) is a viable path for natural history museums to move beyond isolated "digital islands" and into a global, interconnected ecosystem.
Key Results
The experimental Wikibase instance successfully integrated:
8,941 specimen records linked to CCH2.
13,462 field image and notebook records linked to BRIT/PTH.
301 publication records, with 37 specifically linked to the BHL.
Biographical data for Carlquist, connecting the collection to the broader Wikidata/Wikipedia ecosystem.
The result is a system where a single query can now retrieve all field photos associated with a specific specimen, even though the data lives in two different states and two different database architectures.
Limitations and Future Work
While the pilot was successful, the authors note several hurdles:
Data Modeling Complexity: Accurately modeling complex biological entities (like the relationship between a single field trip and multiple resulting specimens) requires significant manual effort and community consensus on standards.
Sustainability: Maintaining a separate Wikibase instance requires technical expertise and resources.
Scaling Up: This was a focused project on one prominent botanist. Scaling this to entire museum collections will require more automated tools for data mapping and entity resolution.
The authors conclude that while Wikibase isn't a "magic bullet," it provides a powerful, flexible toolkit for institutions looking to break down the walls between their digital collections.
Summary updated
Abstract
Introduction The Extended Specimen Network (ESN) (Lendemer et al. 2019) concept recognizes that scientific value extends beyond physical specimens to include field notes, field photographs, publications, and other research products. The Sherwin Carlquist ESN (Anonymous 2025) unites the legacy of Dr. Sherwin Carlquist (1930–2021), a prominent American botanist whose career focused on island biogeography and plant anatomy. This ESN connects Carlquist's physical specimens at California Botanic Garden (CalBG) with his archival materials at the Botanical Research Institute of Texas (BRIT), demonstrating both the potential and challenges of creating comprehensive ESNs across multiple institutions and digital platforms. Project Infrastructure and Goals The project established several objectives: imaging and transcribing approximately 9,000 specimens imaging and transcribing 26 field notebooks; digitizing and describing approximately 100,000 field photographs with metadata establishing linkages between field images and botanical specimens applying discovered linkages across digital platforms imaging and transcribing approximately 9,000 specimens imaging and transcribing 26 field notebooks; digitizing and describing approximately 100,000 field photographs with metadata establishing linkages between field images and botanical specimens applying discovered linkages across digital platforms Digital records are distributed across the Consortium of California Herbaria (CCH2)*1 , a Symbiota*2 portal for biological specimens, and the Portal to Texas History (PTH)*3 for archival materials. Cross-Platform Challenges Implementation of the ESN on the digital platforms revealed some limitations. The PTH's restriction to Dublin Core metadata*4 forced use of generic relationship terms "references" and "isReferencedBy"—both lacking semantic specificity. PTH also offered limited external linking capability (with relationships and URLs only describable in free text) and lacked the ability to search or filter to target only archival records with linked resources. Symbiota initially lacked functionality for linking to external archival items, a limitation addressed by creating a linked resources module through collaboration with the Symbiota developers. Both platforms shared limitations: difficulty creating complex linkages for entities like people, taxa, and publications; limited integration with existing linked data networks; and insufficient semantic richness for expressing some ESN relationships. Linked Data Approach Linked data represents structured information interlinked through semantic relationships, enabling machine-readable queries. This aligns naturally with ESNs, where specimens, images, notes, and publications form interconnected information networks. Wikidata, containing millions of structured items, represents the largest openly accessible linked data resource. Wikibase, the open-source software underlying Wikidata, offers institutions the opportunity to implement similar infrastructure while connecting to the broader linked open data ecosystem. We established a Wikibase instance*5 to experiment with and explore the capabilities and potential of the platform as a complementary extension of the Carlquist ESN created in our primary digital platforms. Implementation Methods To populate the Wikibase ESN, we began by aggregating data using multiple approaches: Sickle*6 (a Python module) retrieved PTH archival records; Symbiota's Darwin Core Archive (GBIF 2021) provided specimen data; and scripts using the Biodiversity Heritage Library (BHL) API*7 retrieved publication data. Data preparation involved iterative cleaning and standardization using OpenRefine*8. Wikibase properties were created using the WikibaseIntegrator*9 Python module, datasets were uploaded via WikibaseIntegrator with SPARQL*10 queries, and relationships established using the Wikibase QuickStatements tool*11. Results The Carlquist ESN Wikibase instance contains 8,941 specimen records linking to California Botanic Garden/CCH2; 13,462 field image and notebook records linking to BRIT/PTH; 301 publication records (37 linking to BHL); and biographical data for Carlquist linking to Wikipedia and Wikidata. Each record maintains bidirectional links to source platforms, creating cross-institutional relationship networks. This integrated approach enables capabilities that were challenging or impossible within original platforms: specimens link to field images across institutions; publications connect to referenced specimens and images; complex queries retrieve related items across data types; and the ESN connects to broader linked data networks through Wikidata integration. Conclusion Wikibase offers significant promise as an ESN enhancement layer. Rather than replacing existing infrastructure, it provides complementary capabilities: specimen and extension relationships across platforms; expansion beyond platform limitations; comprehensive complex relationships; cross-dataset queries; inclusion of entities not in collection systems; and openness for community contribution. Before Wikibase can be fully embraced for implementation of an ESN, more effort will be required to accurately model entities such as specimens, field notebooks, and field photos. Nevertheless, this experimental implementation demonstrates the feasibility and value for institutions seeking to extend digital collections beyond traditional platform constraints while participating in the linked open data ecosystem.
BibTeX
@inproceedings{best2025wikibase,
author = {Jason Best and Sam Ekberg and Mare Nazaire and Ana Niño and Krishna V. Shenoy},
title = {{Wikibase to the Rescue? Exploring the Use of Wikibase to Extend the Sherwin Carlquist Digital Extended Specimen Network}},
booktitle = {Biodiversity},
year = {2025},
doi = {10.3897/biss.9.183060},
}