Time-lapse imagery and volunteer classifications from the Zooniverse Penguin Watch project

Fiona M. Jones, Campbell Allen, Carlos Arteta, Joan Arthur, Caitlin Black, Louise Emmerson, Robin Freeman, Greg Hines, Chris Lintott, Zuzana Macháčková, Grant Miller, R. E. H. Simpson, Colin Southwell, Holly R. Torsey, Andrew Zisserman, Tom HartScientific 2018 · DOI

Abstract

Automated time-lapse cameras offer a consistent method for monitoring wild animal populations in remote regions. This report details a dataset of 73,802 images from 15 Penguin Watch cameras capturing penguin breeding colonies across the Antarctic Peninsula and South Georgia from 2012 to 2014. By leveraging the Zooniverse citizen science platform, the project processed massive photographic datasets, providing validated annotations for ecological monitoring and machine learning training.

Introduction: The Data Deluge in Antarctica

Monitoring wildlife in the harsh, remote environments of Antarctica presents significant logistical hurdles. While automated time-lapse cameras provide a solution for continuous data collection, they generate a "data deluge" that exceeds the processing capacity of small research teams. Traditional ecological methods often rely on regional extrapolations that may miss the localized impacts of climate change and commercial fishing. To address this, the Penguin Watch project utilizes crowdsourced annotations to transform millions of images into scientifically rigorous data.

Methodology: From Field Cameras to Consensus Data

The researchers deployed a network of Reconyx HC500 Hyperfire trail cameras across the Antarctic Peninsula and South Georgia. These units were programmed to capture images at regular intervals, typically hourly, providing a longitudinal view of colony dynamics.

Field deployment of time-lapse cameras at penguin colonies. Image (a) shows a camera at a Chinstrap penguin colony; (b) shows a camera at a Gentoo penguin colony.

The core of the data processing pipeline is the Penguin Watch workflow hosted on the Zooniverse platform. This multi-stage process converts individual volunteer efforts into a reliable consensus.

The Penguin Watch classification workflow on Zooniverse, showing the sequence of tasks from initial detection to detailed marking.

The Penguin Watch Workflow

  1. Annotation: Volunteers identify and mark individuals as ‘adult’, ‘chick’, ‘egg’, or ‘other’.
  2. Aggregation: To reconcile multiple annotations for the same image, the authors employed agglomerative hierarchical clustering (Ward’s method) to group clicks based on spatial proximity.
  3. Consensus Calculation: A "consensus click" is determined using the median coordinates of a cluster.
  4. Validation: Volunteer-derived counts (Citizen Science or CS) were benchmarked against "Gold Standard" (GS) counts performed by experts to determine optimal agreement thresholds.

Dataset Characteristics

The released dataset encompasses 73,802 images from 15 cameras (2012–2014), covering three primary species: Gentoo (Pygoscelis papua), Chinstrap (Pygoscelis antarcticus), and Adélie (Pygoscelis adeliae). Each image is accompanied by metadata including date, time, temperature, and lunar phase. The annotation data includes both raw volunteer clicks and processed consensus coordinates with associated probability values.

Key Insights and Validation

Validation efforts revealed several critical findings for large-scale citizen science:

  • The "Power of Three": A threshold requiring at least four volunteers (>3) to agree on a location provided the most accurate balance for adult penguin counts, minimizing both over- and underestimation.
  • Expert-Level Filtering: Volunteers achieved a 96% agreement rate with experts when identifying "empty" images, allowing researchers to efficiently "retire" blank data.
  • The Density Challenge: Accuracy tends to decrease as colony density increases. "Conspecific obscuration"—where penguins stand in front of one another—creates challenges for both human counters and automated algorithms.
  • Chick Identification: Accuracy for chicks was notably lower than for adults, often because chicks are hidden during the brood-guard stage or resemble adults after losing their downy feathers.

Conclusion and Future Directions

The Penguin Watch project demonstrates the scalability of citizen science for "big data" ecology, having engaged nearly 50,000 volunteers. Beyond its immediate ecological utility, this dataset is explicitly designed to support the computer vision community. By providing precise XY coordinates, the authors aim to facilitate the development of automated object detection and density estimation models, eventually moving toward a hybrid human-AI pipeline for wildlife monitoring.

Data is hosted on the Dryad Digital Repository, with source code available on GitHub and Figshare.

Summary updated

Abstract

Automated time-lapse cameras can facilitate reliable and consistent monitoring of wild animal populations. In this report, data from 73,802 images taken by 15 different Penguin Watch cameras are presented, capturing the dynamics of penguin (Spheniscidae; Pygoscelis spp.) breeding colonies across the Antarctic Peninsula, South Shetland Islands and South Georgia (03/2012 to 01/2014). Citizen science provides a means by which large and otherwise intractable photographic data sets can be processed, and here we describe the methodology associated with the Zooniverse project Penguin Watch, and provide validation of the method. We present anonymised volunteer classifications for the 73,802 images, alongside the associated metadata (including date/time and temperature information). In addition to the benefits for ecological monitoring, such as easy detection of animal attendance patterns, this type of annotated time-lapse imagery can be employed as a training tool for machine learning algorithms to automate data extraction, and we encourage the use of this data set for computer vision development.
BibTeX
@inproceedings{jones2018time,
  author = {Fiona M. Jones and Campbell Allen and Carlos Arteta and Joan Arthur and Caitlin Black and Louise Emmerson and Robin Freeman and Greg Hines and Chris Lintott and Zuzana Macháčková and Grant Miller and R. E. H. Simpson and Colin Southwell and Holly R. Torsey and Andrew Zisserman and Tom Hart},
  title = {{Time-lapse imagery and volunteer classifications from the Zooniverse Penguin Watch project}},
  booktitle = {Scientific},
  year = {2018},
  doi = {10.1038/sdata.2018.124},
}
Figure