TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors

Zhaolan Huang, Adrien Tousnakhoff, Polina Kozyr, Roman Rehausen, F. Bießmann, Robert Lachlan, Cédric Adjih, Emmanuel Baccelli

TL;DR

TinyChirp is a new TinyML-based framework that enables low-power wireless sensors to identify specific bird species on-device and in real-time. By replacing continuous "dumb" recording with an intelligent two-stage classification pipeline, the system extends sensor battery life from two weeks to nearly five months—covering an entire breeding season on a single charge.

What Problem Does This Paper Address?

Traditional bioacoustic monitoring is a logistical nightmare. Researchers typically deploy battery-powered "Autonomous Recording Units" (ARUs) that record audio continuously to an SD card. Because these devices record everything, they generate massive amounts of irrelevant data (silence, wind, rain), causing SD cards to fill up and batteries to drain in just a couple of weeks. Researchers then have to trek into the field frequently to swap cards and batteries, only to find that less than 10% of the recorded audio actually contains the target bird songs.

The challenge is that state-of-the-art bird recognition models (like BirdNET) are far too resource-heavy for the microcontrollers (MCUs) used in these sensors, which often have less than 256KB of RAM. TinyChirp aims to bridge this gap by bringing high-accuracy machine learning directly to the "edge" on extremely constrained hardware.

Methods

The authors propose a two-stage binary classification pipeline to balance accuracy with energy efficiency:

  1. Baseline Filtering: A lightweight, non-ML signal processing step. It uses a 9th-order Butterworth highpass filter and a simple power calculation to "pre-screen" audio. If the signal power is below a certain threshold, the device stays in a low-power state and discards the audio.
  2. TinyML Inference: If the baseline filter is triggered, a neural network wakes up to perform a more rigorous check.

The researchers compared two main approaches for the neural network:

  • Spectrogram-based: Converting audio into visual "images" (Mel-spectrograms) and using 2D CNNs.
  • Time-series-based: Operating directly on the raw 1D audio waveform using 1D CNNs or Transformers.

To fit these models onto an MCU, they employed Post-Training Quantization (8-bit) and a novel Partial Convolution technique. Partial convolution allows the device to compute average pooling iteratively over a small sliding window, drastically reducing the peak RAM required to store intermediate feature maps.

Datasets

The study utilized a mix of public and project-specific data:

  • Oxfordshire Corn Buntings: A new, curated dataset of Emberiza calandra songs recorded in the UK.
  • Macaulay Library & Xeno-Canto: Used to source "non-target" bird species to ensure the model doesn't trigger on the wrong birds.
  • Google AudioSet: Used to provide "environmental noise" (rain, wind, thunder) to train the model to ignore non-biological sounds.

Key Insights and Ideas

  • The Spectrogram Bottleneck: In traditional deep learning, spectrograms are the gold standard for audio. However, the authors found that on a microcontroller, calculating a Mel-spectrogram can take longer than the actual model inference (e.g., 2.4 seconds of processing for a 3-second clip). This makes time-series models (which skip this step) much more attractive for the edge.
  • Transformers on the Edge: Surprisingly, a lightweight Transformer-Time model outperformed 1D CNNs in terms of the balance between accuracy and compute latency on the test hardware.
  • Memory is the Real Constraint: While many papers focus on "accuracy," the authors highlight that "Out-of-Memory" (OOM) errors are the primary deal-breaker for deployment. Their partial convolution strategy was essential for making standard architectures like SqueezeNet viable on hardware with only 256KB of RAM.

Key Results

  • High Precision: TinyChirp achieved a precision of over 0.98 for detecting corn bunting songs.
  • Massive Energy Savings: By only storing relevant audio, the system reduces SD card writes by 90%.
  • Extended Field Life: The autonomous recording unit's lifetime was extended from 2 weeks to 18 weeks on a single battery charge—effectively allowing a "set it and forget it" approach for an entire season.
  • Hardware Performance: On an nRF52840 (ARM Cortex-M4) board, the Transformer-Time model emerged as the best candidate, fitting within the memory budget while maintaining high predictive performance.

Limitations and Future Work

  • Species Scaling: The current work focuses on a binary "target vs. non-target" classification for one species. Scaling this to a "universal" bird recognizer that can identify hundreds of species on an MCU remains a significant challenge.
  • Environmental Robustness: While the models were trained on noisy data, real-world performance in extremely dense acoustic environments (like a tropical rainforest) may require further tuning of the "knobs" (thresholds) in the two-stage pipeline.
  • Hardware Specifics: Some optimized architectures (like SqueezeNet-Mel) still hit OOM limits on the specific test board, suggesting that even more aggressive model pruning or architecture search is needed for the smallest MCUs.

Summary updated

Abstract

Monitoring biodiversity at scale is challenging. De-tecting and identifying species in fine grained taxonomies requires highly accurate machine learning (ML) methods. Training such models requires large high quality data sets. And deploying these models to low power devices requires novel compression techniques and model architectures. While species classification methods have profited from novel data sets and advances in ML methods, in particular neural networks, deploying these state-of-the-art models to low power devices remains difficult. Here we present a comprehensive empirical comparison of various tinyML neural network architectures and compression techniques for species classification. We focus on the example of bird song detection, and more concretely on a data set curated for studying the corn bunting bird species. We publish the data set along with all the code and experiments of this study. In our experiments we comparatively evaluate predictive performance, memory and time complexity of spectrogram-based methods and of more recent approaches operating directly on the raw audio signal. Our results demonstrate that TinyChirp - our approach - can robustly detect individual bird species with precisions over 0.98 and reduce energy consumption compared to state-of-the-art, such that an autonomous recording unit lifetime on a single battery charge is extended from 2 weeks to 8 weeks, almost an entire season.
BibTeX
@inproceedings{huang2024tinychirp,
  author = {Zhaolan Huang and Adrien Tousnakhoff and Polina Kozyr and Roman Rehausen and F. Bießmann and Robert Lachlan and Cédric Adjih and Emmanuel Baccelli},
  title = {{TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors}},
  booktitle = {IS2},
  year = {2024},
  url = {https://openreview.net/forum?id=savbwO7uWg},
}

Loading related content...

Figure