Partially observable Markov models inferred using statistical tests reveal context-dependent syllable transitions in Bengalese finch songs

Jiali Lu, Sumithra Surendralal, Kristofer E. Bouchard, Dezhe Z. JinbioRxiv 2022 · DOI

TL;DR

This paper introduces a novel statistical method for inferring minimal Partially Observable Markov Models (POMMs) from sequential data, specifically Bengalese finch songs. They demonstrate that auditory feedback is crucial for maintaining context-dependent syllable transitions in these songs, as evidenced by changes in the inferred POMMs after deafening the birds.

What Problem Does This Paper Address?

Understanding how complex sequential behaviors, like human language or birdsong, are generated and controlled by the brain is a significant challenge. While standard Markov models can capture simple sequential dependencies, they often fail to account for the nuanced, context-dependent transitions observed in these behaviors. The authors aim to address this by developing a method to infer more sophisticated models, specifically Partially Observable Markov Models (POMMs), which can represent context-dependent transitions. They apply this to Bengalese finch songs, a well-studied model system for vocal learning, to investigate the role of auditory feedback in shaping song syntax.

Methods

The core contribution is a new statistical method for inferring minimal POMMs. This method involves:

  • Augmented Sequence Completeness ($P_\beta$): A combined measure of sequence completeness ($P_c$) and total variation distance ($d$) to evaluate how well a POMM fits observed sequences. A perfect model would have $P_\beta = 1$.
  • Statistical Test: A hypothesis test using $P_\beta$ to determine if a POMM is a statistically compatible model for the observed sequences. A p-value < 0.05 leads to rejection.
  • Minimal POMM Inference: An iterative process to find the simplest POMM that passes the statistical test. This involves constructing higher-order Markov models, simplifying them through state merging and deletion, and then refining transition probabilities.

This approach is designed to be automated and robust, overcoming limitations of previous heuristic methods.

Datasets

The study utilizes a dataset of songs from six adult male Bengalese finches, collected both before and after deafening. This dataset was previously used for analyzing syllable repetitions. The authors focus on the non-repetitive versions of syllable sequences for their analysis.

Key Insights and Ideas

  • Auditory Feedback is Key for Context: The most striking finding is that auditory feedback plays a critical role in shaping the context-dependent syllable transitions in Bengalese finch songs. Removing this feedback significantly alters the song's structure.
  • POMMs Capture Context: Partially Observable Markov Models (POMMs), with their ability to assign multiple states to a single syllable, are well-suited to capture the context-dependent nature of these transitions.
  • Deafening Simplifies Song Syntax: After deafening, the complexity of the inferred POMMs (specifically, state multiplicity) is significantly reduced, indicating a loss of context dependencies. For some birds, the song syntax becomes essentially Markovian.
  • Intrinsic Mechanisms Play a Role: While auditory feedback is crucial, the persistence of some state multiplicity after deafening suggests that intrinsic neural mechanisms also contribute to context dependencies.
  • Novel Method for Model Inference: The developed statistical method for inferring minimal POMMs is a significant advancement, offering a more automated and robust way to model complex sequential data.

Key Results

  • Markov Models Often Fail: For most birds, Markov models were incompatible with their song sequences before deafening. After deafening, Markov models became acceptable for some birds, but not universally.
  • Reduced State Multiplicity Post-Deafening: Deafening significantly reduced the number of "extra states" (states beyond the minimum required for a syllable) in the POMMs. For example, in the normal condition, songs comprised 44 syllables, with many requiring multiple states. After deafening, most syllables required only one state.
  • Increased Transition Randomness: The mean normalized transition entropy was notably higher after deafening, indicating that transitions became more random.
  • Individual Differences: The study highlights significant individual differences in the complexity of song syntax and the impact of deafening across the six birds.

Limitations and Future Work

  • Computational Intensity: The authors acknowledge that their method is computationally intensive, particularly in determining the minimal number of states. They suggest investigating more efficient methods for estimating state multiplicity as a future direction.
  • Small Sample Size Effects: The method is conservative with small sample sizes (N), potentially underestimating the true number of states. They suggest examining sequence completeness ($P_c$) as a practical approach to assess if N is sufficiently large.
  • Neural Mechanisms: While the study provides strong evidence for the role of auditory feedback, further research is needed to fully elucidate the underlying neural mechanisms, potentially exploring unified models that integrate intrinsic and reafferent processes.
  • Generalizability: The authors suggest their approach should be widely applicable to the analysis of behavioral sequences in other animals.

Summary updated

Abstract

Abstract Generative models have broad applications, ranging from language processing to analyzing bird-song. In this study, we demonstrate how a statistical test, designed to prevent overgeneralization in sequence generation, can be used to deduce minimal models for the syllable sequences in Bengalese finch songs. We focus on the partially observable Markov model (POMM), which consists of states and the probabilistic transitions between them. Each state is associated with a specific syllable, with the possibility of multiple states being associated to a single syllable. This feature sets the POMM apart from a standard Markov model, where each syllable is associated to just one state. This multiplicity suggests that syllable transitions are influenced by the specific contexts in which the transitions appear. We apply this method to analyze the songs of six adult male Bengalese finches, both before and after they are deafened. Our findings indicate that auditory feedback is crucial in shaping the context-dependent syllable transitions characteristic of Bengalese finch songs. Significance Generative models are adept at representing sequences where the order of elements, such as words or birdsong syllables, depends on the context. In this study, we demonstrate that a probabilistic model, inspired by neural encoding of song production in songbirds, effectively captures context-dependent transitions of syllables in Bengalese finch songs. Our findings indicate that the absence of auditory input, as seen in deafened finches, diminishes these context dependencies. This implies that auditory feedback is vital for establishing context-based sequencing in their songs. Our method can be applied to various behavioral sequences, offering insights into the neural underpinnings that govern statistical patterns in these sequences.
BibTeX
@misc{lu2022partially,
  author = {Jiali Lu and Sumithra Surendralal and Kristofer E. Bouchard and Dezhe Z. Jin},
  title = {{Partially observable Markov models inferred using statistical tests reveal context-dependent syllable transitions in Bengalese finch songs}},
  year = {2022},
  doi = {10.1101/2022.11.15.516592},
  howpublished = {bioRxiv},
}

Loading related content...

Figure