The effect of use of drugs on speaker's fundamental frequency and formants

Andrey Raev, Yuri Matveev, Tatiana GoloshchapovaInterspeech 2012

TL;DR

This paper investigates the impact of drug intoxication and long-term drug use on speech acoustics, specifically fundamental frequency (F0) and formants. The authors found no significant direct link between drug intoxication and changes in these vocal parameters, suggesting emotional state plays a larger role. However, prolonged use of heroin was associated with a decrease in F0.

What Problem Does This Paper Address?

Understanding how altered states of consciousness, such as drug intoxication, affect human speech is crucial for various applications, including forensic analysis and speaker identification. While it's generally accepted that emotional and functional states influence vocal characteristics, there's a lack of systematic research on the specific effects of drug intoxication. Existing studies are limited, and there's a particular gap in understanding how different drug types, intoxication levels, and the duration of drug use impact acoustic features like fundamental frequency (F0) and formants. This paper aims to fill this gap by analyzing a specialized speech database of individuals under the influence of drugs.

Methods

The researchers collected a specialized speech database, the Speech Database Narco (SDBN), comprising recordings of speakers both under the influence of narcotics and in a sober state. The data was collected by the Speech Technology Center (STC) in Russia at the request of the Federal Drug Control Service.

For analysis, the paper focuses on:

  • Fundamental Frequency (F0): This is the basic pitch of the voice, determined by the rate of vocal fold vibration.
  • Formants: These are resonant frequencies of the vocal tract that shape the sound of speech.

The study analyzed the effect of:

  • Degree of drug intoxication: Categorized as mild, moderate, or severe.
  • Type of drug used: Plant-based (marijuana, hashish), semi-synthetic (heroin), and synthetic (amphetamine).
  • Duration of narcotic drug usage: Estimated using indirect indicators like registration in treatment clinics or history of drug use.

Statistical analysis involved comparing histograms of F0 and formants between intoxicated and sober states, as well as examining correlations with the other factors.

Datasets

  • Speech Database Narco (SDBN): A newly collected, specialized database containing speech samples from 156 Russian speakers (67 female, 89 male). Recordings were made both while speakers were under the influence of drugs and in a sober state. The database includes metadata on speaker gender, estimated degree of intoxication, and hypothetical drug type used.

Key Insights and Ideas

  • Emotional State Over Intoxication: The study strongly suggests that changes in a speaker's emotional state (e.g., stress, mood) are a more significant driver of F0 and formant variations than the direct effect of drug intoxication itself.
  • No Direct Link to Intoxication Level: Contrary to common assumptions, the paper found no statistically significant, regular dependency between the degree of drug intoxication and distortions in F0 or formants.
  • Heroin and F0 Decrease: A notable finding is the tendency for prolonged use of heroin to lead to a decrease in fundamental frequency, estimated at approximately 3% per year. This suggests a cumulative, long-term effect rather than an acute intoxication effect.
  • Formant Stability: Formant trajectories showed less systematic change, with only a slight shift in the first formant observed. The researchers attribute some observed variations in formant patterns to low signal-to-noise ratios during severe intoxication rather than a direct drug effect.

Key Results

  • F0 and Intoxication: Histograms of F0 for intoxicated speakers did not show statistically significant anomalies compared to sober states. For both male and female speakers, median F0 values generally fell within normal ranges.
  • Formants and Intoxication: Formant trajectories were generally stable. While some variations were observed, they were not consistently linked to intoxication. The first formant showed a slight shift (250-400 Hz to 300-500 Hz), but other formants remained largely in place.
  • Duration of Use (Heroin): For speakers with prolonged heroin use (five or more years), a significant shift in the F0 distribution was observed, with the main mode moving from the 120-140 Hz range to 90-100 Hz. This indicates a substantial decrease in fundamental frequency.
  • Estimated F0 Decrease Rate: The average rate of F0 decrease for heroin users was roughly estimated at 4.5 Hz (3%) per year, though this is a rough estimate and limited to 2-8 years of intensive use.

Limitations and Future Work

  • Indirect Estimation of Intoxication and Duration: The paper acknowledges that determining the exact degree of drug intoxication and the duration of drug use relied on indirect methods (e.g., MOS scores, speaker statements, medical history). This introduces potential inaccuracies.
  • Limited Data for Other Drugs: While the study explored different drug types, the conclusion regarding the duration of use is primarily based on heroin users due to insufficient data for other drug categories.
  • Nonlinear F0 Decrease: The authors suggest that the decrease in F0 due to prolonged drug use might be nonlinear and potentially underestimated by their linear model.
  • Future Work: The paper implies a need for more complex models to evaluate longer durations of drug use and to explore more intricate dependencies. Further research could also focus on other drug types and their specific acoustic impacts. The findings are also noted as important for developing automatic speaker identification systems.

Summary updated

BibTeX
@inproceedings{raev2012effect,
  author = {Andrey Raev and Yuri Matveev and Tatiana Goloshchapova},
  title = {{The effect of use of drugs on speaker's fundamental frequency and formants}},
  booktitle = {Interspeech},
  year = {2012},
}
Figure