Interspeech 2024

1,036 papers

Top Research Directions

Research directions most represented by Interspeech 2024 papers.

Learning High-Level Acoustic Structures from Unlabeled Audio 50
Partitioning Variance with Linear Mixed Effects Models 27
Fine Tuning Speech Models for Specialized Domains 22
Overcoming the Modality Gap in Audio Language Models 19
Mitigating the Acoustic Mismatch in Atypical Speech Recognition 19
Overcoming Data Scarcity in Low-Resource Speech Recognition 19
Zero Shot Speaker Generalization for Speech Synthesis 18
Resolving Overlapping Speech in Multi-Speaker Audio 18
The Single Speaker Generalization Bottleneck in Speech Synthesis 18
Temporal Alignment of Speech and Text 17
Speech Analysis for Early Detection of Cognitive Decline 17
Layer Specialization in Deep Speech Representations 16
Visual Anchoring for Robust Speech Enhancement 15
Low-Rank Weight Decomposition for Efficient Model Adaptation 15
Parameter Efficient Speech and Audio Processing 14

Top Authors

AuthorPapers
Shinji Watanabe24
Joon-Hyuk Chang11
Haizhou Li10
Jiatong Shi10
Helen M. Meng9
Jianhua Tao9
Lei Xie9
Hung-yi Lee8
Xixin Wu7
Yanmin Qian7
Chao Zhang6
Xie Chen6
Zhengqi Wen6
EngSiong Chng5
Junlan Feng5
Shrikanth Narayanan5
Yossi Adi5
Yuxun Tang5
Zengrui Jin5
Zhen-Hua Ling5

Impactful Papers

Papers from Interspeech 2024 that shaped research clusters.

Foundational

Influential

Papers

Title
M2ASR: Multilingual Multi-task Automatic Speech Recognition via Multi-objective Optimization
M2D-CLAP: Masked Modeling Duo Meets CLAP for Learning General-purpose Audio-Language Representation
Macro-descriptors for Alzheimer's disease detection using large language models
Magnitude and timing of acceleration peaks in stressed and unstressed syllables
MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance
MaLa-ASR: Multimedia-Assisted LLM-Based ASR
Mandarin T3 Production by Chinese and Japanese Native Speakers
MaskSR: Masked Language Model for Full-band Speech Restoration
MaViLS, a Benchmark Dataset for Video-to-Slide Alignment, Assessing Baseline Accuracy with a Multimodal Alignment Algorithm Leveraging Speech, OCR, and Visual Features
Measurement and simulation of pressure losses due to airflow in vocal tract models
Measuring acoustic dissimilarity of hierarchical markers in task-oriented dialogue with MFCC-based dynamic time warping
Meta Learning Text-to-Speech Synthesis in over 7000 Languages
MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition
MFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection
MFSN: Multi-perspective Fusion Search Network For Pre-training Knowledge in Speech Emotion Recognition
mHuBERT-147: A Compact Multilingual HuBERT Model
MinSpeech: A Corpus of Southern Min Dialect for Automatic Speech Recognition
MINT: Boosting Audio-Language Model via Multi-Target Pre-Training and Instruction Tuning
Missingness-resilient Video-enhanced Multimodal Disfluency Detection
Mitigating Overfitting in Structured Pruning of ASR Models with Gradient-Guided Parameter Regularization
Mixed Children/Adult/Childrenized Fine-Tuning for Children's ASR: How to Reduce Age Mismatch and Speaking Style Mismatch
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting
MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model
Mmm whatcha say? Uncovering distal and proximal context effects in first and second-language word perception using psychophysical reverse correlation
MM-NodeFormer: Node Transformer Multimodal Fusion for Emotion Recognition in Conversation
MMSD-Net: Towards Multi-modal Stuttering Detection
Mobile PresenTra: NICT fast neural text-to-speech system on smartphones with incremental inference of MS-FC-HiFi-GAN for law-latency synthesis
Modality Translation Learning for Joint Speech-Text Model
Modeling probabilistic reduction across domains with Naive Discriminative Learning
Modeling Vocal Tract Like Acoustic Tubes Using the Immersed Boundary Method
Modelled Multivariate Overlap: A method for measuring vowel merger
Modelling Lexical Characteristics of the Healthy Aging Population: A Corpus-Based Study
MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms
MSA-DPCRN: A Multi-Scale Asymmetric Dual-Path Convolution Recurrent Network with Attentional Feature Fusion for Acoustic Echo Cancellation
MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis
MSDET: Multitask Speaker Separation and Direction-of-Arrival Estimation Training
MS-HuBERT: Mitigating Pre-training and Inference Mismatch in Masked Language Modelling methods for learning Speech Representations
MSR-86K: An Evolving, Multilingual Corpus with 86, 300 Hours of Transcribed Audio for Speech Recognition Research
MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization
Multi-Channel Extension of Pre-trained Models for Speaker Verification
Multi-Channel Multi-Speaker ASR Using Target Speaker's Solo Segment
MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels
Multi-label Bird Species Classification from Field Recordings using Mel_Graph-GCN Framework
Multi-latency look-ahead for streaming speaker segmentation
Multilingual Speech and Language Analysis for the Assessment of Mild Cognitive Impairment: Outcomes from the Taukadial Challenge
Multi-mic Echo Cancellation Coalesced with Beamforming for Real World Adverse Acoustic Conditions
Multi-modal Adversarial Training for Zero-Shot Voice Cloning
Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of Speech-Silence and Word-Punctuation
Multimodal Belief Prediction

« prev Page 12/21 next »