Challenges and Open Problems in Signal Processing: Panel Discussion Summary from ICASSP 2017 [Panel and Forum]

Yonina C. Eldar, Alfred O. Hero Iii, Li Deng, Jeffrey A. Fessler, Jelena Kovacevic, H. Vincent Poor, Steve J. Young

Abstract

This paper summarizes the high-level roadmap for the future of signal processing (SP) as discussed by five leading experts at ICASSP 2017. The discussion highlights a critical shift in the field: the necessity of moving beyond "black-box" deep learning by integrating rigorous physical models with data-driven algorithms. This integration aims to achieve superior interpretability, efficiency, and robustness across various domains, including medical imaging, wireless communications, and graph signal processing.

Introduction

The field of signal processing is at a crossroads. While deep learning has delivered unprecedented empirical success in speech recognition and computer vision, it faces significant hurdles regarding interpretability, resource intensity, and reliability. At ICASSP 2017, a panel of experts convened to discuss these challenges and outline the future research directions for the SP community. The consensus points toward a hybrid approach that leverages the strengths of both traditional model-based processing and modern data-driven techniques.

Beyond the Black Box: The Need for Interpretability and Efficiency

The central challenge addressed by the panel is the tension between traditional model-based signal processing and the recent explosion of deep learning. Current deep learning models are often "black boxes" that cannot explain their reasoning, requiring massive amounts of labeled data and computational power. Furthermore, these models can fail catastrophically on out-of-distribution cases or under adversarial attacks.

To address these issues, the panel emphasized the need for:

  • Interpretability: Developing models that can provide insights into their decision-making processes.
  • Resource Efficiency: Creating algorithms that learn effectively from smaller datasets, mimicking human learning capabilities.
  • Reliability: Ensuring models are robust against adversarial perturbations and perform predictably in real-world scenarios.

Methodological Frontiers

The panel outlined several promising methodological directions to bridge the gap between models and data:

Neural-Symbolic Integration and Algorithm Unrolling

Researchers are exploring the combination of neural networks with symbolic systems to discover underlying logical rules. In medical imaging, "algorithm unrolling" has emerged as a powerful technique. By unrolling iterative reconstruction loops into deep neural network layers, researchers allow networks to learn specific parameters while maintaining the structural integrity of the physical imaging model.

Graph Signal Processing (GSP)

GSP extends classical tools, such as Fourier transforms and filtering, to irregular structures like social networks, brain connectivity, and power grids. This field aims to handle data where the underlying structure is not a regular grid, representing a significant expansion of traditional SP theory.

Graph Signal Processing (GSP) extends classical tools to irregular data structures.

End-to-End Speech Training and Physical Layer Security

In speech processing, the trend is moving toward continuous space representations and systems trained from raw input to final output, bypassing traditional hand-engineered modular pipelines. Simultaneously, in communications, security is being shifted down to the physical layer using advanced signal design and beamforming.

Domain-Specific Applications and Hurdles

The general challenges of AI manifest uniquely across different sub-fields:

  • Medical Imaging: The primary hurdle is ensuring generalization across different hardware configurations and accelerating the commercialization gap, which currently spans over a decade from publication to clinical use.
  • Wireless Communications (5G): For applications like autonomous driving, the focus is shifting from average-case analysis to worst-case metrics and short-packet communication limits to ensure extreme reliability and low latency.
  • Graph Signal Processing: Scaling statistical signal processing and sampling theory to massive, heterogeneous, and distributed graphs remains a significant open problem.

Conclusion

The future of signal processing lies in "Physics-Aware AI." The next breakthroughs will likely come from the seamless integration of accurate physical models into state-of-the-art data-driven algorithms. By focusing on "learning-to-learn" (metalearning) and addressing the fundamental needs for reasoning and contextual understanding, the SP community can develop the next generation of robust and interpretable intelligent systems.

Summary updated

Abstract

This column summarizes the panel on open problems in signal processing, which took place on 5 March 2017 at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) in New Orleans, Louisiana. The goal of the panel was to draw attention to some of the challenges and open problems in various areas of signal processing and generate discussion on future research areas that can be of major significance and impact in signal processing. Five leading experts representing diverse areas within signal processing made up the panel.
BibTeX
@article{eldar2017challenges,
  author = {Yonina C. Eldar and Alfred O. Hero III and Li Deng and Jeffrey A. Fessler and Jelena Kovacevic and H. Vincent Poor and Steve J. Young},
  title = {{Challenges and Open Problems in Signal Processing: Panel Discussion Summary from ICASSP 2017 [Panel and Forum]}},
  journal = {IEEE Signal Process. Mag.},
  year = {2017},
  doi = {10.1109/msp.2017.2743842},
}
Figure