Two-term Szegő theorem for generalised anti-Wick operators

James Oldfield

Abstract

This article investigates the spectral asymptotics of pseudodifferential operators whose Weyl symbol is defined by the convolution of a dilated discontinuous function with a smooth, constant-scale window. These operators, which include generalised anti-Wick (or Gabor–Toeplitz) operators, are central to signal processing and quantum mechanics. The primary contribution is the derivation of a two-term Szegő theorem, providing an explicit asymptotic expansion for the trace of a function of the operator. This result extends beyond the previously known first-order Weyl term to capture the boundary effects influenced by the smoothing window and the geometry of the phase-space region.

Introduction

In the study of phase-space analysis, operators are frequently used to localize functions within specific regions of time and frequency. Ideally, such localizations would act as sharp projections; however, physical and mathematical constraints often necessitate the use of a "window" function to smooth the transition. These "smoothed" projections are known as generalised anti-Wick operators or Gabor–Toeplitz operators.

Mathematically, we consider the asymptotics of these operators as the underlying region $\Omega$ is dilated by a large scaling parameter $r$. While the leading-order behavior—the "Weyl term" proportional to $r^{2d}$—has been well-understood as representing the bulk volume of the region, it fails to describe the spectral behavior at the boundary. This paper addresses the challenge of identifying the second-order term (proportional to $r^{2d-1}$), which characterizes the "spectral leakage" or the transition zone of the eigenvalues.

The Challenge of Multi-Scale Analysis

The difficulty in deriving a two-term expansion for these operators lies in the presence of two distinct scales: the large scale of the dilated region ($r$) and the constant scale of the smoothing window. Standard semiclassical calculus typically assumes a single small parameter $h$ (where $h \sim 1/r$), but the convolution structure of anti-Wick operators prevents a straightforward application of these techniques. The symbol of the operator varies slowly in the bulk but changes rapidly near the boundary of $\Omega$, necessitating a more nuanced analytical approach.

Methodology

The author employs a two-step analytical framework to overcome these scaling issues:

  1. Weyl Composition and Trace Norm Bounds: The author establishes a new trace norm bound for the composition of Weyl operators (Lemma 3.4). This allows for the approximation of the Weyl symbol of a function of the operator, such as $f(T_r)$, while ensuring the error term remains $O(r^{2d-2})$. This precision is vital for preserving the integrity of the $r^{2d-1}$ boundary term.
  2. Geometric Trace Asymptotics: To calculate the trace, the symbol is integrated over phase space. Near the boundary $\partial\Omega$, the author utilizes the theory of tubular neighborhoods. By re-parameterizing points using a signed distance function and the Weingarten map (shape operator), the author extracts the precise geometric contribution of the boundary to the total trace.

Key Results: The Two-Term Expansion

The central result of the paper is Theorem 2.4, which provides the asymptotic expansion for the trace:

$$\text{tr } f(T_r[a\chi_\Omega]) = r^{2d} A_0 + r^{2d-1} A_1 + O(r^{2d-2})$$

The Bulk Term ($A_0$)

$A_0$ represents the classical Weyl contribution. It is proportional to the integral of $f(a(z))$ over the region $\Omega$. This term depends only on the volume of the region and the values of the symbol $a$ within it.

The Boundary Term ($A_1$)

$A_1$ is the novel second-order contribution. It is expressed as an integral over the boundary $\partial\Omega$ and accounts for the interaction between the function $f$, the symbol $a$, and the smoothing window $W$. Specifically, $A_1$ depends on a directional antiderivative of the window, $Q_\omega(\lambda)$, which links the physical properties of the "blurring" window to the spectral behavior at the edge.

Eigenvalue Distribution and the "Plunge Region"

A significant application of this theorem is found in the eigenvalue counting function (Corollary 2.5). For projection-like operators, eigenvalues typically cluster near 1 (inside the region) or 0 (outside). The second term $A_1$ specifically describes the "plunge region"—the transition zone where eigenvalues fall from 1 to 0. The results show that while $A_0$ is sensitive only to volume, $A_1$ is sensitive to the surface area and the local curvature of the boundary $\partial\Omega$.

Insights and Implications

  • Scale Separation: The research demonstrates that by treating the bulk and boundary regions differently, one can overcome the limitations of standard $h$-admissible operator theory.
  • Geometric Sensitivity: The explicit nature of $A_1$ reveals how the geometry of the phase-space boundary directly influences spectral leakage. This has potential implications for the design of window functions in signal processing to minimize or control such leakage.

Limitations and Future Directions

The current work assumes the boundary of $\Omega$ is at least $C^2$ (twice continuously differentiable), which excludes regions with sharp corners or cusps. Additionally, the smoothing window $W$ is required to be a Schwartz function. Future research may explore extending these results to less regular boundaries, non-smooth windows, or higher-order asymptotic terms ($O(r^{2d-2})$ and beyond), which would require even more sophisticated microlocal analysis. There is also potential to extend these findings to non-self-adjoint operators.

Summary updated

Abstract

This article concerns the asymptotics of pseudodifferential operators whose Weyl symbol is the convolution of a discontinuous function dilated by a large scaling parameter with a smooth function of constant scale. These operators include as a special case generalised anti-Wick operators, also known as Gabor–Toeplitz operators, with smooth windows and dilated discontinuous symbol. The main result is a two-term Szegő theorem, that is, the asymptotics of the trace of a function of the operator. A special case of this is the asymptotic terms of the eigenvalue counting function. In both cases, previously only the first term in the asymptotic expansion was known explicitly.
BibTeX
@article{oldfield2015two,
  author = {James Oldfield},
  title = {{Two-term Szegő theorem for generalised anti-Wick operators}},
  journal = {Journal of Spectral Theory},
  year = {2015},
  doi = {10.4171/jst/113},
}
Figure