Preface

Chun-Nan Hsu, Wee Sun LeeACML 2011

The Preface to the Proceedings of the 3rd Asian Conference on Machine Learning (ACML 2011) serves as an editorial introduction to the state of machine learning research during a pivotal era. Beyond its role as a logistical summary, the document captures a high-stakes snapshot of a field in transition, detailing a rigorous selection process and highlighting the influential themes—such as deep learning hierarchies and model calibration—that would come to define the subsequent decade of AI development.

The Rigor of Selection

As the machine learning community in Asia continued to expand, ACML 2011 acted as a critical gatekeeper for research quality. The conference organizers implemented a stringent peer-review methodology to filter 102 submissions down to the 23 most impactful papers, resulting in a highly selective 22.5% acceptance rate.

To ensure the integrity of the proceedings, the following measures were employed:

  • Double-Blind Review: Each submission was evaluated by at least four committee members.
  • Senior Oversight: Senior Program Committee members moderated discussions to resolve reviewer discrepancies.
  • Plenary-Only Format: Unlike larger conferences that utilize parallel tracks, ACML 2011 maintained a single-track plenary format. This ensured that every accepted paper received maximum visibility from the entire delegation.
  • Hybrid Presentation: Every accepted paper was required to deliver both an oral and a poster presentation, facilitating both broad dissemination and deep technical exchange.

Key Technical Pillars

The preface identifies three major technical gaps and shifts that the conference sought to address through its invited talks and tutorials:

1. The Feature Engineering Bottleneck

Yann LeCun’s contributions highlighted a fundamental shift from manual feature design to automated "feature hierarchies." He argued that the perceptual world is best represented by multi-stage hierarchies where features become increasingly global and invariant. This perspective provided a foundational argument for the deep learning revolution that was then in its early stages.

2. Scalability in Information Extraction

Oren Etzioni introduced the concept of "Open Information Extraction" (Open IE) as a solution to the limitations of closed-domain extraction. By ignoring pre-defined relations and utilizing bootstrapping, Open IE systems could scale to the vast, unstructured nature of the web, learning to recognize relations they had not been explicitly trained to identify.

3. The Calibration Gap in Decision-Making

Peter Flach addressed the critical need for model reliability. He argued that a "good" classifier must be "well-calibrated," meaning its predicted probabilities should reflect real-world frequencies (e.g., a 70% prediction should occur 70% of the time). To quantify these losses more effectively than standard metrics, he introduced the ROL curve as a companion to the traditional ROC curve.

Quantitative and Regional Impact

While regional in focus, the conference demonstrated significant global reach, receiving submissions from 22 different countries. The event was co-located with the Annual Conference on Technologies and Applications of Artificial Intelligence (TAAI), signaling a move toward interdisciplinary collaboration. Although the preface does not list specific datasets for the 23 papers, it notes broad application areas including graph mining for XMLs, chemical compounds, and proteins.

Limitations and Future Outlook

The organizers acknowledged that their commitment to a single-track format imposed capacity constraints, forcing the exclusion of several high-quality papers from the full proceedings. Additionally, the conference highlighted ongoing computational challenges; specifically, the tutorial sessions noted that while Partially Observable Markov Decision Processes (POMDPs) are mathematically elegant, they remained "intractable in the worst case," pointing toward a persistent need for better scaling techniques in reinforcement learning.

In summary, ACML 2011 documented a field moving toward automated feature discovery and web-scale intelligence, while emphasizing the necessity of rigorous calibration for real-world application.

Summary updated

BibTeX
@article{hsu2011preface,
  author = {Chun-Nan Hsu and Wee Sun Lee},
  title = {{Preface}},
  journal = {ACML},
  year = {2011},
}
Figure