Diagnosing Optimizer-Landscape Interaction via Representation in Subset Selection Multitasking: Evidence from Piano Fingering

Ananda Phan Iman, Tingyang Wei, Chang Wook AhnarXiv 2026 · DOI · arXiv

In the world of Evolutionary Multitasking Optimization (EMTO), the goal is to solve multiple related problems simultaneously by sharing "knowledge" between them. To do this, researchers often take discrete problems—like scheduling or routing—and "relax" them into a unified continuous search space.

But how does this translation process change the difficulty of the problem? A new paper, "Diagnosing Optimizer-Landscape Interaction via Representation in Subset Selection Multitasking," argues that the way we represent these problems is not just a technical detail—it is the primary factor determining whether multitasking helps or hurts.

TL;DR

This paper demonstrates that the "continuous relaxation" used to encode discrete problems fundamentally reshapes the fitness landscape, dictating the success of knowledge transfer in multitasking. By analyzing piano fingering as a subset selection problem, the authors show that effective multitasking requires a delicate balance of landscape "neutrality" (to buffer transfer) and "smoothness" (to enable refinement).

What Problem Does This Paper Address?

Evolutionary multitasking relies on a unified search space where different tasks can "talk" to each other. However, most real-world combinatorial problems are discrete. To make them work in EMTO, we map them into continuous spaces (e.g., using random keys).

The authors identify a major gap: we don't fully understand how these mappings reshape the fitness landscape—the mathematical "terrain" the optimizer must navigate. If the mapping turns a simple hill into a jagged mountain range, the optimizer will struggle. Crucially, a representation that works well for a single task might be a disaster for multitasking if it doesn't preserve the structural relationships needed for knowledge transfer.

Methods

The researchers used piano fingering estimation as their experimental laboratory. In this problem, the algorithm must select which fingers ($k$) out of the five available should play a set of notes at any given time—a classic "subset selection" problem.

They tested five different representation variants (R1–R5), grouped into three categories:

  1. Direct (R1): A simple pointwise mapping where each continuous value corresponds directly to a fingering choice.
  2. Modular (R2–R3): "Block-structured" mappings where groups of variables control fingering decisions, naturally creating "neutral" regions (plateaus) in the landscape.
  3. Indirect (R4–R5): Latent-based mappings where a Variational Autoencoder (VAE) is trained on real human fingering data to create a semantically structured search space.
Fig. 1: Illustration of how different unified continuous rep- resentations of the same discrete piano fingering selection x induce distinct search space. Top: A short piano passage with an example of fingering selection. Bottom: Two alternative unified continuous search spaces, within which optimization is performed; color indicates fitness values after decoding.

To "diagnose" these landscapes, they used Fitness Landscape Analysis (FLA), measuring:

  • Ruggedness: How "bumpy" the terrain is (quantified via autocorrelation).
  • Neutrality: How many "flat" plateaus exist where small changes in the representation don't change the fitness.

Datasets

The study utilized the PIG (Piano Fingering) Dataset, which contains real-world piano fingering data. This was used both to train the VAE for the indirect representations and to construct eight pairs of musical tasks with varying degrees of "relatedness" (e.g., same key vs. unrelated keys) to test multitasking performance.

Key Insights and Ideas

  • Neutrality as a "Transfer Buffer": One of the most striking findings is that neutrality—often seen as a hindrance in single-task optimization—is a boon for multitasking. Neutral plateaus act as a buffer, allowing an optimizer to receive "knowledge" from another task without immediately falling off a fitness cliff.
  • The Representation-Optimizer Match: There is no "perfect" representation. For example, the Direct representation (R1) is highly efficient for aggressive searching in single tasks but often leads to "negative transfer" in multitasking because it lacks the structural buffers provided by modular or latent designs.
  • Landscape over Algorithm: The authors suggest that the choice of representation is a "first-order design factor." In many cases, changing the representation had a much larger impact on performance than changing the underlying evolutionary algorithm.
Fig. 2: Illustration of five representation variants(R1–R5) grouped by their underlying representation mechanisms. (1) R1 (Direct): each continuous variable is deterministically mapped to a discrete fingering selection. (2) R2–R3 (Modular): Fingering selections are controlled by blocks of continuous variables. (3) R4–R5 (Indirect): discrete fingerings are embedded in a low- dimensional latent space learned offline, with a fixed latent-to-discrete mapping during optimization.

Key Results

  • Modular Wins for Transfer: The modular representations (R2 and R3) showed the strongest gains in multitasking. Specifically, R3 achieved improvements of up to +27.27% in Differential Evolution (DE)-based multitasking.
  • Single-Task vs. Multi-Task Predictors: In single-task optimization (STO), performance is mostly predicted by ruggedness (smoother is better). However, in multitasking (MTO), neutrality becomes a much more significant predictor of success.
  • Negative Transfer: Some popular multitasking optimizers (like MFEA-AKT or MTES-KG) consistently suffered from negative transfer across almost all representations, highlighting that the "transfer mechanism" must be compatible with the induced landscape.

Limitations and Future Work

The authors acknowledge that their study is focused on subset selection problems. While piano fingering is a sophisticated example, further work is needed to see if these landscape-performance correlations hold true for other combinatorial domains like routing or scheduling.

Additionally, the study uses fixed representations. A promising future direction is adaptive or co-evolving representations, where the mapping itself evolves alongside the solution to maintain an "optimal" landscape for transfer as the search progresses.

Summary updated

Abstract

Continuous relaxations are commonly used as an encoding scheme for evolutionary multitasking optimization (EMTO), allowing heterogeneous tasks to be optimized within a unified search space. However, these continuous representations fundamentally reshape the induced fitness landscape, and their impact on optimization behavior and knowledge transfer remains underexplored. In this work, we bridge the gap by analyzing the interaction between the representation-induced fitness landscape and optimizer behavior through fitness landscape analysis. Using piano fingering estimation as a representative case of the subset selection problem, we introduce several encoding variants and investigate how their induced landscapes influence search dynamics and solution quality under EMTO. Our analysis indicates that transfer efficacy is strongly associated with changes in representation-induced landscape characteristics, rather than algorithmic factors alone, highlighting the representation design as the key factor of effective knowledge transfer in multitasking optimization.
BibTeX
@misc{iman2026diagnosing,
  author = {Ananda Phan Iman and Tingyang Wei and Chang Wook Ahn},
  title = {{Diagnosing Optimizer-Landscape Interaction via Representation in Subset Selection Multitasking: Evidence from Piano Fingering}},
  year = {2026},
  eprint = {2610.39779},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.39779},
}
Figure