Standardization of Multi-Objective QUBOs

Loong Kuan Lee, Thore Gerlach, Nico Piatkowski

TL;DR

This paper introduces a fast, $O(n^3)$ method to standardize Multi-Objective Quadratic Unconstrained Binary Optimization (mQUBO) problems. By scaling objectives to unit variance using a novel closed-form statistical derivation, the authors enable more balanced solutions in multi-objective optimization without the need for computationally expensive range estimations or manual weight tuning.

What Problem Does This Paper Address?

Quadratic Unconstrained Binary Optimization (QUBO) is the "lingua franca" for modern quantum annealers and quantum-inspired digital solvers. While we are getting better at solving single QUBOs, real-world decision-making usually involves Multi-Objective Optimization (MOO)—for example, trying to maximize a portfolio's return while simultaneously minimizing its risk.

The standard way to solve MOO is "scalarization": you multiply each objective by a weight and add them together into one big QUBO. However, if one objective naturally produces values in the thousands while another stays between zero and one, the larger-scale objective will dominate the solver's attention. To fix this, researchers usually normalize objectives by their range (max value minus min value). The catch? Finding the exact range of a QUBO is NP-hard—it's just as difficult as solving the optimization problem itself. Existing approximations, like "roof dual bounds," often provide loose bounds that lead to poor scaling and unbalanced solutions.

Methods

The authors propose standardization instead of normalization. Rather than hunting for elusive min/max values, they treat the objective functions as random variables and scale them based on their variance.

The core technical contributions are:

  1. Statistical Derivation: The authors assume a uniform distribution over the space of all possible binary solution vectors. Under this assumption, they derive closed-form expressions for the mean and variance of any QUBO objective function.
  2. Efficient Algorithm: A naive calculation of QUBO variance would take $O(n^4)$ time. The authors developed a refined algorithm (Algorithm 1 in the paper) that reduces this to $O(n^3)$, where $n$ is the number of binary variables. This makes the preprocessing step extremely fast, even for large problems.
  3. Integration: Once standardized, the individual QUBO matrices are summed. This resulting "balanced" QUBO can then be solved using any standard hardware, such as the Fraunhofer IAIS digital annealer used in their experiments.

Datasets

The researchers evaluated their method using synthetic mQUBO problems built on Barabási-Albert graphs with 1,000 nodes. They combined four distinct types of problems to create 11 different multi-objective scenarios:

  • MC[0,1]: Max Cut with weights from a Beta distribution.
  • MC{0,1}: Max Cut on a complete graph with Bernoulli (0 or 1) weights.
  • MC[1,5]: Max Cut on a complete graph with discrete uniform weights.
  • SubSum: A Subset Sum problem where weights are based on graph node degrees.

Key Insights and Ideas

  • Variance as a Robust Proxy: The "aha moment" is that variance is a much more accessible statistical property than the global minimum or maximum. Because it can be calculated exactly and efficiently, it provides a reliable "common scale" for disparate objectives.
  • The "Fair" Starting Point: In a "no-preference" setting (where a user hasn't specified which objective is more important), standardization acts as a mathematically grounded way to ensure no single objective is ignored simply because of its numerical magnitude.
  • Tightness Matters: As shown in Figure 1b, traditional bounds like "Roof-Dual" can be significantly wider than the actual range of values. This overestimation leads to under-weighting that objective during optimization. Standardization avoids this pitfall by looking at the distribution's spread rather than its theoretical limits.
Fig. 1. Plots over the distribution (b) and the objective space (a,c) of the QUBO objective functions f(x) = x⊤Q1x and g(x) = x⊤Q2x. The 20 × 20 symmetric real-valued matrices Q1 and Q2 are randomly generated by the qubolite package [14] with random_state seeds of 0 and 1 respectively. Additionally Q2 is scaled up by a factor of 10 as well.

Key Results

The authors used the Hypervolume Indicator to measure the quality of the Pareto front (the set of optimal trade-off solutions). A higher hypervolume means the solver found a more diverse and higher-quality set of solutions.

  • Superior Performance: Standardization outperformed both unscaled objectives and roof-dual normalization in 10 out of 11 test cases.
  • Balanced Trade-offs: In Figure 1c, the authors demonstrate that the standardized approach finds solutions much closer to the "Ideal Vector" (the theoretical best for all objectives) compared to the unscaled version, which gets "stuck" favoring one objective.
  • Quantitative Edge: In several instances, the hypervolume achieved by standardization was orders of magnitude better than the alternatives (see Table I).
Extracted table from page 6 of Standardization of Multi-Objective QUBOs

Limitations and Future Work

The primary limitation is the Uniform Distribution Assumption. The variance is calculated assuming every possible binary string is equally likely. However, optimization solvers specifically hunt for low-energy (non-random) states. The authors acknowledge that the variance of the "interesting" parts of the search space might differ from the global variance.

Future directions include: * Testing how standardization interacts with specific user-defined weights (a priori methods). * Exploring if the variance calculation can be adapted to account for specific constraints within the QUBO. * Applying this technique to real-world datasets in finance or logistics where objective scales are notoriously mismatched.

Loading related content...