Not All Branches Are Equal: Adaptive Semantic ID Construction for Generative Recommendation

Guy Hadad, Haggai Roitman, Bracha ShapiraarXiv 2026 · arXiv

TL;DR

Generative recommendation models work best when item identifiers (Semantic IDs) are treated as hierarchical paths rather than independent token sequences. This paper introduces the Adaptive Silhouette Tree (AST), a method that dynamically builds these paths by optimizing branching factors at every level and ensuring even rare items get enough "supervision mass" to be learnable.

What Problem Does This Paper Address?

In generative recommendation, items aren't just ranked; they are represented as sequences of discrete tokens (Semantic IDs) that a language model learns to "generate." Most current methods create these IDs using techniques like Residual Vector Quantization (RQ-VAE), which implicitly assumes that each token in the ID carries independent meaning.

The authors argue this is a fundamental mismatch. Through empirical analysis, they show that a token's meaning is heavily dependent on the tokens that came before it (its prefix). If you share a prefix with another item, you are likely similar; if you only share a suffix, you probably aren't. Current methods also use a fixed "branching factor" (e.g., every node always splits into 10 children), which ignores the fact that some categories of items are much denser and more diverse than others.

Methods

The authors propose the Adaptive Silhouette Tree (AST), a top-down divisive clustering approach.

  1. Adaptive Branching: Instead of a fixed number of children per node, AST searches for the optimal branching factor ($K$) at each split by maximizing the silhouette coefficient—a metric that measures how well-defined and separated clusters are. This allows the tree to branch aggressively in dense regions of the item space and remain compact in homogeneous ones.
  2. Path-Based IDs: Items are assigned IDs based on their path from the root to a leaf. This ensures that geometric proximity in the embedding space translates directly to shared prefixes in the ID space.
  3. Mass Constraints (AST-V1 & V2): To solve the "long-tail" problem, the authors introduce constraints ensuring that every branch carries a minimum percentage of the total "interaction mass" (popularity).
  4. AST-V1 uses Mixed-Integer Linear Programming (MILP) to correct K-Means assignments that violate mass requirements.
  5. AST-V2 integrates mass directly into the clustering objective, using weighted silhouettes and mass-weighted centroids.
Figure 1: Adaptive Silhouette Tree (AST) method (𝐿= 3)

Datasets

The model was evaluated on five diverse Amazon Review datasets:

  • Beauty
  • Toys and Games
  • Sports and Outdoors
  • Health and Personal Care
  • Home and Kitchen

These datasets vary in size and sparsity, providing a robust testing ground for recommendation performance.

Key Insights and Ideas

  • Prefixes are King: The "aha moment" of the paper is the proof that Semantic IDs behave like paths. Sharing the first token of an ID indicates much higher item similarity than sharing the last three tokens.
  • Geometry Matters: By using top-down clustering in the original embedding space (rather than residual spaces), AST maintains "laminar" structure—meaning prefix groups are always geographically contiguous.
  • Supervision Mass: A major reason generative models fail on rare items is that the specific "path" to that item is rarely seen during training. By enforcing a minimum mass per branch, AST ensures the model receives sufficient signal to learn every valid prefix.

Key Results

AST-V2 consistently outperformed a wide array of strong baselines (including RQ-VAE, SEATER, and CoST).

  • Overall Gain: The authors report an average relative improvement of 13.08% across all datasets and metrics (Recall and NDCG).
  • Head vs. Tail: Unlike some models that favor popular items at the expense of rare ones, AST-V2 sits on the Pareto frontier, providing the best trade-off between "head" and "tail" performance.
Figure 2: Pareto front analysis of head versus tail perfor- mance for Recall@10 (left) and NDCG@10 (right).

Limitations and Future Work

  • Embedding Dependency: The quality of the Semantic IDs is still bottlenecked by the quality of the initial item embeddings. If the embeddings are noisy, the tree structure will be too.
  • Computational Complexity: While efficient at inference, the construction phase—specifically the MILP-based constraints—might become computationally expensive when scaling to catalogs with millions or billions of items.
  • Future Directions: The authors suggest moving toward jointly learning the item representations and the tree structure simultaneously, rather than treating them as two separate steps.

Summary updated

Abstract

Generative recommendation models represent items as sequences of discrete tokens known as semantic IDs. Existing approaches derive these identifiers using residual or hierarchical vector quantization, assuming that tokens carry independent semantic meaning across quantization levels. Revisiting this assumption, we argue that semantic IDs should behave as hierarchical paths where each token's meaning is conditioned on its prefix. This highlights a mismatch between conventional fixed-codebook quantization and the hierarchical structure implicitly learned by generative recommenders. Motivated by this insight, we propose Adaptive Silhouette Tree (AST), a top-down divisive clustering method that constructs semantic IDs as paths within a tree structure. Unlike prior methods with fixed branching factors, AST dynamically determines the number of branches at each node by maximizing the silhouette coefficient, enabling finer partitions in dense regions and compact groupings in homogeneous ones. We further introduce constrained variants that enforce minimum probability mass during splitting to improve supervision for long-tail items. Extensive experiments on five Amazon Review datasets of varying sizes and domains show that AST significantly outperforms strong baselines. These results demonstrate that aligning semantic ID construction with the inherent hierarchical structure of generative recommenders leads to more effective recommendations.
BibTeX
@misc{hadad2026not,
  author = {Guy Hadad and Haggai Roitman and Bracha Shapira},
  title = {{Not All Branches Are Equal: Adaptive Semantic ID Construction for Generative Recommendation}},
  year = {2026},
  eprint = {2611.11549},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11549},
}
Figure