HierT2S: Enhancing Part-Level Text-to-Shape Generation via Hierarchical Structure Modeling
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Text-driven 3D shape generation still faces key challenges, especially in achieving high levels of control over the generated outputs. Paticularly, existing text-to-shape methods ignore the explicit modeling of hierarchical structures in the text and 3D shapes, which makes it hard for using long text descriptions with multiple prompts to guide the coherent part-level 3D shape generation. In this work, we introduce HierT2S, a framework that integrates a hierarchical tree representation with a conditional diffusion model, to enhance the generation of 3D shapes with coherent structures induced by the hierarchical and structured text representations. The key idea is to first segment the input text into several clusters and construct a hierarchical tree representation, with each node representing a parent entity or the fine-level part components. Then, we process the lower-level clusters of the tree with a relation graph module which uses self-attention mechanism to aggregate the relationships of the clusters, and generate a new sequence containing the processed text features. Finally, the text features are embedded into the 3D feature space and used for learning the 3D shape generation by a conditional diffusion model, where the sparsely implicit parsed hierarchical tree graph further enhances the structural details of the generated 3D shapes, leading to results that are close to structure-aware generation. We conducted comprehensive experiments on the existing text-to-shape pairing dataset Text2Shape, and the results demonstrate that our model significantly outperforms current state-of-the-art methods. Moreover, our method can enable progressive part-level 3D shape manipulation and modification guided by the partially modified text prompt.
BibTeX
@misc{jiang2025hiert,
author = {Linlian Jiang and Peng Zheng and Yibo Zhang and Xinxin Zuo and Yang Wang and Rui Ma},
title = {{HierT2S: Enhancing Part-Level Text-to-Shape Generation via Hierarchical Structure Modeling}},
year = {2025},
url = {https://openreview.net/forum?id=GQ2Ks23bJ6},
howpublished = {OpenReview},
note = {Submitted to ICLR 2025},
}Loading related content...