Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation
Lists
Only you see this
Abstract
This paper proposes an image-vector dual diffusion model for generative layout design. Distinct from prior efforts that mostly ignores visual information of elements and the whole canvas, our approach integrates the power of a pre-trained large image diffusion model to guide layout composition in a vector diffusion model by providing enhanced salient region understanding and high-level inter-element relationship reasoning. Our proposed model simultaneously operates in two domains: it generates the overall design appearance in the image domain while optimizing the size and position of each design element in the vector domain. The proposed method achieves the state-of-the-art results on several datasets and enables new layout design applications. Project webpage: https://aminshabani.github.io/visual_layout_composer.
BibTeX
@inproceedings{shabani2024visual,
author = {Mohammad Amin Shabani and Zhaowen Wang and Difan Liu and Nanxuan Zhao and Jimei Yang and Yasutaka Furukawa},
title = {{Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation}},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2024},
doi = {10.1109/cvpr52733.2024.00881},
}Loading related content...