RoomEditor: High-Fidelity Furniture Synthesis with Parameter-Sharing U-Net

Zhenyi Lin, Xiaofan Ming, Qilong Wang, Dongwei Ren, Wangmeng Zuo, Qinghua HuNeurIPS 2025 · OpenReview

TL;DR

RoomEditor introduces a parameter-sharing dual U-Net architecture and a new benchmark dataset, RoomBench, to achieve high-fidelity virtual furniture synthesis. By unifying feature extraction and inpainting within a single shared network, the model ensures superior geometric coherence and visual realism, outperforming existing methods while being more computationally efficient.

The Challenge of Virtual Furniture Synthesis

Imagine trying to visualize how a new sofa looks in your living room using an app. For the result to be useful, the sofa must match the room's perspective, lighting, and scale perfectly. This is "virtual furniture synthesis," a specialized form of image composition.

The authors identify two major roadblocks in this field:

  1. Data Scarcity: There are no high-quality, ready-to-use public benchmarks for this specific task. Existing datasets are often restricted or require complex 3D rendering pipelines to be useful for training 2D models.
  2. Technical Misalignment: Current state-of-the-art (SOTA) methods often use "dual-branch" architectures—one branch to extract features from the furniture and another to "paint" it into the room. Because these branches often process images independently (sometimes using different encoders like CLIP), they suffer from "feature misalignment," leading to unnatural "copy-paste" artifacts or warped furniture shapes.

The RoomEditor Approach

The researchers propose RoomEditor, which simplifies the dual-branch approach by using a parameter-sharing dual U-Net.

  • Shared Weights: Instead of two different networks, RoomEditor uses the exact same U-Net weights to process both the reference furniture image and the masked background scene.
  • Unidirectional Information Flow: Features from the reference branch are injected into the background branch at every layer using a "mixture attention" module. This module combines self-attention (on the background) with cross-attention (to the reference features).
  • Unified Feature Learning: By sharing parameters, the model is forced to map both the object and the environment into the same feature space, naturally aligning the extraction and inpainting stages.

Datasets

  • RoomBench (New): A curated, public benchmark specifically for furniture synthesis. It contains 7,298 training pairs and 895 testing samples across 27 categories (sofas, lamps, beds, etc.).
  • DreamBooth: Used to test how well the model generalizes to non-furniture objects like toys or animals.
  • 3D-FUTURE: A large-scale 3D furniture dataset used for cross-dataset validation.

Key Insights & Generalization

  • The "Consistency" Advantage: The authors performed a deep dive into feature misalignment. They found that unshared dual-branch models (even SOTA ones like MimicBrush) have significantly higher $\ell_2$ errors between their intermediate features and the ground truth. RoomEditor’s shared weights act as a powerful constraint that keeps these features aligned.
  • Simplicity is Efficiency: By removing extra image encoders (like CLIP or DINO) and sharing U-Net weights, RoomEditor is much leaner. It has ~60% fewer parameters than MimicBrush while being faster and more accurate.
  • Zero-Shot Generalization: Because the model learns a fundamental way to "compose" objects into scenes, it generalizes remarkably well to objects it has never seen before (like a stuffed sloth or a toy monster) without any extra training.
RoomEditor demonstrates impressive zero-shot generalization, seamlessly integrating unseen objects like a stuffed sloth into new environments.

Key Results

RoomEditor sets a new bar for furniture synthesis:

  • Quantitative Superiority: On the RoomBench dataset, it outperformed PBE, AnyDoor, and MimicBrush across all major metrics, including FID (18.42 vs. 19.04 for the best baseline) and PSNR (21.15 vs. 20.44).
  • Human Preference: In a user study, RoomEditor was ranked "Best" in terms of fidelity, harmony, and overall quality over 50% of the time, far exceeding its competitors.
  • Visual Fidelity: While other methods struggle with "sticker-like" appearances or distorted textures, RoomEditor produces compositions that look like real photographs with correct perspective and lighting across a wide variety of furniture types.
RoomEditor achieves high-fidelity synthesis across diverse furniture categories, maintaining accurate perspective, scale, and lighting.

Limitations and Future Work

  • The Long Tail: The model still struggles with very rare or complex furniture shapes (e.g., intricate clothes racks) due to a lack of diverse training examples for those specific categories.
  • Shadows and Lighting: Since the model only edits the masked region, it cannot generate realistic shadows that fall outside that mask onto the original background.
  • Architectural Evolution: The authors suggest that moving from U-Net to more modern Diffusion Transformer (DiT) architectures could be a promising next step for even higher fidelity.

Summary updated

Abstract

Virtual furniture synthesis, a critical task in image composition, aims to seamlessly integrate reference objects into indoor scenes while preserving geometric coherence and visual realism. Despite its significant potential in home design applications, this field remains underexplored due to two major challenges: the absence of publicly available and ready-to-use benchmarks hinders reproducible research, and existing image composition methods fail to meet the stringent fidelity requirements for realistic furniture placement. To address these issues, we introduce RoomBench, a ready-to-use benchmark dataset for virtual furniture synthesis, comprising 7,298 training pairs and 895 testing samples across 27 furniture categories. Then, we propose RoomEditor, a simple yet effective image composition method that employs a parameter-sharing dual U-Net architecture, ensuring better feature consistency by sharing weights between dual branches. Technical analysis reveals that conventional dual-branch architectures generally suffer from inconsistent intermediate features due to independent processing of reference and background images. In contrast, RoomEditor enforces unified feature learning through shared parameters, thereby facilitating model optimization for robust geometric alignment and maintaining visual consistency. Experiments show our RoomEditor is superior to state-of-the-arts, while generalizing directly to diverse objects synthesis in unseen scenes without task-specific fine-tuning. Our dataset and code are available at https://github.com/stonecutter-21/roomeditor.
BibTeX
@inproceedings{lin2025roomeditor,
  author = {Zhenyi Lin and Xiaofan Ming and Qilong Wang and Dongwei Ren and Wangmeng Zuo and Qinghua Hu},
  title = {{RoomEditor: High-Fidelity Furniture Synthesis with Parameter-Sharing U-Net}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=KOebVBmhqx},
}
Figure