Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylization

Jamie Wynn, Zawar Qureshi, Jakub Powierza, Jamie Watson, Mohamed Sayed

Introduction

3D Gaussian Splatting (3DGS) has revolutionized real-time novel-view synthesis, yet "editing" these scenes remains a significant challenge. Most existing stylization techniques are essentially "skin-deep"—they can change the texture or color of an object but struggle to alter its fundamental geometry. Morpheus is a new framework that allows users to stylize 3D scenes using text prompts, going beyond simple color changes to actually modify the underlying shape while maintaining multi-view consistency.

Diverse stylization results across various artistic and thematic prompts, demonstrating both color and shape modifications.

Methodology: Joint Color and Depth Stylization

Morpheus tackles the challenge of geometric editing by treating stylization as a joint color and depth problem. The pipeline consists of three main stages:

  1. The RGBD Diffusion Model: The authors modified Stable Diffusion 2.1 to generate both RGB images and corresponding depth maps (RGBD). Crucially, they introduced separate "noise schedules" for color and depth. This provides a "knob" for geometric creativity, allowing users to choose whether to change colors significantly while keeping the original shape or to push depth stylization to reinvent the geometry.
  2. Autoregressive Stylization with Warp ControlNet: To maintain multi-view consistency, Morpheus stylizes a sequence of views one by one. For each new frame, it "warps" previous stylized frames into the current camera view using depth information. A specialized Warp ControlNet then guides the diffusion model to fill in gaps while staying true to the established style.
  3. Depth-Informed Feature Sharing: To prevent artifacts like "flickering" or duplicated features, the model uses 4D heatmaps based on the scene's geometry to share features across frames, ensuring stylized features stay anchored to the correct physical location in 3D space.

Results and Comparison

Morpheus outperforms state-of-the-art baselines like GaussCtrl and Instruct-GS2GS across both quantitative and qualitative metrics. It achieved a CLIP Direction Similarity of 0.175, significantly beating GaussCtrl (0.123), indicating better adherence to text prompts. In terms of consistency, it scored 0.606, outperforming all baselines.

Comparison of Morpheus against GaussCtrl for "Hobbit village" and "ice castle" prompts, showing the effect of varying shape edit strengths.

As illustrated in the comparison, Morpheus can dramatically alter the scene's geometry—such as adding the rounded structures of a Hobbit village or the jagged icicles of an ice castle—whereas baseline methods often struggle to move beyond texture-level changes. A user study with 31 participants consistently preferred Morpheus for its aesthetic quality and its ability to follow complex style prompts.

Limitations and Future Work

While Morpheus represents a major step forward, it remains dependent on the chosen camera trajectory during stylization; areas not covered by the path may remain unstylized. Additionally, errors in the initial 3DGS reconstruction can be amplified during the stylization process. Future research will explore faster diffusion architectures, such as Latent Consistency Models, to move toward near-interactive 3D stylization speeds.

Summary updated

Abstract

Exploring real-world spaces using novel-view synthesis is fun, and reimagining those worlds in a different style adds another layer of excitement. Stylized worlds can also be used for downstream tasks where there is limited training data and a need to expand a model's training distribution. Most current novel-view synthesis stylization techniques lack the ability to convincingly change geometry. This is because any geometry change requires increased style strength which is often capped for stylization stability and consistency. In this work, we propose a new autoregressive 3D Gaussian Splatting stylization method. As part of this method, we contribute a new RGBD diffusion model that allows for strength control over appearance and shape stylization. To ensure consistency across stylized frames, we use a combination of novel depth-guided cross attention, feature injection, and a Warp ControlNet conditioned on composite frames for guiding the stylization of new frames. We validate our method via extensive qualitative results, quantitative experiments, and a user study. Code online.
BibTeX
@inproceedings{wynn2025morpheus,
  author = {Jamie Wynn and Zawar Qureshi and Jakub Powierza and Jamie Watson and Mohamed Sayed},
  title = {{Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylization}},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2025},
  doi = {10.1109/cvpr52734.2025.00733},
}
Figure