DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models

Benlei Cui, Chunyang Chai, Yiliang Zhang, Xiaoqian Xia, Chengwen Yao, Song Li, Longtao Huang, Yuwen Zhai, Haiwen Hong

TL;DR

DreamRealm is a novel post-training framework that mitigates visual hallucinations in Multimodal Large Language Models (MLLMs) by "materializing" the model's own errors. By mining a model's specific perceptual confusions and editing images to make those hallucinations factually true, DreamRealm teaches models to precisely match responses to their supporting visual evidence, leading to significant gains in fine-grained visual perception.

What Problem Does This Paper Address?

Despite their impressive capabilities, MLLMs frequently suffer from visual hallucinations—generating descriptions that contradict the image or lack visual support. This is particularly problematic when a correct answer hinges on subtle details, like the direction a giraffe's tail is swinging or the exact number of propellers on a plane.

Current solutions typically fall into two camps:

  1. Text-side correction: They keep the image fixed and teach the model to prefer a "correct" response over a "hallucinated" one. This ignores the potential for supervision on the image-input side.
  2. Generic visual contrast: They use image retrieval or random editing to create visual differences. However, these aren't tailored to a specific model's unique "blind spots," meaning the supervision might not target the model's actual perceptual confusions.

DreamRealm addresses this by asking: What if we show the model the exact world it is imagining when it hallucinates?

Methods

The authors introduce a two-part framework: RealmForgePipe for data construction and RealmMatch for training.

1. RealmForgePipe: Materializing the Hallucination World

Instead of just correcting an error, this pipeline explores the model's "latent" hallucinations.

  • Exploration: It uses high-temperature sampling and attribute enumeration (e.g., changing "left" to "right" or "standing" to "sitting") to find incorrect responses the model is highly inclined to generate.
  • Materialization: It uses an image-editing model to minimally alter the original image so that the hallucinated response becomes factually correct. For example, if a model insists a giraffe's tail is "hanging naturally downward" when it is actually "swung to the left," the pipeline edits the image to show the tail hanging down.
The motivation behind DreamRealm: assigning each hallucinated response to its corresponding supporting image.

2. RealmMatch: Hallucination-Reality Correspondence Learning

Once they have a "family" of images (one original, several edited) and responses (one ground-truth, several hallucinations), they train the model using a likelihood score matrix.

  • Bidirectional Contrastive Loss: The model is trained to not only pick the right text for an image (row-wise contrast) but also to pick the right image for a given text (column-wise contrast). This forces the model to understand the fine-grained relationship between specific visual features and linguistic descriptions.
Overview of the DreamRealm framework, showing the RealmForgePipe and RealmMatch components.

Datasets

  • RealmSet: The authors introduced this new dataset, containing 28,960 human-approved edited examples across 22 perceptual categories (e.g., action, color, position, counting). It was built using hallucinations mined from the Qwen3.5-9B model.
  • Evaluation Benchmarks: The model was tested on six major benchmarks: HallusionBench, MMVP, AMBER, MMHal-Bench, CV-Bench-2D, and ObjectHal.

Key Insights and Ideas

  • Hallucination Assignment: The core "aha moment" is shifting from suppressing hallucinations to assigning them. By showing the model the visual conditions under which its hallucination would be true, the model learns to distinguish subtle visual cues more effectively.
  • Model-Specific Supervision: Training on a model's own hallucinations is significantly more effective than training on generic errors. The authors found that while DreamRealm helps other models, the gains are highest when the mined hallucinations come from the target model itself.
  • Minimal Editing is Key: By only changing the specific attribute the model is confused about, the supervision remains highly focused on the perceptual gap.

Key Results

DreamRealm achieved state-of-the-art results across multiple benchmarks, significantly outperforming specialized hallucination-mitigation methods like VCD, RLAIF-V, and various DPO-based approaches.

Main comparison on hallucination benchmarks. DreamRealm shows significant improvements across all metrics.

On the Qwen3.5-9B backbone, DreamRealm delivered:

  • A 7.26 percentage point gain in HallusionBench accuracy.
  • An 11.34 percentage point boost in MMVP pair accuracy.
  • Significant reductions in hallucination rates on MMHal-Bench (improving from 47.92% to 27.08%).

Ablation studies confirmed that the "Full RealmForgePipe" (including latent hallucinations) and the "RealmMatch" bidirectional objective were both essential for these results.

Ablation studies on data construction and training objectives.

Limitations and Future Work

  • Construction Cost: The pipeline requires significant compute for image generation and, crucially, human review to ensure the edited images actually match the target responses.
  • Editing Capabilities: The framework is limited by the state of current image-editing models. Complex scenes or very subtle physical interactions remain difficult to edit convincingly.
  • Future Directions: The authors suggest exploring more automated verification methods to reduce human-in-the-loop costs and applying this "materialization" logic to video-language models where temporal hallucinations are a major hurdle.

Summary updated

Abstract

Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details. One line of post-training methods constructs visual contrasts through image retrieval, generation, or editing to improve fine-grained perception. However, these contrasts are not built around the model's own hallucinations, making it difficult to ensure that supervision targets its actual perceptual confusions. Another line suppresses hallucinated outputs through response correction or preference learning under fixed image conditions, but leaves the design of supervision signals on the image-input side underexplored. Inspired by how humans correct misconceptions, we introduce DreamRealm, a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image. Our data construction pipeline, RealmForgePipe, mines observed and latent hallucinations from a target model and materializes them through image editing. Using hallucinations mined from Qwen3.5-9B, we construct the Realized Hallucination Dataset (RealmSet). Our training objective, RealmMatch, constructs a likelihood score matrix across image--response combinations and combines supervised learning with bidirectional contrastive losses to reinforce correct matches and suppress mismatches. Compared with the original Qwen3.5-9B model, DreamRealm improves performance across six visual perception and hallucination benchmarks, including gains of 7.26 percentage points in HallusionBench accuracy and 11.34 percentage points in MMVP pair accuracy. Together with ablation studies on data construction and training methods, these results demonstrate that hallucination assignment is a promising paradigm for improving visual perception and mitigating hallucinations.
BibTeX
@misc{cui2026dreamrealm,
  author = {Benlei Cui and Chunyang Chai and Yiliang Zhang and Xiaoqian Xia and Chengwen Yao and Song Li and Longtao Huang and Yuwen Zhai and Haiwen Hong},
  title = {{DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models}},
  year = {2026},
  eprint = {2611.06433},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.06433},
}
Figure