Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation

Wei Wang, Wenqiao Zhang, Yutong Lin, Jun Xiao, Yueting ZhuangarXiv 2026 · arXiv

TL;DR

The paper introduces WorldScope, a framework for visual reasoning under partial observation that requires models to infer the strongest conclusions compatible with all "possible worlds" consistent with limited evidence. The authors propose WorldFlow, a model that utilizes an image-subset evidence lattice and "certified counterworld" supervision to significantly outperform standard multimodal LLMs, achieving a 24.88 percentage point gain over baseline methods.

What Problem Does This Paper Address?

Most current Visual Question Answering (VQA) benchmarks assume a "complete" view of a scene. If a model sees two apples on a table, it is trained to say there are "two." However, in a real-world setting with partial observations—such as occlusions or limited fields of view—the correct answer is often "at least two."

The authors argue that visual reasoning should be grounded in possible-world semantics: a conclusion is only "determined true" if it holds across every complete world state compatible with the current observations. Existing models struggle with this because they lack supervision for unobserved content and don't systematically test evidence boundaries (e.g., how conclusions should change as views are added, removed, or reordered).

Methods

The authors introduce a new model architecture and a novel supervision strategy:

  1. WorldFlow Architecture: Unlike standard models that simply fuse image features, WorldFlow represents every possible subset of available images. It uses a "two-sided" evidence approach:
  2. Observed Evidence: A cross-view entity fusion module that identifies and counts unique physical objects across views.
  3. Latent Evidence: A coverage branch that predicts a 4x4 grid representing which parts of the support surface are still hidden.
  4. Evidence Lattice: The model organizes these subset representations into a lattice. This structure allows the model to explicitly compare different combinations of views to determine which are necessary, redundant, or sufficient to resolve a claim.
  5. Certified Counterworld Supervision: To teach the model about ambiguity, the authors generated "counterworlds"—pairs of scenes that look identical from one viewpoint but contain different objects in hidden areas. This provides a "physical witness" of uncertainty, forcing the model to recognize when an answer is truly unresolved.
Overview of WorldScope, showing how partial observations support bounds or leave claims unresolved.

Datasets

The paper introduces the WorldScope data suite, which consists of:

  • WorldScope-1.2M: A massive training set of 1.2 million QA pairs covering eight world properties (like counting, existence, and regional distribution) and ten distinct task interfaces.
  • WorldScope-Bench: A 5,000-question balanced test set. Crucially, 3,000 of these questions come from "structure-disjoint" scenes—room geometries entirely unseen during training—to test the model's ability to generalize spatial reasoning.
  • Certified Counterworlds: 4,800 groups of scenes used specifically for training-only compatibility supervision.

The taxonomy of the queries and tasks is detailed in the tables below:

Base-query taxonomy showing the types of properties the model must infer.
Task-interface taxonomy showing the different ways evidence is manipulated (e.g., adding/removing views).

Key Insights and Ideas

  • Ambiguity as a First-Class Citizen: By using possible-world semantics, the model learns to provide bounds (e.g., "between 2 and 4") or admit it "cannot be determined" rather than hallucinating a specific number.
  • The Power of Subsets: Explicitly modeling image subsets via the evidence lattice is highly effective for tasks like finding the "minimal sufficient view set" or identifying "redundant views."
  • Counterfactuals Grounded in Physics: Using physically valid scene completions (counterworlds) is a more robust way to supervise uncertainty than simple label-based "I don't know" training, as it ties the uncertainty directly to unobserved regions of the 3D world.

Key Results

  • State-of-the-Art Performance: WorldFlow achieved 64.34% exact accuracy on the full benchmark, a massive improvement over the native Qwen3.5-9B backbone (15.06%) and the same backbone trained only on QA pairs (39.46%).
  • Generalization: On the challenging structure-disjoint (unseen) scenes, WorldFlow retained 50.43% accuracy, significantly outperforming the QA-only baseline (35.60%).
  • Task-Specific Gains: The largest improvements occurred in "Evidence Operations" tasks, such as finding the shortest disambiguating sequence, where WorldFlow gained over 38 percentage points compared to the baseline.

Limitations and Future Work

  • Domain Specificity: The current work is limited to controlled tabletop scenes and static objects. It does not yet handle deformable objects, dynamic events, or complex outdoor environments.
  • Coarse Coverage: The 4x4 coverage grid is relatively low-resolution and may discard fine-grained geometric information that a denser representation could capture.
  • Active Perception: While the model can evaluate candidate views, the authors suggest that future work could integrate this into an "active" system that autonomously selects the next best camera angle to resolve uncertainty.

Summary updated

Abstract

World modeling under partial observation requires reasoning about the complete worlds that remain compatible with limited visual evidence. Occluded objects and unseen regions can leave several world states possible; additional views can exclude alternatives and strengthen the conclusions supported by the observations. We introduce WorldScope to study this process through possible-world semantics, evidence-grounded data, and learned visual representations. WorldScope-1.2M provides 1.2 million English question-answer pairs spanning eight world properties, ten task interfaces, and three observation protocols. Its answers encode confirmed facts, supported bounds, and unresolved possibilities. Complementary supervision comprises 4,800 certified counterworld groups with equivalent base observations and different hidden object configurations and query answers. These groups provide physical witnesses of ambiguity and training-only labels for world compatibility and view-induced exclusions. We propose WorldFlow, which composes cross-view entity evidence and support-surface coverage into an image-subset evidence lattice. Counterworld compatibility and transition objectives train subset representations to reflect how new observations constrain possible worlds. A shared answer generator uses these representations to predict the strongest supported conclusion. WorldScope-Bench evaluates claim judgments and evidence-dependent conclusions as views are selected, combined, removed, or ordered. On its 5,000-question test set, WorldFlow reaches 64.34% exact accuracy, improving over the same backbone trained on QA alone by 24.88 percentage points. It retains 50.43% accuracy on the 3,000 questions from structure-disjoint scenes.
BibTeX
@misc{wang2026seeing,
  author = {Wei Wang and Wenqiao Zhang and Yutong Lin and Jun Xiao and Yueting Zhuang},
  title = {{Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation}},
  year = {2026},
  eprint = {2609.32456},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2609.32456},
}
Figure