Q-CamTuning: A Multimodal Large Language Model for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning

Yanchao Bi, Pengfei Chen, Yulong Yan, Qian Zhang, Biao Wang, Leida LiarXiv 2026 · arXiv

TL;DR

Q-CamTuning is a novel Multimodal Large Language Model (MLLM) that moves beyond simple image quality scoring to provide fine-grained reasoning and actionable camera-tuning advice for livestreaming. By integrating a frequency-aware evidence adapter and physical-prior mapping, it can distinguish subtle quality differences and suggest specific parameter adjustments (like ISO or sharpness) to improve visual performance in real-time.

What Problem Does This Paper Address?

Livestreaming has exploded in popularity, but achieving professional-grade image quality remains a challenge for most users. While automatic camera tuning systems exist, they rely on Image Quality Assessment (IQA) methods that have two major flaws:

  1. Lack of Sensitivity: They struggle to identify the subtle quality differences between very similar candidate images produced by minor parameter tweaks.
  2. Lack of Actionability: Most IQA models output a single scalar score. They don't explain why an image is better or provide concrete suggestions on how to fix remaining issues (e.g., "the image is sharp, but too noisy—reduce the ISO").

This paper aims to bridge the gap between passive quality assessment and active, explainable camera control.

Methods

The authors propose a Progressive Perception–Evidence–Guidance framework, implemented in two training stages:

  • Stage-I: Perceptual Alignment: The model (Q-CamTuning-P) is trained on multi-attribute quality ratings and fine-grained pairwise rankings to establish a foundational "eye" for quality.
  • Stage-II: Evidence-Guided Reasoning: The model (Q-CamTuning-G) is instruction-tuned to generate structured explanations and tuning recommendations.

Two key architectural innovations support this:

  • Frequency-Dimension Evidence Adapter (FDEA): This module uses Haar transforms to decompose images into frequency bands. Since different quality issues manifest in different frequencies (e.g., noise in high frequencies, exposure in low), specialized "expert" branches can extract more relevant visual evidence for each attribute.
  • Physical-Prior Quality-to-Parameter Mapping (PQPM): To ensure recommendations are physically sound, this module uses a fixed matrix of known physical relationships (e.g., the link between noise and ISO) to guide the model's suggestions.
Figure 3: Progressive Training Strategy of Q-CamTuning.

Datasets

The researchers introduced FGLive-Comments, a large-scale instruction-tuning dataset specifically for camera tuning.

  • Source: Built upon the FGLive-10K dataset.
  • Content: Contains 12,077 training and 3,291 test image-description pairs.
  • Annotations: Includes global and local visual evidence, image-level summaries, and selective parameter-adjustment directions.
  • Creation: Developed via a human–machine collaborative pipeline where an LLM (Gemini) generated initial descriptions that were then verified and corrected by humans.
Figure 2: Dimension-wise Data Generation and Verification Pipeline.

Key Insights and Ideas

  • Reasoning as a Bridge: The authors argue that for camera tuning, the "why" is as important as the "what." By forcing the model to provide evidence-based reasoning, they improve its ability to make fine-grained judgments.
  • Frequency Decomposition is a Powerful Prior: Explicitly separating frequency bands provides a strong inductive bias that helps the model "see" subtle degradations that general-purpose MLLMs often miss.
  • Grounding in Physics: By using the PQPM module, the model avoids "hallucinating" impossible camera adjustments, making its advice reliable for real-world hardware.

Key Results

Q-CamTuning sets a new state-of-the-art (SOTA) for livestreaming IQA:

  • Superior Accuracy: On the FGLive-10K benchmark, it achieved an SRCC of 0.962 and PLCC of 0.960, significantly outperforming the previous task-specific leader, TuningIQA (0.939/0.936).
  • Fine-Grained Ranking: It reached a fine-grained ranking accuracy (FG-ACC) of 75.6%, a notable improvement over prior methods.
  • Human Preference: In a blind user study, Q-CamTuning's tuning recommendations were preferred over those from general-purpose models like GPT-4V and Qwen-VL.
Figure 1: Motivation. Coarse-grained preference reasoning may yield incorrect attribute-aware judgment, while the pro- posed Q-CamTuning performs comparison and further rec- ommends camera-parameter adjustment directions.

Limitations and Future Work

  • Directional vs. Numerical: Currently, the model suggests the direction of adjustment (e.g., "slightly decrease Contrast") rather than precise numerical values (e.g., "set Contrast to -10").
  • Closed-Loop Integration: While the reasoning is sound, the authors note that future work is needed to integrate this model into a fully autonomous, real-time closed-loop tuning system.
  • Computational Overhead: As an MLLM, real-time deployment on mobile devices for livestreaming would require significant optimization or edge-cloud collaboration.

Summary updated

Abstract

With the popularization of livestreaming applications, automatic camera tuning has become indispensable for ordinary users to enjoy high Quality of Experience (QoE). However, the existing Image Quality Assessment (IQA) methods face two challenges in camera tuning. First, they struggle to identify subtle quality difference between images, which is common in camera tuning. Second, the ability to explain fine-grained differences and to provide suggestions for camera tuning are even more lacking. To address these challenges, we first construct FGLive-Comments, an instruction tuning dataset with rich annotations of both preferences for fine-grained image pairs and quality reasoning from global and local visual evidence, which supports selective adjustment recommendations of camera parameters. Based on FGLive-Comments, we develop Q-CamTuning, a multimodal large language model for livestreaming camera tuning. Its progressive perception-evidence-guidance framework learns quality-aware visual representations, enhances fine-grained reasoning with global-local evidence, and maps quality issues to camera-parameter adjustment directions. Extensive experimental results demonstrate that Q-CamTuning outperforms existing IQA models in both quality scoring and fine-grained image pair ranking. User study also validates its ability to recommend camera tuning suggestions.
BibTeX
@misc{bi2026q,
  author = {Yanchao Bi and Pengfei Chen and Yulong Yan and Qian Zhang and Biao Wang and Leida Li},
  title = {{Q-CamTuning: A Multimodal Large Language Model for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning}},
  year = {2026},
  eprint = {2611.03007},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.03007},
}
Figure