TL;DR
Feature caching is a standard trick to speed up Diffusion Transformers (DiTs), but it often "silently" garbles rendered text while maintaining high image-level quality scores. This paper introduces GuideCache, a method that identifies and recomputes only the specific image tokens where guidance error is highest, restoring near-perfect text fidelity with a ~2.4x speedup.
What Problem Does This Paper Address?
Modern Diffusion Transformers like Z-Image and Qwen-Image have finally cracked the code on rendering long, legible text. However, generating high-resolution (1024²) images is computationally expensive, requiring dozens of passes through multi-billion parameter networks.
To speed things up, researchers use feature caching: instead of computing every step fully, they compute "anchor" steps and extrapolate the features for the steps in between. While standard metrics like CLIP score or FID suggest these caches are "lossless," the authors discovered a phenomenon they call silent text rewriting. As shown in Figure 1, accelerated models might keep the overall layout and "vibe" of an image perfectly, but they subtly swap characters or turn legible words into gibberish. Because standard metrics don't "read" the text, this failure goes unnoticed during evaluation.
Methods
The authors trace the root of the problem to Classifier-Free Guidance (CFG). In CFG, the model makes two predictions: an unconditional one ($u$) and a conditional one ($c$). The final output is a weighted combination: $v = u + w(c - u)$, where $(c - u)$ is the "guidance term" ($g$).
Their key discovery is that caching errors are not distributed equally. The guidance term $g$ is much harder to extrapolate than the shared part $u$, especially in text regions.
GuideCache addresses this with a surgical approach:
- Split Caching: It stores the shared part $u$ and the guidance term $g$ separately at anchor steps.
- Error Prediction: On cached steps, it doesn't just guess. It uses the finite difference of stored guidance terms to predict which tokens will have the highest extrapolation error.
- Selective Recomputation: It performs a "partial forward pass" to recompute both CFG branches only for the top-$k$ tokens with the highest predicted error. The rest of the tokens are extrapolated as usual.
Datasets
The authors evaluated their method on:
- LongText-Bench: A benchmark with 320 English and Chinese prompts specifically designed to test text rendering.
- DrawBench: Used to ensure general image quality (non-text) remains high.
- CVTG-2K: Used for calibrating the error-proportional budget.
- Models: They tested on Z-Image (6B) and Qwen-Image (20B) at $1024^2$ resolution.
Key Insights and Ideas
- Text Lives in the Guidance: Text regions have a significantly higher "guidance share" than the background. In Z-Image, the guidance term makes up 1.66x more of the output norm in text regions compared to texture-matched control regions.
- The Extrapolation Gap: Caches extrapolate the guidance term roughly twice as poorly in text as in other regions, while the shared "unconditional" part is extrapolated equally well everywhere.
- Causal Splice: By manually "splicing" exact guidance values into a cached run only within text boxes, the authors recovered 83% of the lost prompt fidelity. This proved that the guidance term is the primary failure point.
- Guidance as a Signal: You don't need OCR or attention maps to find the text. The magnitude and curvature of the guidance signal itself are excellent predictors of where the cache will fail, naturally highlighting text tokens.
Key Results
- Fidelity Recovery: On TaylorSeer (a state-of-the-art cache), GuideCache at a 2.4x speedup recovered 91% of the word accuracy lost by the plain cache on Z-Image and 73% on Qwen-Image.
- Efficiency: GuideCache achieves better text rendering than other token-wise methods like ToCa or TeaCache while staying much closer to the full model's original output (measured by lower LPIPS).
- Robustness: It works across different cache orders (0th-order reuse like FORA or 1st-order Taylor expansion). Even at high speedups (3.85x), it prevents the total collapse of text that occurs in standard caches.
Limitations and Future Work
- True CFG Dependency: GuideCache relies on the model having separate conditional and unconditional branches. It is not directly applicable to "guidance-distilled" models (like SDXL-Turbo or Lightning) that merge these steps.
- OCR-Centric Evaluation: The study uses OCR readers to score success. While effective for legibility, it doesn't account for more subjective "stylistic" rewriting or typographic nuances.
- Future Directions: The authors suggest that all future acceleration methods for DiTs should be evaluated specifically on their ability to preserve rendered text, as standard image-level metrics are insufficient "silent" witnesses to text degradation.
Summary updated