Introduction
Generative AI models have reached a level of visual sophistication that often masks underlying cultural biases. While text-to-image (T2I) generation has been widely studied, the iterative process of image-to-image (I2I) editing—where users attempt to refine or "fix" outputs—remains a black box regarding cultural fidelity. This research introduces a framework to audit these models, revealing a persistent "Global-North" default and a phenomenon termed "metric drift," where automated scores fail to capture the erosion of cultural authenticity.
The ECB Corpus and Evaluation Framework
To systematically evaluate cultural bias, the researchers developed the Exposing Cultural Blindspots (ECB) corpus. This dataset spans six countries—China, India, Kenya, Korea, Nigeria, and the U.S.—and covers 36 cultural subcategories across eight top-level domains such as Architecture, Food, and Art.
The evaluation pipeline utilizes era-aware prompting (traditional vs. modern) and multi-step I2I editing loops. To move beyond standard metrics, the authors implemented a Retrieval-Augmented Generation (RAG) based metric that verifies specific cultural markers against Wikipedia data, validated by a panel of 17 domain experts.
The "Global-North" Default and Metric Drift
A primary finding is the models' tendency to default to Western aesthetics when prompts are country-agnostic. Even when specific countries are mentioned, the models often produce "Westernized" versions of local traditions, failing to adapt phenotypes or architectural styles appropriately.
More critically, the study identifies Metric Drift. During iterative editing, standard metrics like CLIPScore often remain stable or improve, suggesting the model is successfully following the text prompt. However, human expert audits reveal a sharp decline in cultural quality—averaging a 44.2% drop in Human Quality Score (HQS) by the fifth edit. The models often resort to "sticker" editing, adding superficial cues like flags rather than deep, contextually accurate cultural transformations.
Results and Implications
The audit of five major model families, including FLUX.1 and Stable Diffusion 3.5, shows that while some models have higher initial alignment, all suffer from cultural decay during editing. Nigeria and the U.S. were found to be particularly vulnerable to quality loss in repetitive loops. Furthermore, occupational audits confirmed that deep-seated demographic biases persist, with high-status roles predominantly rendered as light-skinned males.
This work highlights the urgent need for generative models that move beyond superficial cultural markers toward deep, context-preserving representations. Future developments should focus on finer-grained cultural data and training objectives that penalize "shortcut" cues in favor of authentic diversity.
Summary updated