When machine learning researchers evaluate whether an AI model understands "culture," they face a fundamental measurement problem: culture is fluid, invisible, and notoriously difficult to quantify. To make the problem computationally tractable, the field has historically relied on convenient shortcuts. If a text is written in Farsi, a photo is geotagged in Nairobi, or a user logs in from an IP address in Seoul, the data is frequently labeled with a corresponding national or linguistic proxy.
This approach—treating geopolitical borders, language, or income levels as direct stand-ins for cultural identity—is known as cultural proxy simplification. While computationally convenient, a growing body of research demonstrates that this reductionism introduces severe biases, flattens human diversity, and fundamentally undermines how we train and evaluate culturally competent AI.
The Monolithic Fallacy: Why Borders Do Not Equal Cultures
The core flaw of using national borders as a proxy for culture is that it treats highly heterogeneous populations as monoliths. Geopolitical boundaries are historical and political constructs; human traits and traditions, by contrast, rarely snap perfectly to customs checkpoints.
As Mohammad Tariqul Islam et al. demonstrated in their geographic analysis of human appearance in the Large-scale geo-facial image analysis dataset, human traits and visual features exist along continuous geographic gradients rather than discrete political divisions. When machine learning models categorize human data strictly by country, they ignore these continuous gradients and oversimplify complex visual patterns. Similarly, in audio processing, Maria Panteli et al. found that using geopolitical boundaries to label world music introduces significant noise into supervised learning models because political borders frequently misalign with actual ethnic and stylistic musical boundaries in Learning a Feature Space for Similarity in World Music.
By forcing a complex distribution of human behaviors into a single national label, models rely on what statisticians call point estimations. As Aida Ramezani et al. argue in Knowledge of cultural moral norms in large language models, flattening a country's diverse moral beliefs into a single national average completely obscures the massive variance that exists between urban and rural populations or different ethnic groups within that nation.
When models are trained on these flattened averages, they inevitably default to majoritarian perspectives. Shaily Bhatt notes in Extrinsic Evaluation of Cultural Competence in Large Language Models that treating countries as uniform cultural blocks risks reinforcing majoritarian stereotypes and erasing the subcultures and intersectional identities that define a nation's internal diversity.
The Erasure of Intra-National and Intersectional Diversity
When an AI model assumes that every individual within a geographic boundary shares the same dominant culture, it fails to serve minority groups, regional subcultures, and global diasporas. This creates a distinct form of aggregation bias.
[Actual Population] ───► Contains: Regional Subcultures, Ethnic Minorities, Diasporas
│
(Flattened by National Proxy)
▼
[AI Model Evaluation] ──► Sees Only: Monolithic Majoritarian Identity
This erasure manifests across multiple domains:
- Social Norms and Taboos: AI systems frequently over-generalize dominant cultural or religious practices to an entire citizenry. For instance, Hamidreza Saffari et al. discovered that state-of-the-art large language models (LLMs) fail to capture intra-cultural granularity, often incorrectly assuming that religious or ethnic minority groups follow the dominant religious rituals of their geographic region in Can I Introduce My Boyfriend to My Grandmother? Evaluating Large Language Models Capabilities on Iranian Social Norm Classification.
- Hate Speech and Sensitive Content: Perceptions of offense and hate speech are deeply localized. Nayeon Lee et al. showed that defining culture solely by nationality marginalizes the specific linguistic and social norms of minority groups within English-speaking nations in Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis. Similarly, Minh Duc Bui et al. found that national proxies fail to account for the regional, ethnic, or socioeconomic variations that dictate how individuals perceive sensitive content in Multi³Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Models.
- Intersectionality: Geography is only one layer of identity. Agrima Seth et al. point out that reductionist geographic boundaries completely miss intersectional layers like religion, caste, and gender in DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures.
- Diasporas and Migration: Digital and physical mobility further break the link between location and culture. Tim Sheerman-Chase et al. note that using IP addresses or geographic location as a proxy for culture completely overlooks an individual's upbringing and migration history in Cultural factors in the regression of non-verbal communication perception. In public health and social science data, Qiwei Lin et al. show that relying on country of origin leads to severe misclassifications when individuals belong to a diaspora or an ethnic group distinct from the majority population of their origin country in Enabling disaggregation of Asian American subgroups: a dataset of Wikidata names for disparity estimation.
The Risk of Cultural Essentialism
When researchers attempt to fix these biases, they often fall into a second trap: cultural essentialism. In an attempt to build culturally aware benchmarks, developers frequently codify cultures into rigid, predefined taxonomies or multiple-choice questions.
However, as Lingzhi Shen et al. argue in CALM: Culturally Self-Aware Language Models, relying on fixed frameworks or binary dimensions (such as strictly dividing the world into "collectivist" versus "individualist" societies) oversimplifies complex social identities and inadvertently reinforces binary stereotypes.
This risk is particularly high when designing evaluation benchmarks. Christabel Acquaye et al. emphasize that the very process of codifying cultural norms into multiple-choice questions carries the danger of essentializing fluid social behaviors into static rules in Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US. Culture is a dynamic, evolving spectrum; treating it as a fixed database of facts causes models to generate narrow, stereotypical outputs rather than capturing genuine, lived experiences.
Moving Toward Granular and Dynamic Cultural Modeling
To overcome the limitations of geographic reductionism, recent work proposes a shift in how AI models represent and evaluate human diversity.
1. Disaggregating Data and Expanding Dimensions
Instead of relying on country of origin as a catch-all proxy, newer evaluation frameworks advocate for multi-dimensional, granular cultural markers. The authors of CuRe: Cultural Gaps in the Long Tail of Text-to-Image Systems suggest explicitly incorporating sub-national dimensions like religion and spoken language to achieve a more nuanced representation. By moving away from broad geographic regions, models can be evaluated on the specific nuances of localized commonsense rather than homogenized regional profiles.
2. Shifting from Intrinsic Knowledge to Extrinsic Performance
Early cultural evaluations focused on "intrinsic" knowledge—asking models to answer survey questions about values or identify cultural facts. However, Shaily Bhatt demonstrates that a model's ability to adjust its vocabulary based on nationality correlates poorly with actual psychological frameworks. The field is therefore shifting toward "extrinsic" evaluation: measuring how models actually reason, generate text, or interpret images in culturally complex scenarios.
3. Modeling Culture as a Dynamic Reasoning Process
Rather than treating culture as a static lookup table of customs, recent architectures treat culture as a dynamic, reflective process. For example, the framework developed by Lingzhi Shen et al. disentangles cultural signals from core task logic, allowing models to use self-correction loops to reason about social contexts dynamically.
By moving past rigid national proxies and embracing the fluid, intersectional reality of human identity, the machine learning community can build models that truly understand the nuances of global cultures, rather than merely memorizing their borders.
Key Foundational Work
Cultural factors in the regression of non-verbal communication perception (2011) — contributed 1 concept elements to this direction.
Large-scale geo-facial image analysis (2015) — contributed 1 concept elements to this direction.