Abstract
The successful application of neural methods to machine translation has realized huge quality advances for the community. With these improvements, many have noted outstanding challenges, including the modeling and treatment of gendered language. While previous studies have identified issues using synthetic examples, we develop a novel technique to mine examples from real world data to explore challenges for deployed systems. We use our method to compile an evaluation benchmark spanning examples for four languages from three language families, which we publicly release to facilitate research. The examples in our benchmark expose where model representations are gendered, and the unintended consequences these gendered representations can have in downstream application.
The Gender Problem in Machine Translation
Machine translation (MT) has a persistent "gender problem." When translating from a language with minimal gender marking, such as English, to languages with rich grammatical gender like Spanish, German, or Russian, MT systems are often forced to "choose" a gender for neutral terms. For example, the English word "doctor" might be translated as el médico (masculine) or la médica (feminine) in Spanish.
Historically, research into these biases has relied on synthetic datasets—hand-crafted templates like "The [PROFESSION] went to work." While these are useful for controlled testing, they fail to capture the nuance and complexity of real-world language. Moreover, they are limited by the researchers' own preconceptions. This paper introduces an automated pipeline to discover these "at-risk" sentences using naturally occurring text from the web.
Methodology: BERT-Based Perturbations
The authors developed a multi-stage pipeline to identify gender issues without requiring exhaustive manual word lists. The core innovation lies in using BERT as a masked language model to suggest substitutes for human entities in real-world sentences mined from the r/Career subreddit.
The pipeline follows these steps:
- Filtering: Real-world sentences are filtered to find those containing exactly one human entity, excluding those with existing gendered English terms (like "mother").
- Perturbation via BERT: BERT suggests substitutes for the human entity. For instance, if the original sentence mentions a "mechanic," BERT might suggest "nurse" as a contextual substitute.
- Translation: Both the original and perturbed sentences are translated into target languages (French, German, Spanish, and Russian) using a production MT system.
- Alignment and Gender Identification: The pipeline aligns source and target tokens to find the translated entity and uses a morphological analyzer to determine its grammatical gender.
- Identifying "At-Risk" Pairs: If the MT system assigns different genders to the two sentences in a pair (e.g., translating "doctor" as masculine but "nurse" as feminine in the same context), the pair is flagged as "at risk" for gender bias.
Key Insights and Results
By using BERT to suggest substitutions, the authors discovered biased entities that are often overlooked in manual lists. For example, they found that "fighter" is strongly associated with masculine translations—a discovery enabled by their automated approach.
The Masculine Default
In the "not at-risk" group (where the gender did not flip), there was an overwhelming prior for masculine translations across almost all terms. This suggests that MT systems default to masculine forms unless a specific stereotype (like "nurse") triggers a feminine translation.
Quantifying the Bias
The study confirmed that "nurse" and "secretary" are the most consistently feminine-translated forms across languages, aligning with real-world labor statistics. Conversely, "manager" is overwhelmingly masculine.
As shown in the data, the bias is extreme. For "manager" in French, the ratio was 8:0 (purely masculine) in the at-risk group, while in the negative (not at-risk) group, the ratio was a staggering 685:1.
Challenges and Future Work
The authors highlighted the issue of "fixed grammatical gender" as a significant hurdle. Some words, like the French victime (victim), are always feminine regardless of the person's actual gender. These "false positives" represent a challenge for automated detection. Future work may focus on perturbing adjectives or verbs, where gender marking is more flexible, and expanding the study to more diverse language pairs and text genres beyond career discussions.
Summary updated