Share Bias

Error Categories

Incorrect pronoun(s)

Name:	Incorrect pronoun(s)
Type:	Error Category
Description:	The source contains a pronoun that is incorrectly translated in the target.
Example:	Katharina Freese dirige el Instituto de Física Teórica de Estocolmo, su área de especialización es la materia oscura. -> Katharina Freese heads the Institute for Theoretical Physics in Stockholm, his area of expertise is dark matter.

Incorrect grammatical gender

Name:	Incorrect grammatical gender
Type:	Error Category
Description:	The MT output contains word(s) of a wrong gender for the person being described.
Example:	Marie Curie was born in Poland. The renowned scientist received the Nobel Prize twice. -> Marie Curie wurde in Polen geboren. Der berühmte Wissenschaftler hat zweimal den Nobelpreis gewonnen.

Other

Bias Categories

Stereotyping based on gender due to profession

Name:	Stereotyping based on gender due to profession
Type:	Bias Category
Description:	A gender-neutral profession in the source sentence is translated in a gender-stereotypical way in the target.
Example:	'The doctor' is translated by a masculine noun, 'the nurse' is translated by a feminine noun.

Stereotyping based on gender due to adjectives

Name:	Stereotyping based on gender due to adjectives
Type:	Bias Category
Description:	A gender-neutral word in the source sentence is translated in a gender-stereotypical way in the target due to the presence of a stereotypical gender association of an adjective.
Example:	'The pretty professor' translated as being a woman, 'the smart professor' translated as being a man.

Stereotyping based on gender due to trigger words in broader context

Name:	Stereotyping based on gender due to trigger words in broader context
Type:	Bias Category
Description:	A gender-neutral word in the source sentence is translated in a gender-stereotypical way in the target because of the presence of a stereotypical gender association of the broader context.
Example:	The word is translated as female when the sentence contains words like 'yoga' or 'gossiping', the word is translated as male when the sentence contains words like 'hammer' or 'gym'.

Underrepresentation due to generic masculine

Name:	Underrepresentation due to generic masculine
Type:	Bias Category
Description:	The generic masculine is used when referring to a group of people or a person of unknown gender.
Example:	The students -> die Studenten

Underrepresentation of non-binary people

Name:	Underrepresentation of non-binary people
Type:	Bias Category
Description:	When translating an ambiguous or gender-inclusive source sentence, the MT output contains only masculine and feminine forms, not recognising the existence of non-binary people.
Example:	The students -> die Studenten (masculine) und Studentinnen (femine)

Other

All submissions are stored in our database and evaluated for correctness. Accepted submissions are publicly available in a downloadable dataset. Please do not make any submissions containing personal info.