FemResThe Living Review

Data Feminism · Commentary

Artificial Intelligence and Gender Equality

Standfirst

UN Women connects biased AI outputs with the data, institutions and decisions that shape technology.

FemRes / June 28, 2024
Share this resource
X ↗Facebook ↗

01

Article analysis

A story-writing experiment opens a useful route into this UN Women explainer: artist Beyza Doğuç asks an AI to write about a doctor and a nurse, and it repeatedly assigns them stereotypical genders. The example makes an apparently technical question recognizable. A model can reproduce a familiar social hierarchy while presenting its output as an ordinary description of the world.

From an output to its conditions

The article links gender bias to training data, unequal participation in technology and decisions about governance. It brings together an artist’s experience, researcher Sola Mahfouz’s questions about equity and student Natacha Sangwa’s observations from a coding initiative. These are different kinds of testimony; an anecdote is not a controlled evaluation of every model, and a participant’s concern about health tools is not itself a clinical finding.

That distinction matters for feminist reading. The question is not simply whether a generated character is male or female. It is also who becomes visible as an expert, whose experience is recorded as data, and who can challenge a system when its decisions affect employment, credit or access to services. A better-looking sample output does not answer all of those questions.

Who can change a system?

Increasing women’s participation can broaden the questions a development team asks. Representation alone, however, cannot substitute for authority over deployment, resources and remedies. A person may be present in a workplace while lacking the power to halt a harmful product. Likewise, adding more examples to a dataset does not automatically resolve a discriminatory institutional use of that data.

The explainer’s attention to governance helps connect these levels. Readers can distinguish three demands: examine what a system produces, change how decisions about it are made, and establish ways for affected people to obtain redress. These demands can reinforce one another, but progress on one should not be treated as proof that all three have been met.

The article is an entry point into AI politics rather than a current benchmark ranking. Its discussion of the Global Digital Compact belongs to the negotiations taking place in 2024. A productive next step is to choose a concrete application and ask who defines acceptable error, who bears its cost, and whether refusal or appeal is possible.

02

Continue following this issue

01
Further reading / October 17, 2022

Not My AI: A Feminist Framework to Challenge Public-Sector Algorithmic Decisions

Joana Varon and Paz Peña

02
Further reading / June 22, 2022

Women’s Digital Inclusion in Latin America and the Caribbean

Iliana Vaca-Trigo; María Elena Valenzuela

03
Further reading / November 23, 2021

UNESCO Recommendation on the Ethics of Artificial Intelligence

UNESCO General Conference

Reader responses

Letters from readers

Respond to this article or add a source that belongs in the discussion.

Join the Discussion

Responses

Loading comments...

Support Us

If you find our content valuable, please consider supporting FemRes.

Support FemRes