Skip to content
169 HD – AI is neutral – 1
10 May 2021| doi: 10.5281/zenodo.4745653

Myth: AI will end discrimination

As an allegedly objective state-of-the-art technology, there are hopes that AI may overcome human weaknesses. Some people believe that AI might be able to gain privileged access to knowledge, free of human biases and errors and thus end discrimination by realizing all in all fair and objective decisions.
We approach the de-mystification of this claim by looking at concrete examples of how AI (re)produces inequalities and connect those to several aspects which help to illustrate socio-technical entanglements. Drawing on a range of critical scholars, we argue that this simplifying myth might even be dangerous and point out what to do about it.

Myth

AI will end discrimination (or is at least less discriminatory than fallible and unfair human beings).

As part of society, AI is deeply rooted in it and as such not separable from structures of discrimination. Due to this socio-technical embeddedness, AI cannotmake discrimination disappear by itself.

Watch the talk

Material

Presentation slides
CORE READINGS

Benjamin, R. (2019a): Captivating Technology. Race, Carceral Technoscience, and Liberatory Imagination in Everyday Life. Durham: Duke University Press.

Benjamin, R. (2019b): Race after technology: abolitionist tools for the new Jim code. Cambridge: UKPolity.

Criado-Perez, C. (2020): Unsichtbare Frauen. Wie eine von Daten beherrschte Welt die Hälfte der Bevölkerung ignoriert. München: btb Verlag.

D’Ignazio, C.; Klein, L. F. (2020): Data Feminism.
Strong ideas series Cambridge, Massachusetts London, England: The MIT Press.

Buolamwini, J.; Gebru, T. (2018): Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In: Proceedings of Machine Learning Research 81. Paper präsentiert bei der Conference on Fairness, Accountability, and Transparency, 1–15.

ADDITIONAL READINGS

Eubanks, V. (2017): Automating inequality. How high-tech tools profile, police, and punish the poor. First Edition. New York, NY: St. Martin’s Press

O’Neil, C. (2016): Weapons of math destruction. How big data increases inequality and threatens democracy. First edition. New York: Crown.

Zuboff, S. (2020): The Age of Surveillance Capitalism. The Fight for a Human Future at the new Frontier of Power. First Trade Paperback Edition. New York: PublicAffairs.

Cave, S.; Dihal, K. (2020): The Whiteness of AI. In: Philosophy & Technology 33(4), 685–703.
UNICORN IN THE FIELD

Epicenter.works
AlgorithmWatch
netzforma* e.V.

About the authors

Miriam Fahimi, Digital Age Research Center (D!ARC), University of Klagenfurt

Miriam, MA BSc is Marie Skłodowska-Curie Fellow within the ITN-ETN Marie Curie Training Network „NoBIAS – Artificial Intelligence without Bias“, funded by the EU through Horizon 2020 at the Digital Age Research Center (D!ARC), University of Klagenfurt. She is also a PhD candidate in Science and Technology Studies at the University of Klagenfurt, supervised by Katharina Kinder-Kurlanda. Her research interests include algorithmic fairness, philosophy of science, science and technology studies, and feminist theory.

@feminasmus

Phillip Lücking, Gender/Diversity in Informatics Systems (GeDIS), University of Kassel

Phillip is a research associate and PhD candidate at the University of Kassel. He graduated from Bielefeld University in Intelligent Systems (MSc). His research interest encompasses machine learning and robotics in relation to their societal impacts, as well as questions on how these technologies can be utilized for social good.


Why, AI?

This post is part of our project “Why, AI?”. It is a learning space which helps you to find out more about the myths and truths surrounding automation, algorithms, society and ourselves. It is continuously being filled with new contributions.

Explore all myths


This post represents the view of the author and does not necessarily represent the view of the institute itself. For more information about the topics of these articles and associated research projects, please contact info@hiig.de.

HIIG Digest

HIIG-Newsletter-Header

A monthly selection of new blog posts and videos by email.

Platform governance

How can the goals of corporations and the values of society be reconciled on online platforms?

Dossier erkunden
Du siehst eine Tastatur auf der eine Taste rot gefärbt ist und auf der „Control“ steht. Eine bildliche Metapher für die Regulierung von digitalen Plattformen im Internet und Data Governance. You see a keyboard on which one key is coloured red and says "Control". A figurative metaphor for the regulation of digital platforms on the internet and data governance.

Data governance

How can the technical, organisational and regulatory mechanisms of data sharing and use serve the public interest?

Dossier erkunden
Du siehst Eisenbahnschienen. Die vielen verschiedenen Abzweigungen symbolisieren die Entscheidungsmöglichkeiten von Künstlicher Intelligenz in der Gesellschaft. Manche gehen nach oben, unten, rechts. Manche enden auch in Sackgassen. Englisch: You see railway tracks. The many different branches symbolise the decision-making possibilities of artificial intelligence and society. Some go up, down, to the right. Some also end in dead ends.

Artificial intelligence and society

How can we better understand the complex and reciprocal relationship between AI systems and social processes?

Dossier erkunden

Digitalisation and sustainability

How can technology be used responsibly, taking into account social, economic and ecological dimensions?

Dossier erkunden
Man sieht einen leeren Büroraum ohne Möbel und braunen Teppichboden. Das Bild steht sinnbildlich für die Frage, wie die Arbeit der Zukunft und digitales Organisieren und Zukunft unseren Arbeitsplatz beeinflusst. You see an empty office room without furniture and brown carpeting. The image is emblematic of the question of how the work of the future and digital organising and the future will influence our workplace.

Digital future of the workplace

How will digital organisation, digitalisation, and AI in the workplace transform the world of work?

Dossier erkunden