{"id":72260,"date":"2020-12-03T17:18:51","date_gmt":"2020-12-03T16:18:51","guid":{"rendered":"https:\/\/www.hiig.de\/?p=72260"},"modified":"2023-03-28T16:33:18","modified_gmt":"2023-03-28T14:33:18","slug":"when-scholars-sprint-bad-algorithms-are-on-the-run","status":"publish","type":"post","link":"https:\/\/www.hiig.de\/en\/when-scholars-sprint-bad-algorithms-are-on-the-run\/","title":{"rendered":"When scholars sprint, bad algorithms are on the run"},"content":{"rendered":"\n

Der erste Research Sprint des von der Mercator-Stiftung finanzierten Projekts zur <\/em>\u201eEthik der Digitalisierung<\/a>“hat die Ziellinie erreicht. Dreizehn internationale Fellows besch\u00e4ftigten sich mit den Herausforderungen, die mit dem Einsatz von KI in der Moderation von Online-Inhalten einhergehen. Nach zehn intensiven Wochen interdisziplin\u00e4rer Forschung geben wir einen \u00dcberblick \u00fcber die zentralen Ergebnisse.<\/i><\/p>\n\n

\n\n

In response to increasing public pressure to tackle hate speech and other challenging content, platform companies have turned to algorithmic content moderation systems. These automated tools promise to be more effective and efficient in identifying potentially illegal or unwanted\u00a0 material. But algorithmic content moderation also raises many questions – all of which eschew simple answers. Where is the line between hate speech and freedom of expression \u2013 and how to automate this on a global scale? Should platforms scale the use of AI tools for illegal online speech, like terrorism promotion, or also for regular content governance? Are platforms\u2019 algorithms over-enforcing against legitimate speech, or are they rather failing to limit hateful content on their sites? And how can policymakers ensure an adequate level of transparency and accountability in platforms\u2019 algorithmic content moderation processes?<\/p>\n\n

Research sprint within the framework of \u201cThe Ethics of Digitalisation\u201d<\/strong><\/h3>\n\n

These were just some of the issues that drove the research sprint on AI and content moderation hosted by the Alexander von Humboldt Institute for Internet and Society. The sprint, which took place virtually over the course of ten weeks from August until October 2020, was the first research format of the project \u201cThe Ethics of Digitalisation \u2013 from Principles to Practices\u201d under the patronage of the German Federal President Frank-Walter Steinmeier.\u00a0 This project, which will run until July 2022, aims to foster a global dialogue on the ethics of digitalisation by involving stakeholders from academia, civil society, policy, and the industry. The project comprises research sprints and smaller clinic formats hosted by several research institutes of the Global Network of Centers<\/a>. Main partners of the project are the Stiftung Mercator, the HIIG, the Berkman Klein Center at Harvard University, and the Digital Asia Hub.<\/p>\n\n

Thirteen fellows, nine countries, seven time zones<\/strong><\/h3>\n\n

In line with the project\u2019s interdisciplinary approach, the HIIG team led by Nadine Birner, Christian Katzenbach, Matthias C. Kettemann, Alexander Pirang and Friederike Stock,assembled a highly diverse group of participants for the first research sprint. They selected thirteen brilliant fellows working in nine different countries and across seven different time zones, whose academic expertise ranged from law and public policy to data science and digital ethics.<\/p>\n\n

The fellows formed working groups to address key challenges arising from the use of automation and machine learning in content moderation. They were mentored in this effort by Julia Reda (Gesellschaft f\u00fcr Freiheitsrechte, Berkman Klein Center), Mackenzie Nelson (AlgorithmWatch), and Juan Carlos de Martin (Politecnico di Torino, Berkman Klein Center). To engage with industry perspectives, the fellows also met with representatives from Facebook and Google. Most importantly, however, the fellows had intense discussions among themselves, which we \u2013 as scientific leads \u2013 found as captivating as thought-provoking.<\/p>\n\n

This is a sprint, not a marathon: three policy briefs to guide the way<\/strong><\/strong><\/h3>\n\n

This journey was challenging at times. Research usually feels more like a marathon than a sprint, yet, in our case, the time pressure was high right from the start. And mind you, all this took place virtually during a pandemic.<\/p>\n\n

The fellows more than met our high expectations, constantly pushing the boundaries of the research sprint\u2019s format with their motivation and intellectual curiosity. Starting with the premise that algorithmic content moderation is here to stay, the fellows identified glaring gaps in our knowledge of how platform companies automate content moderation processes. Moreover, they recognized that highly imperfect machines pose grave risks for fundamental rights, particularly freedom of expression. Against this background, the working groups produced policy briefs that make recommendations on how to address these challenges across the following key areas.<\/p>\n\n

\n\n

Meaningful transparency obligations: <\/strong>In order to overcome the current information gap, the fellows propose wide-ranging measures to establish a multi-level transparency regime, thus facilitating evidence-based platform regulation and society-wide debate about how algorithmic content moderation systems should be designed.<\/p>\n\n

Effective appeal mechanisms: <\/strong>Given a lack of redress against automated enforcement decisions, the fellows recommend imposing binding and enforceable obligations on platforms to provide users with effective appeal mechanisms. The proposals also recommend establishing an independent Ombudsperson with the powers to supervise and evaluate platforms\u2019 algorithmic content moderation practices.<\/p>\n\n

Principle-based algorithmic auditing: <\/strong>Lastly, the fellows identify algorithmic audits as the most promising mechanism for monitoring the risks associated with the use of AI in content moderation. In order to ensure carefully crafted legal mandates, the fellows recommend the four guiding principles of independence, access, publicity, and resources.<\/p>\n\n

For more details, we invite you to read the policy briefs here:<\/p>\n\n