Thursday

28th Mar 2024

Opinion

Racist algorithms and AI can't determine EU migration policy

  • If MEPs allow AI to be used to facilitate violence against people trying to reach Europe, states will be fundamentally undermining the right to seek asylum (Photo: Jannik, Unsplash)
Listen to article

Stranding people at sea and leaving them to drown instead of rescuing them. Decisions about people's lives in the hands of unreliable lie detector tests. Major decisions about security in the hands of algorithms.

These are just a few examples of the path we are going down — that EU legislators now have a rare chance to prevent.

Read and decide

Join EUobserver today

Get the EU news that really matters

Instant access to all articles — and 20 years of archives. 14-day free trial.

... or subscribe as a group

We have visited high-tech refugee camps in Greece, seen violent borders all over Europe, and spoken with hundreds of people who are at the sharp end of technologically-assisted brutality. AI in migration is increasingly used to make predictions, assessments, and evaluations based on racist assumptions it is programmed with.

But with upcoming, legislation to regulate Artificial Intelligence (the EU"s "AI Act") the EU has a chance to live its self-proclaimed values, set a global standard and draw red lines on the most harmful technologies.

Politicians have turned migration into a political weapon and the EU's policies are becoming increasingly violent: hardening of borders, increased deportation, empowering agencies like Frontex which have been repeatedly implicated in severe human rights abuses, and even condoning the arrest and incarceration of search-and-rescue volunteers, doctors, lawyers, and journalists.

Increasingly, surveillance and automated technologies are being tested out at borders and in migration procedures — with people seeking safety being treated as guinea pigs.

Biometric data collection

This technology often relies on the large-scale systematic collection of people's personal and biometric data. Enormous resources are invested in IT tools to store and manage colossal amounts of data.

The EU's privacy watchdog called out this machinery for side-stepping Europe's commitments to fundamental rights in the service of Fortress Europe.

In negotiations stepping up this week, the European Parliament will have a choice over which technologies it prohibits. They can make sure that the AI Act adequately regulates all harmful uses of this technology, and make a major difference to the lives of people-on-the-move and racialised people already living in Europe.

A coalition of civil society, academics, and international experts have been calling for amendments to the act for nearly a year, with nearly 200 signatories supporting much-needed changes and a new campaign lead by EDRi, AccessNow, PICUM, and the Refugee Law Lab called #ProtectNotSurveil to shed light on these issues.

The AI Act's blind spot on border violence undermines the entire act as a tool to regulate dangerous tech. Already, compromises are being made behind closed doors of the European Parliament that do not include the necessary bans in the migration context.

This is both harmful and shortsighted. In the absence of such bans, governments and institutions will develop and use invasive technologies that will put them at odds with regional and international laws.

Specifically, if MEPs allow AI to be used to facilitate violence against people trying to reach Europe, states will be fundamentally undermining the right to seek asylum.

Red lines

To protect the rights of all people, the AI Act must prohibit the use of individual risk assessments and profiling that uses personal and sensitive data; ban AI lie detectors in the migration context; prohibit the use of predictive analytics to facilitate pushbacks; and ban remote biometric identification and categorisation in public spaces, including in border and migration control.

The category of 'high-risk' must also be strengthened to include several uses of AI in the migration context, including biometric identification systems, and AI for monitoring and surveillance at borders.

Finally, the act needs stronger oversight and accountability measures that recognise the risks of inappropriate data sharing impacting people's fundamental human rights of mobility and asylum, and ensure that the EU's own migration databases are covered by the act.

Unless amended, the EU's AI Act fails to prevent irreversible harms in migration and in so doing it undermines its very purpose — protecting the rights of all people affected by the use of AI.

Technology is always political. It reflects the society that creates it and so can speed up and automate racism, discrimination, and systemic violence.

And unless we take action now, the EU's Artificial Intelligence Act will enable dangerous technology in migration and pave the way to a future where everyone's rights are threatened.

With EU border forces expanding their use of surveillance technology and racial profiling; and deaths and human rights abuses routine at EU borders; new AI systems can only supercharge current abuses and risk more lives.

Once it's in use there's no going back — and we all risk being dragged into the experiment. The act is a once-in-a-generation chance to ensure AI cannot be used for ill — the European Parliament must act to save it.

Author bio

Alyna Smith is deputy director at the Platform for International Cooperation on Undocumented Migrants (PICUM), Caterina Rodelli is EU policy analyst at Access Now, Sarah Chander of European Digital Rights (EDRi) and Petra Molnar of the Refugee Law Lab at York University.

Disclaimer

The views expressed in this opinion piece are the author's, not those of EUobserver.

Magazine

Expansion of data-collection is eroding EU values and rights

The EU is trampling on its own values and peoples' rights to privacy and data-protection as it expands its collection of data in areas such as migration, the EU's data protection advisor tells Nikolaj Nielsen.

EU migration and asylum pact faces reality check

The EU wants to finalise the overhaul of the migration and asylum laws before the end of the current mandate in 2024. But big issues on solidarity remain unsolved, including in the European Parliament.

Big Tech's attempt to water down the EU AI act revealed

The launch of ChatGPT has sparked a worldwide debate on Artificial Intelligence systems. Amidst Big Tech's proclamations that these AI systems will revolutionise our daily lives, the companies are engaged in a fierce lobbying battle to water-down regulations.

Column

EU's Gaza policy: boon for dictators, bad for democrats

While they woo dictators and autocrats, EU policymakers are becoming ever more estranged from the world's democrats. The real tragedy is the erosion of one of Europe's key assets: its huge reserves of soft power, writes Shada Islam.

Latest News

  1. 'Swiftly dial back' interest rates, ECB told
  2. Moscow's terror attack, security and Gaza
  3. Why UK-EU defence and security deal may be difficult
  4. EU unveils plan to create a European cross-border degree
  5. How migrants risk becoming drug addicts along Balkan route
  6. 2024: A Space Odyssey — why the galaxy needs regulating
  7. Syrian mayor in Germany speaks out against AfD
  8. Asian workers pay price for EU ship recycling

Stakeholders' Highlights

  1. Nordic Council of MinistersJoin the Nordic Food Systems Takeover at COP28
  2. Nordic Council of MinistersHow women and men are affected differently by climate policy
  3. Nordic Council of MinistersArtist Jessie Kleemann at Nordic pavilion during UN climate summit COP28
  4. Nordic Council of MinistersCOP28: Gathering Nordic and global experts to put food and health on the agenda
  5. Friedrich Naumann FoundationPoems of Liberty – Call for Submission “Human Rights in Inhume War”: 250€ honorary fee for selected poems
  6. World BankWorld Bank report: How to create a future where the rewards of technology benefit all levels of society?

Stakeholders' Highlights

  1. Georgia Ministry of Foreign AffairsThis autumn Europalia arts festival is all about GEORGIA!
  2. UNOPSFostering health system resilience in fragile and conflict-affected countries
  3. European Citizen's InitiativeThe European Commission launches the ‘ImagineEU’ competition for secondary school students in the EU.
  4. Nordic Council of MinistersThe Nordic Region is stepping up its efforts to reduce food waste
  5. UNOPSUNOPS begins works under EU-funded project to repair schools in Ukraine
  6. Georgia Ministry of Foreign AffairsGeorgia effectively prevents sanctions evasion against Russia – confirm EU, UK, USA

Join EUobserver

EU news that matters

Join us