5th Jun 2023


Racist algorithms and AI can't determine EU migration policy

  • If MEPs allow AI to be used to facilitate violence against people trying to reach Europe, states will be fundamentally undermining the right to seek asylum (Photo: Jannik, Unsplash)
Listen to article

Stranding people at sea and leaving them to drown instead of rescuing them. Decisions about people's lives in the hands of unreliable lie detector tests. Major decisions about security in the hands of algorithms.

These are just a few examples of the path we are going down — that EU legislators now have a rare chance to prevent.

Read and decide

Join EUobserver today

Become an expert on Europe

Get instant access to all articles — and 20 years of archives. 14-day free trial.

... or subscribe as a group

We have visited high-tech refugee camps in Greece, seen violent borders all over Europe, and spoken with hundreds of people who are at the sharp end of technologically-assisted brutality. AI in migration is increasingly used to make predictions, assessments, and evaluations based on racist assumptions it is programmed with.

But with upcoming, legislation to regulate Artificial Intelligence (the EU"s "AI Act") the EU has a chance to live its self-proclaimed values, set a global standard and draw red lines on the most harmful technologies.

Politicians have turned migration into a political weapon and the EU's policies are becoming increasingly violent: hardening of borders, increased deportation, empowering agencies like Frontex which have been repeatedly implicated in severe human rights abuses, and even condoning the arrest and incarceration of search-and-rescue volunteers, doctors, lawyers, and journalists.

Increasingly, surveillance and automated technologies are being tested out at borders and in migration procedures — with people seeking safety being treated as guinea pigs.

Biometric data collection

This technology often relies on the large-scale systematic collection of people's personal and biometric data. Enormous resources are invested in IT tools to store and manage colossal amounts of data.

The EU's privacy watchdog called out this machinery for side-stepping Europe's commitments to fundamental rights in the service of Fortress Europe.

In negotiations stepping up this week, the European Parliament will have a choice over which technologies it prohibits. They can make sure that the AI Act adequately regulates all harmful uses of this technology, and make a major difference to the lives of people-on-the-move and racialised people already living in Europe.

A coalition of civil society, academics, and international experts have been calling for amendments to the act for nearly a year, with nearly 200 signatories supporting much-needed changes and a new campaign lead by EDRi, AccessNow, PICUM, and the Refugee Law Lab called #ProtectNotSurveil to shed light on these issues.

The AI Act's blind spot on border violence undermines the entire act as a tool to regulate dangerous tech. Already, compromises are being made behind closed doors of the European Parliament that do not include the necessary bans in the migration context.

This is both harmful and shortsighted. In the absence of such bans, governments and institutions will develop and use invasive technologies that will put them at odds with regional and international laws.

Specifically, if MEPs allow AI to be used to facilitate violence against people trying to reach Europe, states will be fundamentally undermining the right to seek asylum.

Red lines

To protect the rights of all people, the AI Act must prohibit the use of individual risk assessments and profiling that uses personal and sensitive data; ban AI lie detectors in the migration context; prohibit the use of predictive analytics to facilitate pushbacks; and ban remote biometric identification and categorisation in public spaces, including in border and migration control.

The category of 'high-risk' must also be strengthened to include several uses of AI in the migration context, including biometric identification systems, and AI for monitoring and surveillance at borders.

Finally, the act needs stronger oversight and accountability measures that recognise the risks of inappropriate data sharing impacting people's fundamental human rights of mobility and asylum, and ensure that the EU's own migration databases are covered by the act.

Unless amended, the EU's AI Act fails to prevent irreversible harms in migration and in so doing it undermines its very purpose — protecting the rights of all people affected by the use of AI.

Technology is always political. It reflects the society that creates it and so can speed up and automate racism, discrimination, and systemic violence.

And unless we take action now, the EU's Artificial Intelligence Act will enable dangerous technology in migration and pave the way to a future where everyone's rights are threatened.

With EU border forces expanding their use of surveillance technology and racial profiling; and deaths and human rights abuses routine at EU borders; new AI systems can only supercharge current abuses and risk more lives.

Once it's in use there's no going back — and we all risk being dragged into the experiment. The act is a once-in-a-generation chance to ensure AI cannot be used for ill — the European Parliament must act to save it.

Author bio

Alyna Smith is deputy director at the Platform for International Cooperation on Undocumented Migrants (PICUM), Caterina Rodelli is EU policy analyst at Access Now, Sarah Chander of European Digital Rights (EDRi) and Petra Molnar of the Refugee Law Lab at York University.


The views expressed in this opinion piece are the author's, not those of EUobserver.

EU migration and asylum pact faces reality check

The EU wants to finalise the overhaul of the migration and asylum laws before the end of the current mandate in 2024. But big issues on solidarity remain unsolved, including in the European Parliament.

Big Tech's attempt to water down the EU AI act revealed

The launch of ChatGPT has sparked a worldwide debate on Artificial Intelligence systems. Amidst Big Tech's proclamations that these AI systems will revolutionise our daily lives, the companies are engaged in a fierce lobbying battle to water-down regulations.

The EU needs to foster tech — not just regulate it

The EU's ambition to be a digital superpower stands in stark contrast to the US — but the bigger problem is that it remains far better at regulation than innovation, despite decades of hand-wringing over Europe's technology gap.

Latest News

  1. Subcontracting rules allow firms to bypass EU labour rights
  2. Asylum and SLAPP positions in focus This WEEK
  3. Spanish PM to delay EU presidency speech due to snap election
  4. EU data protection chief launches Frontex investigation
  5. Madrid steps up bid to host EU anti-money laundering hub
  6. How EU leaders should deal with Chinese government repression
  7. MEPs pile on pressure for EU to delay Hungary's presidency
  8. IEA: World 'comfortably' on track for renewables target

Stakeholders' Highlights

  1. International Sustainable Finance CentreJoin CEE Sustainable Finance Summit, 15 – 19 May 2023, high-level event for finance & business
  2. ICLEISeven actionable measures to make food procurement in Europe more sustainable
  3. World BankWorld Bank Report Highlights Role of Human Development for a Successful Green Transition in Europe
  4. Nordic Council of MinistersNordic summit to step up the fight against food loss and waste
  5. Nordic Council of MinistersThink-tank: Strengthen co-operation around tech giants’ influence in the Nordics
  6. EFBWWEFBWW calls for the EC to stop exploitation in subcontracting chains

Stakeholders' Highlights

  1. InformaConnecting Expert Industry-Leaders, Top Suppliers, and Inquiring Buyers all in one space - visit Battery Show Europe.
  2. EFBWWEFBWW and FIEC do not agree to any exemptions to mandatory prior notifications in construction
  3. Nordic Council of MinistersNordic and Baltic ways to prevent gender-based violence
  4. Nordic Council of MinistersCSW67: Economic gender equality now! Nordic ways to close the pension gap
  5. Nordic Council of MinistersCSW67: Pushing back the push-back - Nordic solutions to online gender-based violence
  6. Nordic Council of MinistersCSW67: The Nordics are ready to push for gender equality

Join EUobserver

Support quality EU news

Join us