Friday

29th Sep 2023

AI must have human oversight, MEPs recommend

  • The EU’s regulatory framework for artificial intelligence should make it possible for consumers to seek human review when mistakes appear as a result of automated decisions (Photo: Ars Electronica/Vanessa Graf)

Developments in artificial intelligence and automated decision-making by computer algorithms should always require human oversight, according to the European Parliament's internal market committee (IMCO) on Thursday (23 January), which passed a draft resolution aimed at ensuring humans remain in control of the technology.

Automated decision-making systems (ADMs) - technical systems that replace human decision making - are being used by public and private entities for tasks from recruiting to predictive policing, and are most widely-used in the US.

Read and decide

Join EUobserver today

Become an expert on Europe

Get instant access to all articles — and 20 years of archives. 14-day free trial.

... or subscribe as a group

However, according to the resolution, "humans must always be ultimately responsible for, and able to overrule, decisions" that are taken by new technologies, especially in medical, legal and accounting professions.

For the banking sector, the committee calls for a regulatory framework that ensures independent supervision of automated decision-making systems by qualified professionals in cases where the public interest is at stake.

This framework should also make it possible for consumers to seek human review when mistakes appear as a result of using this type of new technologies.

Likewise, automated decision-making systems should only use high-quality and unbiased data sets and "explainable and unbiased algorithms" to guarantee trust and acceptance, the resolution states.

"We have to make sure that consumer protection and trust is ensured and that the data sets used in automated decision-making systems are of high-quality and are unbiased," said Belgian MEP Petra De Sutter (Greens/EFA), who chairs the IMCO committee.

Following the provisions of the General Data Protection Regulation (GDPR) regarding explainability, MEPs also stressed that consumers should be "properly informed about how [this technology] functions, about how to reach a human with decision-making powers, and about how the system's decisions can be checked and corrected".

However, explaining in layman's terms the results and functionalities of large and complex technical models might be problematic.

This resolution, which was initiated by Green MEP Alexandra Geese, marks the parliament's first official position on the safeguards needed for the deployment and implementation of ADMs.

"All algorithmic systems must be checked for their legality and neutrality according to a risk model. If a discriminatory bias cannot be remedied, such fundamental rights-violating systems must not be used in Europe," Geese wrote for the German newspaper Tagesspiegel.

Additionally, MEPs called on the European Commission to ensure that the EU's rules on safety and liability for products and services are fit for purpose in the digital age - what it is already part of the commission's white paper for AI.

The text approved by the committee will be voted on the next plenary session by all MEPs, ahead of the commission's announcement for a European approach to AI expected on 19 February.

Magazine

The challenge of artificial intelligence

The fast-growing impact of artificial intelligence will be the biggest challenge for business and consumers in Europe's single market of tomorrow.

EU warned over fast-tracking facial recognition

A new report of the European Agency for Fundamental Rights calls for "a clear legal framework" to regulate facial recognition technologies, saying that collecting facial images of individuals without their consent can harm people's dignity.

Analysis

EU plan on AI: new rules, better taxes

The bloc wants to become a global leader in innovation in the data economy and AI. However, proportional legislation, better data-availability and huge invesment will be needed across the EU to compete with China and the US.

Opinion

Why EU will find it difficult to legislate on AI

The private sector, governments, academia, and civil society have all been calling for ethical guidelines in AI development - but these discussions remain vague, open to interpretation, non-universal, and most importantly, unenforceable.

AI will destroy more female jobs than male, study finds

About four percent of global female employment is subject to potential automation through generative AI technologies, compared to only 1.4 percent of male employment. The trend is even more pronounced in high-income countries, a new study reveals.

Column

EU lobbying clean-up — what happened to that?

Six months after Qatargate, as institutional inertia and parliamentary privileges weigh in, the sense of gravity and collective resolve have all but disappeared. MEPs show little enthusiasm for reform of the rules that today allow them significant outside paid activities.

Latest News

  1. Poland's culture of fear after three years of abortion 'ban'
  2. Time for a reset: EU regional funding needs overhauling
  3. Germany tightens police checks on Czech and Polish border
  4. EU Ombudsman warns of 'new normal' of crisis decision-making
  5. How do you make embarrassing EU documents 'disappear'?
  6. Resurgent Fico hopes for Slovak comeback at Saturday's election
  7. EU and US urge Azerbijan to allow aid access to Armenians
  8. EU warns of Russian 'mass manipulation' as elections loom

Stakeholders' Highlights

  1. International Medical Devices Regulators Forum (IMDRF)Join regulators, industry & healthcare experts at the 24th IMDRF session, September 25-26, Berlin. Register by 20 Sept to join in person or online.
  2. UNOPSUNOPS begins works under EU-funded project to repair schools in Ukraine
  3. Georgia Ministry of Foreign AffairsGeorgia effectively prevents sanctions evasion against Russia – confirm EU, UK, USA
  4. International Medical Devices Regulators Forum (IMDRF)Join regulators & industry experts at the 24th IMDRF session- Berlin September 25-26. Register early for discounted hotel rates
  5. Nordic Council of MinistersGlobal interest in the new Nordic Nutrition Recommendations – here are the speakers for the launch
  6. Nordic Council of Ministers20 June: Launch of the new Nordic Nutrition Recommendations

Stakeholders' Highlights

  1. International Sustainable Finance CentreJoin CEE Sustainable Finance Summit, 15 – 19 May 2023, high-level event for finance & business
  2. ICLEISeven actionable measures to make food procurement in Europe more sustainable
  3. World BankWorld Bank Report Highlights Role of Human Development for a Successful Green Transition in Europe
  4. Nordic Council of MinistersNordic summit to step up the fight against food loss and waste
  5. Nordic Council of MinistersThink-tank: Strengthen co-operation around tech giants’ influence in the Nordics
  6. EFBWWEFBWW calls for the EC to stop exploitation in subcontracting chains

Join EUobserver

Support quality EU news

Join us