Monday

20th May 2019

AI experts tell MEPs ban on 'killer robots' is unrealistic

A panel of defence and artificial intelligence (AI) experts on Wednesday (10 October) poured cold water on the feasibility of an international a ban on autonomous weapons systems, requested by a majority of the European Parliament last month.

Wendy Anderson, a former civil servant from the Obama administration and researcher at the Center for a New American Security, was assertive in her views.

Read and decide

Join EUobserver today

Support quality EU news

Get instant access to all articles — and 18 year's of archives. 30 days free trial.

... or join as a group

  • From left to right: MEP Clare Moody, Tim Sweijs, and Wendy Anderson. (Photo: European Parliament)

"I don't think bans work. I'm just a realist on this," said the American researcher.

She noted as an analogy that the non-proliferation treaty for nuclear weapons also did not prevent North Korea from developing atomic bombs.

Anderson said that semi-autonomous weapons were already being deployed by the US military, in particular the navy - but also pointed to China.

"I think it's irreversible. I just don't have any evidence or data to suggest that the opposite is true," she said.

"Regulations and controls will not prevent the development of AI. All you have to do is sit and meditate for 15 minutes on what the Chinese are doing to know that," Anderson said.

China is spending billions of investment on AI, with a goal to be world leader in the field by 2030.

Meanwhile, Russia's Military Industrial Committee has set a target for 2025, when it wants 30 percent of military equipment to be robotic.

"The AI train has left the station," said Anderson. "However we feel about it is actually irrelevant."

"The fact is realistically, we are already engaged - I don't really want to say 'in an arms race' because I don't want to use that sort of combative language or infer it - but certainly there is a competitive global arms race on the defence side for AI and who will out-advance the other."

The director of research at The Hague Centre for Strategic Studies, Tim Sweijs, used more indirect language, but also questioned the feasibility of a ban on autonomous weapons - known colloquially as 'killer robots'.

"If you look at military history, I think there has never been an occasion in which states have not taken up the chance to get a military competitive edge over their competitors if they could," said Sweijs.

"If you look at the adoption of machine rifles, or aircraft for military purposes, or unrestricted submarine warfare, or tanks rather than horses - states always adopted that technology when push came to shove. That is an observation that I make as a student of war," he said.

There are of course other experts who disagree - some of them do call for a ban - but the general tone of the panel in the European Parliament was sombre.

"I'm so terribly concerned, really, and I'm really much more concerned after this hearing," said Swedish Green MEP Bodil Valero.

While some suggest that automated weapons systems may decrease the number of human casualties in armed conflict, a large-scale deployment of AI weapons could also raise new problems.

"More precise targeting through AI may make war paradoxically more humane," said Sweijs, adding that AI could also improve medical treatment in the battle field.

But: "The political costs of going to war are likely to be lower if fewer humans are sent to the front, thereby taking away an important constraint of going to war," he added.

Moreover, one scary scenario is that an armed conflict between two AI systems speeds up beyond human understanding and control, leading to a 'flash war' analogous to the financial market phenomenon of 'flash crash'.

If one country decides to give full autonomous decision-making to a weapons system, it will create a dilemma for its opponents.

"Whether to keep the human in the loop and possibly face defeat or follow suit and take the human out of the loop," said Sweijs.

"Then not only the character but also the nature of war will drastically change, leading to a whole new era in human history where machines will fight against one another," he said, adding that this was likely to remain science fiction for now.

A third expert, Allan Dafoe, director of the Governance of AI programme at the University of Oxford, said it would be difficult to have arms control of autonomous weapons.

"It something we should pursue and discuss and explore, but it will be a great challenge, as we learned from history," he noted.

Priority list

Dafoe added that nevertheless autonomous weapons should be high on politicians' agenda.

"I think we should be having this conversation very seriously, more seriously than we are today," said Dafoe.

He encouraged MEPs to "push this up your priority list". There is still some way to go for that.

While a broad majority of MEPs (566 of 751) supported the call for an international ban on lethal autonomous weapons in a resolution last month, Wednesday's hearing was poorly attended.

Of the 30 members of the subcommittee on security and defence, which organised the hearing, only 13 attended parts of the hearing. There were no more than a handful of MEPs present at any time.

Except for centre-left MEP Clare Moody, who chaired the meeting, none were there from beginning to the end.

MEPs delay debate about 'killer robots'

"International regulation has to be agreed before the development gets completely out of hand," says one MEP as the European Parliament is due to vote on an EU defence fund that could see taxpayer-funded development of the controversial weapons systems.

Mogherini's tech experts talk more freely in secret

The EU's foreign service says there are no "records" of the Global Tech Panel meetings, but acknowledged foreign policy chief Federica Mogherini writes summary letters. Five MEPs worried about killer robots suggest the panel's composition is skewed.

Opinion

On Armistice Day, EU is still best gift we can give our children

While young people fought each other in 1918, young people in 2018 travel to study together under the Erasmus programme. But there is a risk of limiting our commemoration to representing the past through just speeches, museum exhibits and visits.

News in Brief

  1. EU flies rainbow flag on anti-homophobia day
  2. EU to freeze money and visas of foreign cyber-attackers
  3. EU reassures US on arms sales
  4. Use euros over dollars in energy contracts, France says
  5. UK cross-party Brexit talks collapse
  6. Climate activists occupy German-Russian gas pipeline
  7. Farage got €515,000 of private perks
  8. French EU commissioner urges Italy not to overspend

EU agrees draft copyright reform, riling tech giants

After marathon talks, EU negotiators agree on provisional copyright reform, requiring companies to filter content to prevent unauthorized work on their platform. Online platforms and open-internet advocates warn it will hurt the free flow of information.

Stakeholders' Highlights

  1. Vote for the EU Sutainable Energy AwardsCast your vote for your favourite EUSEW Award finalist. You choose the winner of 2019 Citizen’s Award.
  2. Nordic Council of MinistersEducation gets refugees into work
  3. Counter BalanceSign the petition to help reform the EU’s Bank
  4. UNICEFChild rights organisations encourage candidates for EU elections to become Child Rights Champions
  5. UNESDAUNESDA Outlines 2019-2024 Aspirations: Sustainability, Responsibility, Competitiveness
  6. Counter BalanceRecord citizens’ input to EU bank’s consultation calls on EIB to abandon fossil fuels
  7. International Partnership for Human RightsAnnual EU-Turkmenistan Human Rights Dialogue takes place in Ashgabat
  8. Nordic Council of MinistersNew campaign: spot, capture and share Traces of North
  9. Nordic Council of MinistersLeading Nordic candidates go head-to-head in EU election debate
  10. Nordic Council of MinistersNew Secretary General: Nordic co-operation must benefit everybody
  11. Platform for Peace and JusticeMEP Kati Piri: “Our red line on Turkey has been crossed”
  12. UNICEF2018 deadliest year yet for children in Syria as war enters 9th year

Stakeholders' Highlights

  1. Nordic Council of MinistersNordic commitment to driving global gender equality
  2. International Partnership for Human RightsMeet your defender: Rasul Jafarov leading human rights defender from Azerbaijan
  3. UNICEFUNICEF Hosts MEPs in Jordan Ahead of Brussels Conference on the Future of Syria
  4. Nordic Council of MinistersNordic talks on parental leave at the UN
  5. International Partnership for Human RightsTrial of Chechen prisoner of conscience and human rights activist Oyub Titiev continues.
  6. Nordic Council of MinistersNordic food policy inspires India to be a sustainable superpower
  7. Nordic Council of MinistersMilestone for Nordic-Baltic e-ID
  8. Counter BalanceEU bank urged to free itself from fossil fuels and take climate leadership
  9. Intercultural Dialogue PlatformRoundtable: Muslim Heresy and the Politics of Human Rights, Dr. Matthew J. Nelson
  10. Platform for Peace and JusticeTurkey suffering from the lack of the rule of law
  11. UNESDASoft Drinks Europe welcomes Tim Brett as its new president
  12. Nordic Council of MinistersNordic ministers take the lead in combatting climate change

Join EUobserver

Support quality EU news

Join us