In the politics of the current international discussion on autonomous weapons taking place within the Convention on Certain Conventional Weapons (CCW), there has been increasing recognition that the matter of ‘human control’ or ‘human-machine interaction’ is the key area for collective work. In order to move discussion forward towards an effective response, states should focus on building understandings of what the detail and substance of these concepts are – and how these could be developed into the ‘operational and normative frameworks’ the CCW is mandated to discuss.

Though it is uncertain which meetings of the Group of Governmental Experts (GGE) on Lethal Autonomous Weapons Systems (LAWS) at the CCW might go ahead this year and how, with the coronavirus pandemic, the GGE’s chair is undertaking an exercise of inviting states to comment on how they would ‘operationalise’ the Guiding Principles for the GGE’s work on LAWS which were agreed in 2019. Though the Guiding Principles themselves were intended as a basis for further work rather than an agreement to implement, this gives countries the opportunity to set out more substantial positions that can help provide the groundwork for an international regulatory approach.

In this context, UK members of the Campaign to Stop Killer Robots wrote to the UK government to encourage the UK to elaborate its position, including by bringing together the contributions it has already made on human control. Though the UK government’s political position is currently not supportive of international legal regulation, such contributions on substance could help encourage common understandings of concepts and content amongst states.

Our letter is available here and reproduced below – and when a response is received, that will also be posted.

 

UK Campaign to Stop Killer Robots
c/o United Nations Association UK
3 Whitehall Court
London
SW1A 2EL

Rt Hon Ben Wallace MP
Secretary of State
Ministry of Defence
Whitehall
London SW1A 2HB

16.06.20

Dear Secretary of State,

As the UK Campaign to Stop Killer Robots, we are writing to encourage you to continue to listen to expertise of scientists.

Discussions in the Convention on Conventional Weapons (CCW) about lethal autonomous weapons systems have attracted strong interest since 2014, with a strong convergence on the essential need to retain human control over the use of force, and widespread recognition that building common understandings on what the nature of “human/machine interaction” should be when it comes to using weapons systems is a key area for further work by states. The goal of an international ban treaty is now sought by 30 states, as well as UN Secretary General António Guterres.

You will be aware that the Chair of the 2020 CCW talks on lethal autonomous weapons systems, Ambassador Janis Karklins of Latvia, has proposed that states participating in the Group of Governmental Experts (GGE) provide recommendations on the “development of aspects of the normative and operational framework” on such weapons. To that end, he has invited CCW commentaries or working papers focusing on “operationalizing” the CCW’s guiding principles.

To achieve progress, talks at the CCW must now focus on detail and substance. To build a shared conceptual framework, the Campaign encourages the UK government to submit to the CCW a paper that elaborates the government’s views in particular on the concept of human control, and how their desired normative and operational framework could be structured and implemented.

To this end the Campaign recommends the UK uses its CCW commentary to:

  1. Identify factors to help determine the necessary quality and extent of human control over weapons systems and the use of force;
  2. Express the UKs preferences with respect to developing a normative and operational framework and what its basic content should be – be it a legally-binding ban instrument or another form of regulation or agreement.

We are pleased to share with you the Campaign to Stop Killer Robots’ commentary submitted to Ambassador Karklins, which gives some more detail of our position on these issues.

We believe that the UK Government should focus on building recognition and engagement around the valuable content you have already contributed to the CCW on aspects of human control,[1] which could help stimulate greater convergence among states on useful points of substance and common understanding in this area.

We look forward to hearing your response and more detail about the approach the UK government will be taking in the talks this year.

The coalition would also appreciate an update on the status of the work being done with DSTL to produce a paper on human control that was slated for the end of May. We are eager to digest and discuss the new thinking you will be bringing to the GGE on this central issue.

We also note that the UN Secretary General’s 2020 report on the Protection of Civilians is the first since 2013 to highlight concerns over lethal autonomous weapons systems. We agree with the UN Secretary General that the use of these weapons would present a major challenge to the protection of civilians in armed conflict. The report finds that “all sides” see a need to retain human control or judgement over the use of force. It describes differences over the adequacy of existing international law and notes the growing number of states calling for a ban. We would be interested to hear the UK government’s reaction to these points.

The Coronavirus pandemic shows why we must pay attention to warnings from scientists and heed calls to collectively handle major threats to humanity, from climate change to killer robots. It makes exceptionally clear the importance of global cooperation.

Yours Sincerely,

Oliver Sprague
Program Director – Military Security and Policing
Amnesty International UK

Richard Moyes
Director
Article 36

Chris Cole
Director
Drone Wars UK

Robert Parker
Director of Policy and Communications
Saferworld

Stuart Parkinson
Executive Director
Scientists for Global Responsibility

Ben Donaldson
Head of Campaigns
United Nations Association UK

Taniel Yusef
International Liaison
Women’s International League for Peace and Freedom UK

[1] For our analysis of these, see Article 36, ‘From “pink eyed terminators” to a clear- eyed policy response? UK government policy on autonomy in weapons systems

 

Read more

The UK has acknowledged the need to define human control in CCW talks since 2017 as well as a general commitment to control and oversight. Two relatively recent publications that give indications of current military policy are a 2017 joint doctrine note and a 2018 MoD concept note on human machine teaming (which was brought out after a Lords enquiry criticised the definition of autonomous weapons used by the UK as too futuristic and out of step with others to be useful to international discussions).

Previous correspondence between with the government during 2017-18 can be found here, here and here.

 

Image: Campaign to Stop Killer Robots launch in Parliament Square, 2013 (© Campaign to Stop Killer Robots)

Posted in: Autonomous weapons, CCW, Latest posts and news,