Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-16T11:56:42.835Z Has data issue: false hasContentIssue false

Toward a Balanced Approach: Bridging the Military, Policy, and Technical Communities

Published online by Cambridge University Press:  01 December 2023

Arun Seraphin
Affiliation:
Emerging Technologies Institute, Virginia, United States (aseraphin@ndia.org) (wmiles@ndia.org)
Wilson Miles
Affiliation:
Emerging Technologies Institute, Virginia, United States (aseraphin@ndia.org) (wmiles@ndia.org)

Abstract

The development of new technologies that enable autonomous weapon systems poses a challenge to policymakers and technologists trying to balance military requirements with international obligations and ethical norms. Some have called for new international agreements to restrict or ban lethal autonomous weapon systems. Given the tactical and strategic value of the technologies and the proliferation of threats, the military continues to explore the development of new autonomous technologies to execute national security missions. The rapid global diffusion and dual-use nature of autonomous systems necessitate a proactive approach and a shared understanding of the technical realities, threats, military relevance, and strategic implications of these technologies from these communities. Ultimately, developing AI-enabled defense systems that adhere to global norms and relevant treaty obligations, leverage emerging technologies, and provide operational advantages is possible. The development of a workable and realistic regulatory framework governing the use of lethal autonomous weapons and the artificial intelligence that underpins autonomy will be best supported through a coordinated effort of the regulatory community, technologists, and military to create requirements that reflect the global proliferation and rapidly evolving threat of autonomous weapon systems. This essay seeks to demonstrate that: (1) the lack of coherent dialogue between the technical and policy communities can create security, ethical, and legal dilemmas; and (2) bridging the military, technical, and policy communities can lead to technology with constraints that balance the needs of military, technical, and policy communities. It uses case studies to show why mechanisms are needed to enable early and continuous engagement across the technical, policymaking, and operational communities. The essay then uses twelve interviews with AI and autonomy experts, which provide insight into what the technical and policymaking communities consider fundamental to the progression of responsible autonomous development. It also recommends practical steps for connecting the relevant stakeholders. The goal is to provide the Department of Defense with concrete steps for building organizational structures or processes that create incentives for engagement across communities.

Type
Roundtable: Global Governance and Lethal Autonomous Weapon Systems
Copyright
Copyright © National Defense Industrial Association, 2023. Published by Cambridge University Press on behalf of Carnegie Council for Ethics in International Affairs

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Notes

1 U.S. Department of Defense, 2022 National Defense Strategy of the United States of America: including the 2022 Nuclear Posture Review and the 2022 Missile Defense Review (Washington, D.C.: Department of Defense, October 2022), p. 2, media.defense.gov/2022/Oct/27/2003103845/-1/-1/1/2022-NATIONAL-DEFENSE-STRATEGY-NPR-MDR.PDF.

2 National Security Commission on Artificial Intelligence, Final Report: National Security Commission on Artificial Intelligence (Washington, D.C.: National Security Commission on Artificial Intelligence, 2021), p. 7, UNT Digital Library, digital.library.unt.edu/ark:/67531/metadc1851188/m2/1/high_res_d/Full-Report-Digital-1.pdf.

4 “Lethal Autonomous Weapons Systems (LAWS),” Office for Disarmament Affairs, United Nations, www.un.org/disarmament/the-convention-on-certain-conventional-weapons/background-on-laws-in-the-ccw/.

5 This is in addition to other U.S. government initiatives, including from Congress, the White House, and agencies such as the National Institute of Standards and Technology, which are also developing regulatory frameworks for AI. All of these guidance documents will affect industry and thereby the technologies available to the DoD.

6 U.S. Department of Defense, Summary of the 2018 Department of Defense Artificial Intelligence Strategy: Harnessing AI to Advance Our Security and Prosperity (Arlington, Va.: U.S. Department of Defense, June 2018), p. 5, media.defense.gov/2019/Feb/12/2002088963/-1/-1/1/SUMMARY-OF-DOD-AI-STRATEGY.PDF.

7 C. Todd Lopez, “DOD Adopts 5 Principles of Artificial Intelligence Ethics,” DoD News, U.S. Department of Defense, February 25, 2020, www.defense.gov/News/News-Stories/Article/Article/2094085/dod-adopts-5-principles-of-artificial-intelligence-ethics/.

8 DoD Responsible AI Working Council, U.S. Department of Defense, U.S. Department of Defense Responsible Artificial Intelligence Strategy and Implementation Pathway (Washington, D.C.: U.S. Department of Defense, June 2022), media.defense.gov/2022/Jun/22/2003022604/-1/-1/0/Department-of-Defense-Responsible-Artificial-Intelligence-Strategy-and-Implementation-Pathway.PDF.

9 Office of the Under Secretary of Defense for Policy, DoD Directive 3000.09, January 25, 2023, www.esd.whs.mil/portals/54/documents/dd/issuances/dodd/300009p.pdf.

10 There are many examples of the impacts of coordination between the policy and technical communities that cannot be detailed in this essay. They include the development of social media, the X-47B unmanned combat air system carrier, and the formulation of the New START Treaty.

11 Technical interview questions included:

  • Are there limits to the kinds of constraints the coder can write? If given the proper time and resources, can programmers build in norms/ethical considerations into the technology?

  • What, if anything, are we losing because of ethical/policy constraints (costs, timeline, performance)?

  • Learning systems will evolve; how do you create constraints for those types of systems?

Policy interview questions included:

  • How do you get your information on laws, regulations, and treaties? How do they shape your autonomous weapons development?

  • How do laws, regulations, and international treaties influence your autonomous system development?

  • Are there success stories of policy positively influencing the development of a technology?

  • What is the best mechanism by which the policy, technology, and warfighting communities can share their expertise to develop the most appropriate policy frameworks?

  • How do defense primes and weapon systems developers approach balancing international partner needs with technological feasibility and exportability?

  • Can you think of one good story and/or bad story of the policy and technology communities working together (or not working together) to improve an outcome or the regulation of the use of a technology?

12 “Doing Diligence to Assess the Risks and Benefits of Life Sciences Gain-of-Function Research,” President Barack Obama, White House, October 17, 2014, obamawhitehouse.archives.gov/blog/2014/10/17/doing-diligence-assess-risks-and-benefits-life-sciences-gain-function-research.

13 “Statement on Funding Pause on Certain Types of Gain-of-Function Research,” NIH Director, National Institutes of Health, October 16, 2014, www.nih.gov/about-nih/who-we-are/nih-director/statements/statement-funding-pause-certain-types-gain-function-research; and Department of Health and Human Services, National Institutes of Health, U.S. Government Gain-of-Function Deliberative Process and Research Funding Pause on Selected Gain-of-Function Research Involving Influenza, MERS, and SARS Viruses, (Washington, D.C.: Department of Health and Human Services) October 17, 2014, www.phe.gov/s3/dualuse/documents/gain-of-function.pdf.

14 National Science Advisory Board for Biosecurity, Recommendations for the Evaluation and Oversight of Proposed Gain-of-Function Research, (Bethesda, Md.: National Institute of Health) May 2016, osp.od.nih.gov/wp-content/uploads/2016/06/NSABB_Final_Report_Recommendations_Evaluation_Oversight_Proposed_Gain_of_Function_Research.pdf.

15 “Doing Diligence to Assess the Risks and Benefits of Life Sciences Gain-of-Function Research.”

16 Ibid.

17 Frances Sharples, Jo Husbands, Anne-Marie Mazza, Audrey Thevenon, and India Hook-Barnard, “Gain-of-Function Research: Background and Alternatives,” ch. 3 in Potential Risks and Benefits of Gain-of-Function Research: Summary of a Workshop (Washington, D.C.: National Academies Press, April 13, 2015), www.ncbi.nlm.nih.gov/books/NBK285579/.

18 Ibid.

19 United States, National Science Advisory Board for Biosecurity, Recommendations for the Evaluation and Oversight of Proposed Gain-of-Function Research.

20 Ibid.

21 Defense Security Cooperation Agency, Foreign Customer Guide (Washington, D.C.: Department of Defense, July 15, 2018).

22 McGinn, Jerry and Roche, Michael T., A “Build Allied” Approach to Increase Industrial Base Capacity (Fairfax, Va.: Greg and Camille Baroni Center for Government Contracting, George Mason University, June 22, 2023)Google Scholar.

23 The original eight allied countries include the United States, United Kingdom, Canada, Denmark, The Netherlands, Norway, Italy, Turkey, and Australia. In July 2019, the DoD removed Turkey from the development program.

24 Interview with Vice Admiral Mathias W. “Mat” Winter, former director, Joint Strike Fighter Program, Office of the Secretary of Defense, conducted by authors (July 25, 2023 via Microsoft Teams).

25 Ibid.

26 Hehs, Eric, “F-35 Lightning Drag Chute,” Code One 31, no. 1 (August 13, 2014)Google Scholar, Lockheed Martin, www.codeonemagazine.com/article.html?item_id=138.

27 Thomas Newdick, “Israel's Specially-Built F-35I Test Jet Just Touched Down In-Country,” Drive, updated November 11, 2020, www.thedrive.com/the-war-zone/37579/israels-specially-built-f-35i-test-jet-just-touched-down-in-country.

28 IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems, Ethically Aligned Design: A Vision for Prioritizing Human Well-Being with Autonomous and Intelligent Systems, 1st ed. (Institute of Electrical and Electronics Engineers, 2019), standards.ieee.org/content/ieee-standards/en/industry-connections/ec/ autonomous-systems.html.

29 This might be modeled on activities under the National Nanotechnology Initiative, which has supported the development of safety standards and public educational materials, or on the structure of the F-35 program office.