Back to news

January 7, 2019 | International, Aerospace, C4ISR

Pentagon Seeks a List of Ethical Principles for Using AI in War

BY PATRICK TUCKER

An advisory board is drafting guidelines that may help shape worldwide norms for military artificial intelligence — and woo Silicon Valley to defense work.

U.S. defense officials have asked the Defense Innovation Board for a set of ethical principles in the use of artificial intelligence in warfare. The principles are intended to guide a military whose interest in AI is accelerating — witness the new Joint Artificial Intelligence Center — and to reassure potential partners in Silicon Valley about how their AI products will be used.

Today, the primary document laying out what the military can and can't do with AI is a 2012 doctrine that says a human being must have veto power over any action an autonomous system might take in combat. It's brief, just four pages, and doesn't touch on any of the uses of AI for decision support, predictive analytics, etc. where players like Google, Microsoft, Amazon, and others are making fast strides in commercial environments.

“AI scientists have expressed concern about how DoD intends to use artificial intelligence. While the DoD has a policy on the role of autonomy in weapons, it currently lacks a broader policy on how it will use artificial intelligence across the broad range of military missions,” said Paul Scharre, the author of Army of None: Autonomous Weapons and the Future of War.

Josh Marcuse, executive director of the Defense Innovation Board, said crafting these principles will help the department “safely and responsibly” employ new technologies. “I think it's important when dealing with a field that's emergent to think through all the ramifications,” he said.

The Board, a group of Silicon Valley corporate and thought leaders chaired by former Google and Alphabet chairman Eric Schmidt, will make the list public at its June meeting. Defense Department leaders will take them under consideration.

Marcuse believes that the Pentagon can be a leader not just in employing AI but in establishing guidelines for safe use — just as the military pioneered safety standards for aviation. “The Department of Defense should lead in this area as we have with other technologies in the past. I want to make sure the department is not just leading in developing AI for military purposes but also in developing ethics to use AI in military purposes,” he says.

The effort, in part, is a response to what happened with the military's Project Maven, the Pentagon's flagship AI project with Google as its partner. The effort applied artificial intelligence to the vast store of video and and image footage that the Defense Department gathers to guide airstrikes. Defense officials emphasized repeatedly that the AI was intended only to cut down the workload of human analysts. But they also acknowledged that the ultimate goal was to help the military do what it does better, which sometimes means finding and killing humans. An employee revolt ensued at Google. Employees resigned en masse and the company said that they wouldn't renew the contract.

Scharre, who leads the Technology and National Security Program at the Center for a New American Security, said, “One of the challenges for things like Project Maven, which uses AItechnology to process drone video feeds, is that some scientists expressed concern about where the technology may be heading. A public set of AI principles will help clarify DoD's intentions regarding artificial intelligence.”

Full artcile: https://www.defenseone.com/technology/2019/01/pentagon-seeks-list-ethical-principles-using-ai-war/153940/

On the same subject

  • FLIR set to add Endeavor Robotics to its unmanned future

    February 19, 2019 | International, C4ISR

    FLIR set to add Endeavor Robotics to its unmanned future

    By: Kelsey D. Atherton A camera is never just a camera anymore. For FLIR — the company whose bread and butter may be lenses and images but whose product is best thought of as an intelligence add-on more than any pedestrian photography — was never just about the camera. FLIR's cameras and sensors have been incorporated into vehicles for decades, a platform on platforms. But in the past two years, FLIR has moved to acquire robotics companies of its own. A new deal, announced Feb. 11, 2019, is set to have FLIR acquire Endeavor Robotics. In November 2016, FLIR acquired Prox Dynamics, maker of the sparrow-sized Black Hornet micro-drone. It was FLIR's first foray into its own unmanned vehicles. In January 2019, FLIR acquired drone-maker Aeryon Labs, which produces vehicles that weigh less than 20 pounds for a number of militaries across the globe. “Now with Endeavor, we've started down that path of executing our inorganic phase of our growth strategy for unmanned,” said David Ray, president of the Government and Defense Business Unit at FLIR. “What that does is it allows us to have a platform to move the customer's vision forward for this whole notion of manned-unmanned teaming. It's driving an open architecture, an environment where you can have both manned vehicles and unmanned really cooperating and delivering missions like never before.” Endeavor Robotics is the largest get by FLIR of the lot. FLIR is set to buy Endeavor for $385 million — almost twice as much as FLIR paid for Aeryon Labs, and nearly three times as much as it spent on Prox Dynamics. With Endeavor Robotics comes a whole host of tracked unmanned ground vehicles, including the infantry-deployable (and -tossable) FirstLook, and the larger and heavier PackBot and Kobra. These robots can incorporate a variety of sensors from FLIR, for everything from video and infrared to chemical detection. Being in-house means FLIR can experiment and explore more fusion of its various platforms. “With our Black Hornet we can have a reconnaissance system that is connected to a vehicle,” Ray said, “a tank or whatever it may be, where you could actually launch Black Hornet aircraft from another vehicle. As we enhance our sensors across both, we're able to bring that power to bear in terms of layered surveillance.” While FLIR is still relatively new to robotics, it's used to working across sectors. FLIR sensors have been used by the military, government, law enforcement and in the security space, and have had to stay competitive with commercial companies. Lessons learned from an application in nuclear reactor security might be applicable to a sensor on an explosive ordnance disposal robot. Those updates and lessons have stayed fixed to the specific sensor. With the new robotics companies acquired by FLIR, it can adapt its vehicles and sensors in a more holistic way. “Our latest Black Hornet III is able to operate in GPS-denied environments,” Ray said. “And so the beauty of Endeavor being part FLIR is we can go look at how we take an investment and enhancements we've made and see what it takes to go transfer that into a vehicle. The ultimate goal is being able to build world-class R&D and generate world-class capability, and then be able to expand that across multiple platforms.” FLIR's past, present and future remain very much about the core business of providing sensors for others to incorporate. Also in that future we can anticipate FLIR adapting and designing its own vehicles around its sensors. That means looking at the way the data collected by those sensors can be turned into everything from useful navigational information for an autonomous system on the vehicle, to vital information relayed by tablet to soldiers commanding the robot nearby. https://www.c4isrnet.com/unmanned/2019/02/15/flir-set-to-add-endeavor-robotics-to-its-unmanned-future

  • Budget office says amphibious ship could cost triple Navy’s estimate

    April 11, 2024 | International, Land

    Budget office says amphibious ship could cost triple Navy’s estimate

    The cost estimate is based on a hybrid military-commercial ship design, as Navy and Marine Corps leaders have indicated they’ll pursue.

  • At London arms fair, global war fears are good for business | Reuters

    September 17, 2023 | International, Land

    At London arms fair, global war fears are good for business | Reuters

    As Russia's Vladimir Putin and North Korean leader Kim Jong-un met this week to discuss what analysts believe will be a deal for an exchange of weapons, the West's leading companies were descending on Europe's biggest arms show in London.

All news