26 septembre 2019 | International, C4ISR

No AI For Nuclear Command & Control: JAIC’s Shanahan


GEORGETOWN UNIVERSITY: “You will find no stronger proponent of integration of AI capabilities writ large into the Department of Defense,” Lt. Gen. Jack Shanahan said here, “but there is one area where I pause, and it has to do with nuclear command and control.”

In movies like WarGames and Terminator, nuclear launch controls are the first thing fictional generals hand over to AI. In real life, the director of the Pentagon's Joint Artificial Intelligence Center says, that's the last thing he would integrate AI with. The military is beginning a massive multi-billion dollar modernization of its aging system for Nuclear Command, Control, & Communications (NC3), much of which dates to the Cold War. But the Joint Artificial Intelligence Center is not involved with it.

A recent article on the iconoclastic website War on the Rocks argued “America Needs A ‘Dead Hand',” a reference to the Soviet system designed to automatically order a nuclear launch if the human leadership was wiped out. “I read that,” Shanahan told the Kalaris Intelligence Conference here this afternoon. “My immediate answer is ‘No. We do not.'”

Instead, the JAIC is very deliberately starting with relatively low-risk, non-lethal projects — predicting breakdowns in helicopter engines and mapping natural disasters — before moving on to combat-related functions such as intelligence analysis and targeting next year. On the Pentagon's timeline, AI will be coming to command posts before it is embedded in actual weapons, and even then the final decision to use lethal force will always remain in human hands.

The standard term in the Pentagon now for human involvement with AI and weapons now is “human on the loop,” a shift from human IN the loop. That reflects greater stress on the advisory function of humans with AI and a recognition that domains like cyber require almost instantaneous responses that can't wait for a human.

Hawkish skeptics say slowing down to ask human permission could cripple US robots against their less-restrained Russian or Chinese counterparts. Dovish skeptics say this kind of human control would be too easily bypassed.

Shanahan does see a role for AI in applying lethal force once that human decision is made. “I'm not going to go straight to ‘lethal autonomous weapons systems,'” he said, “but I do want to say we will use artificial intelligence in our weapons systems... to give us a competitive advantage. It's to save lives and help deter war from happening in the first place.”

The term “lethal autonomous weapons systems” was popularized by the Campaign to Stop Killer Robots, which seeks a global ban on all AI weapons. Shanahan made clear his discomfort with formal arms control measures, as opposed to policies and international norms, which don't bind the US in the same way.

“I'll be honest with you,” Shanahan said. “I don't like the term, and I do not use the term, ‘arms control' when it comes to AI. I think that's unhelpful when it comes to artificial intelligence: It's largely a commercial technology,” albeit with military applications.

“I'm much more interested, at least as a starting point, in international rules and norms and behavior,” he continued. (Aside from the space is governed almost exclusively “It's extremely important to have those discussions.”

“This is the ultimate human decision that needs to be made....nuclear command and control,” he said. “We have to be very careful. Knowing ...the immaturity of technology today, give us a lot of time to test and evaluate.”

“Can we use artificial intelligence to make better decisions, to make more informed judgments about what might be happening, to reduce the potential for civilian casualties or collateral damage?” Shanahan said. “I'm an optimist. I believe you can. It will not eliminate it, never. It's war; bad things are going to happen.”

While Shanahan has no illusions about AI enabling some kind of cleanly surgical future conflict, he doesn't expect a robo-dystopia, either.

“The hype is a little dangerous, because it's uninformed most of the time, and sometimes it's a Hollywood-driven killer robots/Terminator/SkyNet worst case scenario,” he said. “I don't see that worst case scenario any time in my immediate future.”

“I'm very comfortable saying our approach — even though it is emerging technology, even though it unfolds very quickly before our eyes — it will still be done in a deliberate and rigorous way so we know what we get when we field it,” Shanahan said.

“As the JAIC director, I'm focused on really getting to the fielding,” he said, moving AI out of the lab into the real world — but one step at a time. “We're always going to start with limited narrow use cases. Say, can we take some AI capability and put it in a small quadcopter drone that will make it easier to clear out a cave, [and] really prove that it works before we ever get it to a [large] scale production.”

“We will have a very clear understanding of what it can do and what it can't do,” he said. “That will be through experimentation, that will be through modeling and simulation, and that will be in wargames. We've done that with every piece of technology we've ever used, and I don't expect this to be any different.”

The JAIC is even looking to hire an in-house ethicist of sorts, a position Shanahan has mentioned earlier but sought to clarify today. “It'll be someone who's a technical standards [expert] / ethicist,” he said. “As we develop the models and algorithms... they can look at that make sure the process is abiding by our rules of the road.”

“I'm also interested in, down the road, getting some help from the outside on sort of those deeper philosophical questions,” he continued. “I don't focus on them day to day, because of my charter to field now, but it's clear we have to be careful about this.”

“I do not see that same approach in Russia or China,” Shanahan said. “What sets us apart is... our focus on real rigor in test and evaluation, validation and verification, before we field capability that could have lives at stake.”


Sur le même sujet

  • QinetiQ receives second DA62 MPP special mission platform - Skies Mag

    3 octobre 2022 | International, Aérospatial

    QinetiQ receives second DA62 MPP special mission platform - Skies Mag

    The brand-new DA62 MPP special mission aircraft will support QinetiQ’s delivery of training and reconnaissance missions.

  • With all eyes on F-35, AAR Corp. looks to ‘clean up’ on F-16 maintenance

    25 juin 2019 | International, Aérospatial

    With all eyes on F-35, AAR Corp. looks to ‘clean up’ on F-16 maintenance

    By: Jill Aitoro LE BOURGET, France — As a number of companies chase maintenance work for the F-35 fighter jet, one firm is planning to clean up on the F-16. AAR Corp., a provider of global aftermarket aviation services, won a seven-year contract with the Royal Danish Air Force to perform maintenance, repair and overhaul, or MRO, of Pratt & Whitney F100-220 engine components on the General Dynamics F-16 jet. That win, which came earlier this year, is the latest contract in a long-term relationship supporting the Danish Air Force and air forces across Europe with MRO services from the company's repair facility in Amsterdam. That facility supports about $500 million in business, much of it tied to the F-16. But the win also fits well into a grander ambition of the company, said Brian Sartain, senior vice president of repair and engineering services at AAR. “Everybody is running after F-35 capability,” he said. “But the Danish Air Force is still going to have a lot of F-16s for [the] foreseeable future, and there are still a lot of F-16s being flown around the world.” Sartain pointed to “fairly high-publicized” F-16 maintenance requirements coming down the pike for the U.S. Air Force, which reported a 65-70 percent mission-capable rate for F-16s in 2017. AAR has a facility in Duluth, Minnesota, which is located across the airfield from Duluth Air National Guard Base — home to the 148th Fighter Wing and its F-16C Fighting Falcon aircraft. “Our facility is a perfect place to do F-16 maintenance. We have a lot of capacity,” Sartain said. “We're three tiers down in the F-35 component chain in the way those are being bid. We're not interested. So, while others are running after the F-35, we're cleaning up on the F-16s, and we're happy to do that.” Beyond its F-16 work, AAR supports airframe maintenance for the P-8A fleet for the U.S. Navy, Australia and Foreign Military Sales customers. AAR and Boeing were each awarded seven-year indefinite delivery, indefinite-quantity contracts from Naval Air Systems Command in February 2018, competing each year on workshare. While Boeing performed the majority of work the first year, AAR was recently awarded the larger slice for 2019. “Frankly, we're moving to majority share because our performance has been better,” Sartain said. “Most program competitors will need to sub tier to another company and then stack profit on top of profit. For government, it's a better value for us to be a prime, and for us it's a great opportunity to be a prime.” AAR supports the P-8 work from its Indianapolis facility, where at any given time four P-8s are in the hanger, with two steady lines of maintenance. The location is also used to support maintenance of Southwest Airlines 737 aircraft, which share the same airframe as the P-8. It's gone from about 20 percent military and 80 percent commercial maintenance to an even split. “Southwest asks that airplanes are returned in about 21 days. For the P-8, the Navy allows 60 for turnaround,” Sartain said. “The airplane comes in, we have a small crew of 30-40 that hold secret clearances and lock in a room the top-secret equipment, and then I can flex mechanics from Southwest to take advantage of that experience." https://www.defensenews.com/digital-show-dailies/paris-air-show/2019/06/21/with-all-eyes-on-f-35-aar-looks-to-clean-up-on-f-16-maintenance/

  • Marines expect ‘big year’ for drone, ship and logistics testing

    25 mars 2024 | International, Naval

    Marines expect ‘big year’ for drone, ship and logistics testing

    Aerial and maritime drones coupled with a new shore-to-shore connector aim to overcome logistical hurdles.

Toutes les nouvelles