26 septembre 2019 | International, C4ISR

No AI For Nuclear Command & Control: JAIC’s Shanahan

By SYDNEY J. FREEDBERG JR.

GEORGETOWN UNIVERSITY: “You will find no stronger proponent of integration of AI capabilities writ large into the Department of Defense,” Lt. Gen. Jack Shanahan said here, “but there is one area where I pause, and it has to do with nuclear command and control.”

In movies like WarGames and Terminator, nuclear launch controls are the first thing fictional generals hand over to AI. In real life, the director of the Pentagon's Joint Artificial Intelligence Center says, that's the last thing he would integrate AI with. The military is beginning a massive multi-billion dollar modernization of its aging system for Nuclear Command, Control, & Communications (NC3), much of which dates to the Cold War. But the Joint Artificial Intelligence Center is not involved with it.

A recent article on the iconoclastic website War on the Rocks argued “America Needs A ‘Dead Hand',” a reference to the Soviet system designed to automatically order a nuclear launch if the human leadership was wiped out. “I read that,” Shanahan told the Kalaris Intelligence Conference here this afternoon. “My immediate answer is ‘No. We do not.'”

Instead, the JAIC is very deliberately starting with relatively low-risk, non-lethal projects — predicting breakdowns in helicopter engines and mapping natural disasters — before moving on to combat-related functions such as intelligence analysis and targeting next year. On the Pentagon's timeline, AI will be coming to command posts before it is embedded in actual weapons, and even then the final decision to use lethal force will always remain in human hands.

The standard term in the Pentagon now for human involvement with AI and weapons now is “human on the loop,” a shift from human IN the loop. That reflects greater stress on the advisory function of humans with AI and a recognition that domains like cyber require almost instantaneous responses that can't wait for a human.

Hawkish skeptics say slowing down to ask human permission could cripple US robots against their less-restrained Russian or Chinese counterparts. Dovish skeptics say this kind of human control would be too easily bypassed.

Shanahan does see a role for AI in applying lethal force once that human decision is made. “I'm not going to go straight to ‘lethal autonomous weapons systems,'” he said, “but I do want to say we will use artificial intelligence in our weapons systems... to give us a competitive advantage. It's to save lives and help deter war from happening in the first place.”

The term “lethal autonomous weapons systems” was popularized by the Campaign to Stop Killer Robots, which seeks a global ban on all AI weapons. Shanahan made clear his discomfort with formal arms control measures, as opposed to policies and international norms, which don't bind the US in the same way.

“I'll be honest with you,” Shanahan said. “I don't like the term, and I do not use the term, ‘arms control' when it comes to AI. I think that's unhelpful when it comes to artificial intelligence: It's largely a commercial technology,” albeit with military applications.

“I'm much more interested, at least as a starting point, in international rules and norms and behavior,” he continued. (Aside from the space is governed almost exclusively “It's extremely important to have those discussions.”

“This is the ultimate human decision that needs to be made....nuclear command and control,” he said. “We have to be very careful. Knowing ...the immaturity of technology today, give us a lot of time to test and evaluate.”

“Can we use artificial intelligence to make better decisions, to make more informed judgments about what might be happening, to reduce the potential for civilian casualties or collateral damage?” Shanahan said. “I'm an optimist. I believe you can. It will not eliminate it, never. It's war; bad things are going to happen.”

While Shanahan has no illusions about AI enabling some kind of cleanly surgical future conflict, he doesn't expect a robo-dystopia, either.

“The hype is a little dangerous, because it's uninformed most of the time, and sometimes it's a Hollywood-driven killer robots/Terminator/SkyNet worst case scenario,” he said. “I don't see that worst case scenario any time in my immediate future.”

“I'm very comfortable saying our approach — even though it is emerging technology, even though it unfolds very quickly before our eyes — it will still be done in a deliberate and rigorous way so we know what we get when we field it,” Shanahan said.

“As the JAIC director, I'm focused on really getting to the fielding,” he said, moving AI out of the lab into the real world — but one step at a time. “We're always going to start with limited narrow use cases. Say, can we take some AI capability and put it in a small quadcopter drone that will make it easier to clear out a cave, [and] really prove that it works before we ever get it to a [large] scale production.”

“We will have a very clear understanding of what it can do and what it can't do,” he said. “That will be through experimentation, that will be through modeling and simulation, and that will be in wargames. We've done that with every piece of technology we've ever used, and I don't expect this to be any different.”

The JAIC is even looking to hire an in-house ethicist of sorts, a position Shanahan has mentioned earlier but sought to clarify today. “It'll be someone who's a technical standards [expert] / ethicist,” he said. “As we develop the models and algorithms... they can look at that make sure the process is abiding by our rules of the road.”

“I'm also interested in, down the road, getting some help from the outside on sort of those deeper philosophical questions,” he continued. “I don't focus on them day to day, because of my charter to field now, but it's clear we have to be careful about this.”

“I do not see that same approach in Russia or China,” Shanahan said. “What sets us apart is... our focus on real rigor in test and evaluation, validation and verification, before we field capability that could have lives at stake.”

https://breakingdefense.com/2019/09/no-ai-for-nuclear-command-control-jaics-shanahan

Sur le même sujet

  • Against Army’s wishes, Congress primes pump to buy newest CH-47 variant for active force

    18 décembre 2019 | International, Aérospatial

    Against Army’s wishes, Congress primes pump to buy newest CH-47 variant for active force

    By: Jen Judson WASHINGTON — Congressional appropriators and authorizers have increased advance procurement funds for the newest variant of the CH-47 Chinook cargo helicopter as preparation to supply the aircraft to the Army's active force, even though the service asked to only buy a small number of the helos in fiscal 2020 for special operations. The service's decision to cut the aircraft from the active force was based on the need to free up future cash to cover the cost of an ambitious plan to buy two new future vertical lift aircraft for long-range assault and attack reconnaissance missions. But Congress has gone against the Army's wishes to divert funding away from procurement for the active force, instead adding $28 million in FY20 funding — in both the recently released spending and policy bill conference reports — for advance procurement to begin to prime the pump to restore CH-47F Block II deliveries to the conventional Army. The cut the service made would only buy 69 special operations variants — or "G" models. The original plan was to procure 473 "F"-model Block II helicopters for the active force. The Army approved the Block II effort to move into the engineering and manufacturing development phase in April 2017, and the program officially began in July 2017. In October 2018, the first two EMD Block II Chinooks were already on the assembly line with plans to fly in mid-2019. Boeing, which manufactures the aircraft, expects a production decision in July 2021. While $28 million won't get the service much, based on the original plan the Army would start building five CH-47F Block IIs in 2021 meant for the active force. The advance procurement in FY20 would support buying longer-lead items from suppliers, but is still a stretch to claim that the additional funding restores the program. Those five aircraft would be delivered in 2023 based on Boeing's typical three-year lead time to build an airframe. It remains to be seen whether the congressional plus-up will prompt the Army to restore funding for the five CH-47F Block IIs in its FY21 budget request due out early next year. It's also unclear how many of those long-lead parts procured in FY20 could be used in G-model aircraft or are exclusive to F-models. Therefore, it's also murky how much of the $28 million in parts might be wasted if the Army sticks to its plan to only procure G-model aircraft. The Army has indicated it might reconsider the CH-47F Block II cut; the FY21 budget request, when it is released, will likely reveal the Army's decision. Shortly after the service's plan to cut the CH-47F Block II was revealed in its FY20 budget request, then-Army Vice Chief of Staff Gen. James McConville, who is now chief, told reporters the Army was comfortable with its decision, but tempered that, adding: “I think in two to three years, we will have a better idea about where we are, as far as developing the helicopters we talked about, and that will drive the decision.” McConville was referring to the Army's plan to buy two future vertical lift aircraft. The same day, then-Army Secretary Mark Esper, who is now defense secretary, told another group of reporters that the service would not be rethinking its plans to build CH-47 Block IIs for the conventional force. The Army has also claimed it is pursuing foreign military sales of its CH-47F Chinooks to soften the blow from cuts made to its intended buy of the Block II variant, but none of the possible sales — to the United Kingdom or to the United Arab Emirates — were newly in the works at the time. And neither country has plans to buy Block II variants. Moreover, the number of helicopters the two countries plan to procure amount to less than 30 aircraft. https://www.defensenews.com/land/2019/12/17/against-armys-wishes-congress-primes-pump-to-buy-newest-ch-47-variant-for-active-force

  • Raytheon injecting Collins Aerospace unit with $2.7 billion JADC2 jolt

    19 juin 2023 | International, C4ISR

    Raytheon injecting Collins Aerospace unit with $2.7 billion JADC2 jolt

    Raytheon in September was named to the U.S. Air Force’s ABMS Digital Infrastructure Consortium alongside four other defense industry heavyweights.

  • EUAM Ukraine: mission extended, budget approved

    20 novembre 2017 | International, Sécurité

    EUAM Ukraine: mission extended, budget approved

    On 20 November, the Council extended the mandate of the European Union Advisory Mission (EUAM) in Ukraine until 31 May 2019 and approved a budget of € 32 million for the next 18 months. The European Union Advisory Mission for Civilian Security Sector Reform Ukraine, EUAM Ukraine, has been deployed since December 2014, with a mandate to support Ukrainian state agencies in the reform of the civilian security sector. The mission is one of the central elements of the EU's enhanced support to the Ukrainian authorities in recent years. EUAM aims to strengthen and support reform in state agencies such as the police, other law enforcement agencies and the judicial sector, particularly the prosecutor's office. The mission provides strategic advice to the Ukrainian authorities, supported by operational activity, including training, to develop sustainable, accountable and efficient security services that strengthen the rule of law. This process is ultimately designed to restore the trust of the Ukrainian people in their civilian security services, which have been beset by allegations of corruption and malpractice. EUAM is an unarmed, non-executive civilian mission with its headquarters in Kyiv and regional presences in Lviv and Kharkiv, as well as soon in Odessa. http://www.consilium.europa.eu/fr/press/press-releases/2017/11/20/euam-ukraine-mission-extended-budget-approved/

Toutes les nouvelles