26 septembre 2019 | International, C4ISR

No AI For Nuclear Command & Control: JAIC’s Shanahan

By SYDNEY J. FREEDBERG JR.

GEORGETOWN UNIVERSITY: “You will find no stronger proponent of integration of AI capabilities writ large into the Department of Defense,” Lt. Gen. Jack Shanahan said here, “but there is one area where I pause, and it has to do with nuclear command and control.”

In movies like WarGames and Terminator, nuclear launch controls are the first thing fictional generals hand over to AI. In real life, the director of the Pentagon's Joint Artificial Intelligence Center says, that's the last thing he would integrate AI with. The military is beginning a massive multi-billion dollar modernization of its aging system for Nuclear Command, Control, & Communications (NC3), much of which dates to the Cold War. But the Joint Artificial Intelligence Center is not involved with it.

A recent article on the iconoclastic website War on the Rocks argued “America Needs A ‘Dead Hand',” a reference to the Soviet system designed to automatically order a nuclear launch if the human leadership was wiped out. “I read that,” Shanahan told the Kalaris Intelligence Conference here this afternoon. “My immediate answer is ‘No. We do not.'”

Instead, the JAIC is very deliberately starting with relatively low-risk, non-lethal projects — predicting breakdowns in helicopter engines and mapping natural disasters — before moving on to combat-related functions such as intelligence analysis and targeting next year. On the Pentagon's timeline, AI will be coming to command posts before it is embedded in actual weapons, and even then the final decision to use lethal force will always remain in human hands.

The standard term in the Pentagon now for human involvement with AI and weapons now is “human on the loop,” a shift from human IN the loop. That reflects greater stress on the advisory function of humans with AI and a recognition that domains like cyber require almost instantaneous responses that can't wait for a human.

Hawkish skeptics say slowing down to ask human permission could cripple US robots against their less-restrained Russian or Chinese counterparts. Dovish skeptics say this kind of human control would be too easily bypassed.

Shanahan does see a role for AI in applying lethal force once that human decision is made. “I'm not going to go straight to ‘lethal autonomous weapons systems,'” he said, “but I do want to say we will use artificial intelligence in our weapons systems... to give us a competitive advantage. It's to save lives and help deter war from happening in the first place.”

The term “lethal autonomous weapons systems” was popularized by the Campaign to Stop Killer Robots, which seeks a global ban on all AI weapons. Shanahan made clear his discomfort with formal arms control measures, as opposed to policies and international norms, which don't bind the US in the same way.

“I'll be honest with you,” Shanahan said. “I don't like the term, and I do not use the term, ‘arms control' when it comes to AI. I think that's unhelpful when it comes to artificial intelligence: It's largely a commercial technology,” albeit with military applications.

“I'm much more interested, at least as a starting point, in international rules and norms and behavior,” he continued. (Aside from the space is governed almost exclusively “It's extremely important to have those discussions.”

“This is the ultimate human decision that needs to be made....nuclear command and control,” he said. “We have to be very careful. Knowing ...the immaturity of technology today, give us a lot of time to test and evaluate.”

“Can we use artificial intelligence to make better decisions, to make more informed judgments about what might be happening, to reduce the potential for civilian casualties or collateral damage?” Shanahan said. “I'm an optimist. I believe you can. It will not eliminate it, never. It's war; bad things are going to happen.”

While Shanahan has no illusions about AI enabling some kind of cleanly surgical future conflict, he doesn't expect a robo-dystopia, either.

“The hype is a little dangerous, because it's uninformed most of the time, and sometimes it's a Hollywood-driven killer robots/Terminator/SkyNet worst case scenario,” he said. “I don't see that worst case scenario any time in my immediate future.”

“I'm very comfortable saying our approach — even though it is emerging technology, even though it unfolds very quickly before our eyes — it will still be done in a deliberate and rigorous way so we know what we get when we field it,” Shanahan said.

“As the JAIC director, I'm focused on really getting to the fielding,” he said, moving AI out of the lab into the real world — but one step at a time. “We're always going to start with limited narrow use cases. Say, can we take some AI capability and put it in a small quadcopter drone that will make it easier to clear out a cave, [and] really prove that it works before we ever get it to a [large] scale production.”

“We will have a very clear understanding of what it can do and what it can't do,” he said. “That will be through experimentation, that will be through modeling and simulation, and that will be in wargames. We've done that with every piece of technology we've ever used, and I don't expect this to be any different.”

The JAIC is even looking to hire an in-house ethicist of sorts, a position Shanahan has mentioned earlier but sought to clarify today. “It'll be someone who's a technical standards [expert] / ethicist,” he said. “As we develop the models and algorithms... they can look at that make sure the process is abiding by our rules of the road.”

“I'm also interested in, down the road, getting some help from the outside on sort of those deeper philosophical questions,” he continued. “I don't focus on them day to day, because of my charter to field now, but it's clear we have to be careful about this.”

“I do not see that same approach in Russia or China,” Shanahan said. “What sets us apart is... our focus on real rigor in test and evaluation, validation and verification, before we field capability that could have lives at stake.”

https://breakingdefense.com/2019/09/no-ai-for-nuclear-command-control-jaics-shanahan

Sur le même sujet

  • Pentagon taps $688 million in coronavirus aid for defense industry

    3 juin 2020 | International, Aérospatial, Naval, Terrestre, C4ISR, Sécurité

    Pentagon taps $688 million in coronavirus aid for defense industry

    By: Joe Gould WASHINGTON ― The Pentagon plans to spend hundreds of millions of dollars in coronavirus relief funding to support vulnerable manufacturers of submarine torpedo tubes, aircraft engine parts and hardened microelectronics that were hit by closures or other effects of the COVID-19 pandemic. The $688 million defense-industrial base fund is just one category within the $10.5 billion the Department of Defense received from Congress' $2.1 trillion CARES Act package. The department submitted its 54-page spending plan to Congress on Friday amid pressure from lawmakers after DoD had spent only 23 percent of that money weeks after it was signed into law in late March. The Pentagon has thus far obligated $167 million of the $1 billion Congress granted under the Defense Production Act, a Korean War-era law that the president recently invoked, to have industry produce key items such as N95 respirator masks and swabs needed for coronavirus testing, ventilators and other items. Under the same law, the Pentagon's spending plan says it would use $688 million to address impacts to the defense-industrial base caused by COVID-19, "by directly offsetting financial distress in the DIB and providing investments to regions most severely impacted to sustain essential domestic industrial base capabilities and spur local job creation.” The plan calls for $171 million for the aircraft propulsion industrial base; $150 million for shipbuilding and submarine launch tubes; $150 million for the space launch industrial base; $80 million for the microelectronics base; $62 million for body armor suppliers; and $40 million for high-temperature materials used in hypersonic weapons. The priorities likely overlap with vulnerable industrial base areas previously identified by the Pentagon's assessment last year, said Wesley Hallman, the National Defense Industrial Association's senior vice president of strategy and policy . “It makes sense given what's going on now economically to ― under the [coronavirus aid] legislation ― reinforce some of the critical vulnerabilities that were identified in that report,” Hallman said. The Pentagon plans $171 million to sustain and preserve the aircraft propulsion industrial base, as many military aviation suppliers have been hard hit from the commercial side by coronavirus travel restrictions. Some would preserve an "essential workforce through support to sustained operations at key repair facility and stabilizing sub-vendors essential to a healthy propulsion industrial base,” according to the department. What that means is the DoD may have to absorb some of suppliers' overhead costs to keep vital suppliers in business, said Teal Group aviation analyst Richard Aboulafia. “Commercial aviation is in the worst crisis it's ever faced, and aviation propulsion aftermarket is the single part of the industry most hit by COVID-19,” Aboulafia said. “It could be [that] if there's a part like a combustor, DoD could be saying: ‘What do you need by way of guaranteed orders to keep that line open?' ” The department, which relies on a vulnerable network of suppliers for parts for the venerable TF33 engine, hopes to “support initiatives to certify and approve new parts sources for” the engine and “catalyze the sub-tier vendor base and mitigate risk of sub-tier vendors exiting the propulsion business.” Pratt & Whitney hasn't made the TF33 in more than 40 years, but it's still used by the B-52 bomber, and no replacement is due for years. The DoD also planned $150 million for the shipbuilding industrial base in areas such as castings, forgings and submarine launch equipment, as well as to support continuous production of essential components such as missile tubes. (Shipbuilding overall has contracted over the last decade, and there were only four suppliers with the capability to manufacture large, complex, single-pour aluminum and magnesium sand castings, according to the DoD's 2019 industrial capabilities report to Congress.) The CEO of Virginia-based military contractor BWXT, Rex Geveden, said on an earnings call last year that the company ― which makes missile tubes for the Columbia-class submarine ― was mulling an exit from the missile tube business. The Navy and its Naval Sea Systems Command, he said, were seeking more than one supplier, adding: “We're not interested in the future orders unless we do have a way to make money on these orders.” The DoD planned another $150 million to maintain a competitive space launch industrial base. DoD relies on a small pool of companies to launch satellites into orbit, but there are numerous companies of all sizes that support those launches, and the DoD has sought to reintroduce more competition over the enterprise in recent years. The department would also spend $80 million to support several critical suppliers of radiation-hardened microelectronics ― products vital to DoD but with limited commercial applications. The funding would “protect the domestic capacity to ensure radiation hardened microelectronics testing capability, and key subcompacts such as substrates and wafer, are available for DoD weapon systems," according to the spending plan. The $40 million would protect suppliers of high-temperature materials used in potentially game-changing hypersonic weapons. “An expanded, sustainable domestic production capability for hypersonic systems is essential to the Department achieving its modernization priorities,” the plan states. https://www.defensenews.com/congress/2020/06/02/688m-in-covid-aid-helping-defense-firms-per-dod-plan/

  • Lockheed Martin Awarded Fourth And Fifth Production Lots For Long Range Anti-Ship Missiles

    24 février 2021 | International, Aérospatial

    Lockheed Martin Awarded Fourth And Fifth Production Lots For Long Range Anti-Ship Missiles

    The  combined Lot 4/5 contract continues production of the air-launched variant of LRASM, now operational on the U.S. Navy F/A-18E/F and U.S. Air Force B-1B.

  • Upgraded F-35 deliveries could slip to June 2024

    6 septembre 2023 | International, Aérospatial

    Upgraded F-35 deliveries could slip to June 2024

    The F-35 Joint Program Office says the upgraded jet is showing software troubles in flight tests, prompting it to push the schedule back.

Toutes les nouvelles