Back to news

June 22, 2020 | International, C4ISR

Artificial intelligence systems need ‘checks and balances’ throughout development

The Pentagon's primary artificial intelligence hub is already studying how to aim a laser at the correct spot on an enemy vehicle, pinpointing which area to target to inflict the most damage, and identifying the most important messages headed to commanders, officials said June 16.

But as part of that work, the Department of Defense needs to carefully implement checks and balances into the development process, experts urged June 16.

“Fundamentally I would say there's a requirement ... that there's going to be a mixture of measures taken to ensure the governability of the system from the first stage of the design of the system all the way up through the operations of the system in a combat scenario,” said Greg Allen, the Joint Artificial Intelligence Center's chief of strategy and communications at the Joint Artificial Intelligence Center, at the Defense One Tech Summit June 16.

The JAIC is working on several lethality projects through its new joint warfighting initiative, boosted by a new contract award to Booz Allen potentially worth $800 million.

“With this new contract vehicle, we have the potential to do even more this next year than we did in the past,” Allen said.

Meanwhile, the Army's Artificial Intelligence Task Force is working on an advanced threat recognition project. DARPA is exploring complementing AI systems that would identify available combat support assets and quickly plan their route to the area.

Throughout all of the development work, experts from the military and from academia stressed that human involvement and experimentation was critical to ensuring that artificial intelligence assets are trustworthy. The department has released a document of five artificial intelligence ethical principles, but the challenge remains implementing those principles into projects across a department with disparate services working on separate artificial intelligence projects.

“We want safe, reliable and robust systems deployed to our warfighters,” said Heather Roff, senior research analyst at the Johns Hopkins Applied Physics Lab. “We want to be able to trust those systems. We want to have some sort of measure of predictability even if those systems act unpredictably.”

Brig. Gen. Matt Easley, director of the artificial intelligence task force at Army Futures Command, said the service is grappling with those exact challenges, trying to understand how the service can insert “checks and balances” as it trains systems and soldiers.

Easley added that the unmanned systems under development by the Army will have to be adaptable to different environments, such as an urban or desert scenarios. In order to ensure that the systems and soldiers are ready for those scenarios, the Army has to complete a series of tests, just like the autonomous vehicle industry.

“We don't think these systems are going to be 100 percent capable right out of the box,” Easley said on the webinar. “If you look at a lot of the evolution of the self-driving cars throughout our society today, they're doing a lot of experimentation. They're doing lots of testing, lots of learning every day. We in the Army have to learn how to go from doing one to two to three vehicle experiments to have many experiments going on every day across all our camp posts and stations.”

Increasingly autonomous systems also mean that there needs to a cultural shift in among all levels of military personnel who will need to better understand how artificial intelligence is used. Roff said that operators, commanders and judge advocate generals will need to better understand how systems are supposed “to ensure that the human responsibility and governability is there.”

“We need to make sure that we have training, tactics, procedures, as well as policies, ensuring where we know the human decision maker is,” Roff said.

https://www.c4isrnet.com/it-networks/2020/06/18/artificial-intelligence-systems-need-checks-and-balances-throughout-development/

On the same subject

  • Lockheed Martin Continues Partnership With Spain For Future Frigates

    December 6, 2019 | International, Naval

    Lockheed Martin Continues Partnership With Spain For Future Frigates

    Moorestown, N.J., Dec. 5, 2019 – Lockheed Martin (NYSE: LMT) recently signed a contract with Navantia to equip five new F-110 multimission frigates and their land-based test site (Centro de Integración de Sistemas en Tierra or CIST) – with Lockheed Martin's first naval installation of its solid state S-band radar. The new F-110 frigates will be built by Spain's national shipbuilder, Navantia. Recently designated by the U.S. Government as AN/SPY-7(V)1, this technology is derived from current radar programs and significant Lockheed Martin investment. Variants of the SPY-7 radar will also be utilized on programs with Japan's Aegis Ashore, the Royal Canadian Navy for the Canadian Surface Combatant program and the U.S. Government. Why Does It Matter? Providing Spain's homeland with a defense for evolving threats, the F-110 program will further protect the country and its citizens. Equipped with the latest digital, solid-state radar technology, this crucial program: Ensures Spain's warfighters have the most capable combat system to perform new missions. Strengthens Spain's economy through industrial participation. Advances Spain's competitiveness in the global market by providing an opportunity for joint technology development. Paves the way for interoperability with navies across the world, thanks to Aegis' open architecture. What's the Technology? The F-110 will host the first-ever naval solid state S-band radar for the Spanish Navy. To foster the growth of Spain's defense and technology industries, Lockheed Martin and Spanish company, Indra, will jointly provide the radar. It will go to sea as part of the Aegis Weapon System, which will be integrated with the ship's combat management system SCOMBA, when the first frigate deploys in 2026. The Aegis Weapon System is the most deployed combat system in the world, and its flexible system enables it to fulfill a variety of missions. Due in part to its unique open architecture design, the Aegis family continues to grow internationally as more nations around the world partner with Lockheed Martin. What's the History? Lockheed Martin and its Spanish partners have over 20 years of experience in development, production and integration of tactical naval radar systems. Spain's defense industry growth and expansion of their maritime defense portfolio is a mission Lockheed Martin continues to support. In the exciting future that lies ahead, Lockheed Martin will continue to work with Spanish industry to explore new areas of industrial cooperation in radar and combat system technologies. This will help pave the way for future international sales of the F-110 frigate and new technologies, including the new S-band radar. For more information about Lockheed Martin radars, visit www.lockheedmartin.com/en-us/capabilities/radar-sensors.html About Lockheed Martin Headquartered in Bethesda, Maryland, Lockheed Martin is a global security and aerospace company that employs approximately 105,000 people worldwide and is principally engaged in the research, design, development, manufacture, integration and sustainment of advanced technology systems, products and services. View source version on Lockheed Martin: https://news.lockheedmartin.com/2019-12-05-Lockheed-Martin-Continues-Partnership-with-Spain-for-Future-Frigates

  • Pakistan to replace Orion patrol aircraft with Brazilian jetliner

    October 27, 2020 | International, Aerospace, Naval

    Pakistan to replace Orion patrol aircraft with Brazilian jetliner

    Usman Ansari ISLAMABAD — Pakistan's Navy has selected the Embraer Lineage 1000 jetliner to replace its P-3C Orion long-range maritime patrol aircraft, a source with knowledge of the program has confirmed to Defense News. Outgoing naval chief Adm. Adm. Zafar Mahmood Abbasi announced Oct. 6 that the Navy would replace its P-3C Orion fleet with 10 converted commercial jets, the first of which has been ordered. However, he did not identify the type. The Ministry of Defence Production, which handles acquisition, did not return requests for comment regarding the conversion and possible partners. With only a single aircraft ordered thus far, the program is in its early stages. When converted for Pakistani service, the aircraft will be called Sea Sultan. It is unclear if the aircraft is being acquired directly from the manufacturer or another party. Embraer did not respond to requests for comment. The question of what issues may arise in converting the aircraft was put to Douglas Barrie, an aerospace analyst at the International Institute for Strategic Studies: “Using a commercial turbofan engine-powered aircraft as the basis for an ASW [anti-submarine warfare] platform is not unheard of. After all, the U.S. P-8 is a Boeing 737-800 derivative," he said. But there are challenges in converting the aircraft, he added, "not least of all if internal weapons carriage is required where a bomb bay will need to be cut into the airframe.” The question of what issues may arise in converting the aircraft was put to Douglas Barrie, an aerospace analyst at the International Institute for Strategic Studies: “Using a commercial turbofan engine-powered aircraft as the basis for an ASW [anti-submarine warfare] platform is not unheard of. After all, the U.S. P-8 is a Boeing 737-800 derivative," he said. But there are challenges in converting the aircraft, he added, "not least of all if internal weapons carriage is required where a bomb bay will need to be cut into the airframe.” “[It is a] significant undertaking, and risk management is going to be important,” he said, adding that it's likely Embraer will be asked to help with the conversion, “otherwise the challenges just get all the greater.” Frederico Lemos, Embraer's defense representative who handles business in Asia, did not respond to Defense News' questions about whether the company is or would be involved in the conversion process. https://www.defensenews.com/naval/2020/10/26/pakistani-navy-confirms-brazilian-jetliner-will-replace-orion-patrol-aircraft/

  • Saab to expand US footprint with new munitions facility

    March 26, 2024 | International, Land

    Saab to expand US footprint with new munitions facility

    Saab is in the process of selecting a site, having issued a request for proposals. Six states are in the running.

All news