20 avril 2018 | International, C4ISR, Sécurité

DARPA official: To build trust in AI, machines must explain themselves

By: 

Artificially intelligent systems must be able to explain themselves to operators if they are to be trusted, according to an expert from the Defense Advanced Research Agency, who voiced concern that methods used by current AI systems are often masked by mysterious algorithms.

“A lot of the machine learning algorithms we’re using today, I would tell you ‘good luck,” Fred Kennedy, the director of DARPA’s Tactical Technology Office during a panel at Navy League’s Sea-Air-Space on April 10. “We have no idea why they know the difference between a cat and a baboon.”

“If you start diving down into the neural net that’s controlling it,” Kennedy continued, “you quickly discover that the features these algorithms are picking out have very little to do with how humans identify things.”

Kennedy’s comments were in response to Deputy Assistant Secretary of the Navy for Unmanned Systems Frank Kelley, who described the leap of faith operators must make when dealing with artificially intelligent systems.

“You’re throwing a master switch on and just praying to God that [Naval Research Laboratory] and John’s Hopkins knew what the hell that they were doing,” Kelley said of the process.

The key to building trust, according to Kennedy, lies with the machines.

“The system has to tell us what it’s thinking,” Dr. Kennedy said. “That’s where the trust gets built. That’s how we start to use and understand them.”

DARPA’s Explainable Artificial Intelligence program seeks to teach AI how to do just that. The program envisions systems that will have the ability to explain the rationale behind their decisions, characterize their strengths and weaknesses, and describe how they will behave in the future. Such capabilities are designed to improve teamwork between man and machine by encouraging warfighters to trust artificially intelligent systems.

“It’s always going to be about human-unmanned teaming,” said Kennedy. “There is no doubt about that.”

https://www.defensenews.com/home/2018/04/10/darpa-official-to-build-trust-in-ai-machines-must-explain-themselves/

Sur le même sujet

  • New bill aims to cut the price of spare parts for DoD

    20 janvier 2022 | International, Aérospatial, Naval, Terrestre, C4ISR, Sécurité

    New bill aims to cut the price of spare parts for DoD

    Legislation proposed Wednesday would force government vendors to publicly disclose data about their costs, a move to help the government negotiate better deals for spare parts.

  • U.S. Army And Air Force Team Up For Multi-Domain Operations

    22 janvier 2020 | International, Aérospatial, C4ISR

    U.S. Army And Air Force Team Up For Multi-Domain Operations

    White Sands Missile Range, January 21, 2020  – Two U.S. Air Force F-35s were integrated with the U.S. Army Integrated Air and Missile Defense Battle Command System (IBCS), providing an airborne sensor capability to successfully detect, track and intercept near simultaneous air-breathing threats in a test at White Sands Missile Range, New Mexico. The December 2019 test marked the first time F-35s were used as sensors during an IBCS live fire test against multiple airborne targets. Linking F-35s to IBCS via the Multifunction Advanced Data Link (MADL) provided enhanced situational awareness and weapons-quality track data to engage airborne targets. The proof of concept demonstration used experimental equipment developed by Lockheed Martin, including the Harvest Lightning Ground Station and IBCS adaptation kit (A-Kit). “The F-35’s advanced sensors and connectivity enable it to gather, analyze and seamlessly share critical information with the joint fighting force to lead the multi-domain battlespace,” said Greg Ulmer, Lockheed Martin vice president and general manager of the F-35 program. “This test validated the F-35’s capability to serve as an airborne sensor and extend the range of critical Integrated Air and Missile Defense interceptors.” “This test represents a major milestone for multi-domain operations by leveraging airborne assets to detect and track threats that can then be countered with ground-based effectors. This demonstrates a tremendous capability to defeat threats that are terrain masked or beyond ground-based sensor detection capabilities due to terrain and curvature of the earth,” said Jay Pitman, vice president, Lower Tier Integrated Air and Missile Defense at Lockheed Martin Missiles and Fire Control. This test is the latest in a series of successful activities to demonstrate the F-35’s role as the keystone of the joint force. Lockheed Martin is evolving technologies that connect, share and learn to create a holistic network that provides unprecedented situational awareness across the battlespace and enables Multi-Domain Operations. For additional information, visit our website. About Lockheed Martin Headquartered in Bethesda, Maryland, Lockheed Martin is a global security and aerospace company that employs approximately 105,000 people worldwide and is principally engaged in the research, design, development, manufacture, integration and sustainment of advanced technology systems, products and services. View source version on Lockheed Martin: https://news.lockheedmartin.com/2020-01-21-U-S-Army-and-Air-Force-Team-up-for-Multi-Domain-Operations

  • Airbus A330 delivery brings dedicated tanker capability to South Korean Air Force

    14 novembre 2018 | International, Aérospatial

    Airbus A330 delivery brings dedicated tanker capability to South Korean Air Force

    By: Mike Yeo MELBOURNE, Australia ― The first Airbus A330 Multi Role Tanker Transport for the Republic of Korea Air Force has landed in South Korea for its acceptance tests. According to a news release from the manufacturer, the aircraft, which was piloted by a joint Airbus and Air Force crew, arrived at Gimhae Air Base in Busan after a ferry flight from the Airbus Final Assembly Line in Getafe, Spain, with a stop in Vancouver, Canada. It will now undergo ground and flight tests in Gimhae. The Air Force will be supported by a team from Airbus, which will be based in South Korea for the duration of the tests and until the aircraft is officially handed over to the customer. Airbus did not specify how long the acceptance tests will last, and referred questions about the specifics of the test program to the Air Force. This aircraft is the first of four ordered by South Korea. Its arrival marks the second regional customer of the A330 MRTT to receive its first aircraft this year, with the first of Singapore’s six aircraft having been delivered in August. Another customer, France, had also taken delivery of its first MRTT in October. The A330 MRTT marks the introduction of a dedicated tanker capability for South Korea’s Air Force, and it will allow the service’s fighters to increase their persistence during missions. The service is currently operating the Boeing F-15K Slam Eagle and the Lockheed Martin KF-16C/D Fighting Falcon as its primary combat aircraft. South Korea has also ordered the Lockheed Martin F-35A Lightning II Joint Strike Fighter, with the first one for the Air Force rolling out earlier this year. South Korea selected the A330 MRTT for its $1.26 billion KC-X program in 2015 after evaluating competing proposals from Boeing, with the KC-46 Pegasus, and Israel Aerospace Industries, who proposed converting 767 airliners in a tanker aircraft. https://www.defensenews.com/air/2018/11/13/airbus-a330-delivery-brings-dedicated-tanker-capability-to-south-korean-air-force

Toutes les nouvelles