7 février 2019 | International, C4ISR

DARPA: Defending Against Adversarial Artificial Intelligence

Today, machine learning (ML) is coming into its own, ready to serve mankind in a diverse array of applications – from highly efficient manufacturing, medicine and massive information analysis to self-driving transportation, and beyond. However, if misapplied, misused or subverted, ML holds the potential for great harm – this is the double-edged sword of machine learning.

“Over the last decade, researchers have focused on realizing practical ML capable of accomplishing real-world tasks and making them more efficient,” said Dr. Hava Siegelmann, program manager in DARPA's Information Innovation Office (I2O). “We're already benefitting from that work, and rapidly incorporating ML into a number of enterprises. But, in a very real way, we've rushed ahead, paying little attention to vulnerabilities inherent in ML platforms – particularly in terms of altering, corrupting or deceiving these systems.”

In a commonly cited example, ML used by a self-driving car was tricked by visual alterations to a stop sign. While a human viewing the altered sign would have no difficulty interpreting its meaning, the ML erroneously interpreted the stop sign as a 45 mph speed limit posting. In a real-world attack like this, the self-driving car would accelerate through the stop sign, potentially causing a disastrous outcome. This is just one of many recently discovered attacks applicable to virtually any ML application.

To get ahead of this acute safety challenge, DARPA created the Guaranteeing AI Robustness against Deception (GARD) program. GARD aims to develop a new generation of defenses against adversarial deception attacks on ML models. Current defense efforts were designed to protect against specific, pre-defined adversarial attacks and, remained vulnerable to attacks outside their design parameters when tested. GARD seeks to approach ML defense differently – by developing broad-based defenses that address the numerous possible attacks in a given scenario.

“There is a critical need for ML defense as the technology is increasingly incorporated into some of our most critical infrastructure. The GARD program seeks to prevent the chaos that could ensue in the near future when attack methodologies, now in their infancy, have matured to a more destructive level. We must ensure ML is safe and incapable of being deceived,” stated Siegelmann.

GARD's novel response to adversarial AI will focus on three main objectives: 1) the development of theoretical foundations for defensible ML and a lexicon of new defense mechanisms based on them; 2) the creation and testing of defensible systems in a diverse range of settings; and 3) the construction of a new testbed for characterizing ML defensibility relative to threat scenarios. Through these interdependent program elements, GARD aims to create deception-resistant ML technologies with stringent criteria for evaluating their robustness.

GARD will explore many research directions for potential defenses, including biology. “The kind of broad scenario-based defense we're looking to generate can be seen, for example, in the immune system, which identifies attacks, wins and remembers the attack to create a more effective response during future engagements,” said Siegelmann.

GARD will work on addressing present needs, but is keeping future challenges in mind as well. The program will initially concentrate on state-of-the-art image-based ML, then progress to video, audio and more complex systems – including multi-sensor and multi-modality variations. It will also seek to address ML capable of predictions, decisions and adapting during its lifetime.

A Proposers Day will be held on February 6, 2019, from 9:00 AM to 2:00 PM (EST) at the DARPA Conference Center, located at 675 N. Randolph Street, Arlington, Virginia, 22203 to provide greater detail about the GARD program's technical goals and challenges.

Additional information will be available in the forthcoming Broad Agency Announcement, which will be posted to www.fbo.gov.

https://www.darpa.mil/news-events/2019-02-06

Sur le même sujet

  • Lockheed Martin receives $2.3B deal for helicopter parts maintenance

    3 février 2020 | International, Aérospatial

    Lockheed Martin receives $2.3B deal for helicopter parts maintenance

    ByChristen McCurdy Jan. 31 (UPI) -- Lockheed Martin has received a $2.3 billion contract for parts maintenance for MH-60R and MH-60S helicopters for the U.S. Navy, the Department of Defense announced. The MH-60R -- also called the 'Romeo' aircraft -- has been operational since 2006. The helicopters are jointly built by Lockheed and Sikorsky Aircraft Corp. According to Lockheed, MH-60R replaces the SH-60B Bravo and SH-60F Foxtrot, and is equipped for combat duty as well as high-risk rescues. Itcan fly at speeds of up to 180 knots while carrying extra fuel tanks or torpedoes and Hellfire missiles. The MH-60S, also called the Knighthawk, replaced the CH-46 Sea Knight helicopters in 2001 and is used seek out and destroy naval mines from the air. Both models have a digital cockpit with four flat-panel color display screens that provide the crew access to advanced surveillance and information on weather conditions. The contract funds approximately 1,049 weapon replaceable assemblies and shop replaceable assemblies associated with both helicopter models. Forty-eight percent of work on the contract will be performed at various contractor supplier locations throughout the U.S., with 38 percent of work taking place in Stratford, Conn., and Owego, N.Y. Work should be completed by January 2025, but the contract does include an option that would extend the work through January 2027. https://www.upi.com/Defense-News/2020/01/31/Lockheed-Martin-receives-23B-deal-for-helicopter-parts-maintenance/3901580519254/

  • Croatia gives Israel deadline for sale of US-made fighter jets

    4 janvier 2019 | International, Aérospatial

    Croatia gives Israel deadline for sale of US-made fighter jets

    Croatia urges Israel to overcome disagreement with the US by January 11 or says it will cancel deal. Croatia has urged Israel to overcome a rare disagreement with the United States and to confirm it can carry through on a deal to sell 12 used American-made fighter jets. Croatia's Defence Ministry said on Thursday it needed an answer from Israel by January 11 or the Balkan country's $500m order for a dozen F-16 aircraft would be cancelled. Israel made a tentative deal to sell the upgraded F-16 Barak fighters to Croatia in March pending US approval for allowing the jets to go to a third party. The deal ran into trouble after the US State Department hinted that Israel needs to strip off the upgrades that were added after Israel took delivery of the planes from the US some 30 years ago. Israel upgraded the jets with sophisticated electronic and radar systems, which was crucial in Croatia's decision to buy the planes from Israel rather than from the US. "If the planes are not in accordance with what we have agreed, the deal will not be carried out and we will have another purchase bid," Croatia's parliament speaker, Gordan Jandrokovic, said. Relations between the Trump administration and Israel have been very close, particularly on defence issues. But the sale of the jets to Croatia appears to be an exception. US Secretary of State Mike Pompeo and Israeli Prime Minister Benjamin Netanyahu met on Tuesday in Brazil but didn't agree on a way to end the impasse. "We are expecting final and clear stands from both Israel and the United States on this issue and then we will make a final decision," Croatian Prime Minister Andrej Plenkovic said. Croatian Defence Minister Damir Krsticevic said Thursday that Israel provided guarantees during the contract bidding process that US officials would greenlight the sale. The controversy over the bid has triggered calls for the defence minister's resignation. The deal is Croatia's largest single military buy since it split from the Yugoslav federationduring the 1991-95 war. NATO member Croatia faces a mini arms race with Russian ally Serbia, which recently received six used Russian MiG-29 fighter jets. SOURCE: NEWS AGENCIES https://www.aljazeera.com/news/europe/2019/01/croatia-israel-deadline-sale-fighter-jets-190103180521852.html

  • HENSOLDT receives order for further TRS-4D radars for German Navy F126 frigates

    19 août 2024 | International, Naval

    HENSOLDT receives order for further TRS-4D radars for German Navy F126 frigates

    The TRS-4D naval radar from HENSOLDT will be installed in its non-rotating version with four fixed antenna arrays.

Toutes les nouvelles