Back to news

February 4, 2019 | International, C4ISR

DARPA: Building Trusted Human-Machine Partnerships

A key ingredient in effective teams – whether athletic, business, or military – is trust, which is based in part on mutual understanding of team members' competence to fulfill assigned roles. When it comes to forming effective teams of humans and autonomous systems, humans need timely and accurate insights about their machine partners' skills, experience, and reliability to trust them in dynamic environments. At present, autonomous systems cannot provide real-time feedback when changing conditions such as weather or lighting cause their competency to fluctuate. The machines' lack of awareness of their own competence and their inability to communicate it to their human partners reduces trust and undermines team effectiveness.

To help transform machines from simple tools to trusted partners, DARPA today announced the Competency-Aware Machine Learning (CAML) program. CAML aims to develop machine learning systems that continuously assess their own performance in time-critical, dynamic situations and communicate that information to human team-members in an easily understood format.

“If the machine can say, ‘I do well in these conditions, but I don't have a lot of experience in those conditions,' that will allow a better human-machine teaming,” said Jiangying Zhou, a program manager in DARPA's Defense Sciences Office. “The partner then can make a more informed choice.”

That dynamic would support a force-multiplying effect, since the human would know the capabilities of his or her machine partners at all times and could employ them efficiently and effectively.

In contrast, Zhou noted the challenge with state-of-the-art autonomous systems, which cannot assess or communicate their competence in rapidly changing situations.

“Under what conditions do you let the machine do its job? Under what conditions should you put supervision on it? Which assets, or combination of assets, are best for your task? These are the kinds of questions CAML systems would be able to answer,” she said.

Using a simplified example involving autonomous car technology, Zhou described how valuable CAML technology could be to a rider trying to decide which of two self-driving vehicles would be better suited for driving at night in the rain. The first vehicle might communicate that at night in the rain it knows if it is seeing a person or an inanimate object with 90 percent accuracy, and that it has completed the task more than 1,000 times. The second vehicle might communicate that it can distinguish between a person and an inanimate object at night in the rain with 99 percent accuracy, but has performed the task less than 100 times. Equipped with this information, the rider could make an informed decision about which vehicle to use.

DARPA has scheduled a pre-recorded webcast CAML Proposers Day for potential proposers on February 20, 2019. Details are available at: https://go.usa.gov/xE9aQ.

The CAML program seeks expertise in machine learning, artificial intelligence, pattern recognition, knowledge representation and reasoning, autonomous system modeling, human-machine interface, and cognitive computing. To maximize the pool of innovative proposal concepts, DARPA strongly encourages participation by non-traditional proposers, including small businesses, academic and research institutions, and first-time Government contractors.

DARPA anticipates posting a CAML Broad Agency Announcement solicitation to the Federal Business Opportunities website in mid-February 2019.

https://www.darpa.mil/news-events/2019-01-31

On the same subject

  • US offers helicopters to Slovakia for giving jets to Ukraine

    March 22, 2023 | International, Aerospace

    US offers helicopters to Slovakia for giving jets to Ukraine

    Bratislava would pay $340 million for the Bell AH-1Z attack choppers in a deal worth about $1 billion that also includes 500 AGM-114 Hellfire II missiles.

  • Réunion extraordinaire du Conseil européen, consacrée à la Défense

    June 2, 2022 | International, Aerospace, Naval, Land, C4ISR, Security

    Réunion extraordinaire du Conseil européen, consacrée à la Défense

    A Bruxelles, lundi 30 et mardi 31 mai, les pays européens dessinent les contours d'une véritable Défense européenne, lors de la réunion extraordinaire du Conseil européen. Avec l'appui de l'Agence européenne de Défense (AED), la Commission européenne a présenté, le 18 mai, une analyse sur les déficits d'investissements en matière de capacité de Défense et sur les réponses à y apporter. Ainsi, entre 1999 et 2021, les dépenses combinées de l'Union européenne dans le domaine de la Défense ont augmenté seulement de 20%, contre 66% pour les États-Unis, 292% pour la Russie et 592% pour la Chine. « Notre base industrielle de Défense n'est aujourd'hui plus adaptée, ni dimensionnée - en volume et cadence - au type de menaces de haute intensité auxquelles nous faisons face » avait commenté, le 18 mai, le commissaire européen Thierry Breton. La Commission envisage lors de la révision du cadre financier pluriannuel de renforcer les budgets du Fonds européen de la Défense (FED) et la mobilité militaire gr'ce au Mécanisme pour l'Interconnexion en Europe (MIE). Ensemble de la presse du 30 mai

  • UK Declared F-35 Operational Despite Issues, Auditors Say

    March 20, 2020 | International, Aerospace

    UK Declared F-35 Operational Despite Issues, Auditors Say

    Tony Osborne The UK declared the F-35 operational even though the fleet was suffering from availability, infrastructure, logistics and security issues, auditors have revealed. The UK National Audit Office (NAO) found that the December 2018 initial operating capability (IOC) from land bases was granted with 67 exceptions, with almost one-third of those still yet to be resolved more than a year later. It is not clear on how many criteria IOC (Land) was judged. In its report studying how new capabilities are delivered into front-line operations, the NAO reported that in the run-up to the milestone there had been delays in the provision of synthetic training facilities. This impacted the availability of pilots and maintainers, while operational availability of the aircraft “hampered the ability to deliver training.” The report appears to confirm the reasons behind a 34-day flying break by the UK-based fleet in the late summer of 2018 reported by Aerospace DAILY. Plans to use simulators for training have been frustrated by “technical difficulties and delays in security vetting.” The NAO said the UK Ministry of Defense is able to use exemptions when bringing a new capability into service. Capabilities that do not meet specifications but are deemed good enough would be given an exemption. The NAO also says that IOC acceptance criteria for the F-35 was not finalized “until several years” after business case approval in the second half of 2017. Exemptions arose from “not being able to demonstrate deployability through a planned exercise,” because of aircraft availability, a reliance on contractors for mission support because of a lack of trained Royal Air Force personnel, and a lack of access to mission support training facilities in the U.S. Another challenge was an inability to program aircraft with UK mission data independently of the U.S. This has since been addressed with the opening of the Australian, Canadian and United Kingdom Reprogramming Laboratory (ACURL) at Eglin AFB, Florida, which was declared operational in February. The NAO notes that some 20 of the exemptions had still not been resolved as of last month. But the NAO says the Royal Air Force and Royal Navy have made progress in the areas of training personnel and logistics. The UK now has 15 F-35Bs based in the country flying with front-line unit 617 Sqdn. and with 207 Sqdn, a training unit. Since their arrival to the UK, the aircraft have been deployed to Cyprus and flown operational missions in the Middle East. They also recently took part in a Tier 1 Red Flag exercise with Five Eyes partners Australia and the U.S. A Lockheed Martin spokesman said that while it was for the customer to answer questions concerning IOC, “the F-35 program globally continues to mature, and Lockheed Martin has made significant steps in terms of reliability and aircraft availability, with the global fleet averaging greater than 65% mission-capable rates and operational units consistently performing near 75%.” Questions to the UK Ministry of Defense had not been answered at the time of publication. https://aviationweek.com/defense-space/budget-policy-operations/uk-declared-f-35-operational-despite-issues-auditors-say

All news