22 juin 2020 | International, C4ISR

Artificial intelligence systems need ‘checks and balances’ throughout development

The Pentagon's primary artificial intelligence hub is already studying how to aim a laser at the correct spot on an enemy vehicle, pinpointing which area to target to inflict the most damage, and identifying the most important messages headed to commanders, officials said June 16.

But as part of that work, the Department of Defense needs to carefully implement checks and balances into the development process, experts urged June 16.

“Fundamentally I would say there's a requirement ... that there's going to be a mixture of measures taken to ensure the governability of the system from the first stage of the design of the system all the way up through the operations of the system in a combat scenario,” said Greg Allen, the Joint Artificial Intelligence Center's chief of strategy and communications at the Joint Artificial Intelligence Center, at the Defense One Tech Summit June 16.

The JAIC is working on several lethality projects through its new joint warfighting initiative, boosted by a new contract award to Booz Allen potentially worth $800 million.

“With this new contract vehicle, we have the potential to do even more this next year than we did in the past,” Allen said.

Meanwhile, the Army's Artificial Intelligence Task Force is working on an advanced threat recognition project. DARPA is exploring complementing AI systems that would identify available combat support assets and quickly plan their route to the area.

Throughout all of the development work, experts from the military and from academia stressed that human involvement and experimentation was critical to ensuring that artificial intelligence assets are trustworthy. The department has released a document of five artificial intelligence ethical principles, but the challenge remains implementing those principles into projects across a department with disparate services working on separate artificial intelligence projects.

“We want safe, reliable and robust systems deployed to our warfighters,” said Heather Roff, senior research analyst at the Johns Hopkins Applied Physics Lab. “We want to be able to trust those systems. We want to have some sort of measure of predictability even if those systems act unpredictably.”

Brig. Gen. Matt Easley, director of the artificial intelligence task force at Army Futures Command, said the service is grappling with those exact challenges, trying to understand how the service can insert “checks and balances” as it trains systems and soldiers.

Easley added that the unmanned systems under development by the Army will have to be adaptable to different environments, such as an urban or desert scenarios. In order to ensure that the systems and soldiers are ready for those scenarios, the Army has to complete a series of tests, just like the autonomous vehicle industry.

“We don't think these systems are going to be 100 percent capable right out of the box,” Easley said on the webinar. “If you look at a lot of the evolution of the self-driving cars throughout our society today, they're doing a lot of experimentation. They're doing lots of testing, lots of learning every day. We in the Army have to learn how to go from doing one to two to three vehicle experiments to have many experiments going on every day across all our camp posts and stations.”

Increasingly autonomous systems also mean that there needs to a cultural shift in among all levels of military personnel who will need to better understand how artificial intelligence is used. Roff said that operators, commanders and judge advocate generals will need to better understand how systems are supposed “to ensure that the human responsibility and governability is there.”

“We need to make sure that we have training, tactics, procedures, as well as policies, ensuring where we know the human decision maker is,” Roff said.

https://www.c4isrnet.com/it-networks/2020/06/18/artificial-intelligence-systems-need-checks-and-balances-throughout-development/

Sur le même sujet

  • Italy to test Starlink satellites to boost internet penetration

    15 octobre 2024 | International, Aérospatial

    Italy to test Starlink satellites to boost internet penetration

  • As European defense evolves, here’s how industry is responding

    13 juin 2018 | International, Aérospatial, Naval, Terrestre, C4ISR

    As European defense evolves, here’s how industry is responding

    WASHINGTON — As priorities in Europe evolve, particularly with the threat of Russia growing more profound, industry partners are left to adapt. Defense News spoke to Kim Ernzen, vice president of land warfare systems in Raytheon Missile Systems, to find out the company's approach to meeting customer expectations. EU and NATO cooperation on defense is evolving. As they work out roles, is it challenging for industry? From an international or global footprint, we are looking to continue to expand in international marketspaces. As we look particularly to EU and NATO starting to cooperate more, the EU brings some capabilities to the table. Obviously NATO is typically backed more from the U.S. [But] it's how we merge the capabilities together so the fighting forces have what they need when they go into harm's way. From a U.S. defense industry perspective, we like to make sure we protect the latest and greatest. When we look to international, we work through the normal releasability channels to make sure we can release our products. I think there is going to be increased opportunity, because the threats are continuing to evolve. From a pure RMS perspective, we're well positioned to support [combatting] those threats. We continue to work closely not only with the U.S.-based customer, but through them, the international partners to look at the capabilities they may need. Missile defense remains a huge priority in Europe, but how have hybrid warfare tactics, particularly from Russia, influences defense strategies and as a result the investments? As we as a nation look at how to pivot from urban warfare of the last two decades to what many would consider more traditional warfare, but with added complexities of things like cyberattacks, EW. So now you go into overmatch capability, a long-range standoff capability. Army is focused on how to get long-range precision fires that supports the [combatant commands] in the international footprints, being able to protect the European front against advancing Russia threats. And it's got to have that standup capability, they also have to be able to see further. From a company perspective, we're involved in the PRSM [program] — the new Long Range Precision Fire competition between us and Lockheed Martin. And we're also working to enhance the sighting capability on the vehicle, so they can see farther and identity threats sooner. We see a lot of exercises in Europe. Does industry have enough of a seat at the table? We don't necessarily engage one-on-one with the exercising activities that go on; we'll get feedback through customer communities. This is something we talk with our customers about continually: the more we can be engaged, the more we can bring to bear, whether company investments, a spin on the product; the more we can partner with the customer community, sooner, the better it is for them and us as well. We just haven't necessarily always done that. We've seen a great deal of emphasis on increased defense spending of our European allies. Have you seen a bump up? Or if not, where do you see them focusing in on in terms of spending? We have seen a modest increase, particularly across the munitions fronts. Everyone [is looking] in the cupboard drawer, wanting to make sure they have the right stockpiles should they need to go into any engagement with the enemy. We're also continuing to see internationally more system integrated solutions. Not just coming forward with a product, but how a system would work and operate so they can be more nimble in the battlefield. That's a transition we're seeing. The FMS system can be painful to work through. Have their been improvements? We need to look at [whether we] can start converting more programs to direct commercial sales, depending on where we're at in a lifecycle of a product, and what it is we're trying to protect or throttle. FMS is a slow an laborious process. It hinders industry from capitalizing on market opportunities. The more we can change the paradigm and partner with the government side to do more [direct sales], the more they will benefit long term because they get the volume to drive down prices, and allow us to recoup funds to invests in future technology. But there are challenges, because each branches has organizations that support foreign military sales. There's a balance. As more and more countries seek indigenous capacities as well as a return on defense investments domestically, has the nature of partnership changed? Part of partnering with some of these countries involves offset requirements. Often as we start to partner with indigenous capable industries, it used to be ok to [offer up] basic machining. But there is more pull for being able to put high levels of noble work into these countries. Some are more advanced in capabilities, and as we look to partner, how to do we strike that balance, leveraging some technology they may bring to bear, with what we're trying to keep domestically and protected? It's an interesting paradigm. And a tipping point with how U.S. industry deals with going international. https://www.defensenews.com/digital-show-dailies/eurosatory/2018/06/12/as-european-defense-evolves-heres-how-industry-is-responding/

  • Embraer Predicts E175-E2 First Flight By Year-End

    10 octobre 2019 | International, Aérospatial

    Embraer Predicts E175-E2 First Flight By Year-End

    Helen Massy-Beresford Brazilian aircraft manufacturer Embraer expects the E175-E2 to make its first flight later this year, with an entry into service for the latest member of its new-generation E-Jets family expected at the end of 2021. Meanwhile, the E195-E2, Embraer's largest commercial aircraft, which offers up to 146 seats and boasts lower operating costs per seat, better fuel consumption and lower emissions, is partway through a global demonstration tour. The tour has just left Europe and is now in North America before heading to Africa next month. “The first prototype of the E175-E2 is being built, and the engine is being hung. We're looking forward to going into service at the end of 2021 and to the first flight at the end of this year,” Martyn Holmes, Embraer Commercial Aviation's VP for Europe, Russia, Central Asia and Leasing, told a press conference at the European Regions Airline Association general assembly Oct. 9. “I think there are great opportunities for the E175-E2 in western continental Europe, I think it will be a great hub feeder. We're stepping up our activity with airlines–watch this space.” As for the E195-E2, following certification by Brazilian, European and U.S. authorities in April, Embraer delivered its first aircraft Sept. 12 to Brazilian low-cost operator Azul, the type's global launch operator, and to lessor AerCap. The E195-E2 is due to enter service with Binter Canarias and Helvetic Airways in the next few weeks. Embraer Commercial Aviation CEO John Slattery also said the manufacturer is considering the turboprop market. “There's absolutely a place in the world for turboprops but the current technology for turboprops is over three decades old,” he said. “I do believe there is an opportunity to significantly improve the operations and the emissions against what's available in the market today in turboprops. “This is something we have been looking at now in earnest for quite some time. We're continuing to spend meaningful dollars in continuing our review. We're always running the ruler over what's next. We're also running the ruler over what should come after the turboprop: What should we be doing on electric hybrid or autonomous travel, for example. There's a role for turboprops, and I'd like to own a piece of that, but we haven't quite closed the business case yet.” Embraer has spoken to operators and lessors in the turboprop segment around the world who “uniformly” see a market for a new-technology turboprop that would yield reduced operating costs and emissions, Slattery added. https://aviationweek.com/crossover-narrowbody-jets/embraer-predicts-e175-e2-first-flight-year-end

Toutes les nouvelles