10 novembre 2020 | International, C4ISR

Mixed-reality systems can bring soldier feedback into development earlier than ever before. Here’s how the US Army is using it.

ABERDEEN PROVING GROUND, Md. — The U.S. Army's Combat Capabilities Development Command has made clear it wants to introduce soldier feedback earlier in the design process, ensuring that new technologies are meeting users' needs.

“Within the CCDC, the need to get soldier feedback, to make sure that we're building the appropriate technologies and actually getting after the users' needs is critical,” said Richard Nabors, acting principal deputy for systems and modeling at the command's C5ISR Center (Command, Control, Computers, Communications, Cyber, Intelligence, Surveillance and Reconnaissance).

“There's a concerted effort within the C5ISR Center to do more prototyping not just at the final system level ... but to do it at the component level before the system of systems is put together,” he added.

But how can the service accomplish that with systems still in development?

One answer: virtual reality.

The Army's CCDC is testing this approach with its new artificial intelligence-powered tank concept: the Advanced Targeting and Lethality Aided System, or ATLAS. While tank operations are almost entirely manual affairs, ATLAS aims to automate the threat detection and targeting components of a gunner's job, greatly increasing the speed of end-to-end engagements.

Using machine-learning algorithms and a mounted infrared sensor, ATLAS automatically detects threats and sends targeting solutions to a touch-screen display operated by the gunner. By touching an image of the target, ATLAS automatically slews the tank's gun to the threat and recommends the appropriate ammunition and response type. If everything appears correct, the gunner can simply pull the trigger to fire at the threat.

The process takes just seconds, and the gunner can immediately move on to the next threat by touching the next target on the display.

ATLAS could revolutionize the way tank crews operate — at least in theory. But to understand how the system works with real people involved and whether this is a tool gunners want, CCDC needed to test it with soldiers.

The Army has set up an ATLAS prototype at Aberdeen Proving Ground in Maryland, and it hopes to conduct a live-fire exercise soon with targets in a field. However, to collect useful feedback, CCDC is giving soldiers a more robust experience with the system that involves multiple engagements and varying levels of data quality. To do this, the command has built a mixed-reality environment.

“It gives us the opportunity ... to get the soldiers in front of this system prior to it being here as a soldier touchpoint or using the live system so we get that initial feedback to provide back to the program, to get that soldier-centric design, to get their opinions on the system, be that from how the GUI is designed to some of the ways that the system would operate,” explained Christopher May, deputy director of the C5ISR Center's Modeling and Simulation Division.

The virtual world

In the new virtual prototyping environment — itself a prototype — users are placed in a 3D world that mimics the gunner station while using a physical controller and display that is a carbon copy of the current ATLAS design. The CCDC team can then feed simulated battlefield data into the system for soldiers to respond to as if they were actually using ATLAS.

Like most virtual reality systems, the outside looks less impressive than the rendered universe that exists on the inside. Sitting down at the gunner's seat, the user's vision is enveloped by a trifold of tall blue walls, cutting the individual off from the real world. Directly in front of the chair is a recreation of ATLAS' touch-screen display and a 3D-printed copy of the controller.

Putting on the virtual reality headset, the user is immersed in a 3D rendering of the ATLAS prototype's gunner station, but with some real-world elements.

“We're leveraging multiple technologies to put this together. So as the operator looks around ... he has the ability to see the hand grips. He also has the ability to see his own hands,” May said.

All in all, the mixed-reality environment creates the distinct impression that the user is in the gunner's chair during a real-life engagement. And that's the whole point.

It's important to note the virtual reality system is not meant to test the quality of the AI system. While the system populates the virtual battlefield with targets the same way ATLAS would, it doesn't use the targeting algorithm.

“We're not using the actual algorithm,” May said. “We're controlling how the algorithm performs.”

Switching up the scenarios

Another advantage to the mixed-reality environment: The Army can experiment with ATLAS in different vehicles. CCDC leaders were clear that ATLAS is meant to be a vehicle-agnostic platform. If the Army decides it wants ATLAS installed on a combat vehicle rather than a tank — like the current prototype — the CCDC team could recreate that vehicle within the simulated environment, giving users the opportunity to see how ATLAS would look on that platform.

“We can switch that out. That's a 3D representation,” May said. “This could obviously be an existing tactical vehicle or a future tactical vehicle as part of the virtual prototype.”

But is the virtual reality component really necessary to the experience? After all, the interactions with the ATLAS surrogate take place entirely through the touch screen and the controller, and a soldier could get an idea of how the system works without ever putting on the headset.

May said that, according to feedback he's received, the virtual reality component adds that extra level of realism for the soldier.

“They thought it added to their experience,” May said. “We've run through a version of this without the mixed reality — so they're just using the touch screens and the grips — and they thought the mixed reality added that realism to really get them immersed into the experience.”

“We've had over [40 soldiers] leveraging the system that we have here to provide those early insights and then also to give us some quantitative data on how the soldier is performing,” he added. “So we're looking from a user evaluation perspective: Again, how does the [aided target recognition] system influence the soldier both positively, potentially and negatively? And then what is the qualitative user feedback just of the system itself?”

In other words, the team is assessing how soldiers react to the simulated battlefield they are being fed through the mixed reality system. Not only is the team observing how soldiers operate when the data is perfect; it also wants to see how soldiers are impacted when fed less accurate data.

Soldiers are also interviewed after using the system to get a sense of their general impressions. May said users are asked questions such as “How do you see this impacting the way that you currently do your operations?” or “What changes would you make based off your use of it?”

The virtual prototyping environment is an outgrowth of CCDC's desire to push soldier interactions earlier in the development process, and it could eventually be used for other systems in development.

“We're hoping that this is kind of an initial proof of concept that other programs can kind of leverage to enhance their programs as well,” May said.

“This is a little bit of a pilot, but I think we can expect that across the C5ISR Center and other activities to spend and work a lot more in this virtual environment,” added Nabors. “It's a great mechanism for getting soldier feedback [and] provides us an opportunity to insert new capabilities where possible.”

https://www.c4isrnet.com/artificial-intelligence/2020/11/09/mixed-reality-systems-can-bring-soldier-feedback-into-development-earlier-than-ever-before-heres-how-the-us-army-is-using-it/

Sur le même sujet

  • Croatia plans to order HIMARS this year

    25 août 2024 | International, Terrestre

    Croatia plans to order HIMARS this year

    The country is posed to join a number or central and eastern European nations adopting the weapon system.

  • Contract Awards by US Department of Defense - June 25, 2020

    26 juin 2020 | International, Aérospatial, Naval, Terrestre, C4ISR, Sécurité

    Contract Awards by US Department of Defense - June 25, 2020

    U.S. SPECIAL OPERATIONS COMMAND L3 Unmanned Systems Inc., Ashburn, Virginia (H92408-20-D-0001); Precision Integrated Programs LLC Newberg, Oregon (H92408-20-D-0002); Arcturus UAV Inc., Petaluma, California (H92408-20-D-0003); Insitu Inc., Bingen, Washington (H92408-20-D-0004); Wildflower International Ltd., Santa Fe, New Mexico (H92408-20-D-0005); and AAI Corp., doing business as Textron Unmanned Systems Inc., Hunt Valley, Maryland (H92408-20-D-0006), is awarded six indefinite-delivery/indefinite-quantity contracts with a maximum combined ceiling of $975,000,000 for Mid-Endurance Unmanned Aircraft Systems IV intelligence, surveillance and reconnaissance (ISR) services in support of U.S. Special Operations Command enterprise requirements worldwide. This multiple-award acquisition supports competition at the task-order level to ensure the most capable platforms and payloads provide real-time, responsive airborne ISR solutions to Special Operations Forces. Fiscal 2020 operations and maintenance funds in the amount $1,500 have been obligated for each contract at the time of award. The contracts were awarded competitively through a full and open competition with 10 proposals received. U.S. Special Operations Command, Tampa, Florida, is the contracting activity. ARMY The Boeing Co., Mesa, Arizona, was awarded a $439,179,677 modification (P00062) to contract W58RGZ-16-C-0023 for new-build Apache AH-64E aircraft and Longbow crew trainers. Work will be performed in Mesa, Arizona, with an estimated completion date of March 1, 2025. Fiscal 2020 Foreign Military Sales (Morocco) funds in the amount of $439,179,677 were obligated at the time of the award. U.S. Army Contracting Command, Redstone Arsenal, Alabama, is the contracting activity. BAE Systems Inc., York, Pennsylvania, was awarded a $266,865,094 modification (P00039) to contract W56HZV-18-C-0133 for Bradley A4 Production Option Two, which awards 159 vehicles. Work will be performed in York, Pennsylvania, with an estimated completion date of March 31, 2023. Fiscal 2019 and 2020 weapons and tracked combat vehicle procurement (Army) funds in the amount of $266,865,094 were obligated at the time of the award. U.S. Army Contracting Command, Detroit Arsenal, Michigan, is the contracting activity. BHI Construction LLC,* Harrisburg, South Dakota (W912MM-20-D-0001); G.A. Johnson Construction Inc.,* Harrisburg, South Dakota (W912MM-20-D-0002); Golden Rule Construction Co. Inc.,* Sioux Falls, South Dakota (W912MM-20-D-0003); Howe Inc.,* Sioux Falls, South Dakota, Dakota (W912MM-20-D-0004); MDM Construction LLC.,* West Fargo, North Dakota (W912MM-20-D-0005); and Sunkota Construction Inc.,* Sioux Falls, South Dakota (W912MM-20-D-0006), will compete for each order of a $20,000,000 firm-fixed-price contract to support the National Guard with construction projects. Bids were solicited via the internet with seven received. Work locations and funding will be determined with each order, with an estimated completion date of June 24, 2025. U.S. Property and Fiscal Office, Rapid City, South Dakota, is the contracting activity. Orion Marine Construction Inc., Tampa, Florida, was awarded a $14,648,100 firm-fixed-price contract for pipeline dredging. Bids were solicited via the internet with three received. Work will be performed in Port Mansfield, Texas, with an estimated completion date of March 1, 2021. Fiscal 2019 civil construction funds in the amount of $14,648,100 were obligated at the time of the award. U.S. Army Corps of Engineers, Galveston, Texas, is the contracting activity (W912HY-0C0021). NAVY Northrop Grumman Systems Corp., San Diego, California, is awarded a $333,401,760 modification (P00007) to previously-awarded fixed-price-incentive-firm-target contract N00019-19-C-0008. This modification exercises options for the production and delivery of three low-rate initial production MQ-4C Triton unmanned aircraft, two main operating bases and one forward operating base in an integrated functional capability-four and multiple-intelligence configuration, with associated export compliance support for the government of Australia. Work will be performed in San Diego, California (23.3%); Red Oak, Texas (13%); Palmdale, California (11.5%); Linthicum, Maryland (9.4%); Salt Lake City, Utah (9.3%); Bridgeport, West Virginia (5.2%); McClellan, California (4.7%); Indianapolis, Indiana (4.5%); Moss Point, Mississippi (3.3%); Waco, Texas (2.1%); San Clemente, California (1.5%); Newton, North Dakota (1%); various locations within the continental U.S. (9.8%); and various locations outside the continental U.S. (1.4%). Work is expected to be completed by April 2025. Foreign cooperative project funds for $27,601,190 will be obligated at time of award, none of which will expire at the end of the current fiscal year. The Naval Air Systems Command, Patuxent River, Maryland, is the contracting activity. General Dynamics Information Technology Inc., Falls Church, Virginia, is awarded a $38,824,217 firm-fixed-price, indefinite-delivery/indefinite-quantity contract to provide MK-41 Vertical Launch System repair and refurbishment. Work will be performed in Norfolk, Virginia, and potentially other locations based only on an emergent basis. Work is expected to be completed by June 2021. If options are exercised, work will be completed by June 2025. Fiscal 2020 operations and maintenance (Navy) funding in the amount of $5,000 (for the minimum guarantee) will be obligated at time of award and will expire at the end of the current fiscal year. This contract was procured as full and open competition via the beta.SAM.gov website and one offer was received. The Mid-Atlantic Regional Maintenance Center, Norfolk, Virginia, is the contracting activity (N50054-20-D-0006). The Boeing Co., St. Louis, Missouri, is awarded a $16,543,143 firm-fixed-price order (N00019-20-F-0870) against previously-issued basic ordering agreement N00019-16-G-0001. This order procures retrofit modification upgrades to the series aircrafts' F/A-18 Block II Super Hornet and Growler display suites within the Block III Super Hornet and Growler Advanced Cockpit Systems. Work will be performed in St. Louis, Missouri (65%); Mesa, Arizona (15%); China Lake, California (10%); and Ft. Walton Beach, Florida (10%), and is expected to be completed by February 2025. Fiscal 2020 aircraft procurement (Navy) funds in the amount of $15,075,223; and Foreign Military Sales funds in the amount of $1,467,920 will be obligated at time of award, none of which will expire at the end of the current fiscal year. The Naval Air Systems Command, Patuxent River, Maryland, is the contracting activity. Q.E.D. Systems Inc.,* Virginia Beach, Virginia, is awarded a $14,193,833 cost-plus-fixed-fee, indefinite-delivery/indefinite-quantity contract for Marine Gas Turbine Alteration Installation Team services in support of the Navy's Marine Gas Turbine (MGT) program. Work will be performed at various locations throughout the world based on each individual task order. The purpose of the contract is to provide for the installation of shipboard changes in accordance with approved ship change documents and to effect repairs and troubleshooting in accordance with government specifications on ships which utilize MGTs. Work is expected to be completed by June 2026. Fiscal 2020 operations and maintenance (Navy) funding in the amount of $400,000 will be obligated at time of award and will expire at the end of the current fiscal year. This contract was a small business set-aside and competitively procured via the Contract Opportunities website at beta.SAM.gov and two offers were received. The Naval Surface Warfare Center, Philadelphia Division, Philadelphia, Pennsylvania, is the contracting activity (N64498-20-D-4015). L3 Harris Technologies Inc., Palm Bay, Florida, is awarded an $11,688,708 modification (P00016) to previously-awarded firm-fixed-price contract N00421-17-C-0024. This modification is for the procurement of 133 Fibre Channel Network switches in support of F/A-18 Lot 44 requirements for the EA-18 Growler, F/A-18E/F Super Hornet and E-2D Hawkeye aircraft. Work will be performed in Malabar, Florida, and is expected to be completed by November 2022. Fiscal 2020 aircraft procurement (Navy) funds in the amount of $11,688,708 will be obligated at the time of award, none of which will expire at the end of the current fiscal year. The Naval Air Warfare Center Aircraft Division, Patuxent River, Maryland, is the contracting activity. General Dynamics National Steel and Shipbuilding Co., San Diego, California, is awarded an $11,172,403 modification to previously-awarded contract N00024-18-C-4439 to extend the delivery date of the USS Cowpens (CG 63) fiscal 2018 modernization period from December 28, 2019, to November 25, 2020, in order to complete ship repairs and alterations. Work will be performed in San Diego, California, and is expected to be completed by November 2020. Fiscal 2018 operations and maintenance (Navy) funding in the amount of $11,172,403 will be obligated at time of award and will not expire at the end of the current fiscal year. The use of fiscal 2018 operations and maintenance (Navy) funds was approved by the assistant secretary of the Navy (financial management and comptroller) on May 27, 2020, to fund within scope changes for this availability. The Southwest Regional Maintenance Center, San Diego, California, is the contracting activity. MISSILE DEFENSE AGENCY Kepler Research Inc., Woodbridge, Virginia, is being awarded a $73,119,865 competitive cost-plus-fixed-fee level-of-effort contract with a two-year base value of $16,925,921 and three one-year options for contracting, compliance, cost/price and operations advisory and assistance services. The work will be performed in the National Capital Region; Dahlgren, Virginia; Huntsville, Alabama; and other locations as directed with an estimated completion date of July 2025. This contract was competitively procured via publication on the beta.SAM.gov website with five proposals received. Fiscal 2020 research, development, test and evaluation funds in the amount of $1,099,719 are being obligated at time of award. The Missile Defense Agency, Huntsville, Alabama, is the contracting activity (HQ0858-20-C-0008). DEFENSE LOGISTICS AGENCY Marketing Assessment Inc., Sterling, Virginia (SPE2DE-20-D-0015, $48,000,000); and Manus Medical LLC, Richmond, Virginia (SPE2DE-20-D-0014, $30,000,000), have each been awarded a fixed-price with economic-price-adjustment, indefinite-delivery/indefinite-quantity contract under solicitation SPE2DE-18-R-0001 for medical and surgical supplies. These were competitive acquisitions with 41 responses received. They are five-year contracts with no option periods. Location of performance is Virginia, with an ordering period end date of June 24, 2025, for Marketing Assessment Inc. and July 1, 2025, for Manus Medical LLC. Using customers are Army, Navy, Air Force, Marine Corps and federal civilian agencies. Type of appropriation is fiscal 2020 through 2025 defense working capital funds. The contracting activity is the Defense Logistics Agency Troop Support, Philadelphia, Pennsylvania. The Raytheon Co., McKinney, Texas, has been awarded a $14,737,383 firm-fixed-price delivery order (SPRPA1-20-F-QD02) against a six-year long-term contract (SPRBL1-15-D-0017) for aircraft radar system spare parts. This was a sole-source acquisition using justification 10 U.S. Code 2304 (c)(1), as stated in Federal Acquisition Regulation 6.302-1. Location of performance is Texas, with a Nov. 14, 2022, performance completion date. Using military service is Navy. Type of appropriation is fiscal 2020 through 2022 (Navy) working capital funds. The contracting activity is the Defense Logistics Agency Aviation, Philadelphia, Pennsylvania. *Small Business https://www.defense.gov/Newsroom/Contracts/Contract/Article/2232845/source/GovDelivery/

  • Ultimate Cyber Hygiene Guide: Learn How to Simplify Your Security Efforts

    9 juin 2024 | International, Sécurité

    Ultimate Cyber Hygiene Guide: Learn How to Simplify Your Security Efforts

    Ransomware, DDoS, data breaches—attacks are on the rise. But there's hope. Basic cyber hygiene can make a difference.

Toutes les nouvelles