Back to news

November 10, 2020 | International, C4ISR

Mixed-reality systems can bring soldier feedback into development earlier than ever before. Here’s how the US Army is using it.

ABERDEEN PROVING GROUND, Md. — The U.S. Army's Combat Capabilities Development Command has made clear it wants to introduce soldier feedback earlier in the design process, ensuring that new technologies are meeting users' needs.

“Within the CCDC, the need to get soldier feedback, to make sure that we're building the appropriate technologies and actually getting after the users' needs is critical,” said Richard Nabors, acting principal deputy for systems and modeling at the command's C5ISR Center (Command, Control, Computers, Communications, Cyber, Intelligence, Surveillance and Reconnaissance).

“There's a concerted effort within the C5ISR Center to do more prototyping not just at the final system level ... but to do it at the component level before the system of systems is put together,” he added.

But how can the service accomplish that with systems still in development?

One answer: virtual reality.

The Army's CCDC is testing this approach with its new artificial intelligence-powered tank concept: the Advanced Targeting and Lethality Aided System, or ATLAS. While tank operations are almost entirely manual affairs, ATLAS aims to automate the threat detection and targeting components of a gunner's job, greatly increasing the speed of end-to-end engagements.

Using machine-learning algorithms and a mounted infrared sensor, ATLAS automatically detects threats and sends targeting solutions to a touch-screen display operated by the gunner. By touching an image of the target, ATLAS automatically slews the tank's gun to the threat and recommends the appropriate ammunition and response type. If everything appears correct, the gunner can simply pull the trigger to fire at the threat.

The process takes just seconds, and the gunner can immediately move on to the next threat by touching the next target on the display.

ATLAS could revolutionize the way tank crews operate — at least in theory. But to understand how the system works with real people involved and whether this is a tool gunners want, CCDC needed to test it with soldiers.

The Army has set up an ATLAS prototype at Aberdeen Proving Ground in Maryland, and it hopes to conduct a live-fire exercise soon with targets in a field. However, to collect useful feedback, CCDC is giving soldiers a more robust experience with the system that involves multiple engagements and varying levels of data quality. To do this, the command has built a mixed-reality environment.

“It gives us the opportunity ... to get the soldiers in front of this system prior to it being here as a soldier touchpoint or using the live system so we get that initial feedback to provide back to the program, to get that soldier-centric design, to get their opinions on the system, be that from how the GUI is designed to some of the ways that the system would operate,” explained Christopher May, deputy director of the C5ISR Center's Modeling and Simulation Division.

The virtual world

In the new virtual prototyping environment — itself a prototype — users are placed in a 3D world that mimics the gunner station while using a physical controller and display that is a carbon copy of the current ATLAS design. The CCDC team can then feed simulated battlefield data into the system for soldiers to respond to as if they were actually using ATLAS.

Like most virtual reality systems, the outside looks less impressive than the rendered universe that exists on the inside. Sitting down at the gunner's seat, the user's vision is enveloped by a trifold of tall blue walls, cutting the individual off from the real world. Directly in front of the chair is a recreation of ATLAS' touch-screen display and a 3D-printed copy of the controller.

Putting on the virtual reality headset, the user is immersed in a 3D rendering of the ATLAS prototype's gunner station, but with some real-world elements.

“We're leveraging multiple technologies to put this together. So as the operator looks around ... he has the ability to see the hand grips. He also has the ability to see his own hands,” May said.

All in all, the mixed-reality environment creates the distinct impression that the user is in the gunner's chair during a real-life engagement. And that's the whole point.

It's important to note the virtual reality system is not meant to test the quality of the AI system. While the system populates the virtual battlefield with targets the same way ATLAS would, it doesn't use the targeting algorithm.

“We're not using the actual algorithm,” May said. “We're controlling how the algorithm performs.”

Switching up the scenarios

Another advantage to the mixed-reality environment: The Army can experiment with ATLAS in different vehicles. CCDC leaders were clear that ATLAS is meant to be a vehicle-agnostic platform. If the Army decides it wants ATLAS installed on a combat vehicle rather than a tank — like the current prototype — the CCDC team could recreate that vehicle within the simulated environment, giving users the opportunity to see how ATLAS would look on that platform.

“We can switch that out. That's a 3D representation,” May said. “This could obviously be an existing tactical vehicle or a future tactical vehicle as part of the virtual prototype.”

But is the virtual reality component really necessary to the experience? After all, the interactions with the ATLAS surrogate take place entirely through the touch screen and the controller, and a soldier could get an idea of how the system works without ever putting on the headset.

May said that, according to feedback he's received, the virtual reality component adds that extra level of realism for the soldier.

“They thought it added to their experience,” May said. “We've run through a version of this without the mixed reality — so they're just using the touch screens and the grips — and they thought the mixed reality added that realism to really get them immersed into the experience.”

“We've had over [40 soldiers] leveraging the system that we have here to provide those early insights and then also to give us some quantitative data on how the soldier is performing,” he added. “So we're looking from a user evaluation perspective: Again, how does the [aided target recognition] system influence the soldier both positively, potentially and negatively? And then what is the qualitative user feedback just of the system itself?”

In other words, the team is assessing how soldiers react to the simulated battlefield they are being fed through the mixed reality system. Not only is the team observing how soldiers operate when the data is perfect; it also wants to see how soldiers are impacted when fed less accurate data.

Soldiers are also interviewed after using the system to get a sense of their general impressions. May said users are asked questions such as “How do you see this impacting the way that you currently do your operations?” or “What changes would you make based off your use of it?”

The virtual prototyping environment is an outgrowth of CCDC's desire to push soldier interactions earlier in the development process, and it could eventually be used for other systems in development.

“We're hoping that this is kind of an initial proof of concept that other programs can kind of leverage to enhance their programs as well,” May said.

“This is a little bit of a pilot, but I think we can expect that across the C5ISR Center and other activities to spend and work a lot more in this virtual environment,” added Nabors. “It's a great mechanism for getting soldier feedback [and] provides us an opportunity to insert new capabilities where possible.”

https://www.c4isrnet.com/artificial-intelligence/2020/11/09/mixed-reality-systems-can-bring-soldier-feedback-into-development-earlier-than-ever-before-heres-how-the-us-army-is-using-it/

On the same subject

  • US Army cancels current effort to replace Bradley vehicle

    January 16, 2020 | International, Land

    US Army cancels current effort to replace Bradley vehicle

    By: Jen Judson WASHINGTON — The U.S. Army is taking a step back on its effort to replace its Bradley Infantry Fighting Vehicle after receiving only one bid in its competitive prototyping program, but this does not mean the end of the road for the future optionally manned fighting vehicle, service leaders told reporters Jan. 16 at the Pentagon. Until now, the Army has been tight-lipped ever since it appeared the competitive effort was no longer competitive, as the service had received only one prototype submission. “Today the U.S. Army will cancel the current solicitation for the Section 804 Middle Tier acquisition rapid prototyping phase of the [optionally manned fighting vehicle]. Based on feedback and proposals received from industry, we have determined it is necessary to revisit the requirements, acquisition strategy and schedule moving forward,” said Bruce Jette, the Army's acquisition chief. “Since its inception, the OMFV program has represented an innovative approach to Army acquisition by focusing on delivering an essentially new capability to armored brigade combat teams under a significantly reduced timeline compared to traditional acquisition efforts. The Army asked for a great deal of capability on a very aggressive schedule and, despite an unprecedented number of industry days and engagements to include a draft request for proposals over a course of nearly two years, all of which allowed industry to help shape the competition, it is clear a combination of requirements and schedule overwhelmed industry's ability to respond within the Army's timeline,” Jette said. “The need remains clear. OMFV is a critical capability for the Army, and we will be pressing forward after revision." In October, the Army ended up with only one bidder in the OMFV competition — General Dynamics Land Systems. The service had planned to hold a prototyping competition, selecting two winning teams to build prototypes with a downselect to one at the end of an evaluation period. Defense News broke the news that another expected competitor — a Raytheon and Rheinmetall team — had been disqualified from the competition because it had failed to deliver a bid sample to Aberdeen Proving Ground, Maryland, by the deadline. A bellwether for what was to come in the prototyping competition happened earlier in the year when BAE Systems, which manufactures the Bradley, decided not compete, Defense News first reported. And, according to several sources, Hanwha also considered competing but decided against the opportunity. The CEO of BAE Systems' U.S.-based business, Jerry DeMuro, told Defense News in a recent interview that the company didn't regret its decision not to pursue OMFV as the requirements and schedule were previously laid out, but said it continues to talk to the Army about future opportunities. “It was a very challenging program,” DeMuro said. “It always comes down to three things: requirements, schedule and funding. The schedule was very, very aggressive, especially early on, and at the same time trying to get leap-ahead technologies. There's a little bit of dichotomy there. “The requirements that were being asked for was going to require, in our estimation, significantly more development that could not be done in that time frame and significantly more capital than the Army was willing to apply.” Jette said the Army had a large number of vendors interested in the effort, hosted 11 industry days and had a number of draft requests for proposals on the street, but, he said, “it's always a challenge for industry. I was on the outside two years ago, and you get an RFP in after the discussions — it still cannot align with what you thought, and that is what you have to respond to is the RFP.” The acquisition chief believes what happened in this case is there was “a large number interested, they started paring down, which started causing us some uncertainty about the competition, but we still had viable vendors in. And when you get out to actually delivering on those requirements, we had one vendor who had challenges meeting compliance issues with delivery, and the second vendor had difficulty meeting responsive issues, critical issues within the requirement — not knowing how to fulfill that.” When pressed as to whether GDLS met the requirements with its bid sample, the Army's program executive officer for ground combat systems, Brig. Gen. Brian Cummings, who was present at the media roundtable along with the Next-Generation Combat Vehicle Cross-Functional Team leader Brig. Gen. Ross Coffman, said the Army could not discuss results and findings regarding the company's submission. Several sources confirmed a letter was circulating around Capitol Hill from GDLS to the Army secretary that strongly urged the service to continue with the program without delay. So now it's back to the drawing board to ensure the Army gets the prototyping program right. Jette took pains to stress that the OMFV effort is not a failed program with the likes of Comanche, Future Combat Systems, Crusader or the Armed Reconnaissance Helicopter. “This is a continuing program. This is an initial effort at trying to get to a programmatic solution yielded, input that we needed to evaluate, which said we needed to revise our approach, not abandon the program or that it was a failure.” Some major failed programs in the past, Jette noted, were canceled after spending large amounts of money and still moving along even though problems were identified as the service proceeded. Crusader cost about $2 billion, Comanche about $6.9 billion and Future Combat Systems about $19 billion, Jette said. “We've spent a very small amount of money in trying to get to where we are, and in fact a good bit of the technology development that was part of the assessment phase is still totally recoverable," he added. Army Futures Command chief Gen. Mike Murray told the same group of reporters he is hesitant to call OMFV a program because it's a prototyping program, not a program of record. “We are still committed to this. This is like a tactical pause,” he said. The effort so far “gave us a great deal of clarity in understanding what is truly doable,” Jette noted. Army leaders said they would be unable to estimate how long its renewed analysis on the program might take before proceeding with a new solicitation to industry, or what that would mean for the program's schedule in its entirety. The original plan was to field OMFV in 2026. Last month, Congress hacked funding for the OMFV prototyping program, providing $205.6 million in fiscal 2020, a reduction of $172.8 million, which would have made it impossible to conduct a competitive prototyping effort. What happens to that funding or congressional support for the overall program is unclear. While sources confirmed to Defense News in early October that the failure with the OMFV prototyping effort revealed rifts between the acquisition community and the Army's new modernization command, Army Futures Command, Jette said while there is a bit of “scuffing here and there" the two organizations are working together “much better.” Murray added it is his view that the acquisition community and Army Futures Command is moving forward as “one team” with “one goal in mind.” https://www.defensenews.com/land/2020/01/16/army-takes-step-back-on-bradley-replacement-prototyping-effort/

  • Marines want electroshock rounds to fire from standard weapons

    September 5, 2018 | International, Land

    Marines want electroshock rounds to fire from standard weapons

    By: Todd South Marines have dazzling laser lights to wave off unwanted intruders at checkpoints and close-range police-style Tasers for crowd control. But what about when a Marine needs to reach out and shock someone? A new notice posted on the Department of Defense Small Business Innovation Research website shows that the Marines are looking for a Taser round that can be fired from conventional weapons such as 9 mm pistols, 12-gauge shotguns or even 40 mm grenade launchers, first reported by The National Interest. This request for Small Arms Long-Range Human Electro-Muscular Incapacitation Munition, or HEMI, is one of a range of nonlethal weapons sought and being fielded by all the services. The Army announced in June it would acquire a paintball-type gun that fires a round that releases a “debilitating cloud” of irritant, much like hot sauce. Earlier this year at a Pentagon showcase, the Joint Non-Lethal Weapons Program displayed concepts and prototypes of weapons, specifically lasers, that would do everything from heat a person's skin from a distance to create a plasma ball at any location that can “talk” to a target to ward it away from a restricted area. Full article: https://www.marinecorpstimes.com/news/your-marine-corps/2018/09/04/marines-want-electroshock-rounds-to-fire-from-standard-weapons

  • Meet Britain's new ship that will test autonomous and lethal technologies

    July 29, 2022 | International, Naval, C4ISR

    Meet Britain's new ship that will test autonomous and lethal technologies

    The 270-ton vessel will be used by NavyX, the British Royal Navy's experimental technology unit.

All news