Back to news

July 20, 2020 | International, C4ISR

Augmented reality: Seeing the benefits is believing

Lt. Col. Brett Lindberg and

There is always something taken away when there are added functionalities. Does the concept of wearing augmented reality that digitally provides situational awareness create an upside that outweighs what it takes away for rifleman skills? The supercharged hearing, six senses for those equipped, broader view of sight, picking up smells, changes in lights and shadows, slightest change in the near environment: With all these close-action skills, will augmented reality create more distraction than enhancement? Is it too early to push digital situational awareness all the way down to the soldier in maneuver units? Is the upside present?

Naturally, all new defense technology takes time to find its place in the fight. The helicopter was invented in the 1930s, and it found a limited military role in the Korean War, not meeting the military expectation of higher impact. But 15 years later, it played a pivotal role in the war in Vietnam. New technology is not only technology — the human component to properly implement it is likely slower than the technological advancements.

It is always easier to question than explain, and we understand that many thoughts and thousands of work hours have gone into designing the early augmented reality systems. However, still we find our questions worth discussing because once fielded, utilized and put into action in a conflict, it is too late to raise any concerns. This is the time to discuss.

How reliable are the sensors? Can the sensors be easily spoofed? Is it too early to push it all the way down to the individual soldier? A technologically advanced adversary will likely devote research already in peacetime to develop one-time use, tossable, simple, low-cost devices that can — in close combat — create spurious sensor data and derail augmented reality. If the integrity of the sensor data is in question, it will likely force commanders to refrain from using augmented reality.

A similar, relevant issue is the extent of the augmented reality technology's electromagnetic signature. Will the interconnectivity of the squad's augmented reality compromise the unit and deliver information to the enemy? What we do not want to face is a situation where adversaries can pinpoint the location or proximity to U.S. forces by simple detection measures.

So, worst-case scenario, inexpensive devices can nullify a significant U.S. investment in technology, training and tactics. Added to the loss of usable augmented reality equipment, the soldiers could be “HUD-crippled.” Navy aviators use the term “HUD-cripple” to visualize a complete dependency of heads-up displays in the cockpit. The “HUD-cripple” is the loss of traditional Navy aviator skills such as landing on an aircraft carrier without the heads-up display. Will soldiers have retained the skills to fight effectively without augmented reality if it goes down?

Technical advancements bring us new options and abilities, and they increase mission success. But as with all uncharted territory, they also bring surprises and unanticipated outfalls. During the war in Vietnam in the 1960s and 1970s, military aviation instruments took a significant leap forward, going from World War II-styled gauges in fixed-winged Douglas A-1 Skyraider planes to an earlier version of today's instrumentation in McDonnell Douglas F-15 Eagle fighter jets rolled out as the war in Vietnam came to an end.

Parallel with the military advancements, these avionic upgrades were transposed into civilian cockpits with increased complexity and variations, as jetliners are multi-engine airframes, where the number of information points and alarms became numerous in the jetliner cockpit. In the late 1970s and early 1980s, civilian aviation faced several accidents that were hard to explain with standard aviation physics and crash evidence. Instead, the conversations recorded in the black boxes revealed these fatal air crashes. Several of the deadly crashes could have had another outcome if the pilots had not become overwhelmed by all the blinking lights, alarms, buzzers and avionics grabbing their attention, so the pilots lost situational awareness and focus.

The warnings, avionics and buzzers had the correct information, but the presentation was a tsunami of red blinkers and alarming sounds, lacking any hints on how to prioritize what needs to be done to recover from a dangerous in-flight emergency.

In our view, the key to effective augmented reality is to structure and segment what matters and when.

Units — and it varies from soldier to soldier — have different experience levels, so information has a variation in value down to the soldier level. In research design, you seek to explain as much as you can with as little as you can without losing rigor. The same challenge goes for augmented reality, where rigor could be said to be the integrity of the information.

Transferred to the ground-fighting world, are we, as an engineering-driven nation, so technology-happy that instead of creating tools for increased survivability and mission success, we initially increase the risks for the war fighter and only correct these after we suffered a surprise in combat?

We understand that implementing augmented reality is a long process that is just now at the stage of proving the concept; with setbacks and successes, where are we on the learning curve? In our view, synthetic learning environments have already matured and provide an ample opportunity to use the augmented reality technology with a high return on investment. The opportunities reside in knowledge transfer, sharing experiences, preparing for an ever-changing operational environment, and by doing so, increasing soldiers' survivability and ensuring mission success. The question is: Are we ready to rely on augmented reality in combat?

Lt. Col. Brett Lindberg is a research scientist at the Army Cyber Institute at West Point and a simulation operations officer. Jan Kallberg is a research scientist at the Army Cyber Institute at West Point, and an assistant professor at the U.S. Military Academy. The views expressed are those of the author and do not reflect the official policy or position of the Army Cyber Institute at West Point, the U.S. Military Academy or the U.S. Defense Department.

https://www.c4isrnet.com/opinion/2020/07/17/augmented-reality-seeing-the-benefits-is-believing/

On the same subject

  • Boeing Wins $1.6 Billion U.S. Air Force KC-46 Order

    January 14, 2021 | International, Aerospace

    Boeing Wins $1.6 Billion U.S. Air Force KC-46 Order

    Lee Hudson January 13, 2021 The U.S. Air Force has awarded Boeing a $1.6 billion contract modification for 12 KC-46A tanker aircraft and anticipates the work will wrap up in April 2023. The order for 12 aircraft is the sixth production lot, which means Boeing is now on contract for 79 KC-46As. The first KC-46 was delivered to the Air Force in January 2019. The funding for the Lot 6 deal is from the fiscal 2020 budget. The company is still awaiting a contract modification for 15 aircraft that are funded in fiscal 2021. “The investments Boeing is making in the KC-46 today will benefit generations of service members,” Jamie Burgess, Boeing KC-46 tanker vice president and program manager, said in a Jan. 12 statement. “I believe the partnership between Boeing and the Air Force will also produce additional KC-46 innovations that will carry the warfighter well into the future.” This year will mark a major decision point for the program because the Air Force expects to decide on a new projection method for the remote vision system (RVS), a technology akin to virtual or augmented reality. To correct a “rubber-sheeting” effect that distorts the image on a visual display used by the boom operator during refueling operations, the Air Force is considering a liquid-crystal display screen or a “collimated mirror design” for the RVS projection method. Once a projection design is selected, a laboratory will build a system to test each new component. Doing ground testing will give the team confidence before installing the new equipment on the actual aircraft. https://aviationweek.com/defense-space/aircraft-propulsion/boeing-wins-16-billion-us-air-force-kc-46-order?elq2=57a289d9235b4bbf82af3324d06072f1

  • Elbit Systems UK to supply British Armed Forces target acquisition solution

    January 28, 2021 | International, Land, C4ISR

    Elbit Systems UK to supply British Armed Forces target acquisition solution

    Seth J. Frantzman Elbit Systems' UK subsidiary secured a $137 million five-year deal for future target acquisition solutions for the British Armed Forces. It is part of the Dismounted Joint Fires Integration (D-JFI) program, which will provide close air support and other capabilities to infantry and other ground forces. The acquisition solutions are included in the joint terminal attack controllers and fire support teams portions of system, intended to be in operation by 2027. “We understand the need for full operational sovereignty and freedom of action for the UK. This is why we have invested in new facilities in Kent and Bristol in the last 18 months and will continue to invest in our people as we move forward with the delivery of these vital programs,” said Martin Fausset, the CEO of Elbit Systems UK. The contract is part of series of deals for Elbit in the UK, which has shown interest in Israeli technology. Last year Elbit brought its RHINO mobile command to the Army Warfighting Experiment on Salisbury Plain in the UK to showcase how armies can use more digital technology on the modern battlefield. The company also pitched its Hermes 900 UAV last year for maritime patrols in the UK and announced Jan. 11 that it had received a $166 million contract for modernization of a shore-based naval training facility. “Our successes are not just with the Armed Forces but for the UK as a whole. Last year, using the Hermes 900, we successfully delivered a series of search and rescue demonstrations for the Maritime and Coastguard Agency and the National Police Air Service, helping them assess their future fleet requirements and operational concepts,” said Fausset, who also pointed to the naval training and simulation contract. The company has seen a strong start to 2021, he said. “We will continue to build on our position in the UK market over the coming months and remain committed to providing high-technology products to the UK Armed Forces through our local supply chain.” The D-JFI solution “is a networked, passive and active target acquisition solution that acquires, generates and communicates target information to effector systems for effective engagement of joint precision and nonprecision fires,” according to the company. Powered with artificial intelligence, it integrates Torch-X and HattoriX systems that are used for precision targeting. Elbit rolled out HattoriX in 2018 and has demonstrated it for eight countries in Western Europe. It consists of a lightweight system with electro-optics that can be packed and deployed in the field. “The D-JFI solution will enable fast and secured transmission of target information across the British and allied armed forces, allowing swift and accurate utilization of artillery and close air support,” the company said. https://www.c4isrnet.com/industry/2021/01/27/elbit-systems-uk-to-supply-british-armed-forces-target-acquisition-solution

  • Shipbuilder eyeing Portland or Seattle to build the Army’s navy

    September 10, 2018 | International, Naval

    Shipbuilder eyeing Portland or Seattle to build the Army’s navy

    PORTLAND, Ore. — A shipbuilding company with a $1 billion contract with the U.S. Army is choosing between Portland and Seattle to set up a production line for new landing vessels. The Oregonian/OregonLive reports Portland-based Vigor Industrial says it's planning to make the decision within the next 60 days. The company says the chosen city is expected to get up to 300 new jobs that are slated to last a decade. The company is contracted to build as many as 36 landing vessels with improved maneuverability and stability. The company is building a prototype of the landing craft in Seattle. It plans to start full production within three years. https://www.navytimes.com/news/your-navy/2018/09/07/shipbuilder-eyeing-portland-or-seattle-to-build-the-armys-little-navy

All news