Virtual Reality System Trains Air Crews to React to Threats
Jun 15, 2022 — Atlanta, GA
Threat reaction training of air crews is a critical factor in protecting aircraft and crews from ground-based missiles and other weapons. To help provide this training, GTRI researchers are working with the 189th Airlift Wing (AW) of the Arkansas National guard to develop a high-fidelity immersive multi-player simulation of the battle airspace known as FITRE.
Threat reaction training of aircrews is a critical factor in protecting aircraft and crews from ground-based missiles and other weapons. To help provide this training, GTRI researchers are working with the 189th Airlift Wing (AW) of the Arkansas National Guard to develop a high-fidelity immersive multi-player simulation of the battle airspace.
The 189th Airlift Wing is an active duty organization aligned with Air Mobility Command, and is the center of legacy training in the Air National Guard. Based in Little Rock, Ark., its mission is to provide premier training to and certification of the C-130 community, consisting of pilots, navigators, flight engineers, and loadmasters.
GTRI has been performing sponsored research for the 189th AW Innovation Cell led by Lt. Col. Justin Fitzpatrick as the Wing’s Innovation Lead. The goal of this research has been to design and develop a system that allows aircrews to repeatedly practice threat responses with a level of realism that simulates as closely as possible what happens in real-world missions. The high level of realism helps convert correct aircrew responses into reflexes bordering on rote learning and memorization.
Developing the Fully Immersive Threat Reaction Environment
The research has led to the development of the Fully Immersive Threat Reaction Environment (FITRE) system with a goal of revolutionizing the way that the crews train. FITRE, at the basic level, is a multi-player video game consisting of four players that takes place in virtual reality. An instructor orchestrates the C-130H training mission and controls the parameters of the game. A pilot is placed into a high-fidelity C-130H virtual cockpit that includes a missile warning system (MWS) simulation and all necessary flight instruments.
A loadmaster is placed on either side of the back of the C-130H and operates a realistic flare dispensing switch. And finally, a shooter is placed on the ground of the mission space and is able to operate a number of weapons, which include shoulder-fired surface-to-air missiles and large-caliber anti-aircraft machine guns. The shooter has the ability to easily move around the mission space to obtain the desired vantage point.
A high-fidelity simulation framework provides authoritative threat simulation capabilities that enable the modeling and simulation of the supported weapon systems within FITRE and their kill chains at the engagement and mission levels. FITRE supports both day and night modes. Advantages during night engagements can be realized by the trainees when operating from the shooter's perspective, while nighttime aircraft flare dispenses noticeably increase exposure of the aircraft to the shooter.
In the virtual cockpit, necessary aircraft details improve navigation effectiveness of the pilot while visual and audio declarations identify encountered threats during engagements. All these details help the crew engage with the simulation.
“Because this type of training is all about the quick reaction to specific stimuli, if the stimuli during training don’t resemble the real thing, the crew may feel like they are experiencing this very dangerous situation for the first time. The key is to simulate the cognitive load as accurately as possible,” said Izudin Ibrahimbegovic, a GTRI senior research scientist who led the development of the system.
Evaluating Air Crew Response to the Threats
Because so much happens in very limited time, instructors can have difficulty evaluating how the aircrew responded to the threats. The FITRE system helps with evaluating the participants’ performance by tracking eye movements, head movements, and flight control inputs.
“Not only can we can tell them what they should have done during the first seconds of the engagement,” said Andrew Braun, the lead systems engineer on the project, “but now we can show them exactly how it should be done. We can also focus on assisting in the evaluation of the crew as a whole during these situations.”
Threat reaction training is currently done with a much lower-fidelity system that does not include an immersive virtual reality cockpit or alternate views of the training space. Threat reaction training can also take place during flights into test ranges. However, the number of range opportunities is limited and requires significant investments of time and money – and comes with inherent risks.
Expansion, Future Enhancements Planned
So far, FITRE has been developed only for the C-130H aircraft, which is what the 189th Airlift Wing operates and trains for. However, the system can be adapted for other fixed-wing and rotary-wing platforms to enable crews of those aircraft access to threat reaction training.
GTRI researchers developed the simulation using publicly available terrain data. If the project receives additional funding, plans exist to expand scenery to simulate other geographic locations around the world.
Beyond expanding the number of aircraft and geographic backgrounds, the researchers are also working on connecting systems to allow multiple crews to train together for multi-ship missions.
The simulation runs on commercial-off-the-shelf hardware, including standard headsets and laptop computers. FITRE training can be done in very confined spaces and the system setup can be accomplished in under an hour by a trained team.
Ibrahimbegovic and his team have been demonstrating FITRE to interested groups and receive a positive reception every time.
Project Resulted from Partnerships
The research project also has been supported by the Advanced Airlift Tactics Training Center (AATTC), Air National Guard Air Force Reserve Command Test Center (AATC), ARCWERX (the innovation cell of the Air Force Reserve Command), and the Defense Intelligence Agency.
Writer: John Toon
Photo/Video: Sean McNeil
GTRI Communications
Georgia Tech Research Institute
Atlanta, Georgia USA
The Georgia Tech Research Institute (GTRI) is the nonprofit, applied research division of the Georgia Institute of Technology (Georgia Tech). Founded in 1934 as the Engineering Experiment Station, GTRI has grown to more than 2,800 employees supporting eight laboratories in over 20 locations around the country and performing more than $700 million of problem-solving research annually for government and industry. GTRI's renowned researchers combine science, engineering, economics, policy, and technical expertise to solve complex problems for the U.S. federal government, state, and industry.
(Interim) Director of Communications
Michelle Gowdy
Michelle.Gowdy@gtri.gatech.edu
404-407-8060
