×

Maintenance Repair & Overhaul Space Air Cargo

Home- Stories

MetaVR and Varjo Introduce Eye Tracking Capability for Pilot Training

Jay Menon - : Jun 4, 2021 - : 11:54 am

MetaVR and Varjo have combined the capabilities of Virtual Reality Scene Generator (VRSG) and the Varjo XR-3 mixed-reality headset to provide a real-time, pilot eye gaze tracking facility to enhance After Action Review (AAR) for simulator-based pilot training.

The Varjo XR-3 mixed-reality headset includes a built-in, real-time 200 Hz pupil-tracking capability that can precisely capture even the smallest eye movement of the wearer when training in virtual reality and mixed-reality environments. MetaVR’s VRSG version 6.6* includes the means to harness this eye-tracking data. At the end of the training mission, VRSG exports this data via DIS as a PDU log and visualizes the pilot’s head position, orientation, and gaze vector (with the gaze of each eye depicted as a color-coded cone) over the events of the training session for AAR.

During training mission debrief, the trainer and the pilot can see where the pilot’s head position and eye movements were directed throughout the simulated air engagement, providing the ability to objectively assess the engagement so as to fully understand what lead to the mission outcome. From a tactical perspective, the eye-tracking playback can help identify missed moments of attention to instrumentation or the direction of an important activity, help identify areas for improvement and track pilot progress throughout the training cycle. It also has application for beyond-visual range systems management review.

In addition to recording the eye tracking visualization for after-action playback, the VRSG session with the eye tracking visualization can also be monitored by instructors in real time during the simulated engagement, to further enhance understanding of the nature of the training engagement.

“What’s best, pilot training can be enriched without adding to the trainee’s cognitive burden,” said Urho Konttori, Co-Founder and Chief Technology Officer, Varjo. “This can help achieve better learning outcomes and improved live missions down the line. The realistic simulation of flight scenarios in virtual and mixed reality is not science fiction. It’s here today already with Varjo XR-3, already producing tangible value for pilot training.”

“Essentially what we are doing here is turning a normally subjective process into a quantitative review, enriching pilot simulator training and improving learning outcomes for trainees,” Bert Haselden, Mixed-Reality Lead, MetaVR, said. “The Varjo XR-3 gives pilots the most natural and fully immersive training possible; when combined with VRSG the result is a capability that is – we believe – unique to the current simulator training space.”

MORE NEWS

Headquartered in Singapore with reporters spread across all major regions, GBP Aerospace & Defence is a leading media house that publishes three publications that serve the aerospace and defence sector - Asian Defence Technology, Asian Airlines & Aerospace and Daily News. Known industry-wide for quality journalism, GBP Aerospace & Defence is present at more international tradeshows and exhibitions than any other competing publication in the region.
For over three decades, our award-winning team of reporters has been producing top-notch content to help readers stay abreast of the latest developements in the field of commercial aviation, MRO, defence, and Space.

Popular Posts

Copyright 2023. GBP. All Rights Reserved.

Home Defence & Security Space Commercial Aviation Maintence Repair & Overhaul Daily News Events About Us

z-index: 9999; /* Ensure the ad is on top of other elements */