Display in VR Headsets With Simulated MFDs
in Augmented Reality Pilot Training
Back to MetaVR Videos

This real-time VRSG video, captured using an HTC Vive Pro with left and right eye views, demonstrates VRSG's H.264 streaming, Battlespace Simulations (BSI) MACE’s dynamic multifunction display (MFD) and VRSG sensor data on static geometry within the cockpit. The video's main viewpoint is from the pilot seat of our FA-18E model, in flight over our 3D terrain of Buckley AFB. Also shown is a zoom mode, which allows the trainee wearing the Vive Pro to enlarge the size of the MFD to better see the data. (In addition, VRSG also supports the Vive Tracker, which will allow the zoomed display of similar data in VR on a hand-held device for ground-based simulations or even within the actual aircraft cockpit, as a helmet supported augmented reality.)

In collaboration with BSI, MetaVR has developed a way to provide equipment and instrumentation data dynamically to a pilot trainee who is wearing a VR headset during simulation training. BSI’s MACE can create a texture that it shares with our VRSG, which can update with real-time instrumentation data such as multi-function display (MFD) data and sensor views. VRSG can then display that data in the VR cockpit while the pilot is training. Coupled with VRSG’s ability to stream H.264 video over UDP, this setup produces a sensor view in one VRSG channel and stream that image data to another VRSG channel for display in an MFD or other digital device.

Our goal is to provide software tools that enable the innovators working within the Pilot Training Next effort to prototype features and field them in low-cost simulators.


We recommend that you view the video in HD full-screen mode.

See more MetaVR videos on Vimeo.