12. Mixed Reality Application

The application has a mixed reality counterpart, designed for XR headsets. Specifically, the application was developed and tested on the Meta Oculus Quest 2, but it’s compatible with other visor models as well.
The Desktop and VR versions share the majority of the features, with almost a 1 : 1 correspondence between them. Due to the differences between target platforms, the UI was designed with a slightly different layout, but it’s essentially equivalent to its Desktop counterpart.
Here is a quick preview of the appearance of the UI in VR.
../_images/11-1.png

Fig. 12.1 Main Menu screen in VR
../_images/11-2.png

Fig. 12.2 Advanced options Menu screen in VR
../_images/11-3.png

Fig. 12.3 3D View on the Earth with UI panel at side

../_images/11-4.png

Fig. 12.4 UI Panel with currently selected data source (IANOS SWH)
../_images/11-5.png

Fig. 12.5 UI Panel with currently selected layer (Relative Humidity volume layer)

12.1. VR Navigation with controllers

Since the VR platforms come with their specific controllers, the VR version features its own configuration of the commands. If you wish to learn how to navigate, click on the info button “I” to look at the mapping between touch controllers and commands.

../_images/11-6.png

Fig. 12.6 Radial navigation commands for VR controllers
../_images/11-7.png

Fig. 12.7 Radial navigation commands for VR controllers

12.2. VR Navigation with gestures

The VR visor technologies provide other two ways of navigation beside the traditional controls, which are through controller triggers, and through gestures.

Here is a quick overview of the correspondence between commands and their trigger and gesture counterpart, both for Radial and Fly Navigation.

To trigger an action (click) :

  • press controller Trigger button

  • perform Pinch gesture with the hand: index and thumb fingers touching

Radial Navigation

  • Move On (Zoom In): bring your hands together, Trigger with both controllers or Pinch with both hands, then keep your hands away

  • Move Back (Zoom Out): keep your hands away, Trigger with both controllers or Pinch with both hands, then bring your hands together

  • Rotate: Trigger with only one controller or Pinch with only one hands, move the controller or the hand in the desired rotation direction

  • Tilt Up: Raise both hands to the same height, Trigger with both controllers or Pinch with both hands, then lower both hands

  • Tilt Down: Lower both hands to the same height, Trigger with both controllers or Pinch with both hands, then raise both hands

  • Roll Left/Right: Place both hands in front of you about 40 cm apart, Trigger with both controllers or Pinch with both hands, rotate your hands counterclockwise/clockwise as if you were turning a steering wheel

  • Reset camera position (only with hand gesture): make fists with both hands

Fly Navigation

  • Move On: bring your hands together, Trigger with both controllers or Pinch with both hands, then keep your hands away; movement speed depends on the distance between the controllers/hands; the direction the direction depends on where you are looking

  • Move Backward: keep your hands away, Trigger with both controllers or Pinch with both hands, then bring your hands together; movement speed depends on the distance between the controllers/hands; the direction depends on where you are looking

  • Roll Left/Right: Place both hands in front of you about 40 cm apart, Trigger with both controllers or Pinch with both hands, rotate your hands counterclockwise/clockwise as if you were turning a steering wheel

  • Reset camera position (only with hand gesture): make fists with both hands