MyndPlay Occulus integration

A VR-enabled scene with a video playing and graphs displaying real-time data from a head-mounted sensor

This was an experimental proof-of-concept project which included integrating a large number of different technologies:

  • Stereoscopic VR-enabled rendering using modern OpenGL, embedded into a QML application
  • Post-processing, including lens distortion and aberration correction, using Qt Graphical Effects
  • Reading sensor data directly from an Oculus Rift device, bypassing the official SDK, and progressively adjusting the view to match the head movement
  • Exporting and importing a complex 3D scene from Blender, appropriately handling lighting, transparent surfaces, and different materials
  • Displaying multiple interactive objects inside the 3D scene
    • A video file
    • Interactive QML-powered menu
    • Semi-transparent graphs backed by readings from a brainwave sensor
  • Interactive control of both the scene (adjusting lighting, video playback control, movement) and rendering (tuning the VR distortion and corrections)
  • Making sure it all works on Windows, OS X, Linux and Android

Due to all the different technologies included, this was a very intensive project, demanding a large amount of flexibility from my side.