Recent developments in game-based virtual reality educational laboratories using the Microsoft Kinect

Zhang, M., Zhang, Z., Chang, Y., E.-S. Aziz, Esche, S. K. & Chassapis, C.
Accepted for publication in International Journal of Emerging Technologies in Learning, 2018.

Abstract

Virtual Reality (VR) is a well-known concept and has been proven to be beneficial in various areas. However, several disadvantages inherent in VR prevent its broad deployment in the educational arena. These limitations include non-realistic representation, lack of customizability and flexibility, financial feasibility, physical and psychological discomforts of the users, simulator sickness, etc. In this paper, an innovative method that uses the Microsoft Kinect as an essential component for developing game-based VR educational laboratories is presented. This technique addresses three different aspects. First, it represents an efficient method for creating the VE using the Kinect as a measuring tool. Second, the Kinect is employed as a substitute DAQ system for acquiring range data and tracking the motion of objects of interest. At last, the Kinect serves as a novel human-computer interface for tracking the users' entire body motion and recognizing their voices. Using the method described here, three major aspects of educational VR development can be accomplished with an inexpensive and commercially available Kinect.