A classroom simulation VR simulation built with Unity
The VR Classroom is an ongoing project for the creation of a semi-realistic classroom environment. The project's aim is to create classroom behavioral scenerios for use by the College of Education at Northeastern State University. This project lays the groundwork for future improvements and scenerios to be created with the purpose of being utilized by students pursuing degrees in education.The simulation is built with Unity, a leading gaming engine and Oculus Rift, a leader in virtual reality hardware technology. VR Classroom was created in conjunction with a capstone project by Jason Oehlberg pursuing a bachelor's degree in Computer Science at Northeastern State University.
- Download and Install Unity version: 2018.2012f1 or later.
- Install these asset libraries from the Unity Assset Store
- Clone this repository or download zip file
git clone https://github.com/JasonOehlberg/vr-classroom.git
- Follow the steps in this video closely for Oculus Integration
- The code for the voice recognition is located in the StudentBehavoir.cs script
- Review the documentation for UnityEngine.Windows.Speech
- For easy use of git and GitHub download and install the Github for Unity asset library.
The simulation takes place in a common classroom environment. The classroom consists of several desks occupied by Students. The user steps into the environment using the virtual reality headset and hand-held controllers. Most of the interaction in the environment is controlled by voice recognition. The Unity Engine exposes the library for Windows Speech allowing for keyword recognition.
The simulation begins with the Students working quietly at their desks. Each of the individual Student's names are displayed in red above their heads. When the keyword "Attendance" is announced by the user each of the Students stops working, sits attentively at their desks and their name is displayed in green. As the user calls the names of each of the Students, the Student raises their hand, the name returns to the default red color and they go back to working quietly. When the name of a Student is called, outside of the attendance scenerio, the Student again sits at attention and the name color appears in blue.
For a more detailed description of the project, please refer to the video links below
Walkthrough without VR Hardware
Test Scene Using Alex for future project integration
The project was developed using Unity (gaming engine), Oculus Rift (VR hardware device), autoDesk Character Generator (3d model generator) and Mixamo (online animation software). Three asset packages, aquired from the Untiy Asset Store are also involved in the development of the project.
- Oculus Integration -- Advanced rendering, social, platform, audio, and Avatars support for Oculus VR devices and some Open VR supported devices. FREE
- School Classroom Pack -- This set includes classrooms, blackboards, curtains, clocks, desks, and corridors, as well as boxed lunch, chalks, bags, cleaning tools, buckets, fried noodle sandwiches, love letters and supernatural fiery balls. PAID
- LipSync Pro -- LipSync Pro is an editor extension for creating high-quality lipsyncing and facial animation inside Unity. PAID
Has not been integrated into main classroom scene as of build 2
- Unity -- Used for building 3d environment, script integration, game object manipulation, and building scenes.
- Oculus Rift --Hardware used for virtual reality integration in conjunction with Unity.
- AutoDesk Character Creator -- Used for generating all the 3d humanoid models found in the project. Each character generated came with skeleton and blend shapes for easy manipulation and animation.
- Mixamo -- Used for basic character animations.
- Windows Speech -- Used for voice recognition
- Holistic3D
- Maya -- Free software for students
- Rogo Digital LipSync Pro Documentation
Northeastern State University Computer Science students are welcome fork and contribute to the project benefitting the College of Education. If you would like to contribute as research or as a capstone project please contact your mentor.
This repository does not include the Oculus integration needed to complete the VR Classroom simulation. Because this repository will be available to NSU students wanting to continue the project, modification can be made without Oculus integration. For further information on Oculus Rift integration please refer to the documentation or review this YouTube video for a quick tutorial.