Garden: An Untethered Mixed Reality Experience
This was my final semester project at Carnegie Mellon's Entertainment Technology Center. We worked with the "Yellowstone" version of the Project Tango tablet and the Durvois Dive headset to create an untethered Mixed Reality experience which combines virtual and augmented reality. It uses 3D reconstruction to build an alternative, voxel representation of the real environment in real-time as the user walks around. The voxel world is then rendered stereoscopically for VR display. The result is an alternative garden world that the user can freely move around untethered without bumping into real world objects. The user also can use their hands and legs to touch wireframes that when filled, bring plants into life. I was the lead programmer, working on the gameplay, interaction and the core 3D scanning and rendering technologies. My teammate and I also wrote a paper on it that has been accepted in CHI 2016.