Drone battle: AR inside VR


Project Description: The video above illustrates the idea with special effect. In reality their game doesn’t have these laser/holo bases visible. But my approach is a little bit different: I want to do it with VR headset while controlling the drone in the real world. Video from the camera on the drone will be displayed to the VR headset in realtime. Special effect such as fire, smoke will be over-layed to the video of real world scene. So the gain is: 1. unlimited scene from real world, 2. first person view from the drone, i.e. you are the pilot. 3. special effect that immerse you in a battle like star-war.

Project Type: This will be a super cool game. In addition, there is a side experiment we can do: what does it feel to be a bee? How the world feels from the perspective of a much smaller creature?

Interest: I’m interested in doing it. Ranked No. 1 among my 3 proposals.

Device(s) to Be Used: VR headset (Vive/Rift), drone with camera, other controllers.

Things I Know How To Do: Computer vision, game development, special effect overlay.

Things I Would Need Help With: play the video from drone on a vr headset in realtime(there is commercial product for this), and anything I know how to do but don’t have enough time to do.