Third Posting

1. What each individual in the group worked on over the last week
a) All four of us(Bixi, Zhicheng, Shruthi and myself) met in the lab twice this week (11/11/2016 – 9.00 am to 11.00 am and 11/14/2016 – 9.00 am to 12.00 pm).
b) Video and Audio integration into Unity Project
c) Similarly Integration of Oculus Rift with Unity Project
d) Research on Text interposition.

2. A description of the accomplishments made
a) We imported the video into Unity on the Lab computer and put it on the sphere. We created a GameObject and wrote a script to play the video.
b) To get 3D view, we added another sphere and camera. We use one group of camera and sphere for left eye and the other group of camera and sphere for right eye. The original video is in over-under layout.
c) We set tiling and offset of textures correctly to make each sphere only shows half of the video.
d) We installed the Oculus SDK and created an Oculus camera in the project. Now we can watch the video in Oculus Rift.
e) We used ffmpeg to extract audio in .wav format from the video.
f) Added the .wav file to the audio source component of the GameObject
g) Added play functionality of audio through script.

3. A description of the problems encountered (this section may be short for this week as we are still very early)
a) Text that we had interposed in the video last week when rendered is not in proportional scale.
b) On close examination of each frame in the video, we observed that text displayed was actually added at three different places in the video frames as shown in below Figure 1.

4. Plans for the upcoming week
a) Work on accurate text placement/interposition in each video frame.
b) Experiment with spatial simulation of audio sources in different directions in the scene.
c) Explore with more articles/videos.
d) Try out the 360 degree camera to capture our own videos.

5. At least one piece of media related to your work (image, video, audio, etc)