Sixth Sense – Due 12/08 – Sixth Posting


  1. What each individual in the group worked on over the last week
    • All four of us met in the lab this week (12/7/2016 – 9:00 am – 11:00am). Finishing the first part of our project (social impact article as a video) which is making the video fit into Unity perfectly. And continually working on the second project (automated object display based on text) together.
    • Sub Modules worked on :
      • Bixi – Editing video and adding music to it  and adjusting text.
      • Ameya – Importing and creating more objects like terrain and tree in Unity.
      • Zhicheng – Importing and automatically display raining in Unity.
      • Shruthi – Mapping of objects to words encountered in streaming text.
  2. A description of the accomplishments made
    • For the first part, we added more text to the video to tell an entire story. This is shown in Figure 1.
    • For the second part, we added more objects like terrain and tree into the scene and set them to the proper position. The terrain is created manually and grass and ground texture is attached. The tree object is downloaded from the Unity asset store.
    • Also, we download and import a raining maker from the Unity asset store to enable raining in our scene. There is sounds playing with the rain.
    • We added a completed scene as a visual information of dictionary and enable a change of raining or not raining in the scene when the words searched in the dictionary is changed. This function is shown in Figure 2 and Figure 3.
  3. A description of the problems encountered:
    • Music editing in Unity doesn’t work well. The transition between two songs is abrupt.
    • The length of the text displayed in the video is too long. We still need to adjust the size and placement.
    • Mapping of words in input text to objects is possible currently, but with increased text length the mapping mechanism is not very scalable.
    • The need to have a pre-instantiated range of objects contained in the main object dictionary is not a practical and scalable solution.
  4. Plans for the upcoming week
    • Finalizing the first project comprising sound and video in Unity
    • Prepare a completed package for presentation next week
    • Creation of mulitple MoveFunction() corresponding to each object.
    • We still wish to experiment with another alternate way of displaying the text. That is, display text and video in alternate separate frames.
  5. At least one piece of media related to your work (image, video, audio, etc)

 

screen-shot-2016-12-07-at-11-10-58-pm

Figure 1 Text matches with video

screen-shot-2016-12-07-at-11-11-08-pm

Figure 2 Scene shown without rain when the word rain doesn’t show in the searching

screen-shot-2016-12-07-at-11-11-19-pm

Figure 3 Raining scene when adding the word rain in searching