Music Visual

Graphics on Screen

This week:

Simon: Mostly I just researched how to best implement timing for beat-detection and other things like that. I also did some more testing on what we already have in place. There’s still some issues that I’m not sure how to fix, like the 3D and the keyboard input, but I think the plan we have in place is on the right track.

Tim:  I am still trying to figure out what to analyze, aka take actually useful information from the song to visualize.

Chelsi: Working on rendering video for the background. Attempting to become familiar with OpenGL and find code that allows us to render a real time video. I’ll be at a music festival next week where I plan to get actual footage (lazers, lights, etc.) that will go along cohesively with what we are building

Overall we have the sphere moving and the ability to change the shapes and color. We are looking at what the best way to analyze the music is (BPM, frequency, etc.) for simplicity and effectiveness. Simon has prepared the sphere for music data, so that it is ready to adapt according to that.

By next week we hope to have the music analyzation decided. We are pretty much on track from our first plan and essentially half way done.

Vex 4/17

 

0003-ab

This week:
Cory – Set up a git repo to work in. Created the initial gamemode that we will build off of. Added some weapons to the only player to test game details. Started looking into how multiplayer works with Garry’s mod.
Giang – Started to look into how to add NPCs (non-player characters) into the gamemode.
Jacob – Started to look into how to create interactive portal zones in our maps.

Accomplishments:
We were able to set up the very basic backbone of the game.

Problems:
Multiplayer did not appear to work immediately for our gamemode. It looks like we may need to do some sort of port forwarding or other configuration to allow creating and accessing new servers.

Still on schedule?
We’re a little behind schedule. We were not able to get very much done this week.

Plans for next week:
Finish creating the basic set up and rules for the RunnerGunner gamemode

Reading 10

For class 4/21/14
Post Comments by 11:59 pm on 4/20/14

Disney’s Aladdin: first steps toward storytelling in virtual reality
Randy Pausch, Jon Snoddy, Robert Taylor, Scott Watson, Eric Haseltine
http://ivizlab.sfu.ca/arya/Papers/ACM/SIGGRAPH-96/Storytelling%20in%20VR.pdf

Serious games continuum: Between games for purpose and experiential environments for purpose
Tim Marsh
http://www.sciencedirect.com/science/article/pii/S1875952110000224

or here on box

https://uwmadison.box.com/s/mpw7kwntw2b29h8p6och

Discussion Article 1 (Pick 3)

  1. Do you feel like storytelling in VR has evolved to the author’s hope?  If why, what do you think has slowed it’s growth.  If yes, descibe examples that you think show this evolution.
  2. Are you surprised by the lack of head rotation?  What did you think contributed most to this result?  Would you expect the same type of head rotation profile in the CAVE?
  3. Which of the general observations do you find most useful for trying to design a project?  In what ways could you use this insight for your project?
  4. In the survey, pick either a result the you found interesting or a question you found curious and briefly discuss.  Do you think it made sense to present the results grouped by gender?
  5. Do you feel like the research challenges are still relevant or have been solved?  Choose one of the  challenges that you think would be interesting to try to explore.  Discuss one idea of how you might start to attempt to undertake this challenge.

Discussion Article 2 (Pick 3)

  1. Do you agree with the author’s definition of serious games (p 63)?  Do you agree with the continuum on Figure 1?  Can something be a game and have no gaming characteristics for experience?
  2. Choose one of the examples listed in section 3.x.  Find and list a  video or external reference for the example.  Discuss how you would position this example on the continuum.
  3. Do you agree with the author’s discussion point that serious gaming is a form of cost-effective VR?  Do you think all of VR could be considered a form of serious gaming?
  4. Define and discuss the term ‘games’.  Discuss how your definition agrees or contradicts this article
  5. You may find a term or topic that you are unfamiliar with.  If you would like to, do a little research on the subject (wikipedia would be a good place to start). Briefly describe your understanding of this concept and how confident you are about this understanding.

RRCP April 11

rrcp picture

Accomplishments:

As a group in this week we really started getting into our project.

– We tested the Emotive system and software- so much fun- We also started to become more familiar with the software by reading the software instruction
– We tried to finalize the number of rooms and make color decision
– Furniture or none? We’ll test both on ourselves first. We’re leaning towards neutral furniture such as in a cruise ship cabin.
– Furniture will color same as wall
– We’ll design 4 rooms off of a central room and allow the participant to walk between the rooms at will. We’ll measure how much time they spend in each room.
– white, red, blue, green will be the colors we’ll test. We discussed trying yellow to cover the primary colors, but decided it was too unusual a room color given the saturation we wish to test.
– Using sketch-up, we made our sample room.
– We made an appointment with a research method professor for the next week in order to get help for drafting the right survey questions, and reached out to the emeritus professor of the class “Color Theory: Environmental Context”
– We came up with some idea to solidify interactive activity of the subject while in the environment
– Tell participants task at hand in advance
– “Which hotel room would you most enjoy having for your vacation?”
– Integrate controller training in lobby
– Participant will verbally say their preference – numbered
– And will offer an adjective for their favorite room
– we will use standard prompt if indecisive
– finally, we’ll compare the results vs. a survey we give to people on paper showing color pictures of the room

We hope we will find out Does being in the immersive environment change people’s preferences for room color?

Next Week’s Plans:
– Testing the Emotive system – what does it add to our study? How would we make it work with test subjects?
– Complete Draft of experiment design
– Complete Draft survey question
– Working on the interactive activity of the subject while in the environment

Note: post written by Soheila Mohamadi

Team VEX 4/11

header

 

This week:
Cory – Set up the Oculus Rift to work with Garry’s Mod using Tridef 3D Ignition software. Went through the game mode creation tutorials
Giang – Went through the game mode creation tutorials and learned lua.
Jacob – Experimented with a Unity example online FPS

Accomplishments:

Accomplishments would be that we are able to run Garry’s Mod using the Oculus Rift and we can start creating a game mode.

Problems:
We didn’t have any specific problems this week.

Still on schedule?
We think we are still on schedule.

Plans for next week:
For next week, we will be creating a basic game for our game mode.

Music Visuals Updates

sphere2

This week:

Simon – I attached all the colors in the sphere to an array, in this case initialized to random values. The values in the array can be changed in groups, so as an example they could change in patterns with the music. I’d like to do testing in the actual lab so I can get to work on the more complicated parts.

Tim – For this week I have been working on familiarizing myself with music analysis and different features of the program. By next week I hope to start working on finding different options for analyzation of the song we selected.

Chelsi – researched geometric inspiration now that we have a set shape (videos below). Also contacted artist about getting individual track pieces for easier analyzation and should receive them over the weekend. I downloaded a sound analyzer and started to work with that – I have a few questions about how this will translate into OpenGL. I also briefly looked into using real video footage in OpenGL and it looks like rendering is a possibility (example: https://www.youtube.com/watch?v=2AVh1x-Uqjs)

Visualizer created in OpenGL:

Simple Geometric visualization:
https://vimeo.com/47085682

Another based off a 3D triangles:
https://vimeo.com/90972800

The one offers a way to include movement:
https://vimeo.com/67248097

We are a bit behind, but hope to catch up within the next week. By next Friday we hope to have the sphere moving and have our execution for the music analyzation figured out.

Reading 9

For class 4/14/14
Post Comments by 11:59 pm on 4/13/14

Your avatar, your guide
S Murphy – Scientific American Mind, 2011 – nature.com
http://vhil.stanford.edu/news/2011/sciam-your-avatar.pdf

AI seduces Stanford students
K Poulsen – Wired News, 2005 – vhil.stanford.edu
http://vhil.stanford.edu/news/2005/wired-aiseduces.pdf

Why digital avatars make the best teachers
J Bailenson – The Chronicle of Higher Education, 2008 – vhil.stanford.edu
http://vhil.stanford.edu/news/2008/che-avatar-teachers.pdf

Discussion Article 1 (Pick 3)

  1. What are your overall impressions of this piece?  Do you find the approaches mentioned more promising or concerning?  Describe why.
  2. What are your thoughts on Doppelgänger avatar therapy?  Does this model make sense to you?  What kind of fields could you see this be useful for besides those mentioned in the piece?
  3. Discuss the results of the “whale” experiment.  Do the results surprise you?  Do you feel like the same effect would happen on adults (to a lesser degree)?
  4. Discuss the concepts of self in relation to this article
  5. You may find a term or topic that you are unfamiliar with.  If you would like to, do a little research on the subject (wikipedia would be a good place to start). Briefly describe your understanding of this concept and how confident you are about this understanding.

Discussion Articles 2 and 3

Formulate a brief response to each of these articles (1 to 2 paragraphs).  Whether your response is positive or negative is up to you.

 

Some news on Diminished Reality

Just a quick follow-up on Diminished Reality,

Rover just announced a prototype featuring an ‘invisible bonnet’: http://www.telegraph.co.uk/motoring/car-manufacturers/land-rover/10752488/Land-Rovers-invisible-bonnet-technology.html which allows the driver to see the road or track conditions through the hood of his car.

This reminded me of the next-generation HMDs in fighter jets, such as the F-35. Northrop Grumman developed a ‘Distributed Aperture System‘, which provides full 360 degree (or more correctly: full hemispherical) vision through distributed cameras. The images are displayed on the helmet’s visor and depend on the pilot’s head position, so the pilot is able to see through the floor of the aircraft. However, integrating this system is quite complex and it has been named as one of the major risk factors for success in this already way-over-budget project.

 

RRCP

This Week: Aprill 4th

 

Caroline-Finish IRB training, dig in to the fundamentals Emotive software (Affectiv), some Sketch Up?

Soheyla-Continue in the research of similar color experiments, find potentially adoptable procedural standard for experiment

Olivia-Finish IRB training as well, find potential google warehouse spaces, familiarize self with SketchUp

 

As a group, we used this week as a learning curve-to continue to familiarize ourselves with the tools/software needed to conduct our experiment so we can dive into the nitty gritty of our experiment starting next week.

 

Accomplishments: Finishing the fun IRB training, and further familiarizing ourselves with the software will make it possible to leave the learning phase—and to really start getting into our project.

 

Problems: Sketch Up’s free trial download allows for eight hours of work time. Without paying for the software, it gives us 24 hours of work time between the three of us, plus any extra computers we can acquire if needed to build our 3D space. Just kidding, you only receive 8 hours free of Sketch Up Pro-basic Make Up lasts forever.

 

On Schedule?:

Roughly. We could be more comfortably further ahead, however being unfamiliar with our tools, it was important to take the time to build fundamental knowledge about the programs we are using in order to accomplish our experiment. This will allow us to forge ahead in the next weeks. More concrete imagery to come!

 

Next Weeks Plans:

  • Finalize room/color decisions
  • Use Sketch Up to build/make adjustments to spaces-so much fun
  • Test run the Emotiv system and software
  • Draft experiment design
  • Draft survey questions
  • Solidify interactive activity of subject while in environment