{"id":273,"date":"2015-10-22T10:33:29","date_gmt":"2015-10-22T15:33:29","guid":{"rendered":"http:\/\/blogs.discovery.wisc.edu\/vr2015\/?p=273"},"modified":"2015-11-12T15:32:36","modified_gmt":"2015-11-12T21:32:36","slug":"team-exploring-interfaces-alex-dave-nicky-ryan","status":"publish","type":"post","link":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/2015\/10\/22\/team-exploring-interfaces-alex-dave-nicky-ryan\/","title":{"rendered":"Team Exploring Interfaces&#8217; Project"},"content":{"rendered":"<p>Team Exploring Interfaces\u00a0&#8211; Alex, Dave, Nicky, Ryan<\/p>\n<p><b>Exploring Interface in Virtual Reality<\/b><\/p>\n<p>Keyboard and mouse are the standard for 2D, non-immersive interfaces; do they work in 3D immersive interfaces, or are thumbsticks, or wands, or hand trackers best? Or maybe, what are they each best at? What kinds of things do we even want to do in VR?<\/p>\n<p>Step 1: Explore the Current State of the Art<br \/>\nStep 2: Mock Up: tasks, input methods, and interfaces<br \/>\nStep 3: Test, with people<\/p>\n<p>&nbsp;<\/p>\n<p>Example Interfaces:<\/p>\n<div id=\"attachment_274\" style=\"width: 310px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/four-interfaces.png\"><img aria-describedby=\"caption-attachment-274\" loading=\"lazy\" class=\"size-medium wp-image-274\" src=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/four-interfaces-300x241.png\" alt=\"Four interfaces, from top left and clockwise: Leap Motion Dragonfly AR demo, Motorcar VR window manager, Heavy Rain ARI, Iron Man poking at things with his eyes\" width=\"300\" height=\"241\" srcset=\"https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/four-interfaces-300x241.png 300w, https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/four-interfaces.png 999w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-274\" class=\"wp-caption-text\">Four interfaces, from top left and clockwise: Leap Motion Dragonfly AR demo, Motorcar VR window manager, Heavy Rain ARI, Iron Man poking at things with his eyes.<\/p><\/div>\n<p>Note that the top two actually exist, and the bottom two are from fiction.<\/p>\n<p>Example Complex Tasks:<\/p>\n<div id=\"attachment_275\" style=\"width: 310px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/unreal-blueprint-visual-scripting.png\"><img aria-describedby=\"caption-attachment-275\" loading=\"lazy\" class=\"size-medium wp-image-275\" src=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/unreal-blueprint-visual-scripting-300x282.png\" alt=\"Blueprint visual programming interface from Unreal Engine\" width=\"300\" height=\"282\" srcset=\"https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/unreal-blueprint-visual-scripting-300x282.png 300w, https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/unreal-blueprint-visual-scripting.png 776w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-275\" class=\"wp-caption-text\">Blueprint visual programming interface from Unreal Engine<\/p><\/div>\n<div id=\"attachment_276\" style=\"width: 310px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/paris-metro-3D-data-visualization.png\"><img aria-describedby=\"caption-attachment-276\" loading=\"lazy\" class=\"size-medium wp-image-276\" src=\"http:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/paris-metro-3D-data-visualization-300x150.png\" alt=\"Visualization of activity on the Paris Metro\" width=\"300\" height=\"150\" srcset=\"https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/paris-metro-3D-data-visualization-300x150.png 300w, https:\/\/blogs.discovery.wisc.edu\/vr2015\/files\/2015\/10\/paris-metro-3D-data-visualization.png 600w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-276\" class=\"wp-caption-text\">Visualization of activity on the Paris Metro<\/p><\/div>\n<p><strong>What\u2019s do we mean by \u201cMock Up\u201d?<\/strong><\/p>\n<p>A small program that combines: atomic task, input method, interface mapping, evaluation.<br \/>\nIn the complex task of 3D modeling, one atomic task might be selecting a point. Input methods might be a mouse or motion tracked hands. Interface mappings might be moving the points directly, or giving interface \u201chandles\u201d to make precise movements easier to describe. We might evaluate speed, accuracy, or comfort.<\/p>\n<p>So we ask you to move points using a few different input methods, and see which works best. Which make you tired? Which make you faster? Which take less concentration?<\/p>\n<p><strong>Skills:<\/strong><\/p>\n<ul>\n<li>we can code and things<\/li>\n<\/ul>\n<p><strong>What we can almost surely do:<\/strong><\/p>\n<ul>\n<li>make at least one mock-up in Unity for the Oculus<\/li>\n<li>use \u201ceasy\u201d input methods: keyboard, mouse, xbox controller, head tracking<\/li>\n<\/ul>\n<p><strong>What we can probably do:<\/strong><\/p>\n<ul>\n<li>Some kind of survey of the state of the art, with some demos (compile motorcar?)<\/li>\n<li>More input methods:\n<ul>\n<li>leap motion<\/li>\n<li>kinect<\/li>\n<li>a wand (wiimote?)<\/li>\n<li>passive haptics + hand tracking (if the interface is poking a sphere, actually have a physical sphere)<\/li>\n<\/ul>\n<\/li>\n<li>More tasks:\n<ul>\n<li>describe a rotation<\/li>\n<li>navigate menus<\/li>\n<li>position windows<\/li>\n<li>navigate in space<\/li>\n<\/ul>\n<\/li>\n<li>What we can maybe do:\n<ul>\n<li>integrate our findings with an existing interface<\/li>\n<li>make more interesting input methods (what can we rig with a kinect and some props?)<\/li>\n<li>some kind of demo that\u2019s fun to play with<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Equipment:<\/strong><\/p>\n<ul>\n<li>Oculus Rift<\/li>\n<li>Maybe the CAVE?<\/li>\n<li>Unity<\/li>\n<li>Whatever input devices we can get working<\/li>\n<li>Maybe Blender for modeling?<\/li>\n<\/ul>\n<p><strong>Next Steps:<\/strong><\/p>\n<ul>\n<li>start exploring<\/li>\n<li>brainstorm possible mock ups<\/li>\n<li>start building the Unity infrastructure we need<\/li>\n<\/ul>\n<p><strong>Links:<\/strong><\/p>\n<p>Motorcar:<br \/>\nhttps:\/\/github.com\/evil0sheep\/motorcar<br \/>\n<iframe loading=\"lazy\" width=\"1170\" height=\"658\" src=\"https:\/\/www.youtube.com\/embed\/Dgtba_GpG-U?feature=oembed\" frameborder=\"0\" allowfullscreen><\/iframe><\/p>\n<p>Heavy Rain ARI:<br \/>\n<iframe loading=\"lazy\" width=\"1170\" height=\"658\" src=\"https:\/\/www.youtube.com\/embed\/SsQT3mbvVWY?feature=oembed\" frameborder=\"0\" allowfullscreen><\/iframe><\/p>\n<p>Leap Dragonfly interface thing:<br \/>\n<iframe loading=\"lazy\" width=\"1170\" height=\"658\" src=\"https:\/\/www.youtube.com\/embed\/zxM4vN_4jJY?feature=oembed\" frameborder=\"0\" allowfullscreen><\/iframe><\/p>\n<p>Magic Leap UI mock up:<br \/>\n<iframe loading=\"lazy\" width=\"1170\" height=\"658\" src=\"https:\/\/www.youtube.com\/embed\/kPMHcanq0xM?feature=oembed\" frameborder=\"0\" allowfullscreen><\/iframe><\/p>\n<p>Unreal Engine Blueprints:<br \/>\nhttps:\/\/docs.unrealengine.com\/latest\/INT\/Engine\/Blueprints\/index.html<\/p>\n<p>Paris Metro data visualization:<br \/>\nhttp:\/\/infosthetics.com\/archives\/2013\/03\/metropolitain_exploring_the_paris_metro_in_3d.html<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Team Exploring Interfaces\u00a0&#8211; Alex, Dave, Nicky, Ryan Exploring Interface in Virtual Reality Keyboard and mouse are the standard for 2D, non-immersive interfaces; do they work in 3D immersive interfaces, or are thumbsticks, or wands, or hand trackers best? Or maybe, what are they each best at? What kinds of things do we even want to [&hellip;]<\/p>\n","protected":false},"author":89,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5,11],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/posts\/273"}],"collection":[{"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/users\/89"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/comments?post=273"}],"version-history":[{"count":5,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/posts\/273\/revisions"}],"predecessor-version":[{"id":292,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/posts\/273\/revisions\/292"}],"wp:attachment":[{"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/media?parent=273"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/categories?post=273"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.discovery.wisc.edu\/vr2015\/wp-json\/wp\/v2\/tags?post=273"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}