-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy paththe_conversation_march_2018.html
183 lines (166 loc) · 13.4 KB
/
the_conversation_march_2018.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
<!DOCTYPE html>
<html lang="en-US">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta name="author" content="Daniel J. Finnegan" />
<meta name="copyright" content="Daniel J. Finnegan" />
<meta property="og:type" content="article" />
<meta name="twitter:card" content="summary">
<meta name="keywords" content="article, vr, Articles, " />
<meta property="og:title" content="How to solve virtual reality's human perception problem "/>
<meta property="og:url" content="https://ps2fino.github.io/the_conversation_march_2018.html" />
<meta property="og:description" content="I wrote a piece for The Conversation on my work in psychophysics. You can read the published article here. Below is the original unedited draft I wrote for those interested. Unedited Article Outside of entertainment, virtual reality (VR) has seen significant uptake in more practical domains. For example, using VR …" />
<meta property="og:site_name" content=""There's always money in the banana stand!"" />
<meta property="og:article:author" content="Daniel J. Finnegan" />
<meta property="og:article:published_time" content="2018-03-05T00:00:00+01:00" />
<meta property="" content="2023-11-16T12:28:52.865246+01:00" />
<meta name="twitter:title" content="How to solve virtual reality's human perception problem ">
<meta name="twitter:description" content="I wrote a piece for The Conversation on my work in psychophysics. You can read the published article here. Below is the original unedited draft I wrote for those interested. Unedited Article Outside of entertainment, virtual reality (VR) has seen significant uptake in more practical domains. For example, using VR …">
<title>How to solve virtual reality's human perception problem · "There's always money in the banana stand!"
</title>
<link href="https://netdna.bootstrapcdn.com/twitter-bootstrap/2.3.2/css/bootstrap-combined.min.css" rel="stylesheet">
<link href="https://netdna.bootstrapcdn.com/font-awesome/4.0.1/css/font-awesome.css" rel="stylesheet">
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/4.2.1/js/bootstrap.min.js"></script> <!-- Added for the footer in the side bar quote -->
<link rel="stylesheet" type="text/css" href="https://ps2fino.github.io/theme/css/pygments.css" media="screen">
<link rel="stylesheet" type="text/css" href="https://ps2fino.github.io/theme/tipuesearch/tipuesearch.css" media="screen">
<link rel="stylesheet" type="text/css" href="https://ps2fino.github.io/theme/css/elegant.css" media="screen">
<link rel="stylesheet" type="text/css" href="https://ps2fino.github.io/theme/css/custom.css" media="screen">
<link href="https://ps2fino.github.io/feeds/all.atom.xml" type="application/atom+xml" rel="alternate" title=""There's always money in the banana stand!" - Full Atom Feed" />
</head>
<body>
<div id="content-sans-footer">
<div class="navbar navbar-static-top">
<div class="navbar-inner">
<div class="container-fluid">
<a class="btn btn-navbar" data-toggle="collapse" data-target=".nav-collapse">
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</a>
<a class="brand" href="https://ps2fino.github.io/"><span class=site-name>"There's always money in the banana stand!"</span></a>
<div class="nav-collapse collapse">
<ul class="nav pull-right top-menu">
<li ><a href="https://ps2fino.github.io">Home</a></li>
<!-- <li ><a href="https://ps2fino.github.io/pages/publications.html">Publications</a></li> -->
<li ><a href="https://ps2fino.github.io/pages/resume.html">Curriculum Vitae</a></li>
<li ><a href="https://ps2fino.github.io/pages/doctoral-supervision.html">Postgraduate Opportunities</a></li>
<li ><a href="https://ps2fino.github.io/pages/grants.html">Funding</a></li>
<li ><a href="https://ps2fino.github.io/pages/publications.html">Publications</a></li>
<li ><a href="https://ps2fino.github.io/pages/resources.html">Resources</a></li>
<!-- <li ><a href="https://ps2fino.github.io/categories.html">Categories</a></li> -->
<li ><a href="https://ps2fino.github.io/tags.html">Tags</a></li>
<!-- <li ><a href="https://ps2fino.github.io/archives.html">Archives</a></li> -->
<li><form class="navbar-search" action="https://ps2fino.github.io/search.html" onsubmit="return validateForm(this.elements['q'].value);"> <input aria-label="make a search query for this site" type="text" class="search-query" placeholder="Search" name="q" id="tipue_search_input"></form></li>
</ul>
</div>
</div>
</div>
</div>
<div class="container-fluid">
<div class="row-fluid">
<div class="span1"></div>
<div class="span10">
<article>
<div class="row-fluid">
<header class="page-header span10 offset2">
<h1><a href="https://ps2fino.github.io/the_conversation_march_2018.html"> How to solve virtual reality's human perception problem </a></h1>
</header>
</div>
<div class="row-fluid">
<div class="span8 offset2 article-content">
<p>I wrote a piece for The Conversation on my work in psychophysics.
You can read the <a class="reference external" href="https://theconversation.com/how-to-solve-virtual-realitys-human-perception-problem-92128">published article here</a>.
Below is the original unedited draft I wrote for those interested.</p>
<div class="section" id="unedited-article">
<h2>Unedited Article</h2>
<p>Outside of entertainment, virtual reality (VR) has seen significant uptake in more practical domains.
For example, using VR to piece together parts of a car engine to test out a look and feel before the manufacturing process. Or to try on the latest fashion accessory before you buy.
<a class="reference external" href="https://www.youtube.com/watch?v=7T4bdlRDOdk">Our own recent work</a> at Bath has applied VR to exercise; imagine going to the gym to take part in the Tour de France and race against the world’s top cyclists.</p>
<p>While VR has been successful, it is not without its kinks.
Designing an interactive system does not stop at the hardware and software; the human must be factored in too.
Perception is the term for how we take information from the world and build understanding from it.
Our perception of reality is what we base our decisions on, and <a class="reference external" href="http://dx.doi.org/10.1109/TVCG.2017.2657138">mostly determines our sense of presence in an environment</a>.</p>
<p>So how to tackle the problem of designing VR systems that really transport us to new worlds with an acceptable sense of presence?
As the scale of the problem grows, it becomes difficult to quantify the contribution each element of the experience makes to the person's sense of presence.
For example, when watching a 360 film in VR, it is difficult to determine if the on screen animations contribute more or less than the 360 audio technology deployed in the experience.
What we need is a method for studying VR in a reductionist manner; removing the clutter then adding piece by piece to observe the effect each has in turn.</p>
<p>One theory blends together computer science and psychology: maximum likelihood estimation explains how we combine the information we receive across all our senses, integrating it together to inform our understanding of the environment.
In its simplest form, it states that we combine sensory information in an optimal fashion; each sense contributes an estimate of the environment but it is noisy.</p>
<p>This scenario is depicted in the figure below which shows how the estimates from our eyes and ears combine to give an optimal estimate somewhere in the middle.
Note how the blue curve is slimmer than the other two showing decreased variance; the combined estimate takes the best of both worlds.
It is also positioned between the two sensory estimates, showing a compromise of the two.
Finally, note it is taller: this corresponds to a higher likelihood in its estimate.</p>
<img alt="Pictorial description of maximum likelihood estimation. 2 sensory signals are combined, with result being a signal of less variance, with a mean value in between the sensory signals" src="https://ps2fino.github.io/images/march-2018/mle.png" />
<p>This has many applications in VR. <a class="reference external" href="http://dx.doi.org/10.1109/SIVE.2017.7901607">Our recent work</a> has applied this to solving a problem in VR with how people estimate distances.
Imagine using a driving simulator for teaching people how to drive.
If people compress distances in VR, then using it as a learning environment would be inappropriate.</p>
<p>Understanding how people integrate information from their senses is crucial to VR because it is not solely visual. Maximum Likelihood Estimation is a tool to model how effectively a VR system <em>needs</em> to render its multisensory environment in order to deliver the desired experience. Understanding perception will lead to more immersive VR experiences.
It's not a matter of separating each signal from the noise; it's a matter of taking all signals with the noise to give the most likely result.</p>
</div>
<hr/>
</div>
<section>
<div class="span2" style="float:right;font-size:0.9em;">
<h4>Published</h4>
<time pubdate="pubdate" datetime="2018-03-05T00:00:00+01:00">Mar 5, 2018</time>
<h4>Last Updated</h4>
<time datetime="2023-11-16T12:28:52.865246+01:00">Nov 16, 2023</time>
<h4>Category</h4>
<a class="category-link" href="https://ps2fino.github.io/categories.html#articles-ref">Articles</a>
<h4>Tags</h4>
<ul class="list-of-tags tags-in-article">
<li><a href="https://ps2fino.github.io/tags.html#article-ref">article
<span>2</span>
</a></li>
<li><a href="https://ps2fino.github.io/tags.html#vr-ref">vr
<span>9</span>
</a></li>
</ul>
<div style="border-bottom: 1px solid #8f8686; margin-top: 10px;">
<h4>Look me up on orcid</h4>
<div itemscope itemtype="https://schema.org/Person"><a itemprop="sameAs" content="https://orcid.org/0000-0003-1169-2842" href="https://orcid.org/0000-0003-1169-2842" target="orcid.widget" rel="noopener noreferrer" style="vertical-align:top;"><img src="https://orcid.org/sites/default/files/images/orcid_16x16.png" style="width:1em;margin-right:.5em;" alt="ORCID iD icon">https://orcid.org/0000-0003-1169-2842</a></div>
</div>
<div style="border-bottom: 1px solid #8f8686; margin-top: 10px;">
<h4>Let's be social</h4>
<a href="https://www.linkedin.com/in/dr-daniel-j-finnegan-50727620/" title="My LinkedIn Profile" class="sidebar-social-links" target="_blank">
<i class="fa fa-linkedin sidebar-social-links"></i></a>
<a href="https://github.com/Ps2Fino" title="My Github Profile" class="sidebar-social-links" target="_blank">
<i class="fa fa-github sidebar-social-links"></i></a>
<!-- Manually add the cardiff icon and link -->
<a href="https://www.cardiff.ac.uk/people/view/1496260-finnegan-daniel" title="My Cardiff Homepage" class="sidebar-social-links" target="_blank">
<i class="fa fa-inst-link sidebar-social-links"><img src="https://ps2fino.github.io/images/cardiff-logo-icon.jpg" alt="Cardiff University Logo" title="Cardiff University Logo" /></i></a>
<!-- Manually add the soundcloud icon and link -->
<a href="https://soundcloud.com/ps2fino" title="My soundcloud homepage" class="sidebar-social-links" target="_blank">
<i class="fa fa-inst-link sidebar-social-links"><img src="https://ps2fino.github.io/images/soundcloud-logo.png" alt="Soundcloud logo" title="Soundcloud logo" /></i></a>
</div>
</div>
</section>
</div>
</article>
</div>
<div class="span1"></div>
</div>
</div>
<div id="push"></div>
</div>
<footer>
<div id="footer">
<ul class="footer-content">
<li class="elegant-license">Content by Daniel J. Finnegan. All articles licensed under the <a href=https://opensource.org/licenses/BSD-3-Clause>BSD-3-Clause</a></li>
<li class="elegant-power">Powered by <a href="https://getpelican.com/" title="Pelican Home Page">Pelican</a>. Theme: <a href="http://oncrashreboot.com/pelican-elegant" title="Theme Elegant Home Page">Elegant</a> by <a href="https://oncrashreboot.com" title="Talha Mansoor Home Page">Talha Mansoor</a></li>
</ul>
</div>
</footer> <script src="https://code.jquery.com/jquery.min.js"></script>
<script src="https://netdna.bootstrapcdn.com/twitter-bootstrap/2.3.2/js/bootstrap.min.js"></script>
<script>
function validateForm(query)
{
return (query.length > 0);
}
</script>
</body>
<!-- Theme: Elegant built for Pelican
License : https://oncrashreboot.com/pelican-elegant -->
</html>