Building a mixed reality system free from visual discomfort

Iuliia Golovchanskaia; Aleksandr Anikeev; Oleg Mirsky; Maksim Sorokin; Dmitry Zhdanov; Andrey Zhdanov; Igor Potemin

doi:10.1117/12.2597182

12 September 2021 Building a mixed reality system free from visual discomfort

Iuliia Golovchanskaia, Aleksandr Anikeev, Oleg Mirsky, Maksim Sorokin, Dmitry Zhdanov, Andrey Zhdanov, Igor Potemin

Proceedings Volume 11876, Optical Instrument Science, Technology, and Applications II; 118760M (2021) https://doi.org/10.1117/12.2597182
Event: SPIE Optical Systems Design, 2021, Online Only

Conference Poster

Abstract

This research focuses on the possibility of building an alternative mixed reality (MR) system, which will eliminate all its main causes of visual discomfort and form a model of the real world in the virtual space, as much as possible corresponding to it. The relationship between virtual reality (VR) systems, which are limited to models of their own virtual world, and MR systems, which add virtual objects to the real world, is examined. This paper presents an approach based on generating a point cloud of static objects using RGB-D sensors of the MR device, its further classification and segmentation, and then searching for a similar CAD object in the appropriate database. The found virtual analogue, after appropriate transformations, replaces the real object of the scene. To create more realism, RGB images of real objects can be superimposed as textures on the corresponding virtual scene objects. The paper proposes a multimodal approach, which consists in searching for objects with similar modalities in databases. A virtual scene created in a single space using this approach eliminates the possibility of forming unnatural lighting and observation conditions for all objects, including virtual copies of real objects and added virtual objects.

Conference Presentation

Citation Download Citation

Iuliia Golovchanskaia, Aleksandr Anikeev, Oleg Mirsky, Maksim Sorokin, Dmitry Zhdanov, Andrey Zhdanov, and Igor Potemin "Building a mixed reality system free from visual discomfort", Proc. SPIE 11876, Optical Instrument Science, Technology, and Applications II, 118760M (12 September 2021); https://doi.org/10.1117/12.2597182

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available