Multimeric interfaces in an active control induced virtual environment

Multimeric interfaces in an active control induced virtual environment

Alexey V. Sergeev
Russian State Scientific Center for Robotics and Technical Cybernetics (RTC), Leading Engineer, 21, Tikhoretsky pr., Saint Petersburg, 194064, Russia, tel.: +7(921)975-04-97, This email address is being protected from spambots. You need JavaScript enabled to view it., ORCID: 0000-0002-4798-6570

Anastasiia Iu. Iusupova
RTC, Engineer, 21, Tikhoretsky pr., Saint Petersburg, 194064, Russia, tel.: +7(999)529-25-08, This email address is being protected from spambots. You need JavaScript enabled to view it., ORCID: 0000-0002-1534-1030

Sergey F. Sergeev
Doctor of Psychological Science, Professor, Peter the Great Saint Petersburg Polytechnical University (SPbPU), Head of Laboratory, 29, Politekhnicheskaya ul., Saint Petersburg, 195251, Russia, tel.: +7(911)995-09-29, This email address is being protected from spambots. You need JavaScript enabled to view it., This email address is being protected from spambots. You need JavaScript enabled to view it., ORCID: 0000-0002-6677-8320

Received March 1, 2022

Abstract
The present work focuses on the usage of multi-dimensional 2D interfaces in the form of WIMP models to ensure human-machine interaction of a human operator with a controlled object in an active virtual environment. We demonstrate that 3D representation of information in a virtual reality 3D interface is not enough to ensure effective activity. We identified the connection between the limitations of visual perception and operating in virtual reality with a keyboard and mouse. We have proved solutions to this problem using the methods of classical engineering psychology and ergonomics for the example of creating objects for the virtual museum of The Russian State Scientific Center for Robotics and Technical Cybernetics. We have analyzed the prospects of using multimeric interfaces to control autonomous mobile robots.

Key words
Virtual reality, human-robot interface, multi-dimensional interfaces, WIMP interface.

Acknowledgements
Work was accomplished within the frame of state task of Ministry of Education and Science of the Russian Federation No 075-00913-21-00 dated 25.12.2020.

DOI
10.31776/RTCJ.10403

Bibliographic description
Sergeev, A.V.,Iusupova, A.Iu. and Sergeev, S.F. (2022). Multimeric interfaces in an active control induced virtual environment. Robotics and Technical Cybernetics, 10(4), pp.261-266.

UDC identifier:
004.896

References 

  1. Martina, V.S. and Sergeev, S.F. (2018). Inzhenerno-psihologicheskie problemy mul'timernyh interfejsov [Engineering and psychological problems of multidimensional interfaces]. In: Trudy III Mezhdunarodnoj Konferencii «CHelovecheskij Faktor v Slozhnyh Tekhnicheskih Sistemah i Sredah» (Ergo-2018) [III International Conference «The Human Factor in Complex Technical Systems and Environments» (Ergo-2018): Proceedings], pp.196–201. (in Russian).
  2. Bowman, D.A. et al. (2020). New Directions in 3D User Interfaces. [online]. Available at: http://www.gm.fh-koeln.de/~hk/lehre/sgmci/ss2012/material/new_directions_in_3D_UI.pdf (Accessed 9 June 2022).
  3. Sergeev, S.F. (2020). Proektirovanie Interfejsov. Uchebnoe posobie. [Interface Design: Textbook]. Saint Petersburg : VVM, p.132. (in Russian).
  4. Andries van Dam (1997). Post-WIMP user interfaces. Communications of the ACM, 40(2), pp.63–67. DOI: 10.1145/253671.253708.
  5. Sergeev, S.F. (2009). Obuchayushchie i Professional'nye Immersivnye Sredy [Educational and Professional Immersive Environments]. Moscow : Narodnoe obrazovanie, p.132. (in Russian).
  6. Sergeev, A.V., Guk, M.Yu. and Dalyaev, I.Yu. (2019). Primenenie tekhnologii virtual'noj real'nosti dlya populyarizacii dostizhenij kosmicheskoj robototekhniki [The use of virtual reality technology to popularize the achievements of space robotics]. In: Materialy XIII Mezhdunarodnoj Nauchno-Prakticheskoj Konferencii «Pilotiruemye Polety v Kosmos» [XIII International Scientific-Practical Conference «Manned Space Flights»: Materials], pp.16–18. (in Russian).
  7. Sergeev, A.V. and Guk, M.Yu. (2018). Upravlenie mobil'nym robotom kosmicheskogo naznacheniya s primeneniem virtual'noj real'nosti i silomomentnogo ochuvstvleniya [Control of a mobile robot for space purposes using virtual reality and force-torque sensing]. Pilotiruemye Polety v Kosmos [Manned Space Flights], 4, pp.44-52. (in Russian).