The problem of increasing the adequacy of environmental perception by the operator of a mobile robot in the remote control is discussed. A real-time surround view system for mobile robotic systems based on cameras with overlapping fields of view and fisheye lenses is proposed. A prototype of the surround view module is developed. The features of the architecture and software of the surround view system are determined. The algorithms for determining the intrinsic parameters of cameras and distortion correction using new models for describing the distortion of wide-angle and ultra-wide-angle lenses are analyzed. Algorithms for finding the extrinsic parameters of cameras, as well as homography matrices, are implemented via invariant descriptors; static homography matrices are used for stitching images into a panorama. Algorithms of blending the overlapping regions of the frames are analyzed and implemented. The methods of projective geometry and augmented reality are discussed to obtain a third-person view. A variant of the surface for projecting a panorama of a surround view is proposed. The software is implemented using cross-platform game engine Unity. Directions for further research are also represented.

Original languageEnglish
Title of host publicationProceedings of 14th International Conference on Electromechanics and Robotics “Zavalishin’s Readings” - ERZR 2019
EditorsAndrey Ronzhin, Vladislav Shishlakov
PublisherSpringer Nature
Pages465-476
Number of pages12
ISBN (Print)9789811392665
DOIs
StatePublished - 2020
Externally publishedYes
Event14th International Conference on Electromechanics and Robotics - Zavalishin's Readings, ER(ZR) 2019 - Kursk, Russian Federation
Duration: 17 Apr 201920 Apr 2019

Publication series

NameSmart Innovation, Systems and Technologies
Volume154
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Conference

Conference14th International Conference on Electromechanics and Robotics - Zavalishin's Readings, ER(ZR) 2019
Country/TerritoryRussian Federation
CityKursk
Period17/04/1920/04/19

    Research areas

  • Augmented reality, Computer vision, Image projection, Image stitching, Mobile robot, Surround view system

    Scopus subject areas

  • Decision Sciences(all)
  • Computer Science(all)

ID: 86294877