The problem of increasing the adequacy of environmental perception by the operator of a mobile robot in the remote control is discussed. A real-time surround view system for mobile robotic systems based on cameras with overlapping fields of view and fisheye lenses is proposed. A prototype of the surround view module is developed. The features of the architecture and software of the surround view system are determined. The algorithms for determining the intrinsic parameters of cameras and distortion correction using new models for describing the distortion of wide-angle and ultra-wide-angle lenses are analyzed. Algorithms for finding the extrinsic parameters of cameras, as well as homography matrices, are implemented via invariant descriptors; static homography matrices are used for stitching images into a panorama. Algorithms of blending the overlapping regions of the frames are analyzed and implemented. The methods of projective geometry and augmented reality are discussed to obtain a third-person view. A variant of the surface for projecting a panorama of a surround view is proposed. The software is implemented using cross-platform game engine Unity. Directions for further research are also represented.
Original language | English |
---|---|
Title of host publication | Proceedings of 14th International Conference on Electromechanics and Robotics “Zavalishin’s Readings” - ERZR 2019 |
Editors | Andrey Ronzhin, Vladislav Shishlakov |
Publisher | Springer Nature |
Pages | 465-476 |
Number of pages | 12 |
ISBN (Print) | 9789811392665 |
DOIs | |
State | Published - 2020 |
Externally published | Yes |
Event | 14th International Conference on Electromechanics and Robotics - Zavalishin's Readings, ER(ZR) 2019 - Kursk, Russian Federation Duration: 17 Apr 2019 → 20 Apr 2019 |
Name | Smart Innovation, Systems and Technologies |
---|---|
Volume | 154 |
ISSN (Print) | 2190-3018 |
ISSN (Electronic) | 2190-3026 |
Conference | 14th International Conference on Electromechanics and Robotics - Zavalishin's Readings, ER(ZR) 2019 |
---|---|
Country/Territory | Russian Federation |
City | Kursk |
Period | 17/04/19 → 20/04/19 |
ID: 86294877