Real-time surround view system for mobile robots. / Varlashin, Viktor; Semakova, Anna; Shmakov, Oleg.
Proceedings of 14th International Conference on Electromechanics and Robotics “Zavalishin’s Readings” - ERZR 2019. ed. / Andrey Ronzhin; Vladislav Shishlakov. Springer Nature, 2020. p. 465-476 (Smart Innovation, Systems and Technologies; Vol. 154).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Research › peer-review
}
TY - GEN
T1 - Real-time surround view system for mobile robots
AU - Varlashin, Viktor
AU - Semakova, Anna
AU - Shmakov, Oleg
N1 - Publisher Copyright: © Springer Nature Singapore Pte Ltd 2020.
PY - 2020
Y1 - 2020
N2 - The problem of increasing the adequacy of environmental perception by the operator of a mobile robot in the remote control is discussed. A real-time surround view system for mobile robotic systems based on cameras with overlapping fields of view and fisheye lenses is proposed. A prototype of the surround view module is developed. The features of the architecture and software of the surround view system are determined. The algorithms for determining the intrinsic parameters of cameras and distortion correction using new models for describing the distortion of wide-angle and ultra-wide-angle lenses are analyzed. Algorithms for finding the extrinsic parameters of cameras, as well as homography matrices, are implemented via invariant descriptors; static homography matrices are used for stitching images into a panorama. Algorithms of blending the overlapping regions of the frames are analyzed and implemented. The methods of projective geometry and augmented reality are discussed to obtain a third-person view. A variant of the surface for projecting a panorama of a surround view is proposed. The software is implemented using cross-platform game engine Unity. Directions for further research are also represented.
AB - The problem of increasing the adequacy of environmental perception by the operator of a mobile robot in the remote control is discussed. A real-time surround view system for mobile robotic systems based on cameras with overlapping fields of view and fisheye lenses is proposed. A prototype of the surround view module is developed. The features of the architecture and software of the surround view system are determined. The algorithms for determining the intrinsic parameters of cameras and distortion correction using new models for describing the distortion of wide-angle and ultra-wide-angle lenses are analyzed. Algorithms for finding the extrinsic parameters of cameras, as well as homography matrices, are implemented via invariant descriptors; static homography matrices are used for stitching images into a panorama. Algorithms of blending the overlapping regions of the frames are analyzed and implemented. The methods of projective geometry and augmented reality are discussed to obtain a third-person view. A variant of the surface for projecting a panorama of a surround view is proposed. The software is implemented using cross-platform game engine Unity. Directions for further research are also represented.
KW - Augmented reality
KW - Computer vision
KW - Image projection
KW - Image stitching
KW - Mobile robot
KW - Surround view system
UR - http://www.scopus.com/inward/record.url?scp=85072891580&partnerID=8YFLogxK
U2 - 10.1007/978-981-13-9267-2_38
DO - 10.1007/978-981-13-9267-2_38
M3 - Conference contribution
AN - SCOPUS:85072891580
SN - 9789811392665
T3 - Smart Innovation, Systems and Technologies
SP - 465
EP - 476
BT - Proceedings of 14th International Conference on Electromechanics and Robotics “Zavalishin’s Readings” - ERZR 2019
A2 - Ronzhin, Andrey
A2 - Shishlakov, Vladislav
PB - Springer Nature
T2 - 14th International Conference on Electromechanics and Robotics - Zavalishin's Readings, ER(ZR) 2019
Y2 - 17 April 2019 through 20 April 2019
ER -
ID: 86294877