Monocular camera relocalization in 3D point-cloud dense map

Songshan Han; Xing Liu; Ruonan Guo; Mi Zhang; Mengyu Hu

doi:10.1117/12.2557582

3 January 2020 Monocular camera relocalization in 3D point-cloud dense map

Songshan Han, Xing Liu, Ruonan Guo, Mi Zhang, Mengyu Hu

Proceedings Volume 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019); 1137325 (2020) https://doi.org/10.1117/12.2557582
Event: Eleventh International Conference on Graphics and Image Processing, 2019, Hangzhou, China

Abstract

Due to the low-cost, lightweight and widely available, approaches that use a single monocular camera to relocalize pose in 3D point-cloud dense map has gained significant interests in a wide range of applications. Relocalizing camera in a given map is of crucial importance for vision-based autonomous navigation. When the robot run in a new map or tracks lost, the robot's global localization cannot be obtained. We propose a novel approach, which relocalizes the pose of monocular camera with respect to a prebuilt dense map. A common monocular visual odometry system is employed to reconstruct a sparse set of 3D points based on local bundle adjustment. These reconstructed points are matched against the dense map to get the camera global pose with the particle filter (PF) algorithm and iterative closest point (ICP) algorithm. The particles state represents the potential initial pose. The ICP alignment result is used to update particles pose and important weight. Meanwhile, adaptive resampling is used to approximate the distribution of pose. Our monocular camera relocalization approach has several advantages. The improved PF algorithm is utilized to tackle the local convergence of ICP alignment. And our approach only relies on matching geometry between local reconstruction and dense map, it is robust to photometric appearance variance in the environment. In addition, the approach also can estimate the metric scale, which cannot be recovered from monocular visual odometry. We present real-world experiments demonstrating that our approach can relocalize the monocular camera and accurately estimate the metric scale in a given dense map. The results verify the effectiveness and robustness of this algorithm.

Citation Download Citation

Songshan Han, Xing Liu, Ruonan Guo, Mi Zhang, and Mengyu Hu "Monocular camera relocalization in 3D point-cloud dense map", Proc. SPIE 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), 1137325 (3 January 2020); https://doi.org/10.1117/12.2557582

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available