Delft University of Technology
Zijlmans, Jeroen (author).
Improving Monocular SLAM: using Depth Estimating CNN.
Degree: 2018, Delft University of Technology
To bring down the number of traffic accidents and increase people’s mobility companies, such as Robot Engineering Systems (RES) try to put automated vehicles on the road. RES is developing the WEpod, a shuttle capable of autonomously navigating through mixed traffic. This research has been done in cooperation with RES to improve the localization capabilities of the WEpod. The WEpod currently localizes using its GPS and lidar sensors. These have proven to be not accurate and reliable enough to safely navigate through traffic. Therefore, other methods of localization and mapping have been investigated. The primary method investigated in this research is monocular Simultaneous Localization and Mapping (SLAM). Based on literature and practical studies, ORB-SLAM has been chosen as the implementation of SLAM. Unfortunately, ORB-SLAM is unable to initialize the setup when applied on WEpod images. Literature has shown that this problem can be solved by adding depth information to the inputs of ORB-SLAM. Obtaining depth information for the WEpod images is not an arbitrary task. The sensors on the WEpod are not capable of creating the required dense depth-maps. A Convolutional Neural Network (CNN) could be used to create the depth-maps. This research investigates whether adding a depth-estimating CNN solves this initialization problem and increases the tracking accuracy of monocular ORB-SLAM. A well performing CNN is chosen and combined with ORB-SLAM. Images pass through the depth estimating CNN to obtain depth-maps. These depth-maps together with the original images are used in ORB-SLAM, keeping the whole setup monocular. ORB-SLAM with the CNN is first tested on the Kitti dataset. The Kitti dataset is used since monocular ORB- SLAM initializes on Kitti images and ground-truth depth-maps can be obtained for Kitti images. Monocular ORB-SLAM’s tracking accuracy has been compared to ORB-SLAM with ground-truth depth-maps and to ORB-SLAM with estimated depth-maps. This comparison shows that adding estimated depth-maps in- creases the tracking accuracy of ORB-SLAM, but not as much as the ground-truth depth images. The same setup is tested on WEpod images. The CNN is fine-tuned on 7481 Kitti images as well as on 642 WEpod images. The performance on WEpod images of both CNN versions are compared, and used in combination with ORB-SLAM. The CNN fine-tuned on the WEpod images does not perform well, missing details in the estimated depth-maps. However, this is enough to solve the initialization problem of ORB-SLAM. The combination of ORB-SLAM and the Kitti fine-tuned CNN has a better tracking accuracy than ORB-SLAM with the WEpod fine-tuned CNN. It has been shown that the initialization problem on WEpod images is solved as well as the tracking accuracy is increased. These results show that the initialization problem of monocular ORB-SLAM on WEpod images is solved by adding the CNN. This makes it applicable to improve the current localization methods on the WEpod. Using only this setup for localization on the WEpod is not possible yet,…
Advisors/Committee Members: Gaisser, Floris (mentor), Kooij, Julian (mentor), Jonker, Pieter (graduation committee), Tejada Ruiz, Arturo (graduation committee), Delft University of Technology (degree granting institution).
Subjects/Keywords: monocular SLAM; Depth-estimating CNN; ORB-SLAM
to Zotero / EndNote / Reference
APA (6th Edition):
Zijlmans, J. (. (2018). Improving Monocular SLAM: using Depth Estimating CNN. (Masters Thesis). Delft University of Technology. Retrieved from http://resolver.tudelft.nl/uuid:af8aad54-e594-4cfe-a2ef-a3b3f302a4d5
Chicago Manual of Style (16th Edition):
Zijlmans, Jeroen (author). “Improving Monocular SLAM: using Depth Estimating CNN.” 2018. Masters Thesis, Delft University of Technology. Accessed November 27, 2020.
MLA Handbook (7th Edition):
Zijlmans, Jeroen (author). “Improving Monocular SLAM: using Depth Estimating CNN.” 2018. Web. 27 Nov 2020.
Zijlmans J(. Improving Monocular SLAM: using Depth Estimating CNN. [Internet] [Masters thesis]. Delft University of Technology; 2018. [cited 2020 Nov 27].
Available from: http://resolver.tudelft.nl/uuid:af8aad54-e594-4cfe-a2ef-a3b3f302a4d5.
Council of Science Editors:
Zijlmans J(. Improving Monocular SLAM: using Depth Estimating CNN. [Masters Thesis]. Delft University of Technology; 2018. Available from: http://resolver.tudelft.nl/uuid:af8aad54-e594-4cfe-a2ef-a3b3f302a4d5