Leaving Flatland: Realtime 3D Stereo Semantic Reconstruction

Citation

Rusu, R.B., Sundaresan, A., Morisset, B., Agrawal, M., Beetz, M. (2008). Leaving Flatland: Realtime 3D Stereo Semantic Reconstruction. In: Xiong, C., Huang, Y., Xiong, Y., Liu, H. (eds) Intelligent Robotics and Applications. ICIRA 2008. Lecture Notes in Computer Science(), vol 5314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88513-9_99

Abstract

We report our first experiences with Leaving Flatland, an exploratory project which studies the key challenges in closing the loop on autonomous perception and action in challenging terrain. A primary objective of the project is to demonstrate the acquisition and processing of robust 3D geometric model maps from stereo data and Visual Odometry techniques. The 3D geometric model is used to infer different terrain types and construct a 3D semantic model which can be used for path planning or teleoperation. This paper presents the set of methods and techniques used for building such a model, and provides insight on the mathematical optimizations used for obtaining realtime processing. To validate our approach, we show results obtained on multiple datasets and perform a comparison with other similar initiatives.

Keywords: Point Cloud, Mobile Robot, Ground Plane, Stereo Camera, Point Cloud Data


Read more from SRI