Special Section on Ultrawide Context- and Content-Aware Imaging

Real-time planar segmentation of depth images: from three-dimensional edges to segmented planes

[+] Author Affiliations
Hani Javan Hemmat, Egor Bondarev, Peter H. N. de With

Eindhoven University of Technology, Department of Electrical Engineering, Signal Processing Systems, Den Dolech 2, P.O. Box 513, 5600 MB Eindhoven, The Netherlands

J. Electron. Imaging. 24(5), 051008 (Oct 22, 2015). doi:10.1117/1.JEI.24.5.051008
History: Received May 14, 2015; Accepted September 23, 2015
Text Size: A A A

Abstract.  Real-time execution of processing algorithms for handling depth images in a three-dimensional (3-D) data framework is a major challenge. More specifically, considering depth images as point clouds and performing planar segmentation requires heavy computation, because available planar segmentation algorithms are mostly based on surface normals and/or curvatures, and, consequently, do not provide real-time performance. Aiming at the reconstruction of indoor environments, the spaces mainly consist of planar surfaces, so that a possible 3-D application would strongly benefit from a real-time algorithm. We introduce a real-time planar segmentation method for depth images avoiding any surface normal calculation. First, we detect 3-D edges in a depth image and generate line segments between the identified edges. Second, we fuse all the points on each pair of intersecting line segments into a plane candidate. Third and finally, we implement a validation phase to select planes from the candidates. Furthermore, various enhancements are applied to improve the segmentation quality. The GPU implementation of the proposed algorithm segments depth images into planes at the rate of 58 fps. Our pipeline-interleaving technique increases this rate up to 100 fps. With this throughput rate improvement, the application benefit of our algorithm may be further exploited in terms of quality and enhancing the localization.

Figures in this Article
© 2015 SPIE and IS&T

Citation

Hani Javan Hemmat ; Egor Bondarev and Peter H. N. de With
"Real-time planar segmentation of depth images: from three-dimensional edges to segmented planes", J. Electron. Imaging. 24(5), 051008 (Oct 22, 2015). ; http://dx.doi.org/10.1117/1.JEI.24.5.051008


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.