The rationality behind Perception Processing Graphs are that most applications that deal with point cloud processing can be formulated as a concrete set of building blocks that are parameterized to achieve different results
3D is here: Point Cloud Library (PCL).
With the advent of new, low-cost 3D sensing hardware such as the Kinect, and continued efforts in advanced point cloud processing, 3D perception gains more and more importance in robotics, as well as other fields. In this paper we present one of our most recent initiatives in the areas of point cloud perception: PCL (Point Cloud Library –...更多
下载 PDF 全文
- For robots to work in unstructured environments, they need to be able to perceive the world.
- The Kinect sensor for the Microsoft XBox 360 game system, based on underlying technology from PrimeSense, can be purchased for under 150, and provides real time point clouds as well as 2D images.
- PCL is a comprehensive free, BSD licensed, library for n-D Point Clouds and 3D geometry processing.
- For robots to work in unstructured environments, they need to be able to perceive the world
- Over the past 20 years, we’ve come a long way, from simple range sensors based on sonar or IR providing a few bytes of information about the world, to ubiquitous cameras to laser scanners
- In the past few years, sensors like the Velodyne spinning LIDAR used in the DARPA Urban Challenge and the tilting laser scanner used on the PR2 have given us high-quality 3D representations of the world - point clouds
- The rationality behind Perception Processing Graphs are that most applications that deal with point cloud processing can be formulated as a concrete set of building blocks that are parameterized to achieve different results
- A concrete nodelet Perception Processing Graphs example for the problem of identifying a set of point clusters supported by horizontal planar areas is shown in Figure 3
- PCL is a fully templated, modern C++ library for 3D point cloud processing.
- PCL is meant to incorporate a multitude of 3D processing algorithms that operate on point cloud data, including: filtering, feature estimation, surface reconstruction, model fitting, segmentation, registration, etc.
- Use setInputCloud to pass the input point cloud dataset to the processing module;
- The rationality behind PPGs are that most applications that deal with point cloud processing can be formulated as a concrete set of building blocks that are parameterized to achieve different results.
- Based on the previous experience of designing other 3D processing libraries, and most recently, ROS, the authors decided to make each algorithm from PCL available as a standalone building block, that can be connected with other blocks, creating processing graphs, in the same way that nodes connect together in a ROS ecosystem.
- A concrete nodelet PPG example for the problem of identifying a set of point clusters supported by horizontal planar areas is shown in Figure 3.
- The authors present two code snippets that exhibit the flexibility and simplicity of using PCL for filtering and segmentation operations, followed by three application examples that make use of PCL for solving the perception problem: i) navigation and mapping, ii) object recognition, and iii) manipulation and grasping.
- Algorithm 2 and Figure 7 present a code snippet and the results obtained after running it on the point cloud dataset from the left part of the figure.
- The second example constitutes a segmentation operation for planar surfaces, using a RANSAC  model, as shown in Algorithm 3.
- Left: the input point cloud, right: the segmented plane represented by the inliers of the model marked with purple color.
- An example of a more complex navigation and mapping application is shown in the left part of Figure 9, where the PR2 robot had to autonomously identify doors and their handles , in order to explore rooms and find power sockets .
- Figure 10 presents a grasping and manipulation application , where objects are first segmented from horizontal planar tables, clustered into individual units, and a registration operation is applied that attaches semantic information to each cluster found.
- PCL is supported by an international community of robotics and perception researchers
- G. Guennebaud, B. Jacob, et al., “Eigen v3,” http://eigen.tuxfamily.org, 2010.
- J. Reinders, Intel threading building blocks: outfitting C++ for multicore processor parallelism. O’Reilly, 2007.
- M. Muja and D. G. Lowe, “Fast approximate nearest neighbors with automatic algorithm configuration,” in International Conference on Computer Vision Theory and Application VISSAPP’09). INSTICC Press, 2009, pp. 331–340.
- R. B. Rusu, N. Blodow, and M. Beetz, “Fast Point Feature Histograms (FPFH) for 3D Registration,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Kobe, Japan, May 12-17 2009.
- W. Schroeder, K. Martin, and B. Lorensen, Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, 4th Edition. Kitware, December 2006.
- R. B. Rusu, Z. C. Marton, N. Blodow, M. Dolha, and M. Beetz, “Towards 3D Point Cloud Based Object Maps for Household Environments,” Robotics and Autonomous Systems Journal (Special Issue on Semantic Knowledge), 2008.
- A. M. Fischler and C. R. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, June 1981.
- R. B. Rusu, W. Meeussen, S. Chitta, and M. Beetz, “Laser-based Perception for Door and Handle Identification,” in International Conference on Advanced Robotics (ICAR), June 22-26 2009.
- W. Meeussen, M. Wise, S. Glaser, S. Chitta, C. McGann, P. Mihelich, E. Marder-Eppstein, M. Muja, V. Eruhimov, T. Foote, J. Hsu, R. Rusu, B. Marthi, G. Bradski, K. Konolige, B. Gerkey, and E. Berger, “Autonomous Door Opening and Plugging In with a Personal Robot,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Anchorage, Alaska, May 3-8 2010.
- B. Steder, R. B. Rusu, K. Konolige, and W. Burgard, “Point Feature Extraction on 3D Range Scans Taking into Account Object Boundaries,” in Submitted to the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 9-13 2010.
- M. Ciocarlie, K. Hsiao, E. G. Jones, S. Chitta, R. B. Rusu, and I. A. Sucan, “Towards reliable grasping and manipulation in household environments,” New Delhi, India, 12/2010 2010.