6 3D Shape Registration |
235 |
the surface [21], (iii) Thin-Plate Splines (TPS) [24, 76], or (iv) linear blend skinning model (LBS) [22]. The error function can be optimized by the Levenberg-Marquardt Algorithm [51], GraphCuts [21], or Expectation-Maximization (EM) [22, 24, 61]. In [42] deformable registration is solved by alternating between correspondence and deformation optimization. Assuming approximately isometric deformations, robust correspondences are generated using a pruning mechanism based on geodesic consistency.
Deformable alignment to account for errors in the point clouds obtained by scanning a rigid object is proposed in [12, 13]. Also, in this case, the authors use TPS to represent the deformable warp between a pair of views, that they estimate through hierarchical ICP [76].
236 |
U. Castellani and A. Bartoli |
Recently, advanced machine learning techniques have been exploited to improve registration algorithms [1, 37, 44, 59, 88]. The general idea is to use data-driven approaches that learn the relevant registration criteria from examples. The most promising methods have been proposed for (i) improving the matching phase, and (ii) detecting an object which is a general instance of one or more classes.
In this section, we report some experiments using pairwise registration in order to show how basic registration techniques work in practice. Two objects are evaluated: Foot and Frog for which two views are available for pairwise registration.3 In
3Experimental material is based on the survey paper [79]. Objects and code are available at http://eia.udg.es/cmatabos/research.htm.
6 3D Shape Registration |
237 |
Fig. 6.9 Two views of Foot (top) and Frog (bottom). Separated views (left) and aligned views (right). The portion of overlap is large for both of the objects
Fig. 6.9 we show the two objects, the overlapping region of both of the objects in the two views is quite large (i.e. around 80 %). The Foot model has approximately 1500 points, while Frog is composed of around 5000 points for each view. The two views have been acquired separately by two scans and are already aligned by the authors of [79], as shown in Fig. 6.9 (right). In order to evaluate the robustness of pairwise registration methods against the initial pose variation, we define 30 poses by generating random angles sampled from a uniform distribution between 0◦ and 10◦ (for the three Euler’s angles) and random translations (for the three translation components tx , ty , tz ) such that the translation is 5 % of the object’s main diagonal. Indeed, such transformations are considered as ground truth. We evaluate the performance of three methods: (i) Besl’s ICP [7] (Besl), which is described in Sect. 6.2.2, (ii) Chen and Medioni ICP [23], (Chen) which introduces the point-to- plane distance, and (iii) Picky ICP proposed by Zinsser et al. [101] (Picky) which implements a combination of ICP variations described in Sect. 6.2.3. A hierarchical sampling strategy is introduced to improve the speed, and a thresholding approach on the residual distribution is employed. More specifically, a threshold is defined as TH = μ + 2.5σ , where μ = mean({ei }), and σ = std({ei }). According to the basic ICP algorithm described in Sect. 6.2.2, the threshold of Step 4 is set as 0.00001 but in most of the evaluated experiments the algorithm stops because it reaches the maximum number of iterations. Therefore, we define two settings with maximum number of iterations 15 and 50 respectively in order to evaluate the speed of convergence for the analyzed cases.
In Fig. 6.10, computational efficiency is evaluated. Experiments were carried out on an entry-level laptop at 1.66 Ghz with 4 Gb. The algorithms are coded using Matlab. The three methods are shown in red (Besl), blue (Chen), and green (Picky). In general, the best results were obtained by the Picky algo-
238 |
U. Castellani and A. Bartoli |
Fig. 6.10 Computational time evaluation. Time (sec) employed for each pairwise registration. The three methods are shown in red (Besl), blue (Chen), and green (Picky)
rithm. Moreover, due to the higher computational cost of the point-to-plane distance, the Chen method is the slowest. Note that a drastic reduction of registration speed is observed when the number of points increases from Foot to
Frog.
In Fig. 6.11, the accuracy of registration is evaluated. In general, especially when the ground truth is not available, a good accuracy evaluation criterion is the Mean Squared Error (MSE) (i.e. mean{ei }). Note that the MSE error is not comparable between the three methods since they compute different distance measures and, in Picky, the error generated by outliers is not considered. Note that, for both the objects, MSE error of Besl does not improve when the number of iterations increases. Conversely, in Picky, the benefit of a higher number of iterations is observed and most of the registrations are able to reach convergence.
In order to get a direct comparison between the methods we use the ground truth transformations, which are available since we have generated them. Indeed, we evaluate the rotation and the translation error, as shown in Figs. 6.12 and 6.13
6 3D Shape Registration |
239 |
Fig. 6.11 MSE evaluation for Besl (top), Chen (middle), and Picky (bottom). The cases employing 15 iterations are shown in magenta, while cases employing 30 iterations are shown in cyan
respectively. Rotation error is computed as the mean of the difference between the observed Euler’s angles of the estimated transform and the ground truth. Angles are in radians. Translation error is the norm of the difference between the two translation vectors.