Multi-Finger 3D Landmark Detection using Bi-Directional Hierarchical Regression

Purpose In this paper we proposed bi-directional hierarchical regression for accurate human finger landmark detection with only using depth information.Materials and Methods Our algorithm consisted of two different step, initialization and landmark estimation. To detect initial landmark, we used difference of random pixel pair as the feature descriptor. After initialization, 16 landmarks were estimated using cascaded regression methods. To improve accuracy and stability, we proposed bi-directional hierarchical structure.Results In our experiments, the ICVL database were used for evaluation. According to our experimental results, accuracy and stability increased when applying bi-directional hierarchical regression more than typical method on the test set. Especially, errors of each finger tips of hierarchical case significantly decreased more than other methods.Conclusion Our results proved that our proposed method improved accuracy and stability and also could be applied to a large range of applications such as augmented reality and simulation surgery.