Depth Camera Based Real-Time Fingertip Detection Using Multi-view Projection

详细信息    查看全文

• 作者：Weixin Yang (17)
  Zhengyang Zhong (17)
  Xin Zhang (17)
  Lianwen Jin (17)
  Chenlin Xiong (17)
  Pengwei Wang (17)
  
• 关键词：Kinect ; depth image ; finger detection ; fingertip detection ; multiview projection
• 刊名：Lecture Notes in Computer Science
• 出版年：2013
• 出版时间：2013
• 年：2013
• 卷：8008
• 期：1
• 页码：262-269
• 全文大小：681KB
• 参考文献：1. Feng, Z., Xu, S., Zhang, X., Jin, L., Ye, Z., Yang, W.: Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system. In: International Conference on Internet Multimedia Computing and Service (ICIMCS 2012), pp. 70鈥?4 (2012)
  2. Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: Proceedings of international Conference on Multimodal Interfaces, pp. 289鈥?96. ACM (2004)
  3. Jin, L., Yang, D., Zhen, L., Huang, J.: A novel vision based finger-writing character recognition system. Journal of Circuits, Systems, and Computers (JCSC)聽16(3), 421鈥?36 (2007) CrossRef
  4. Crowley, J., Berard, F., Coutaz, J.: Finger tracking as an input device for augmented reality. In: International Workshop on Gesture and Face Recognition, pp. 195鈥?00 (1995)
  5. Minnen, D., Zafrulla, Z.: Towards robust cross-user hand tracking and shape recognition. In: IEEE International Conference on Computer Vision Workshops, pp. 1235鈥?241 (2011)
  6. Pugeault, N., Bowden, R.: Spelling it out: Real-time asl fingerspelling recognition. In: IEEE International Conference on Computer Vision Workshops, pp. 1114鈥?119 (2011)
  7. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.聽2, p. 7 (2011)
  8. Tang, Y., Sun, Z., Tan, T.: Real-time head pose estimation using random regression forests. In: Sun, Z., Lai, J., Chen, X., Tan, T. (eds.) CCBR 2011. LNCS, vol.聽7098, pp. 66鈥?3. Springer, Heidelberg (2011) CrossRef
  9. Wu, A., Shah, M., Da Vitoria Lobo, N.: A virtual 3D blackboard: 3D finger tracking using a single camera. In: International Conference on Automatic Face and Gesture Recognition, pp. 536鈥?43 (2000)
  10. Kang, S., Nam, M., Rhee, P.: Color based hand and finger detection technology for user interaction. In: International Conference on Convergence and Hybrid Information Technology, pp. 229鈥?36 (2008)
  
• 作者单位：Weixin Yang (17)
  Zhengyang Zhong (17)
  Xin Zhang (17)
  Lianwen Jin (17)
  Chenlin Xiong (17)
  Pengwei Wang (17)
  
  17. School of Electronic and Information Engineering, South China University of Technology, Guangzhou, P.R. China
  

文摘

We propose a real-time fingertip detection algorithm based on depth information. It can robustly detect single fingertip regardless of the position and direction of the hand. With the depth information of front view, depth map of top view and side view is generated. Due to the difference between finger thickness and fist thickness, we use thickness histogram to segment the finger from the fist. Among finger points, the farthest point from palm center is the detected fingertip. We collected over 3,000 frames writing-in-the-air sequences to test our algorithm. From our experiments, the proposed algorithm can detect the fingertip with robustness and accuracy.