Smooth head tracking for virtual reality applications

详细信息    查看全文

• 作者：Abdenour Amamra
• 关键词：Human–machine interaction ; Virtual reality ; Head tracking ; Head pose estimation ; Pythagorean hodographs
• 刊名：Signal, Image and Video Processing
• 出版年：2017
• 出版时间：March 2017
• 年：2017
• 卷：11
• 期：3
• 页码：479-486
• 全文大小：
• 刊物类别：Engineering
• 刊物主题：Signal,Image and Speech Processing; Image Processing and Computer Vision; Computer Imaging, Vision, Pattern Recognition and Graphics; Multimedia Information Systems;
• 出版者：Springer London
• ISSN：1863-1711
• 卷排序：11

文摘

In this work, we propose a new head-tracking solution for human–machine real-time interaction with virtual 3D environments. This solution leverages RGBD data to compute virtual camera pose according to the movements of the user’s head. The process starts with the extraction of a set of facial features from the images delivered by the sensor. Such features are matched against their respective counterparts in a reference image for the computation of the current head pose. Afterwards, a prediction approach is used to guess the most likely next head move (final pose). Pythagorean Hodograph interpolation is then adapted to determine the path and local frames taken between the two poses. The result is a smooth head trajectory that serves as an input to set the camera in virtual scenes according to the user’s gaze. The resulting motion model has the advantage of being: continuous in time, it adapts to any frame rate of rendering; it is ergonomic, as it frees the user from wearing tracking markers; it is smooth and free from rendering jerks; and it is also torsion and curvature minimising as it produces a path with minimum bending energy.