結合頭部姿態估計與補償的視線追蹤

Abstract

本文提出了一種基於可見光影像的視線追蹤系統，採用單一高速相機，取代傳統依賴紅外光源或專用傳感器的方案，從而顯著提升了使用者體驗。然而，這種設置在補償頭部移動方面面臨更大的挑戰。為解決此問題，我們設計了一種新型視線追蹤系統，結合了精確的頭部姿態估計方法。該方法通過識別臉部特徵點並解決 2D 到 3D 的對應問題，獲取特徵點的 3D 坐標，進而估算頭部運動。該系統能夠實時更新眼球模型並準確計算虹膜區域的初始位置。實驗結果表明，當使用者進行輕微頭部移動或旋轉時，該系統能有效提高視線追蹤的精度與準確性。This paper proposes a visible-light-based gaze tracking system that utilizes a single high-speed camera, replacing traditional systems that rely on infrared light sources or dedicated sensors, thereby significantly enhancing user experience. However, this configuration poses greater challenges in compensating for head movements. To address this issue, we designed a novel gaze tracking system that integrates an accurate head pose estimation method. The method identifies facial feature points and resolves the 2D-to-3D correspondence problem to obtain the 3D coordinates of these points, which are then used to estimate head motion. The system is capable of real-time updates to the eye model and precise calculation of the initial position of the iris region. Experimental results demonstrate that the system effectively improves gaze tracking accuracy and precision when users perform slight head movements or rotations.