<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>The line of sight refers to the gaze direction of the human eye and reflects the focus of human attention. Head movement is an important accompanying behavior in the process of human gaze, and it is of great significance to human visual attention. This paper intends to combine the gaze focus calculation modeling of head movement and eye movement combined with deep learning data fusion. By combining the gaze direction calculation model of data fusion and neural network algorithm, deep learning technology is used to reveal the relationship between head movement and eye movement, and the data of head movement and eye movement are merged to realize accurate and fast real-time gaze spatial direction calculation. New ideas for improving the efficiency, reliability, usability and functionality of the gaze tracking system. In this paper, the convolutional neural network method is used, and the classification accuracy of the line of sight direction reaches 99% when the head posture is free.</p>
</abstract>

The line of sight refers to the gaze direction of the human eye and reflects the focus of human attention. Head movement is an important accompanying behavior in the process of human gaze, and it is of great significance to human visual attention. This paper intends to combine the gaze focus calculation modeling of head movement and eye movement combined with deep learning data fusion. By combining the gaze direction calculation model of data fusion and neural network algorithm, deep learning technology is used to reveal the relationship between head movement and eye movement, and the data of head movement and eye movement are merged to realize accurate and fast real-time gaze spatial direction calculation. New ideas for improving the efficiency, reliability, usability and functionality of the gaze tracking system. In this paper, the convolutional neural network method is used, and the classification accuracy of the line of sight direction reaches 99% when the head posture is free.

Research on the Gaze Direction of Head-Eye Data Fusion

School of Computer Science and Engineering

International Journal of Advanced Network, Monitoring and Controls

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Research on the Gaze Direction of Head-Eye Data Fusion"}

The line of sight refers to the gaze direction of the human eye and reflects the focus of human attention. Head movement is an important accompanying behavior...

Research on the Gaze Direction of Head-Eye Data Fusion

Online veröffentlicht: 21. Mai 2023

Seitenbereich: 1 - 11

DOI: https://doi.org/10.21307/ijanmc-2021-031

Schlüsselwörter
Head Pose Estimation, Pupil Center Detection, Line of Sight Direction, Data Fusion, Neural Network

© 2021 Xin Xu et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Research on the Gaze Direction of Head-Eye Data Fusion

Online veröffentlicht: 21. Mai 2023

Seitenbereich: 1 - 11

DOI: https://doi.org/10.21307/ijanmc-2021-031

SchlüsselwörterHead Pose Estimation, Pupil Center Detection, Line of Sight Direction, Data Fusion, Neural Network

© 2021 Xin Xu et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Schlüsselwörter
Head Pose Estimation, Pupil Center Detection, Line of Sight Direction, Data Fusion, Neural Network