Integration of eye tracking device and 3D motion capture for simultaneous gaze and body movement analysis

Abstract: The purpose of this project was to analyze the coordination between gaze and the upper limb movement while performing a predefined task. We implemented a method to simultaneously compute and visualize recorded gaze data from a head mounted eye tracker and motion data from a motion capture system in the same coordinate system.  A python script was implemented to temporarily synchronize the two systems and then proceed with the spatial/coordinate transformation which was validated with the data acquired while the subject was asked to perform specific tasks. Task 1 was to fixate his gaze on a block placed in the center of a table and the Task 2 was to stack the blocks by picking it up and placing it on top of each other. Wrist and elbow flexion-extension angles were tracked simultaneously based on reflective markers trajectories while performing the task. This was visualized and discussed on how the results of our study suggest that the eye movements play a vital role in planning, estimating, coordinating and providing feedback for the body to perform a motor task.