Improvement of Driving Simulator Eye Tracking Software

Principal Investigator(s):

Brian Davis, Researcher, Mechanical Engineering


Project summary:

This project focuses on improving the eye-tracking tools used with the HumanFIRST driving simulator. Eye tracking is an important feature for simulation-based projects. It allows researchers to understand where participants are focusing their visual attention while driving the simulator. Currently, the eye-tracking system is capable of providing a nearly continuous record of the direction in which the driver is looking with respect to real-world coordinates. However, this by itself does not give any information about what objects the driver was looking at.

To collect this type of information, additional processing is necessary. Current methods to process the raw eye-tracking data are time-intensive, requiring a human to go through eye-tracking data and system video by hand in order to extract useful data. This project examines the process by which the eye-tracking data is processed in order to identify and implement software tools to make the process more efficient.

One method being examined is to use the eye tracking system's 3D-vision vector and apply that to known information about the simulator's state (i.e., the position and speeds of different elements relative to the driver and vehicle. That information can be combined to calculate with what and for how long the driver's line of sight intersects with virtual and real-world objects. A successful project outcome is the software tools and associated documentation for reducing or eliminating the amount of human intervention when processing the eye-tracking data.

Project details:

Reports or Products: