Eye Tracking & ArcGIS: We can read your mind.

Stewart Rouse Rahul Bhosle Laura Tateosian sdrouse@ncsu.edu rbhosle@ncsu.edu lgtateos@ncsu.edu The Center for Earth Observation at North Carolina State University

Abstract
The field of cognitive map design, a subdiscipline of cartography, studies human cognition to improve map design. Effective maps are designed to engage viewers by directing attention in response to carefully selected visual stimuli, but research also indicates that meaningfulness has a role in controlling visual attention. We would like to use eye tracking to determine how and where the viewers attention is drawn to aid in map design. In this work, we combine eye tracking technology with a geographic information system by displaying visual stimuli in ArcGIS, collecting observer eye movements, and superimposing the results on the display. We then perform spatial analysis using ArcGIS. This poster addresses the challenges of transforming screen coordinates to geographic coordinates and demonstrates our results on a world map.

Workflow
I. Preprocessing
Load data into ArcGIS and fix spatial extent. Draw red registration points, Pmin & Pmax, at map corners. Perform screen capture. Calculate data extent in pixels.
Figure 3: Eye tracking in action.

II. Perform eye tracking

A
Figure 4: (x,y) fixation plot.

Calibrate the eye gaze based on sample gaze fixations across the screen. View stimulus (e.g. the world map in Figure 3). Record viewers point of gaze as a percentage of the screen dimensions (Figure 4).

III. Postprocessing
Pmax
Convert screen percentages to map units (see Table 1). Display transformed eye fixation point Esri Shapefile. (points in Figure 5). Derive and display saccades (lines in Figures 5).

Pmin
Figure 1: The Final Roundup with observer eye saccades (red) and fixations (green) overlaid show how the painting directed the observers attention.

Figure 5: Mapped gaze data.

Background & Objectives

Researchers in cognitive map design began using eye tracking in the 1970s [2]. These early studies laid the groundwork for studies that followed by demonstrating the feasibility of using eye-movement analysis in the field of cartography. Recent studies have begun to use eye tracking to evaluate the effectiveness of visual features in geo-visualization [1]. Work by Steffke demonstrated that a GIS can be used to analyze eye tracking results [3]. Based on these related works we identified the following objectives: Interpret eye tracking point of gaze tabular results. Develop a procedure to import tabular results into ArcGIS. Automate the table to ArcGIS import process. Develop analysis approaches.

For each point in the dataset, 1. Convert raw data point Pe ( xe , ye ) to equivalent pixel point Pp ( x p , y p ), 2. Convert pixel point Pp to geographic coordiate Pg x g , y g as follows, Pg Pg min using x p xe mx and y p (1 ye ) m y for monitor resolution mx m y

Pp min Pg max Pg min

p max

Pp min

Table 1: Eye tracking to GIS reference system transformation process.

Applying ArcGIS Analysis

System Architecture
Software
The bundled eye tracking software generates tabular and video output. The ArcGIS software is used to visualize the results and to perform the post-processing. Python: Python Image Library (PIL) was used for pre-processing and the ArcGIS arcpy library was used to display the results.
Figure 6: World map overlaid with tracked fixations with ArcGIS point density analysis (left) and redorange-yellow-green saccades colored for time (right).

Hardware
Mirametrix S2 Eye Tracker with a 0.5-1.0 accuracy. 22-inch monitor with a 1280 1204 resolution.
Infra-red LEDs
Video camera

Discussion & Conclusions

We have developed a procedure to import eye tracking results into a GIS. We have automated this process with Python scripting and identified ArcGIS geoprocessing tools for analyzing eye tracking point data. Several aspects of interpreting the eye tracking results require further attention. The eye tracking results return more data than we are currently considering, such as pupil dilation and fixation duration. We need to develop approaches for incorporating this data. Also, we need to determine how to account for the uncertainty in the data caused by calibration error. The results of this work hold promise for the use of eye tracking and ArcGIS as tools for conducting controlled user studies to evaluate map design.
Acknowledgements This work was supported by a scholarship from The Carolinas Chapter of Geospatial Information & Technology Association (NC GITA). Special thanks to Sarah Gray Tateosian for permission to reproduce her original artwork, The Final Roundup. The world maps shown here are based on Esri Data and Maps 2006.

pupil glint

Figure 2: Mirametrix S2 Eyetracker (left) and detected ocular features (right).

References [1] Garlandini, Simone, and Sara Fabrikant. "Evaluating the effectiveness and efficiency of visual variables for geographic information visualization." Spatial Information Theory (2009): 195-211. [2] Montello, Daniel R. "Cognitive map-design research in the twentieth century: Theoretical and empirical approaches." Cartography and Geographic Information Science 29.3 (2002): 283-304. [3] Steffke, Christy, and Julie Libarkin. Surpassing the Capability of Current Eye Tracking Software Using Geographic Information Systems (GIS) Technology. Poster, Presented at theNational Socio-Environmental Synthesis (SESYNC) Center Visualization TechnologiesWorkshop, July 23 24, 2012.