Author:
Stanislav Popelka
Contact:
standa.popelka@gmail.com
Type of research:
PhD research
Type of stimuli:
Static images
Date:
08/2012
The experiment was performed for investigating the differences between user cognition of classical 2D visualization with contour lines and perspective 3D view.
Methods
Procedure
Before each stimuli, the respondents had 30 seconds to read and remember the task. After that, the fixation cross was presented for 600 ms to ensure that all respondents started from the center of the stimuli. Then, the stimuli with the map was projected for 60 seconds. Respondents had to answer the question with use of mouse click directly into the map. Stimuli were presented in random order. For avoiding the learning effect, map with 3D visualization was inverted or the question was modified a bit. Whole process of experiment is depicted in figure.
Independent variables
In the SingleMap experiment, stimuli were designed as a pair of maps in 2D and 3D. Each slide contained one type of visualization. The aim was to reveal, which kind of visualization will be preferred when searching for answer on spatial query.
Stimuli
SingleMap experiment contained total of 15 stimuli. In this experiment, each stimulus contained one map. Stimuli 1, 2 and 3, 4 formed pairs with similar maps. Stimuli 1 and 3 contained 2D visualization, stimuli 2 and 4 3D visualization. These stimuli were selected for an analysis, because they contained the similar terrain visualization like stimuli presented in DualMap experiment.
Participants
Total of 40 respondents had participated within this eye-tracking study. Half of them were selected from the group of undergraduate students, who already attended cartography course. The rest of them were selected from students of different field of study than cartography. Differences between cartographers and non-cartographers can be investigated
Apparatus
For the study, remote eye-tracking device SMI RED 250, developed by SensoMotoric Instruments, was used. This device was operating at frequency of 120 Hz.
Analyses
For analysis of SingleMap experiment, four stimuli were selected and “ScanPath length” was analyzed in this case. It is described as the length of the gaze fixation connections in pixels. According to Goldberg et al. (2002), a longer ScanPath indicates less efficient searching. Contrast to this assertion, group of cartographers has longer ScanPaths than non-cartographers in all cases. Wilcoxon test was used to investigate differences between ScanPath lengths for “2D” and “3D” maps (always the pair of maps – 1-2 and 3-4). Statistically significant difference was found between map 3 and 4 (in case of NonCartographers, and generally if neglecting groups). No differences were found in case of using other eye-tracking metrics (Fixation duration mean, fixation count, trial duration).
ScanPath comparison was used for stimuli 1 and 2 from the SingleMap experiment. In each stimuli, a rounded AOI around each point in the map was created. ScanPath strings were generated with use of open-source application OGAMA and string comparison was visualized via tree-graph. Software eyePatterns can visualize the string matrix by displaying clusters of similar sequences. Any 2 nodes that come off of the tree in a „V“ in the figure 11 were clustered together. At some point in the clustering process, those two nodes were the most similar items. The figure shows visualization of ScanPath similarity for 40 participants and two stimuli (1 and 2). On both maps, the same AOI’s were created.
The colors in the graph are distinguished according to stimulus 1 (red) and stimulus 2 (blue). The groups with the same color are visible from the graph. For example in the upper part of an image, there is a branch with only red labels. In the bottom part, another large branch contains 16 blue labels and only two red. From this result, the different participants strategy for two stimuli is visible.
Conclusion
In the SingleMap experiment, the differences between 2D and 3D visualization were observed only in case of eye-tracking metric “ScanPath length”. We assume, that between both visualization methods are so small visual differences, that will not be reflected on the length of the fixations or other metrics. It doesn’t mean that participant cognition strategy is the same for both visualization methods. The different strategies for different visualization methods were found with use of method of ScanPath comparison.
Outputs
Popelka, S., & Brychtova, A. (2013). Eye-tracking study on different perception of 2D and 3D terrain visualisation. Cartographic Journal, 50(3), 240-246.
Downloads
OGAMA experiment is available here: OGAMA-SingleMap
All stimuli with questions can be downloaded from here: Stimuli_SingleMap