Evaluating the usefulness of Eye Tracking in Game-based Learning
Keywords:Serious Games, Human-Computer Interaction, Play Testing, Eye Tracking
The challenge of educational game design is to develop solutions that please as many players as possible, but are still educationally effective. How learning happens in games is methodologically very challenging to point out and thus it is usually avoided. In this paper we tackle this challenge with eye tracking method. The aim of this research is to study the meaning of cognitive feedback in educational games and evaluate the usefulness of eye tracking method in game based learning research and game design. Based on perceptual data we evaluated the playing behavior of 43 Finnish and Austrian children aged from 7 to 16. Four different games were used as test-beds. The results indicated that players’ perception patterns varied a lot and some players even missed relevant information during playing. The results showed that extraneous elements should be eliminated from the game world in order to avoid incidental processing in crucial moments. Animated content easily grasps player’s attention, which may disturb learning activities. Especially low performers and inattentive players have difficulties in distinguishing important and irrelevant content and tend to stick to salient elements no matter of their importance for a task. However, it is not reasonable to exclude all extraneous elements because it decreases engagement and immersion. Thus, balancing of extraneous and crucial elements is essential. Overall, the results showed that eye tracking can provide important information from game based learning process and game designs. However, we have to be careful when interpreting the perceptual data, because we cannot be sure if the player understands everything that he or she is paying attention to. Thus, eye tracking should be complemented with offline methods like retrospective interview that was successfully used in this research.
 Dewey J., “Experience and Education”. Simon and Schuster, New York, 1938/1997.
 Alkan, S., Cagiltay, K., “Studying computer game learning experience through eye tracking”. British Journal of Educational Technology, 38(5), 538-542, 2007. http://dx.doi.org/10.1111/j.1467-8535.2007.00721.x
 Kiili, K., “Foundation for Problem-Based Gaming”. British Journal of Educational Technology – Special issue on Game-Based Learning, 38(3), 394-404, 2007.
 Kiili, K, “Digital Game-based Learning: Towards an Experiential Gaming Model”. The Internet and Higher Education, 8(1), 13-2, 2005. http://dx.doi.org/10.1016/j.iheduc.2004.12.001
 Boud, D., Keogh, R., Walker, R., “Reflection: Turning experience into learning”. London: RoutledgeFalmer, 1985.
 Ketamo, H., Kiili, K., “Conceptual change takes time: Game based learning cannot be only supplementary amusement”. Journal of Educational Multimedia and Hypermedia, 19(1), 39-57, 2010.
 Norman, D., “The psychology of everyday things”. Basic Books, New York, 1998.
 Ketamo, H., Suominen, M., “Learning-by-Teaching in Educational Games”. In proceedings of Ed-Media 2008. 30.6.–4.7.2008, Vienna, Austria, pp. 2954-2963, 2008.
 Hyönä, J., “The use of eye movements in the study of multimedia learning”. Learning and Instruction, 20, 172-176, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.013
 Mayer, R. E., ”Unique contributions of eye-tracking research to the study of learning with graphics”. Learning and Instruction, 20, 167-171, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.012
 Boucheix, J.-M, Lowe, R. K., “An eye-tracking comparison of external pointing cues and internal continuous cues in learning with complex animations”. Learning and Instruction, 20, 123135, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.015
 Kickmeier-Rust, M. D., Hillemann, E., Albert, D., "Tracking the UFO’s paths: Using Eye-Tracking for the Evaluation of Serious Games.", In R. Shumaker (Ed.), Virtual and Mixed Reality - New Trends (pp. 315-324). Lecture Notes in Computer Science, 6773. Berlin: Springer, 2011. http://dx.doi.org/10.1007/978-3-642-22021-0_35
 Law, E., Mattheiss, E., Kickmeier-Rust, M. D., Alt, D., “Vicarious learning with a digital educational game: Eye-tracking and survey-based evaluation approaches”. In G. Leitner, M. Hitz & A. Holzinger (Eds.), HCI in Work and Learning, Life and Leisure. Lecture Notes in Computer Science, 6389, (pp. 471-488). Berlin: Springer, 2010. http://dx.doi.org/10.1007/978-3-642-16607-5_33
 Chi M., Siler, S., Jeong, H., Yamauchi, T., Hausmann, R. "Learning from human tutoring.” Cognitive Science, 25, 471-533, 2001. http://dx.doi.org/10.1207/s15516709cog2504_1
 Biswas, G., Schwartz, D., Leelawong, K., Vye, N. Tag, V., "Learning by teaching: A new agent paradigm for educational software". Applied Artificial Intelligence, 19, 363-392, 2001. http://dx.doi.org/10.1080/08839510590910200
 Mayer, R. E., Moreno, R., “Nine ways to reduce cognitive load in multimedia learning.” Educational Psychologist, 38, 43–52, 2003. http://dx.doi.org/10.1207/S15326985EP3801_6
How to Cite
IJSG copyright information is provided here.