Evaluating the usefulness of Eye Tracking in Game-based Learning

  • Kristian Kiili 1Tampere University of Technology, Pori, Finland
  • Harri Ketamo Satakunta University of Applied Sciences, Pori, Finland
  • Michael D. Kickmeier-Rust Graz University of Technology
Keywords: Serious Games, Human-Computer Interaction, Play Testing, Eye Tracking

Abstract

The challenge of educational game design is to develop solutions that please as many players as possible, but are still educationally effective. How learning happens in games is methodologically very challenging to point out and thus it is usually avoided. In this paper we tackle this challenge with eye tracking method. The aim of this research is to study the meaning of cognitive feedback in educational games and evaluate the usefulness of eye tracking method in game based learning research and game design. Based on perceptual data we evaluated the playing behavior of 43 Finnish and Austrian children aged from 7 to 16. Four different games were used as test-beds. The results indicated that players’ perception patterns varied a lot and some players even missed relevant information during playing. The results showed that extraneous elements should be eliminated from the game world in order to avoid incidental processing in crucial moments. Animated content easily grasps player’s attention, which may disturb learning activities. Especially low performers and inattentive players have difficulties in distinguishing important and irrelevant content and tend to stick to salient elements no matter of their importance for a task. However, it is not reasonable to exclude all extraneous elements because it decreases engagement and immersion. Thus, balancing of extraneous and crucial elements is essential. Overall, the results showed that eye tracking can provide important information from game based learning process and game designs. However, we have to be careful when interpreting the perceptual data, because we cannot be sure if the player understands everything that he or she is paying attention to. Thus, eye tracking should be complemented with offline methods like retrospective interview that was successfully used in this research.

Author Biography

Kristian Kiili, 1Tampere University of Technology, Pori, Finland
I'm submitted this for Kristian being only the third author

References

[1] Schell J., “The art of game design: a book of lenses”. Morgan Kaufmann Publishers, Burlington, 2006.
[2] Dewey J., “Experience and Education”. Simon and Schuster, New York, 1938/1997.
[3] Alkan, S., Cagiltay, K., “Studying computer game learning experience through eye tracking”. British Journal of Educational Technology, 38(5), 538-542, 2007. http://dx.doi.org/10.1111/j.1467-8535.2007.00721.x
[4] Kiili, K., “Foundation for Problem-Based Gaming”. British Journal of Educational Technology – Special issue on Game-Based Learning, 38(3), 394-404, 2007.
[5] Kiili, K, “Digital Game-based Learning: Towards an Experiential Gaming Model”. The Internet and Higher Education, 8(1), 13-2, 2005. http://dx.doi.org/10.1016/j.iheduc.2004.12.001
[6] Boud, D., Keogh, R., Walker, R., “Reflection: Turning experience into learning”. London: RoutledgeFalmer, 1985.
[7] Ketamo, H., Kiili, K., “Conceptual change takes time: Game based learning cannot be only supplementary amusement”. Journal of Educational Multimedia and Hypermedia, 19(1), 39-57, 2010.
[8] Norman, D., “The psychology of everyday things”. Basic Books, New York, 1998.
[9] Ketamo, H., Suominen, M., “Learning-by-Teaching in Educational Games”. In proceedings of Ed-Media 2008. 30.6.–4.7.2008, Vienna, Austria, pp. 2954-2963, 2008.
[10] Hyönä, J., “The use of eye movements in the study of multimedia learning”. Learning and Instruction, 20, 172-176, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.013
[11] Mayer, R. E., ”Unique contributions of eye-tracking research to the study of learning with graphics”. Learning and Instruction, 20, 167-171, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.012
[12] Boucheix, J.-M, Lowe, R. K., “An eye-tracking comparison of external pointing cues and internal continuous cues in learning with complex animations”. Learning and Instruction, 20, 123135, 2010. http://dx.doi.org/10.1016/j.learninstruc.2009.02.015
[13] Kickmeier-Rust, M. D., Hillemann, E., Albert, D., "Tracking the UFO’s paths: Using Eye-Tracking for the Evaluation of Serious Games.", In R. Shumaker (Ed.), Virtual and Mixed Reality - New Trends (pp. 315-324). Lecture Notes in Computer Science, 6773. Berlin: Springer, 2011. http://dx.doi.org/10.1007/978-3-642-22021-0_35
[14] Law, E., Mattheiss, E., Kickmeier-Rust, M. D., Alt, D., “Vicarious learning with a digital educational game: Eye-tracking and survey-based evaluation approaches”. In G. Leitner, M. Hitz & A. Holzinger (Eds.), HCI in Work and Learning, Life and Leisure. Lecture Notes in Computer Science, 6389, (pp. 471-488). Berlin: Springer, 2010. http://dx.doi.org/10.1007/978-3-642-16607-5_33
[15] Chi M., Siler, S., Jeong, H., Yamauchi, T., Hausmann, R. "Learning from human tutoring.” Cognitive Science, 25, 471-533, 2001. http://dx.doi.org/10.1207/s15516709cog2504_1
[16] Biswas, G., Schwartz, D., Leelawong, K., Vye, N. Tag, V., "Learning by teaching: A new agent paradigm for educational software". Applied Artificial Intelligence, 19, 363-392, 2001. http://dx.doi.org/10.1080/08839510590910200
[17] Mayer, R. E., Moreno, R., “Nine ways to reduce cognitive load in multimedia learning.” Educational Psychologist, 38, 43–52, 2003. http://dx.doi.org/10.1207/S15326985EP3801_6
Published
2014-06-19
How to Cite
Kiili, K., Ketamo, H., & Kickmeier-Rust, M. D. (2014). Evaluating the usefulness of Eye Tracking in Game-based Learning. International Journal of Serious Games, 1(2). https://doi.org/10.17083/ijsg.v1i2.15
Section
Articles

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.