Data Analytics of Mobile Serious Games: Applying Bayesian Data Analysis Methods

  • Heide Lukosch Delft University of Technoloy
  • Scott Cunningham Delft University of Technology
Keywords: Data analytics, mobile games, serious games, resuscitation

Abstract

Traditional teaching methods in the field of resuscitation training show some limitations, while teaching the right actions in critical situations could increase the number of people saved after a cardiac arrest. For our study, we developed a mobile game to support the transfer of theoretical knowledge on resuscitation.  The game has been tested at three schools of further education. A number of data has been collected from 171 players. To analyze this large data set from different sources and quality, different types of data modeling and analyses had to be applied. This approach showed its usefulness in analyzing the large set of data from different sources. It revealed some interesting findings, such as that female players outperformed the male ones, and that the game fostering informal, self-directed is equally efficient as the traditional formal learning method.

Author Biographies

Heide Lukosch, Delft University of Technoloy
Dr.rer.soc. H.K. (Heide) Lukosch is an assistant professor with a background in social and media sciences. Heide explores the design and effects of interactive visualization techniques like simulation games. Amongst others, she has co-developed virtual environments for team training of police teams, and games for further technical education. Heide’s research aims at supporting actors in complex situations to develop situational awareness in order to increase their performance.
Scott Cunningham, Delft University of Technology
Scott Cunningham earned degrees in engineering and policy from the Georgia Institute of Technology and the Science Policy Research Unit (SPRU) of the University of Sussex. While working in industry he worked for companies both large and small in the fields of knowledge discovery and data mining. His experiences included earning six national and international patents for his knowledge discovery work, and participating in successful startups in the Bay Area of California. He is currently an associate editor of the journal Technological Forecasting and Social Change.

References

Holmberg, M., Holmberg, S., & Herlitz, J. "Factors modifying the effect of bystander cardiopulmonary resuscitation on survival in out-of-hospital cardiac arrest patients in Sweden". European Heart journal, 22(6), 511-519, 2001. https://doi.org/10.1053/euhj.2000.2421

Rea, T. D., Pearce, R. M., Raghunathan, T. E., Lemaitre, R. N., Sotoodehnia, N., Jouven, X., & Siscovick, D. S. "Incidence of out-of-hospital cardiac arrest". The American journal of cardiology, 93(12), 1455-1460, 2004. https://doi.org/10.1016/j.amjcard.2004.03.002

Wouters, P., & van Oostendorp, H. "Overview of Instructional Techniques to Facilitate Learning and Motivation of Serious Games", In Instructional Techniques to Facilitate Learning and Motivation of Serious Games, 1-16. Springer International Publishing, 2017. https://doi.org/10.1007/978-3-319-39298-1

Prensky, M. Digital game-based learning. New York: McGraw-Hill, 2001.

Garris, R., Ahlers, R., & Driskell, J. E. "Games, motivation, and learning: A research and practice model", Simulation and Gaming, 33, 441–467, 2002. https://doi.org/10.1177/1046878102238607

Malone, T. "Toward a theory of intrinsically motivating instruction". Cognitive Science, 4, 333–369, 1981. https://doi.org/10.1207/s15516709cog0504_2

Kiili, K., de Freitas, S., Arnab, S., & Lainema, T. "The design principles for flow experience in educational games". Procedia Computer Science, 15, 78-91, 2012. https://doi.org/10.1016/j.procs.2012.10.060

Veen, W., & Vrakking, B. "Homo Zappiens. Growing up in a digital age", London: Network Continuum Education, 2006.

Shaffer, D. W. How Computer Games Help Children learn. New York: Palgrave Macmillan, 2006. https://doi.org/10.1057/9780230601994

Chalmers, A., & Debattista, K. "Level of Realism for Serious games". In IEEE Proceedings of 2009 Conference in Games and Virtual Worlds for Serious Applications, 225-232. Coventry: IEEE, 2009. https://doi.org/10.1109/VS-GAMES.2009.43

Klabbers, J. H. The Magic Circle: Principles of Gaming & Simulation. Rotterdam/Taipei: Sense Publishers, 2009.

Gee, J. P. What video games have to teach us about learning and literacy. Computers in Entertainment (CIE), 1(1), 20-20, 2003. https://doi.org/10.1145/950566.950595

Murray, J. H. Hamlet on the holodeck: The future of narrative in cyberspace. MIT press, 2017.

Raser, J. R. Simulation and society: An exploration of scientific gaming. Allyn and Bacon, Boston, MA, 1969.

Duke, R. D., & Geurts, J. Policy games for strategic management. Rozenberg Publishers, Amsterdam, 2004.

Greenblat, C. S. “Gaming-simulation as a tool for social research”. In Greenblat, C. S. and Duke, R. D. (Eds.) Gaming-simulation: Rationale, design, and applications. Sage Publications, New York, NY, 320–333, 1975.

Medler, B. “Generations of game analytics, achievements and high scores”. Eludamos. Journal for Computer Game Culture, 3(2), 177-194, 2009.

Brynielsson, Joel, and Stefan Arnborg. "Bayesian games for threat prediction and situation analysis." Seventh International Conference in Information Fusion, Stockholm, Sweden, June 28 – July, 1, 2004.

Shute, V. J., Ventura, M., Bauer, M., & Zapata-Rivera, D. “Melding the power of serious games and embedded assessment to monitor and foster learning”. In: Ritterfeld, U., Cody, M., & Vorderer, P. (eds.) Serious games: Mechanisms and effects, 2, 295-321, 2009.

[20] Kruschke, John K. "What to believe: Bayesian methods for data analysis." Trends in cognitive sciences 14(7), 293-300, 2010. https://doi.org/10.1016/j.tics.2010.05.001

Mertens, J.-F., & Zamir, S. "Formulation of Bayesian analysis for games with incomplete information." International Journal of Game Theory, 14(1), 1-29. https://doi.org/10.1007/BF01770224

Berger, J.O. "Statistical decision theory and Bayesian analysis". New York: Springer, 2013.

Harsanyi, J.C. "Games with incomplete information played by 'Bayesian' players. The basic model". Management Science, 14(3), 159–182, 1967. https://doi.org/10.1287/mnsc.14.3.159

Jackman, S. "Bayesian analysis for the social sciences". Vol. 846. Chichester: John Wiley & Sons, 2009. https://doi.org/10.1002/9780470686621

Reckhow, K. H. "Bayesian approaches in ecological analysis and modelling". In C. D. Canham, J. J. Cole, & W. K. Lauenroth (Eds.), The Role of Models in Ecosystem Science, 168–183. Princeton, NJ: Princeton university Press, 2002.

Shute, Valerie J., Masduki, I. & Donmez, O.. "Conceptual framework for modeling, assessing and supporting competencies within game environments." Technology, Instruction, Cognition & Learning 8(2) (2010).

Kiili, K. "Digital game-based learning: Towards an experiential gaming model." The Internet and higher education, 8(1), 13-24, 2005. https://doi.org/10.1016/j.iheduc.2004.12.001

IJsselsteijn, W., De Kort, Y. A. W., & Poels, K. "The game experience questionnaire". Manuscript in preparation, 2008.

Plummer, M. "JAGS: A program for Bayesian analysis of graphical models using Gibbs sampling". CiteSeer. doi: 10.1.1.13.3406, 2003.

Lukosch, H., Kurapati, S., Groen, D., & Verbraeck, A. "Gender and Cultural Differences in Game-Based Learning Experiences". The Electronic Journal of e-Learning, 15(4), 310-319, 2017.

Bryant, K. J. "Personality correlates of sense of direction and geographic orientation". In Journal of Personality and Social Psychology, 43(6), p. 1318, 1982. https://doi.org/10.1037/0022-3514.43.6.1318

Lawton, C. A. "Gender differences in way-finding strategies: Relationship to spatial ability and spatial anxiety". Sex Roles, 30(11-12), 765-779, 1994. https://doi.org/10.1007/BF01544230

Lawton, C. A. "Strategies for indoor wayfinding: The role of orientation". Journal of Environmental Psychology, 16(2), 137-145, 1996. https://doi.org/10.1006/jevp.1996.0011

Kafai, Y. B., Heeter, C., Denner, J., & Sun, J. Y. "Beyond Barbie [R] and Mortal Kombat: New Perspectives on Gender and Gaming". Boston: MIT Press, 2008.

Jansen, J., Berden, H., Vleuten, C., Grol, R., Rethans, J., & Verhoeff, C. "Evaluation of cardiopulmonary resuscitation skills of general practitioners using different scoring methods". Resuscitation, 34, 35-41, 1997. https://doi.org/10.1016/S0300-9572(96)01028-3

Castillo, J., Gomar, C., Higueras, E., & Gallart, A. "Checklist-based scores overestimate competence in CPR compared with recording strips of manikins in BLS courses." Resuscitation, 114, e17, 2017. https://doi.org/10.1016/j.resuscitation.2017.02.024

Pulakos, E. D., White, L. A., Oppler, S. H., & Borman, W. C. "Examination of race and sex effects on performance ratings". Journal of Applied Psychology, 74(5), 770-780, 1989. https://doi.org/10.1037/0021-9010.74.5.770

Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. "Digital games, design, and learning - A systematic review and meta-analysis". Review of Educational Research, 86(1), 89-122, 2016. https://doi.org/10.3102/0034654315582065
Image of Held game
Published
2018-03-26
How to Cite
Lukosch, H., & Cunningham, S. (2018). Data Analytics of Mobile Serious Games: Applying Bayesian Data Analysis Methods. International Journal of Serious Games, 5(1). https://doi.org/10.17083/ijsg.v5i1.222
Section
Intelligent Learning Assessment in Serious Games

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.