Natural Language Processing in Serious Games: A state of the art.
DOI:
https://doi.org/10.17083/ijsg.v2i3.87Keywords:
E-learning, Natural Language Processing, Serious Games, Computer Assisted Learning,Abstract
In the last decades, Natural Language Processing (NLP) has obtained a high level of success. Interactions between NLP and Serious Games have started and some of them already include NLP techniques. The objectives of this paper are twofold: on the one hand, providing a simple framework to enable analysis of potential uses of NLP in Serious Games and, on the other hand, applying the NLP framework to existing Serious Games and giving an overview of the use of NLP in pedagogical Serious Games. In this paper we present 11 serious games exploiting NLP techniques. We present them systematically, according to the following structure: first, we highlight possible uses of NLP techniques in Serious Games, second, we describe the type of NLP implemented in the each specific Serious Game and, third, we provide a link to possible purposes of use for the different actors interacting in the Serious Game.
References
[1] Amoia M., Brétaudière T., Denis A., Gardent C., Perez-Beltrachini L., et al. A serious game for second language acquisition in a virtual environment. Journal on Systemics, Cybernetics and Informatics (JSCI), 10(1):24–34, 2012.
[2] Amoia M., Gardent C., Perez-Beltrachini L., et al. A serious game for second language acquisition. In CSEDU (1), pages 394–397, 2011.
[3] Arnab S, de Freitas S., Bellotti F., Lim T., Stanescu I., Brisson Moreno-Ger A., Pereira G., Romero M., Ninaus M., Earp J., et a. D2.2: Game and Learning alliance, The European Network of Excellence on Serious Games. Public Deliverable, GALA project, 2012.
[4] Aylett R, Louchart S., and Pickering J., A mechanism for acting and speaking for empathic agents. In Autonomous agents and multi-agent systems workshop, 2004.
[5] Aylett R., Vala M., Sequeira P., and Paiva A., Fearnot!–an emergent narrative approach to virtual dramas for anti-bullying education. In Virtual Storytelling. Using Virtual Reality Technologies for Storytelling, pages 202–205. Springer, 2007.
[6] Bateman J.A., Upper modeling: A general organization of knowledge for natural language processing. In Proceedings of the Workshop on Standards for Knowledge Representation Systems, 1990.
[7] Bernert-Rehaber S. and Schlemminger G., Immersive 3d-technologien optimieren das Fremdsprachenlernen: "eveil-3d - Lernen in virtuellen Welten". Babylonia, 3:44–49, 2013.
[8] Bhagat R., Leuski A., and Hovy E., Statistical shallow semantic parsing despite little training data. In Proceedings of the Ninth International Workshop on Parsing Technology, pages 186–187. Association for Computational Linguistics, 2005. http://dx.doi.org/10.3115/1654494.1654514
[9] Bohus D., Raux A., Harris, T.K., Eskenazi M., and Rudnicky, Alexandre I. Olympus: an open-source framework for conversational spoken language interface research. In Proceedings of the workshop on bridging the gap: Academic and industrial research in dialog technologies, pages 32–39. Association for Computational Linguistics, 2007.
[10] Bohus D. and Rudnicky Alexander I., Ravenclaw: Dialog management using hierarchical task decomposition and an expectation agenda. 2003.
[11] Bohus D. and Rudnicky Alexander I., The Ravenclaw dialog management framework: Architecture and systems. Computer Speech & Language, 23(3):332–361, 2009. http://dx.doi.org/10.1016/j.csl.2008.10.001
[12] Cai Y., Forsyth C., Germany M.-L., Graesser A. and Millis K., Accuracy of tracking student’s natural language in operation aries!, a serious game for scientific methods. In Intelligent Tutoring Systems, pages 626–627. Springer, 2012. http://dx.doi.org/10.1007/978-3-642-30950-2_93
[13] Catalano C.E., Luccini M. A., Mortara M., Guidelines for an effective design of serious games. International Journal of Serious Games, 1(1), 2014. http://dx.doi.org/10.17083/ijsg.v1i1.8
[14] Conconi A., Ganchev T., Kocsis O., Papadopoulos G., Fernández-Aranda F., and Jiménez- Murcia, S., Playmancer: A serious gaming 3d environment. In Automated solutions for Cross Media Content and Multi- channel Distribution, 2008. AXMEDIS’08. International Conference on, pages 111–117. IEEE, 2008.
[15] Cruz-Cunha, M. M., Handbook of Research on Serious Games as Educational, Business and Research Tools, volume 1. Information Science Reference, 2012.
[16] Cruz-Lara S., Denis A., and Bellalem N., Linguistic and multilingual issues in virtual worlds and serious games: a general review. Journal For Virtual Worlds Research, 7(1), 2014.
[17] De Beaugrande R.A. and Dressler, W.U.. Introduction to text linguistics. Longman London, New York, 1981.
[18] Denis A., Falk I., Gardent C., Perez-Beltrachini L., et al. Representation of linguistic and domain knowledge for second language learning in virtual worlds. In LREC-The eighth international conference on Language Resources and Evaluation-2012, pages 2631–2635.
[19] Dernoncourt F., Of the Use of Natural Dialogue to Hide MCQs in Serious Games. francky.me, (1), 2012.
[20] Dias J., Mascarenhas S. and Paiva, A., Fatima modular: Towards an agent architecture with a generic
appraisal framework. In Proceedings of the International Workshop on Standards for Emotion Modeling, 2011.
[21] Dras M., Richards D., Taylor M., and Gardiner M., Generating and detecting deceptive language in
virtual agents. In International Workshop on Interacting with ECAs as Virtual Characters, page 38, 2010.
[22] Fleischman M. and Hovy E., Emotional variation in speech-based natural language generation. In International
Natural Language Generation Conference, Arden House, NY, volume 2, page 4, 2002.
[23] Forgy C.L., Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial intelligence,
19(1):17–37, 1982. http://dx.doi.org/10.1016/0004-3702(82)90020-0
[24] Forsyth C. M., Graesser A. C., Pavlik P. Jr, Cai Z., Butler H., Halpern D., and Millis K., Operation aries!: Methods, mystery, and mixed models: Discourse features predict affect in a serious game. JEDM- Journal of Educational Data Mining, 5(1):147–189, 2013.
[25] Gardent C., Lorenzo A., Perez-Beltrachini L., Rojas-Barahona L. M., et al. Weakly and strongly constrained dialogues for language learning. In Proceedings of the 14th annual SIGdial Meeting on Discourse and Dialogue SIGDIAL 2013, pages 357–359, 2013.
[26] Goodwin C., Transparent vision. Interaction and grammar, 13:370, 1996.
[27] Graesser A., Cai Z., Wood J., Hatfield D., Bagley E., Nash P., and Shaffer D., Comments of journalism mentors on news stories: Classification and epistemic status of mentor contributions. Intelligent Tutoring Technologies for Ill-Defined Problems and Ill-Defined Domains, page 21, 2010.
[28] Graesser A.C., Wiemer-Hastings P.,Wiemer-Hastings K., Harter D., Tutoring Research Group Tutoring Research Group, and Natalie Person. Using latent semantic analysis to evaluate the contributions of students in autotutor. Interactive Learning Environments, 8(2):129–147, 2000. http://dx.doi.org/10.1076/1049-4820(200008)8:2;1-B;FT129
[29] Hall L., Lutfi L. Binti S., Nazir A., Hodgson J., Hall M., et al. Games based learning for exploring cultural conflict. In: AISB 2011 Symposium: AI & Games, 6-7 Apr 2011, York, UK.
[30] Hennigan B., Making the case for nlp in dialogue systems for serious games. 8th International Conference on Natural Language Processing, 1st Workshop on Games and NLP. Kanazawa, Japan. 2012
[31] Hill R. W. Jr, Gratch J., Marsella S., Rickel J., Swartout W. R., and Traum D. R.. Virtual
humans in the mission rehearsal exercise system. KI, 17(4):5, 2003.
[32] Issa S. and Ward W., Cmu’s robust spoken language understanding system. In Proceedings of Eurospeech,
volume 93, 1993.
[33] Jackson J. T., Boonthum C., and McNamara D. S., istart-me: Situating extended learning within a game-based environment. In Proceedings of the Workshop on Intelligent Educational Games at the 14th Annual Conference on Artificial Intelligence in Education, pages 59–68, 2009.
[34] Jackson J. T, Dempsey K. B., and McNamara D. S. Game-based practice in a reading strategy tutoring system: Showdown in istart-me. Computer games, pages 115–138, 2012.
[35] Johnson W.L., Serious use of a serious game for language learning. International Journal of Artificial Intelligence in Education, 20(2):175–195, 2010.
[36] Johnson W.L and Valente A., Tactical language and culture training systems: using ai to teach foreign languages and cultures. AI Magazine, 30(2):72, 2009.
[37] Kostoulas T., Mporas I., Kocsis O., Ganchev T., Katsaounos N., et al., Affective speech interface in serious games for supporting therapy of mental disorders. Expert Systems with Applications, 39(12):11072–11079, 2012. http://dx.doi.org/10.1016/j.eswa.2012.03.067
[38] Laamarti F., Eid M., Saddik A.E., An overview of serious games. International Journal of Computer Games Technology, Volume 2014 (2014), Article ID 358152, 15 pages. http://dx.doi.org/10.1155/2014/358152
[39] Lester J., Lobene E., Mott B., and Rowe J., Serious games with gift: Instructional strategies, game design, and natural language in the generalized intelligent framework for tutoring. Design Recommendations for Intelligent Tutoring Systems, 2:205–215, 2014.
[40] Lester J., Mott B., Rowe J., and Sabourin J., Learner modeling to predict real-time affect in serious games. Design Recommendations for Intelligent Tutoring Systems, pages 199–208, 2013.
[41] Mateas M. and Stern A., Natural language understanding in façade: Surface-text processing. In Technologies for Interactive Digital Storytelling and Entertainment, pages 3–13. Springer, 2004. http://dx.doi.org/10.1007/978-3-540-27797-2_2
[42] Mateas M. and Stern A., Structuring content in the façade interactive drama architecture. In AIIDE, pages 93–98, 2005.
[43] McNamara D. S., Boonthum C., Levinstein I.B., and Millis K., Evaluating self-explanations in istart: Comparing word-based and lsa algorithms. Handbook of latent semantic analysis, pages 227–241, 2007.
[44] McNamara D. S., Jackson J. T, Boonthum C, Deng Y., and He X., istart-me: A natural language game-enhanced comprehension strategy tutor. Journal of South China Normal University, 6, 2012.
[45] Meinedo H., Caseiro D., Neto J., and Trancoso I., Audimus a broadcast news speech recognition system for the european portuguese. In Nuno Mamede, Isabel Trancoso, Jorge Baptista, and M das Gracas Volpe Nunes, editors, Computational Processing of the Portuguese Language, volume 2721 of Lecture Notes in Computer Science, pages 196–203. Springer Berlin Heidelberg, 2003.
[46] Millis K., Forsyth C., Butler H., Wallace P., Graesser A., and Halpern D., Operation aries!: A serious game for teaching scientific inquiry. In Serious games and edutainment applications, pages 169–195. Springer, 2011. http://dx.doi.org/10.1007/978-1-4471-2161-9_10
[47] Mote N., Sethy A., Silva J., Narayanan S., and Johnson W.L., Detection and modeling of learner speech errors: The case of arabic tactical language training for american english speakers. In Proceedings of the InSTIL Symposium on NLP and Speech Technologies in Advanced Language Learning Systems, 2004.
[48] Neto J. P., Silva R., Madeiras Pereira J., and Fernandes J., Solis’ curse-a cultural heritage game using voice interaction with a virtual agent. In Games and Virtual Worlds for Serious Applications (VS-GAMES), 2011 Third International Conference on, pages 164–167. IEEE, 2011.
[49] Nye B.D., Graesser A.C., and Hu X., Autotutor and family: A review of 17 years of natural language tutoring. International Journal of Artificial Intelligence in Education, 24(4):427–469, 2014. http://dx.doi.org/10.1007/s40593-014-0029-5
[50] Oliveira L. C., Paulo S., Figueira L., and Mendes C., The inesc-id blizzard entry: Unsupervised voice building and synthesis. In Blizzard Challenge Workshop, 2008. See: http://www.festvox.org/blizzard/index.html
[51] Paulo S. and Oliveira L., Multilevel annotation of speech signals using weighted finite state transducers. In Speech Synthesis, 2002. Proceedings of 2002 IEEE Workshop on, pages 111–114. IEEE, 2002. http://dx.doi.org/10.1109/wss.2002.1224384
[52] Paulo S., Oliveira L. C., Mendes C., Figueira L., et. al., Dixi–a generic text-to-speech system for european portuguese. In Computational Processing of the Portuguese Language, pages 91–100. Springer, 2008. http://dx.doi.org/10.1007/978-3-540-85980-2_10
[53] Pellegrini T., Ling W., Silva A., Correia R., Trancoso I., Baptista J., and Mamede N.J., Overview of computer-assisted language learning for european portuguese at l2f. In CSEDU (2), pages 538–543, 2012.
[54] Peters W., Espinoza M., Montiel-Ponsoda E., and Sini M., Multilingual and localization support for ontologies. Technical report, Technical report, 2009.
[55] Richards D. and Porte J., Developing an agent-based training simulation using game and virtual reality software: experience report. In Proceedings of the Sixth Australasian Conference on Interactive Entertainment, page 9. ACM, 2009. http://dx.doi.org/10.1145/1746050.1746059
[56] Richards D and Taylor M., Incremental human-based training of an agent-based training system. In
Proc. Agents Learning Interactively from Human Teachers (ALIHT), Workshop at 9th International Conference on Autonomous Agents and Multiagent Systems, Toronto Canada, May, 2010.
[57] Rus V., Moldovan C., Niraula N., and Graesser A. J.. Automated discovery of speech act categories in educational games. International Educational Data Mining Society, 2012.
[58] Shaffer D. W. and Graesser A.. Using a quantitative model of participation in a community of practice to direct automated mentoring in an ill-defined domain. Intelligent Tutoring Technologies for Ill-Defined Problems and Ill-Defined Domains, pages 61–68, 2010.
[59] Silva A., Mamede N., Ferreira A., Baptista J., and Fernandes J., Towards a serious game for portuguese learning. In Serious Games Development and Applications, pages 83–94. Springer, 2011. http://dx.doi.org/10.1007/978-3-642-23834-5_8
[60] Stolcke A., et al. Srilm-an extensible language modeling toolkit. In INTERSPEECH, 2002.
[61] Swartout W.R., Lessons learned from virtual humans. AI Magazine, 31(1):9–20, 2010.
[62] Swartout W.R., , Gratch J., Hill R. W.Jr, Hovy E., Marsella S., Rickel J., Traum D., et al. Toward virtual humans. AI Magazine, 27(2):96, 2006.
[63] Traum D and Rickel J., Embodied agents for multi-party dialogue in immersive virtual worlds. In Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, pages 766–773. ACM, 2002. http://dx.doi.org/10.1145/544862.544922
[64] Vaassen F. and Daelemans W., Emotion Classification in a Serious Game for Training Communication Skills. In Proceedings of Computational Linguistics in the Netherlands 2010.
[65] Vaassen F, Wauters J., Van Broeckhoven F., Van Overveldt M., Daelemans W., and Eneman K., Delearyous: Training interpersonal communication skills using unconstrained text input. Proc. of ECGBL, pages 505–513, 2012.
[66] Wang D. and Narayanan S.S., A confidence-score based unsupervised map adaptation for speech recognition. In Signals, Systems and Computers, 2002. Conference Record of the Thirty-Sixth Asilomar Conference on, volume 1, pages 222–226. IEEE, 2002. http://dx.doi.org/10.1109/acssc.2002.1197181
[67] Wang J., Li H., Cai Z., Keshtkar F., Graesser A., and Shaffer D. W.. Automentor: artificial intelligent mentor in educational game. In Artificial Intelligence in Education, pages 940–941. Springer, 2013. http://dx.doi.org/10.1007/978-3-642-39112-5_154
[68] Weizenbaum J.. Eliza—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1):36–45, 1966. http://dx.doi.org/10.1145/365153.365168
[69] Winebarger J. T., Stüker S., and Waibel A., Adapting automatic speech recognition for foreign language learners in a serious game. In Proceedings of the 3rd Workshop on Games and NLP (GAMNLP-14), October 3rd, 2014, North Carolina State University, Raleigh, NC, USA
[70] Zagal J. P., Tomuro N., and Shepitsen A., Natural Language Processing in Game Studies Research: An Overview. Simulation & Gaming, 43(3):356–373, October 2011. http://dx.doi.org/10.1177/1046878111422560
[2] Amoia M., Gardent C., Perez-Beltrachini L., et al. A serious game for second language acquisition. In CSEDU (1), pages 394–397, 2011.
[3] Arnab S, de Freitas S., Bellotti F., Lim T., Stanescu I., Brisson Moreno-Ger A., Pereira G., Romero M., Ninaus M., Earp J., et a. D2.2: Game and Learning alliance, The European Network of Excellence on Serious Games. Public Deliverable, GALA project, 2012.
[4] Aylett R, Louchart S., and Pickering J., A mechanism for acting and speaking for empathic agents. In Autonomous agents and multi-agent systems workshop, 2004.
[5] Aylett R., Vala M., Sequeira P., and Paiva A., Fearnot!–an emergent narrative approach to virtual dramas for anti-bullying education. In Virtual Storytelling. Using Virtual Reality Technologies for Storytelling, pages 202–205. Springer, 2007.
[6] Bateman J.A., Upper modeling: A general organization of knowledge for natural language processing. In Proceedings of the Workshop on Standards for Knowledge Representation Systems, 1990.
[7] Bernert-Rehaber S. and Schlemminger G., Immersive 3d-technologien optimieren das Fremdsprachenlernen: "eveil-3d - Lernen in virtuellen Welten". Babylonia, 3:44–49, 2013.
[8] Bhagat R., Leuski A., and Hovy E., Statistical shallow semantic parsing despite little training data. In Proceedings of the Ninth International Workshop on Parsing Technology, pages 186–187. Association for Computational Linguistics, 2005. http://dx.doi.org/10.3115/1654494.1654514
[9] Bohus D., Raux A., Harris, T.K., Eskenazi M., and Rudnicky, Alexandre I. Olympus: an open-source framework for conversational spoken language interface research. In Proceedings of the workshop on bridging the gap: Academic and industrial research in dialog technologies, pages 32–39. Association for Computational Linguistics, 2007.
[10] Bohus D. and Rudnicky Alexander I., Ravenclaw: Dialog management using hierarchical task decomposition and an expectation agenda. 2003.
[11] Bohus D. and Rudnicky Alexander I., The Ravenclaw dialog management framework: Architecture and systems. Computer Speech & Language, 23(3):332–361, 2009. http://dx.doi.org/10.1016/j.csl.2008.10.001
[12] Cai Y., Forsyth C., Germany M.-L., Graesser A. and Millis K., Accuracy of tracking student’s natural language in operation aries!, a serious game for scientific methods. In Intelligent Tutoring Systems, pages 626–627. Springer, 2012. http://dx.doi.org/10.1007/978-3-642-30950-2_93
[13] Catalano C.E., Luccini M. A., Mortara M., Guidelines for an effective design of serious games. International Journal of Serious Games, 1(1), 2014. http://dx.doi.org/10.17083/ijsg.v1i1.8
[14] Conconi A., Ganchev T., Kocsis O., Papadopoulos G., Fernández-Aranda F., and Jiménez- Murcia, S., Playmancer: A serious gaming 3d environment. In Automated solutions for Cross Media Content and Multi- channel Distribution, 2008. AXMEDIS’08. International Conference on, pages 111–117. IEEE, 2008.
[15] Cruz-Cunha, M. M., Handbook of Research on Serious Games as Educational, Business and Research Tools, volume 1. Information Science Reference, 2012.
[16] Cruz-Lara S., Denis A., and Bellalem N., Linguistic and multilingual issues in virtual worlds and serious games: a general review. Journal For Virtual Worlds Research, 7(1), 2014.
[17] De Beaugrande R.A. and Dressler, W.U.. Introduction to text linguistics. Longman London, New York, 1981.
[18] Denis A., Falk I., Gardent C., Perez-Beltrachini L., et al. Representation of linguistic and domain knowledge for second language learning in virtual worlds. In LREC-The eighth international conference on Language Resources and Evaluation-2012, pages 2631–2635.
[19] Dernoncourt F., Of the Use of Natural Dialogue to Hide MCQs in Serious Games. francky.me, (1), 2012.
[20] Dias J., Mascarenhas S. and Paiva, A., Fatima modular: Towards an agent architecture with a generic
appraisal framework. In Proceedings of the International Workshop on Standards for Emotion Modeling, 2011.
[21] Dras M., Richards D., Taylor M., and Gardiner M., Generating and detecting deceptive language in
virtual agents. In International Workshop on Interacting with ECAs as Virtual Characters, page 38, 2010.
[22] Fleischman M. and Hovy E., Emotional variation in speech-based natural language generation. In International
Natural Language Generation Conference, Arden House, NY, volume 2, page 4, 2002.
[23] Forgy C.L., Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial intelligence,
19(1):17–37, 1982. http://dx.doi.org/10.1016/0004-3702(82)90020-0
[24] Forsyth C. M., Graesser A. C., Pavlik P. Jr, Cai Z., Butler H., Halpern D., and Millis K., Operation aries!: Methods, mystery, and mixed models: Discourse features predict affect in a serious game. JEDM- Journal of Educational Data Mining, 5(1):147–189, 2013.
[25] Gardent C., Lorenzo A., Perez-Beltrachini L., Rojas-Barahona L. M., et al. Weakly and strongly constrained dialogues for language learning. In Proceedings of the 14th annual SIGdial Meeting on Discourse and Dialogue SIGDIAL 2013, pages 357–359, 2013.
[26] Goodwin C., Transparent vision. Interaction and grammar, 13:370, 1996.
[27] Graesser A., Cai Z., Wood J., Hatfield D., Bagley E., Nash P., and Shaffer D., Comments of journalism mentors on news stories: Classification and epistemic status of mentor contributions. Intelligent Tutoring Technologies for Ill-Defined Problems and Ill-Defined Domains, page 21, 2010.
[28] Graesser A.C., Wiemer-Hastings P.,Wiemer-Hastings K., Harter D., Tutoring Research Group Tutoring Research Group, and Natalie Person. Using latent semantic analysis to evaluate the contributions of students in autotutor. Interactive Learning Environments, 8(2):129–147, 2000. http://dx.doi.org/10.1076/1049-4820(200008)8:2;1-B;FT129
[29] Hall L., Lutfi L. Binti S., Nazir A., Hodgson J., Hall M., et al. Games based learning for exploring cultural conflict. In: AISB 2011 Symposium: AI & Games, 6-7 Apr 2011, York, UK.
[30] Hennigan B., Making the case for nlp in dialogue systems for serious games. 8th International Conference on Natural Language Processing, 1st Workshop on Games and NLP. Kanazawa, Japan. 2012
[31] Hill R. W. Jr, Gratch J., Marsella S., Rickel J., Swartout W. R., and Traum D. R.. Virtual
humans in the mission rehearsal exercise system. KI, 17(4):5, 2003.
[32] Issa S. and Ward W., Cmu’s robust spoken language understanding system. In Proceedings of Eurospeech,
volume 93, 1993.
[33] Jackson J. T., Boonthum C., and McNamara D. S., istart-me: Situating extended learning within a game-based environment. In Proceedings of the Workshop on Intelligent Educational Games at the 14th Annual Conference on Artificial Intelligence in Education, pages 59–68, 2009.
[34] Jackson J. T, Dempsey K. B., and McNamara D. S. Game-based practice in a reading strategy tutoring system: Showdown in istart-me. Computer games, pages 115–138, 2012.
[35] Johnson W.L., Serious use of a serious game for language learning. International Journal of Artificial Intelligence in Education, 20(2):175–195, 2010.
[36] Johnson W.L and Valente A., Tactical language and culture training systems: using ai to teach foreign languages and cultures. AI Magazine, 30(2):72, 2009.
[37] Kostoulas T., Mporas I., Kocsis O., Ganchev T., Katsaounos N., et al., Affective speech interface in serious games for supporting therapy of mental disorders. Expert Systems with Applications, 39(12):11072–11079, 2012. http://dx.doi.org/10.1016/j.eswa.2012.03.067
[38] Laamarti F., Eid M., Saddik A.E., An overview of serious games. International Journal of Computer Games Technology, Volume 2014 (2014), Article ID 358152, 15 pages. http://dx.doi.org/10.1155/2014/358152
[39] Lester J., Lobene E., Mott B., and Rowe J., Serious games with gift: Instructional strategies, game design, and natural language in the generalized intelligent framework for tutoring. Design Recommendations for Intelligent Tutoring Systems, 2:205–215, 2014.
[40] Lester J., Mott B., Rowe J., and Sabourin J., Learner modeling to predict real-time affect in serious games. Design Recommendations for Intelligent Tutoring Systems, pages 199–208, 2013.
[41] Mateas M. and Stern A., Natural language understanding in façade: Surface-text processing. In Technologies for Interactive Digital Storytelling and Entertainment, pages 3–13. Springer, 2004. http://dx.doi.org/10.1007/978-3-540-27797-2_2
[42] Mateas M. and Stern A., Structuring content in the façade interactive drama architecture. In AIIDE, pages 93–98, 2005.
[43] McNamara D. S., Boonthum C., Levinstein I.B., and Millis K., Evaluating self-explanations in istart: Comparing word-based and lsa algorithms. Handbook of latent semantic analysis, pages 227–241, 2007.
[44] McNamara D. S., Jackson J. T, Boonthum C, Deng Y., and He X., istart-me: A natural language game-enhanced comprehension strategy tutor. Journal of South China Normal University, 6, 2012.
[45] Meinedo H., Caseiro D., Neto J., and Trancoso I., Audimus a broadcast news speech recognition system for the european portuguese. In Nuno Mamede, Isabel Trancoso, Jorge Baptista, and M das Gracas Volpe Nunes, editors, Computational Processing of the Portuguese Language, volume 2721 of Lecture Notes in Computer Science, pages 196–203. Springer Berlin Heidelberg, 2003.
[46] Millis K., Forsyth C., Butler H., Wallace P., Graesser A., and Halpern D., Operation aries!: A serious game for teaching scientific inquiry. In Serious games and edutainment applications, pages 169–195. Springer, 2011. http://dx.doi.org/10.1007/978-1-4471-2161-9_10
[47] Mote N., Sethy A., Silva J., Narayanan S., and Johnson W.L., Detection and modeling of learner speech errors: The case of arabic tactical language training for american english speakers. In Proceedings of the InSTIL Symposium on NLP and Speech Technologies in Advanced Language Learning Systems, 2004.
[48] Neto J. P., Silva R., Madeiras Pereira J., and Fernandes J., Solis’ curse-a cultural heritage game using voice interaction with a virtual agent. In Games and Virtual Worlds for Serious Applications (VS-GAMES), 2011 Third International Conference on, pages 164–167. IEEE, 2011.
[49] Nye B.D., Graesser A.C., and Hu X., Autotutor and family: A review of 17 years of natural language tutoring. International Journal of Artificial Intelligence in Education, 24(4):427–469, 2014. http://dx.doi.org/10.1007/s40593-014-0029-5
[50] Oliveira L. C., Paulo S., Figueira L., and Mendes C., The inesc-id blizzard entry: Unsupervised voice building and synthesis. In Blizzard Challenge Workshop, 2008. See: http://www.festvox.org/blizzard/index.html
[51] Paulo S. and Oliveira L., Multilevel annotation of speech signals using weighted finite state transducers. In Speech Synthesis, 2002. Proceedings of 2002 IEEE Workshop on, pages 111–114. IEEE, 2002. http://dx.doi.org/10.1109/wss.2002.1224384
[52] Paulo S., Oliveira L. C., Mendes C., Figueira L., et. al., Dixi–a generic text-to-speech system for european portuguese. In Computational Processing of the Portuguese Language, pages 91–100. Springer, 2008. http://dx.doi.org/10.1007/978-3-540-85980-2_10
[53] Pellegrini T., Ling W., Silva A., Correia R., Trancoso I., Baptista J., and Mamede N.J., Overview of computer-assisted language learning for european portuguese at l2f. In CSEDU (2), pages 538–543, 2012.
[54] Peters W., Espinoza M., Montiel-Ponsoda E., and Sini M., Multilingual and localization support for ontologies. Technical report, Technical report, 2009.
[55] Richards D. and Porte J., Developing an agent-based training simulation using game and virtual reality software: experience report. In Proceedings of the Sixth Australasian Conference on Interactive Entertainment, page 9. ACM, 2009. http://dx.doi.org/10.1145/1746050.1746059
[56] Richards D and Taylor M., Incremental human-based training of an agent-based training system. In
Proc. Agents Learning Interactively from Human Teachers (ALIHT), Workshop at 9th International Conference on Autonomous Agents and Multiagent Systems, Toronto Canada, May, 2010.
[57] Rus V., Moldovan C., Niraula N., and Graesser A. J.. Automated discovery of speech act categories in educational games. International Educational Data Mining Society, 2012.
[58] Shaffer D. W. and Graesser A.. Using a quantitative model of participation in a community of practice to direct automated mentoring in an ill-defined domain. Intelligent Tutoring Technologies for Ill-Defined Problems and Ill-Defined Domains, pages 61–68, 2010.
[59] Silva A., Mamede N., Ferreira A., Baptista J., and Fernandes J., Towards a serious game for portuguese learning. In Serious Games Development and Applications, pages 83–94. Springer, 2011. http://dx.doi.org/10.1007/978-3-642-23834-5_8
[60] Stolcke A., et al. Srilm-an extensible language modeling toolkit. In INTERSPEECH, 2002.
[61] Swartout W.R., Lessons learned from virtual humans. AI Magazine, 31(1):9–20, 2010.
[62] Swartout W.R., , Gratch J., Hill R. W.Jr, Hovy E., Marsella S., Rickel J., Traum D., et al. Toward virtual humans. AI Magazine, 27(2):96, 2006.
[63] Traum D and Rickel J., Embodied agents for multi-party dialogue in immersive virtual worlds. In Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, pages 766–773. ACM, 2002. http://dx.doi.org/10.1145/544862.544922
[64] Vaassen F. and Daelemans W., Emotion Classification in a Serious Game for Training Communication Skills. In Proceedings of Computational Linguistics in the Netherlands 2010.
[65] Vaassen F, Wauters J., Van Broeckhoven F., Van Overveldt M., Daelemans W., and Eneman K., Delearyous: Training interpersonal communication skills using unconstrained text input. Proc. of ECGBL, pages 505–513, 2012.
[66] Wang D. and Narayanan S.S., A confidence-score based unsupervised map adaptation for speech recognition. In Signals, Systems and Computers, 2002. Conference Record of the Thirty-Sixth Asilomar Conference on, volume 1, pages 222–226. IEEE, 2002. http://dx.doi.org/10.1109/acssc.2002.1197181
[67] Wang J., Li H., Cai Z., Keshtkar F., Graesser A., and Shaffer D. W.. Automentor: artificial intelligent mentor in educational game. In Artificial Intelligence in Education, pages 940–941. Springer, 2013. http://dx.doi.org/10.1007/978-3-642-39112-5_154
[68] Weizenbaum J.. Eliza—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1):36–45, 1966. http://dx.doi.org/10.1145/365153.365168
[69] Winebarger J. T., Stüker S., and Waibel A., Adapting automatic speech recognition for foreign language learners in a serious game. In Proceedings of the 3rd Workshop on Games and NLP (GAMNLP-14), October 3rd, 2014, North Carolina State University, Raleigh, NC, USA
[70] Zagal J. P., Tomuro N., and Shepitsen A., Natural Language Processing in Game Studies Research: An Overview. Simulation & Gaming, 43(3):356–373, October 2011. http://dx.doi.org/10.1177/1046878111422560
Downloads
Published
2015-09-18
Issue
Section
Articles
License
IJSG copyright information is provided here.
How to Cite
Natural Language Processing in Serious Games: A state of the art. (2015). International Journal of Serious Games, 2(3). https://doi.org/10.17083/ijsg.v2i3.87
