Abstract
Human-computer interaction (HCI), especially in the games domain, targets to mimic as much as possible the natural human-to-human interaction, which is multimodal, involving speech, vision, haptic, etc. Furthermore, the domain of serious games, aiming to value-added games, makes use of additional inputs, such as biosensors, motion tracking equipment, etc. In this context, game development has become complex, expensive and burdened with a long development cycle. This creates barriers to independent game developers and inhibits the introduction of innovative games, or new game genres. In this paper the PlayMancer platform is introduced, a work in progress aiming to overcome such barriers by augmenting existing 3D game engines with innovative modes of interaction. Playmancer integrates open source existing systems, such as a game engine and a spoken dialog management system, extended by newly implemented components, supporting innovative interaction modalities, such as emotion recognition from audio data, motion tracking, etc, and advanced configuration tools.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bohus, D., Rudnicky, A. (2003). RavenClaw: Dialog management using hierarchical task decomposition and expectation agenda. In: Proceedings Eu-rospeech 2003, pp.597–600, Geneva.
Vildjiounaite, E., Kocsis, O., Kyllonen, V., Kladis, B. (2007) Context-dependent user modeling for smart homes. In: Proceedings 11th International Conference on User Modeling, LNCS, vol. 4511/2007, pp. 345–349, Springer, Heidelberg.
Object-Oriented Graphics Rendering Engine, http://ogre3d.org
Nuance Recognizer, http://www.nuance.com.
The CMU Sphinx Group Open Source Speech Recognition Engines, http://cmusphinx.sourceforge.net/html/cmusphinx.php.
FestVox speech synthesizer, http://festvox.org.
Reitmayr, G., Schmalstieg, D. (2001). OpenTracker — an open software architecture for reconfigurable tracking based on XML. In: Proceedings IEEE Virtual Reality 2001, pp. 285–286.
OpenTracker — An open architecture for reconfigurable tracking based on XML, http://studierstube.icg.tu-graz.ac.at:80/opentracker/
Kostoulas, T., Ganchev, T., Mporas, I., Fakotakis, N. (2008). A real world emotional speech corpus for modern Greek. In: Proceedings LREC′2008, Morocco, May 28–30.
Bourguet, M.L. (2004). Software design and development of multimodal interaction. In: Proceedings IFIP 2004, pp. 409–414.
Navarre, D., Palanque, P., Bastide, R., Schyn, A., Winckler, M., Nedel, L.P., Freitas, C. (2005) A formal description of multimodal interaction techniques for immersive virtual reality applications. In: Proceedings INTERACT′05, LNCS, vol.3585, Springer, pp.170–183.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Kocsis, O., Ganchev, T., Mporas, I., Papadopoulos, G., Fakotakis, N. (2009). Multi-modal System Architecture for Serious Gaming. In: Iliadis, Maglogiann, Tsoumakasis, Vlahavas, Bramer (eds) Artificial Intelligence Applications and Innovations III. AIAI 2009. IFIP International Federation for Information Processing, vol 296. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-0221-4_52
Download citation
DOI: https://doi.org/10.1007/978-1-4419-0221-4_52
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4419-0220-7
Online ISBN: 978-1-4419-0221-4
eBook Packages: Computer ScienceComputer Science (R0)