Abstract
In word meaning acquisition through interactions among humans and agents, the efficiency of the learning depends largely on the dialog strategies the agents have. This paper describes automatic acquisition of dialog strategies through interaction between two agents. In the experiments, two agents infer each other’s comprehension level from its facial expressions and utterances to acquire efficient strategies. Q-learning is applied to a strategy acquisition mechanism. Firstly, experiments are carried out through the interaction between a mother agent, who knows all the word meanings, and a child agent with no initial word meaning. The experimental results showed that the mother agent acquires a teaching strategy, while the child agent acquires an asking strategy. Next, the experiments of interaction between a human and an agent are investigated to evaluate the acquired strategies. The results showed the effectiveness of both strategies of teaching and asking.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Roy, D.: Integration of speech and vision using mutual information. In: Proc. ICASSP, vol. 4, pp. 2369–2372 (2000)
Iwahashi, N.: Language acquisition through a human-robot interface by combining speech, visual, and behavioral information. Information Sciences 156, 109–121 (2003)
Singh, S., Kearns, M., Litman, D., Walker, M.: Empirical Evaluation of Reinforcement Learning Spoken Dialog System. In: Proc. AAAI, pp. 645–651 (2000)
Levin, E., Pieraccini, R., Eckert, W.: A stochastic model of human-machine interaction for learning dialog strategies. IEEE Transactions on Speech and Audio Processing 8(1), 11–23 (2000)
Taguchi, R., Katsurada, K., Nitta, T.: Automatic Acquisition of Dialog Strategies for Concept Learning through Interaction among Agents. In: Zhang, J., He, J.-H., Fu, Y. (eds.) CIS 2004 (FM7.1). LNCS, vol. 3314. Springer, Heidelberg (2004)
Watkins, C.J.C.H., Dayan, P.: Technical Note: Q-learning. Machine Learning 8, 279–292 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Taguchi, R., Katsurada, K., Nitta, T. (2006). Dialog Strategy Acquisition and Its Evaluation for Efficient Learning of Word Meanings by Agents. In: Vogt, P., Sugita, Y., Tuci, E., Nehaniv, C. (eds) Symbol Grounding and Beyond. EELC 2006. Lecture Notes in Computer Science(), vol 4211. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11880172_4
Download citation
DOI: https://doi.org/10.1007/11880172_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45769-5
Online ISBN: 978-3-540-45771-8
eBook Packages: Computer ScienceComputer Science (R0)