ABSTRACT
Ever been in a situation where you didn't get that job despite being the deserving candidate? What went wrong? Psychology literature suggests that the most important skill towards making an impression during interviews is your interpersonal/social skills. Is it possible for people to improve their social skills (e.g., vary the voice intonation, and pauses appropriately; use social smiles, when appropriate; and maintain eye contact) through a computerized intervention? In this thesis, I propose to develop an autonomous and Automated Conversation Helper (3D virtual character) that can play the role of the interviewer, allowing participants to practice their social skills in context of job interviews. The Automated Conversation Helper is being developed with the ability to "see" (facial expression processing), "hear" (speech recognition and prosody analysis) and "respond" (speech and behavior synthesis) in real-time and provide live feedback on participant's non-verbal behavior.
- A. I. Huffcutt, J. M. Conway, P. L. Roth, and N. J. Stone, "Identification and meta-analytic assessment of psychological constructs measured in employment interviews," Journal of Applied Psychology, vol. 86, no. 5, pp. 897--913, 2001.Google ScholarCross Ref
- M. A. McDaniel, D. L. Whetzel, F. L. Schmidt, and S. D. Maurer, "The validity of employment interviews: A comprehensive review and meta-analysis," Journal of Applied Psychology, vol. 79, no. 4, pp. 599--616, 1994.Google ScholarCross Ref
- P. M. Wright, P. A. Lichtenfels, and E. D. Pursell, "The structured interview: Additional studies and a metaanalysis," Journal of Occupational Psychology, vol. 62, pp. 191--199, 1989.Google ScholarCross Ref
- T. DeGroot and J. Gooty, "Can Nonverbal Cues be Used to Make Meaningful Personality Attributions in Employment Interviews?," Journal of Business and Psychology, vol. 24, no. 2, pp. 179--192, 2009.Google ScholarCross Ref
- J. W. Cogger, "Are you a skilled interviewer?," The Personnel journal, vol. 61, no. 11, pp. 840--843, 1982.Google Scholar
- M. A. Walker, D. J. Litman, C. A. Kamm, and A. Abella, "PARADISE: A Framework for Evaluating Spoken Dialogue Agents," Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p. 10, 1997. Google ScholarDigital Library
Index Terms
- My automated conversation helper (MACH): helping people improve social skills.
Recommendations
MFCC-GMM based accent recognition system for Telugu speech signals
Speech processing is very important research area where speaker recognition, speech synthesis, speech codec, speech noise reduction are some of the research areas. Many of the languages have different speaking styles called accents or dialects. ...
Prosody conversion from neutral speech to emotional speech
Emotion is an important element in expressive speech synthesis. Unlike traditional discrete emotion simulations, this paper attempts to synthesize emotional speech by using "strong", "medium", and "weak" classifications. This paper tests different ...
Multimodality Issues in Conversation Analysis of Greek TV Interviews
Multimodal Signals: Cognitive and Algorithmic IssuesThis paper presents a study on multimodal conversation analysis of Greek TV interviews. Specifically, we examine the type of facial, hand and body gestures and their respective communicative functions in terms of feedback and turn management. Taking ...
Comments