Abstract
This article presents a study on coarticulation modeling in French Sign Language. Our aim is to use this model to provide information to deaf people, by the mean of a virtual signer. We propose a definition for “coarticulation”, based on an overview of the literature. We explain the methodology we have set up: from video corpus design to features correlations extractions, through corpus annotations and analysis. We expose first results and what are going to be the next steps of this study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Moody, B.: La communication internationale chez les sourds (International communication of the deaf). Rééducation Orthophonique 107, 213–223 (1979)
Mottez, B.: Les banquets de Sourds-Muets et la naissance du mouvement sourd (Dinners of the Deaf-Mute and root of the deaf movement). Le pouvoir des signes, pp. 170–178. INJS, Paris (1989)
Cuxac, C.: La langue des signes française; Les voies de l’iconicité (French Sign Language; Iconicity). In: Ophrys (ed.) Faits de Langues 15/16, Paris (2000)
Sallandre, M.-A.: Simultaneity in French Sign Language Discourse. In: Vermeerbergen, Leeson, Crasborn (eds.) Simultaneity in Signed Languages: Form and Function (2007)
Cox, S.J., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., Abbott, S.: TESSA, a system to aid communication with deaf people. In: 5th Conference on Assistive Technologies. ASSETS 2002 (2002)
VCom3D: SigningAvatar Frequently Asked Questions (2000), http://www.signingavatar.com/faq/faq.html
Elliott, R., Glauert, J., Kennaway, J., Marshall, I., Safr, E.: Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. In: Springer (ed.) Universal Access in the Information Society (UAIS), Special issue 6/4 (2004)
Segouat, J., Braffort, A.: Toward the Study of Sign Language Coarticulation: Methodology Proposal. In: 2nd International Conference on Advances in Computer-Human Interactions ACHI 2009 (2009)
Wood, S.A.J.: Assimilation or coarticulation? Evidence from the temporal co-ordination of tongue gestures for the palatalization of Bulgarian alveolar stops. Journal of Phonetics 24(1), 139–164 (1996)
Vogler, C.: American Sign Language Recognition: Reducing the Complexity of the Task with Phoneme-Based Modeling and Parallel Hidden Markov Models. Doctoral Thesis. University of Pennsylvania (2002)
Benguerel, A.P., Cowan, H.A.: Coarticulation of upper lip protrusion in French. Phonetica 30, 41–55 (1974)
Marchal, A.: La production de la parole (Speech Production). Hermes Science Publications, Paris (2007)
Shamaie, A., Hai, W., Sutherland, A.: Hand gesture recognition for HCI. ERCIM News 46 (2001), http://www.ercim.org/publication/ErcimNews
Jurafsky, D., Martin, J.H.: Speech and Language Processing. Prentice Hall, Upper Saddle River (2000)
Yang, R., Sarkar, S., Loeding, B.: Enhanced Level Building Algorithm for the Movement Epenthesis Problem in Sign Language Recognition. In: Computer Vision and Pattern Recognition IEEE Conference, pp. 1–8, 17–22 (2007)
Holt, G.T., Hendriks, P., Andringa, T.: Why Don’t You See What I Mean? Prospects and Limitations of Current Automatic Sing Recognition Research. Sign Language Studies 6(4) (2006)
Huenerfauth, M.: Generating American Sign Language classifier predicates for English-to-ASL machine translation, Doctoral Thesis. University of Pennsylvania (2006)
Segouat, J., Braffort, A., Bolot, L., Choisier, A., Filhol, M., Verrecchia, C.: Building 3D French Sign Language lexicon. In: 3rd Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corpora. 6th international conference on Language Resources and Evaluation, LREC 2008 (2008)
Kipp, M.: Anvil - A Generic Annotation Tool for Multimodal Dialogue. In: 7th European Conference on Speech Communication and Technology, Eurospeech 2001 (2001)
Sallandre, M.-A.: Les unités du discours en Langue des Signes Française. Tentative de catégorisation dans le cadre d’une grammaire de l’iconicité (Discourse unit in French Sign Language. A try to categorization within the scope of a grammar of iconicity), Doctoral Thesis. University of Paris VIII (2003)
Johnson, R.E., Liddell, K.S.: Sign language phonetics: architecture and description (in preparation)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Segouat, J., Braffort, A. (2010). Toward Modeling Sign Language Coarticulation. In: Kopp, S., Wachsmuth, I. (eds) Gesture in Embodied Communication and Human-Computer Interaction. GW 2009. Lecture Notes in Computer Science(), vol 5934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12553-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-12553-9_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12552-2
Online ISBN: 978-3-642-12553-9
eBook Packages: Computer ScienceComputer Science (R0)