Skip to main content
placeholder image

USING GRAPHICS TO STUDY THE PERCEPTION OF SPEECH-IN-NOISE, AND VICE VERSA

Conference Paper


Abstract


  • This work aims to use the speech in noise task to assess talking head animations, and talking head animations to investigate the perception of speech-in-noise. The theoretical aim is to determine what visual information is important for speech, while the practical aim is to develop an effective talking head animation system adaptable to robots. The first experiment used the “cuboid”, a deliberately abstract face. Head, jaw and mouth movement were presented separately and in combination. Results showed an advantage of mouth movement independent of the other factors. This shows that even an abstract structure can carry useful facial speech information and that mouth movement is an essential component. Two other experiments reported used ATR’s in-house animation system [1] to look at the relative contribution of face and head movement. The first experiment replicated a combined head and face movement advantage [2]. A 2 Head Movement (present/absent) x 2 Face Movement (present/absent) experiment showed a main effect of face movement, but no effect of head movement or any interaction. We conclude that abstract faces can carry useful visual speech information and that, while mouth and face movement are primary, head and jaw movement do not interfere with and can help.

Publication Date


  • 2005

Citation


  • Hill, H., & Vaikiotis-Bateson, E. (2005). USING GRAPHICS TO STUDY THE PERCEPTION OF SPEECH-IN-NOISE, AND VICE VERSA. In Auditory-Visual Speech Processing 2005, AVSP 2005 (pp. 63-64).

Scopus Eid


  • 2-s2.0-85133464149

Web Of Science Accession Number


Start Page


  • 63

End Page


  • 64

Abstract


  • This work aims to use the speech in noise task to assess talking head animations, and talking head animations to investigate the perception of speech-in-noise. The theoretical aim is to determine what visual information is important for speech, while the practical aim is to develop an effective talking head animation system adaptable to robots. The first experiment used the “cuboid”, a deliberately abstract face. Head, jaw and mouth movement were presented separately and in combination. Results showed an advantage of mouth movement independent of the other factors. This shows that even an abstract structure can carry useful facial speech information and that mouth movement is an essential component. Two other experiments reported used ATR’s in-house animation system [1] to look at the relative contribution of face and head movement. The first experiment replicated a combined head and face movement advantage [2]. A 2 Head Movement (present/absent) x 2 Face Movement (present/absent) experiment showed a main effect of face movement, but no effect of head movement or any interaction. We conclude that abstract faces can carry useful visual speech information and that, while mouth and face movement are primary, head and jaw movement do not interfere with and can help.

Publication Date


  • 2005

Citation


  • Hill, H., & Vaikiotis-Bateson, E. (2005). USING GRAPHICS TO STUDY THE PERCEPTION OF SPEECH-IN-NOISE, AND VICE VERSA. In Auditory-Visual Speech Processing 2005, AVSP 2005 (pp. 63-64).

Scopus Eid


  • 2-s2.0-85133464149

Web Of Science Accession Number


Start Page


  • 63

End Page


  • 64