Skip to main content
placeholder image

Auditory-Visual Perception of Prosodic Information: Inter-linguistic Analysis - Contrastive Focus in French and Japanese

Conference Paper


Abstract


  • Audition and vision are combined for the perception of speech segments and recent studies have shown that this is also the case for some types of supra-segmental information such as prosodic focus. The integration of vision and audition for the perception of speech segments however seems to be less important in Japanese. This study aims at comparing auditory-visual perception of prosodic contrastive focus in French and in Japanese. Two parallel focus identification tests were conducted for three modalities: AV, A and V in the two languages. Four speakers were recorded in both languages. For French, there was no AV advantage due to a ceiling effect. The same was observed for Japanese even though auditory only performances did not reach a ceiling. The results suggest that there are visual cues to prosodic focus in Japanese as well as in French but that these are not systematically combined with auditory information to enhance AV perception in Japanese. However, we also found that in some cases, especially when auditory alone perception is poor, visual and auditory information can be combined to enhance perception in Japanese.

Publication Date


  • 2008

Citation


  • Dohen, M., Wu, C. H., & Hill, H. (2008). Auditory-Visual Perception of Prosodic Information: Inter-linguistic Analysis - Contrastive Focus in French and Japanese. In International Conference on Auditory-Visual Speech Processing 2008, AVSP 2008 (pp. 89-94).

Scopus Eid


  • 2-s2.0-85006243482

Web Of Science Accession Number


Start Page


  • 89

End Page


  • 94

Abstract


  • Audition and vision are combined for the perception of speech segments and recent studies have shown that this is also the case for some types of supra-segmental information such as prosodic focus. The integration of vision and audition for the perception of speech segments however seems to be less important in Japanese. This study aims at comparing auditory-visual perception of prosodic contrastive focus in French and in Japanese. Two parallel focus identification tests were conducted for three modalities: AV, A and V in the two languages. Four speakers were recorded in both languages. For French, there was no AV advantage due to a ceiling effect. The same was observed for Japanese even though auditory only performances did not reach a ceiling. The results suggest that there are visual cues to prosodic focus in Japanese as well as in French but that these are not systematically combined with auditory information to enhance AV perception in Japanese. However, we also found that in some cases, especially when auditory alone perception is poor, visual and auditory information can be combined to enhance perception in Japanese.

Publication Date


  • 2008

Citation


  • Dohen, M., Wu, C. H., & Hill, H. (2008). Auditory-Visual Perception of Prosodic Information: Inter-linguistic Analysis - Contrastive Focus in French and Japanese. In International Conference on Auditory-Visual Speech Processing 2008, AVSP 2008 (pp. 89-94).

Scopus Eid


  • 2-s2.0-85006243482

Web Of Science Accession Number


Start Page


  • 89

End Page


  • 94