論文

査読有り
2012年2月

Audiovisual temporal recalibration for speech in synchrony perception and speech identification

Kansei Engineering International Journal
  • Asakawa, K
  • ,
  • Tanaka, A
  • ,
  • Imai, H

11
1
開始ページ
35
終了ページ
40
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.5057/kei.11.35
出版者・発行元
Japan Society of Kansei Engineering

We investigated whether audiovisual synchrony perception for speech could change after observation of the audiovisual temporal mismatch. Previous studies have revealed that audiovisual synchrony perception is re-calibrated after exposure to a constant timing difference between auditory and visual signals in non-speech. In the present study, we examined whether this audiovisual temporal recalibration occurs at the perceptual level even for speech (monosyllables). In Experiment 1, participants performed an audiovisual simultaneity judgment task (i.e., a direct measurement of the audiovisual synchrony perception) in terms of the speech signal after observation of the speech stimuli which had a constant audiovisual lag. The results showed that the "simultaneous" responses (i.e., proportion of responses for which participants judged the auditory and visual stimuli to be synchronous) at least partly depended on exposure lag. In Experiment 2, we adopted the McGurk identification task (i.e., an indirect measurement of the audiovisual synchrony perception) to exclude the possibility that this modulation of synchrony perception was solely attributable to the response strategy using stimuli identical to those of Experiment 1. The characteristics of the McGurk effect reported by participants depended on exposure lag. Thus, it was shown that audiovisual synchrony perception for speech could be modulated following exposure to constant lag both in direct and indirect measurement. Our results suggest that temporal recalibration occurs not only in non-speech signals but also in monosyllabic speech at the perceptual level.

リンク情報
DOI
https://doi.org/10.5057/kei.11.35
CiNii Articles
http://ci.nii.ac.jp/naid/130002148637
ID情報
  • DOI : 10.5057/kei.11.35
  • ISSN : 1884-0841
  • CiNii Articles ID : 130002148637

エクスポート
BibTeX RIS