論文

査読有り
2015年12月

Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it

LANGUAGE RESOURCES AND EVALUATION
  • Seiichi Yamamoto
  • ,
  • Keiko Taguchi
  • ,
  • Koki Ijuin
  • ,
  • Ichiro Umata
  • ,
  • Masafumi Nishida

49
4
開始ページ
857
終了ページ
882
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1007/s10579-015-9299-2
出版者・発行元
SPRINGER

To investigate the differences in communicative activities by the same interlocutors in Japanese (their L1) and in English (their L2), an 8-h multimodal corpus of multiparty conversations was collected. Three subjects participated in each conversational group, and they had conversations on free-flowing and goal-oriented topics in Japanese and in English. Their utterances, eye gazes, and gestures were recorded with microphones, eye trackers, and video cameras. The utterances and eye gazes were manually annotated. Their utterances were transcribed, and the transcriptions of each participant were aligned with those of the others along the time axis. Quantitative analyses were made to compare the communicative activities caused by the differences in conversational languages, the conversation types, and the levels of language expertise in L2. The results reveal different utterance characteristics and gaze patterns that reflect the differences in difficulty felt by the participants in each conversational condition. Both total and average durations of utterances were shorter in their L2 than in their L1 conversations. Differences in eye gazes were mainly found in those toward the information senders: Speakers were gazed at more in their second-language than in their native-language conversations. Our findings on the characteristics of conversations in the second language suggest possible directions for future research in psychology, cognitive science, and human-computer interaction technologies.

Web of Science ® 被引用回数 : 8

リンク情報
DOI
https://doi.org/10.1007/s10579-015-9299-2
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000364230000003&DestApp=WOS_CPL
URL
http://dblp.uni-trier.de/db/journals/lre/lre49.html#journals/lre/YamamotoTIUN15

エクスポート
BibTeX RIS