論文

査読有り
2007年1月

Out-of-domain utterance detection using classification confidences of multiple topics

IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
  • Ian Lane
  • ,
  • Tatsuya Kawahara
  • ,
  • Tomoko Matsui
  • ,
  • Satoshi Nakamura

15
1
開始ページ
150
終了ページ
161
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1109/TASL.2006.876727
出版者・発行元
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

One significant problem for spoken language systems is how to cope with users' out-of-domain (OOD) utterances which cannot be handled by the back-end application system. In this paper, we propose a novel OOD detection framework, which makes use of the classification confidence scores of multiple topics and applies a linear discriminant model to perform in-domain verification. The verification model is trained using a combination of deleted interpolation of the in-domain data and minimum-classification-error training, and does not require actual OOD data during the training process, thus realizing high portability. When applied to the "phrasebook" system, a single utterance read-style speech task, the proposed approach achieves an absolute reduction in OOD detection errors of up to 8.1 points (40% relative) compared to a baseline method based on the maximum topic classification score. Furthermore, the proposed approach realizes comparable performance to an equivalent system trained on both in-domain and OOD data, while requiring no OOD data during training. We also apply this framework to the "machine-aided-dialogue" corpus, a spontaneous dialogue speech task, and extend the framework in two manners. First, we introduce topic clustering which enables reliable topic confidence scores to be generated even for indistinct utterances, and second, we implement methods to effectively incorporate dialogue context. Integration of these two methods into the proposed framework significantly improves OOD detection performance, achieving a further reduction in equal error rate (EER) of 7.9 points.

リンク情報
DOI
https://doi.org/10.1109/TASL.2006.876727
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000243286900013&DestApp=WOS_CPL
ID情報
  • DOI : 10.1109/TASL.2006.876727
  • ISSN : 1558-7916
  • Web of Science ID : WOS:000243286900013

エクスポート
BibTeX RIS