2005年3月
An objective method for evaluating speech translation system: Using a second, language learner's corpus
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS
- ,
- ,
- ,
- ,
- ,
- 巻
- E88D
- 号
- 3
- 開始ページ
- 569
- 終了ページ
- 577
- 記述言語
- 英語
- 掲載種別
- 研究論文(学術雑誌)
- DOI
- 10.1093/ietisy/e-d.3.569
- 出版者・発行元
- IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG
In this paper we propose an objective method for assessing the capability of a speech translation system. It automates the translation paired comparison method, which gives a simple, easy to understand TOEIC score proposed by Sugaya et al., to succinctly evaluate a speech translation system. To avoid the expensive evaluation cost of the original method where large manual effort is required, the new objective method automates the procedure by employing an objective metric such as BLEU and DP-based measure. The evaluation results obtained by the proposed method are similar to those of the original method. Also, the proposed method is used to evaluate the usefulness of a speech translation system. It is then found that our speech translation system is useful in general, even to users with higher TOEIC score than the system's.
- リンク情報
- ID情報
-
- DOI : 10.1093/ietisy/e-d.3.569
- ISSN : 1745-1361
- Web of Science ID : WOS:000227828100028