2017年12月1日
Testing the comparability of different L2 oral test tasks
Journal of Asia TEFL
- 巻
- 14
- 号
- 4
- 開始ページ
- 717
- 終了ページ
- 735
- 記述言語
- 英語
- 掲載種別
- 研究論文(学術雑誌)
- DOI
- 10.18823/asiatefl.2017.14.4.9.717
- 出版者・発行元
- Asian Association of Teachers of English as a Foreign Language
This study examined the comparability of three L2 oral test tasks (topic discussion, information gap, and semi-direct speaking) in the measurement of the four oral traits (pronunciation, fluency, grammar, and vocabulary). In examining the comparability, a CFA approach to a correlated traits/correlated methods design was employed, and evidence of convergent and discriminant validity was tested in the measurement of the traits by the methods. Through the model comparison approach (Byrne, 2006
Wideman, 1985), the hypothesized model was compared against a series of more restrictive models using χ2 difference tests, and the information from the path coefficients was examined to check the equivalence further. The findings revealed that the method effect in the measurement model was so strong that the trait was not fully reflected in the measurement process. Also, the effect of method on trait was not consistent in that topic discussion produced most trait-related information among the test tasks. Moreover, methods were found discriminant although traits were not. Thus, the three methods cannot be considered comparable in measuring the L2 oral traits, and such incomparability was particularly evident between the two methods of group oral and semi-direct speaking.
Wideman, 1985), the hypothesized model was compared against a series of more restrictive models using χ2 difference tests, and the information from the path coefficients was examined to check the equivalence further. The findings revealed that the method effect in the measurement model was so strong that the trait was not fully reflected in the measurement process. Also, the effect of method on trait was not consistent in that topic discussion produced most trait-related information among the test tasks. Moreover, methods were found discriminant although traits were not. Thus, the three methods cannot be considered comparable in measuring the L2 oral traits, and such incomparability was particularly evident between the two methods of group oral and semi-direct speaking.
- ID情報
-
- DOI : 10.18823/asiatefl.2017.14.4.9.717
- ISSN : 2466-1511
- ISSN : 1738-3102
- SCOPUS ID : 85040745823