닫기

로그인

KOREAN

Published Papers

ISSN 1975-6321 (Print)
ISSN 2713-8372 (Online)

통번역학연구, Vol.29 no.1 (2025)
pp.115~141

DOI : 10.22844/its.2025.29.1.115

- 통역 자동 평가의 가능성과 한계 고찰 - MTQE 적용 사례를 중심으로 - -

최문선

(이화여자대학교)

This study investigated the potential benefits and limitations of automated interpreting assessment by reviewing various approaches, including machine translation (MT) quality metrics and quality estimation (QE), followed by an experimental application of MTQE to a small-scale dataset of English-Korean consecutive interpretations by three interpreting students. CometKiwi, one of the state-of-the-art MTQE methods that show strong evaluation performance without requiring reference translations, was employed to compare automated evaluation with human evaluation. The findings reveal that automated evaluations exhibited a strong correlation with human evaluations and achieved complete agreement in ranking interpreting outputs, confirming the feasibility of QE-based automated evaluation for interpretations. At both the text and segment levels, higher-quality interpreting outputs showed greater alignment between human and automated evaluations, while lower-quality outputs tended to receive relatively higher scores from the QE model, highlighting discrepancies with human evaluations. It was noted that CometKiwi returned scores above zero for uninterpreted segments, possibly overestimating the final overall quality scores. The study suggests that automated evaluation scores could serve as useful resources for interpreting educators and students when an independent reference source is needed to support human evaluation.
  통역 평가,자동 평가,MT 품질 평가 지표,MT 품질 예측,인간-기계 협업

다운로드 (Download) 리스트(List)