Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine Translation
2010 (English)In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC'10), European Language Resources Association, 2010, 2175-2181 p.Conference paper (Refereed)
One problem in statistical machine translation (SMT) is that the output often is ungrammatical. To address this issue, we have investigated the use of a grammar checker for two purposes in connection with SMT: as an evaluation tool and as a postprocessing tool. As an evaluation tool the grammar checker gives a complementary picture to standard metrics such as Bleu, which do not account for grammaticality. We use the grammar checker as a postprocessing tool by applying the error correction suggestions it gives. There are only small overall improvements of the postprocessing on automatic metrics, but the sentences that are affected by the changes are improved, as shown both by automatic metrics and by a human error analysis. These results indicate that grammar checker techniques are a useful complement to SMT.
Place, publisher, year, edition, pages
European Language Resources Association, 2010. 2175-2181 p.
Machine translation, grammar checker, evaluation
Language Technology (Computational Linguistics) Computer Science
IdentifiersURN: urn:nbn:se:liu:diva-58977ISI: 000356879506153ISBN: 2-9517408-6-7OAI: oai:DiVA.org:liu-58977DiVA: diva2:347916
the Seventh Conference on International Language Resources and Evaluation (LREC'10)