Evaluation of two word alignment systems
Independent thesis Basic level (professional degree)Student thesis
This project evaluates two different systems that generate wordalignments on English-Swedish data. The systems to be used are the Giza++ system, that may generate a variety of statistical translation models, and I*Trix system developed at IDA/NLPLab that generates word pairs with frequencies.
The file formats of these two systems, the way of running them and the differences of the two systems are addressed in this paper. Evaluation in this project considers a variety of parameters such as corpus size, characteristics of the corpus, the effect of linguistic knowledge, etc. At the end of this paper, the conclusions of the two systems evaluation are presented. In general, Giza++ is better applying on big corpora while I*Trix is better for small corpora. Especially for corpora with high statistical ratio or special resource, I*Trix has a better performance.
Place, publisher, year, edition, pages
Institutionen för datavetenskap , 2004. , 55 p.
Datalogi, Word alignment, Giza++, I*Trix, Parallel corpora, Statistical ratio, Evaluation, I*Eval, Gold standard.
IdentifiersURN: urn:nbn:se:liu:diva-2215ISRN: LITH-IDA-EX--04/019--SEOAI: oai:DiVA.org:liu-2215DiVA: diva2:19545