keyboard_arrow_up
A New Hybrid Metric for Verifying Parallel Corpora of Arabic English

Authors

Saad Alkahtani, Wei Liu and William J. Teahan, Bangor University, United Kingdom

Abstract

This paper discusses a new metric that has been applied to verify the quality in translation between sentence pairs in parallel corpora of Arabic-English. This metric combines two techniques, one based on sentence length and the other based on compression code length. Experiments on sample test parallel Arabic-English corpora indicate the combination of these two techniques improves accuracy of the identification of satisfactory and unsatisfactory sentence pairs compared to sentence length and compression code length alone. The new method proposed in this research is effective at filtering noise and reducing mis-translations resulting in greatly improved quality.

Keywords

Parallel Corpus, Sentence Alignment for Machine Translation, Prediction by Partial Matching Compression

Full Text  Volume 5, Number 2