Abstract: Online text machine translation systems are widely used throughout the world freely. Most of these systems use statistical machine translation (SMT) that is based on a corpus full with translation examples to learn from them how to translate correctly. Online text machine translation systems differ widely in their effectiveness, and therefore we have to fairly evaluate their effectiveness. Generally the manual (human) evaluation of machine translation (MT) systems is better than the automatic evaluation, but it is not feasible to be used. The distance or similarity of MT candidate output to a set of reference translations are used by many MT evaluation approaches. This study presents a comparison of effectiveness of two free online machine translation systems (Google Translate and Babylon machine translation system) to translate Arabic to English. There are many automatic methods used to evaluate different machine translators, one of these methods; Bilingual Evaluation Understudy (BLEU) method. BLEU is used to evaluate translation quality of two free online machine translation systems under consideration. A corpus consists of more than 1000 Arabic sentences with two reference English translations for each Arabic sentence is used in this study. This corpus of Arabic sentences and their English translations consists of 4169 Arabic words, where the number of unique Arabic words is 2539. This corpus is released online to be used by researchers. These Arabic sentences are distributed among four basic sentence functions (declarative, interrogative, exclamatory, and imperative). The experimental results show that Google machine translation system is better than Babylon machine translation system in terms of precision of translation from Arabic to English.

Laith S. Hadla, Taghreed M. Hailat and Mohammed N. Al-Kabi, “Evaluating Arabic to English Machine Translation” International Journal of Advanced Computer Science and Applications(IJACSA), 5(11), 2014. http://dx.doi.org/10.14569/IJACSA.2014.051112

@article{Hadla2014,
title = {Evaluating Arabic to English Machine Translation},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2014.051112},
url = {http://dx.doi.org/10.14569/IJACSA.2014.051112},
year = {2014},
publisher = {The Science and Information Organization},
volume = {5},
number = {11},
author = {Laith S. Hadla and Taghreed M. Hailat and Mohammed N. Al-Kabi}
}