Multiple-Translation Arabic (MTA) Part 2, Linguistic Data Consortium (LDC) catalog number LDC2005T05 and ISBN 1-58563-328-3, was produced by LDC.
To support the development of automatic means for evaluating translation
quality, LDC was sponsored to solicit four sets of human translations for a
single set of Arabic source materials. LDC was also asked to produce
translations from various commercial-off-the-shelf-systems (COTS, including
commercial Machine Translation (MT) systems as well as MT systems available on
This corpus contains two sets of COTS outputs and one output set from a TIDES 2003 MT Evaluation participant,
which is representative for the state-of-the-art research systems.
To determine if automatic evaluation systems such as BLEU track human assessment, LDC also performed human assessment on the two COTS outputs and the TIDES research system. The corpus includes the assessment results for one of the two COTS systems, the assessment result for the TIDES research system, and the specifications used for conducting the assessments.
Source Data Selection:
- Xinhua News Service (Xinhua): 50 news stories
- Agence France Presse (AFP): 50 news stories
(total: 100 stories)
There are 100 source files and 700 translation files. All source data were drawn from January and
February 2003 collection of Xinhua Arabic data and AFP Arabic data.
The story selection from the two newswire collections was controlled by story length: all selected
stories contain between 700 and 1,500 Arabic characters.
The overall count of Arabic words (excluding markup), by source, is shown in the following table:
- AFP 7,528
- Xinhua 7,551
For samples from this corpus, see this screen shot of the Arabic source file and its translation.
Please contact Xiaoyi Ma with any questions regarding this corpus.
Portions © 2003 Xinhua News Agency, © 2003 Agence France Press, © 2004-2005 Trustees of the University of Pennsylvania