Abstract
Introduction
Multiple-Translation Chinese (MTC) Part 3 was produced by Linguistic Data Consortium (LDC) catalog number LDC2004T07 and ISBN 1-58563-289-9.
To support the development of automatic means for evaluating translation quality, the LDC was sponsored to solicit four sets of human translations for a single set of Mandarin Chinese source materials.
Two similar corpora, Multiple-Translation Chinese Corpus, and Multiple-Translation Chinese Corpus Part 2 were published in 2002 and 2003. The 2002 corpus (Part 1), 2003 corpus (Part 2), and the present corpus used Chinese news articles from multiple sources and provide human translations for them. However, Part 1 also offers translations produced from various commercial-off-the-shelf-systems (COTS). In addition to human and COTS translations, Part 2 also offers translations from a TIDES research system, and provides human assessment for some of the automatic translations.
Data
Two sources of journalistic Mandarin Chinese text were selected to provide the Chinese material:
- AFP News Service: 50 news stories - Xinhua News Service: 50 news stories (total: 100 stories)
The data was drawn from the May and June 2002 collection of AFP and Xinhua news.
The story selection from the two newswire collections was controlled by story length: all selected stories contain between about 230 and 564 Chinese characters. The overall count of Chinese characters by source is shown in the following table:
AFP 22,135 Xinhua 20,321 --------------- total 42,456
For the Chinese data, there are approximately 21K-words, while for the English translation, there are approximately 100K-words in total, and 12K unique words.
Four best translation teams were chosen from the 11 teams which had participated in the translation of Multiple Translation Chinese Corpus Part 1 (LDC2002T01) and Part 2 (LDC2003T17) to take part in the project.
In accordance with the guidelines, each translation team was asked to return the first ten Xinhua stories for quality checking. This was to ensure that each translation team had indeed understood and was following the guidelines, and the translation quality was acceptable. The LDC sent the translations back to the translation team for any deviations from the guidelines or any quality issues detected.
Subsequent translation submissions were continuously monitored for conformance and quality. Once the full set of translations was complete, a final pass of reformatting and validation was carried out, to assure alignability of segments, and to convert the translated texts into SGML format.
Each translation team was also asked to fill out and return a questionnaire to describe their procedures and professional background.
Please click here for a Chinese and an English example. (Characters in Chinese can be displayed by selecting Chinese encoding in your brower.)
(2004-07-12)