Introduction

This file contains documentation on the Chinese English News Magazine Parallel Text, Linguistic Data Consortium (LDC) catalog number LDC2005T10 and ISBN 1-58563-333-X.

This corpus contains Chinese news stories and their English translations LDC collected via Sinorama Magazine, Taiwan, from 1976 to 2004. It totals 6,366 story pairs, 365,568 sentence pairs, 20M Chinese characters and 9M English words. The corpus is aligned at sentence level.

Data

Sinorama Magazine is published monthly in several languages, including Chinese, English, Japanese. LDC received its 1976 to 2000 publications on a single CD, and its 2001 to 2004 publications via Sinorama's website.

The Sinorama Chinese text was encoded in Big5. The data came story aligned but were lack of sentence level alignment. The sentence alignment was done at the LDC using Champollion v 1.1.

The final data is put in the data directory, which contains subdirectories for Chinese documents, English documents, and the sentence level alignment, identified as "Chinese," "English," and "alignment."

The English and Chinese files may contain one or more documents, with each document formatted in SGML as follows:

[English or Chinese text]

[English or Chinese text]
[English or Chinese text]
...

Notes:
* the

and tags are always assigned sequential numeric IDs, starting at one.
* the tags are always placed on the same line with their contents, and are always separated from the contents by a space.

Each alignment file contains the sentence level alignment of multiple documents, each being formatted in SGML as follows:




...

Notes:
* the docid in an English file, its Chinese translation and the ALIGNMENT are the same.
* EnglishSegId and ChineseSegId may have none, one, or more than one segment IDs.

Samples

The following files provide an example of this corpus:

• Chinese
• English
• Alignment

Content Copyright

Portions © 1976-2004 Sinorama Magazine

Portions © 2005 Trustees of the University of Pennsylvania