LDC Catalog

TDT4 Multilingual Text and Annotations


Item Name:	TDT4 Multilingual Text and Annotations
Authors:	Stephanie Strassel, Junbo Kong, and David Graff
LDC Catalog No.:	LDC2005T16
ISBN:	1-58563-339-9
Release Date:	May 15, 2005
Data Type:	text
Data Source(s):	broadcast news
Project(s):	GALE, TDT, TIDES
Application(s):	topic detection and tracking
Language(s):	English, Mandarin Chinese, Modern Standard Arabic
Language ID(s):	ARB, ENG
Distribution:	1 DVD
Member fee:	$0 for 2005 members
Non-member Fee:	US$2000.00
Reduced-License Fee:	US$1000.00
Extra-Copy Fee:	US$200.00
Non-member License:	yes
Online documentation:	yes
Licensing Instructions:	Subscription Members, Standard Members, Non-Members
Citation:	Stephanie Strassel, Junbo Kong, and David Graff 2005 TDT4 Multilingual Text and Annotations Linguistic Data Consortium, Philadelphia

Introduction This page contains documentation on the TDT4 Multilingual Text and Annotations, Linguistic Data Consortium (LDC) catalog number LDC2004T16 and ISBN 1-58563-339-9. The TDT4 corpora were created by Linguistic Data Consortium with support from the DARPA TIDES (Translingual Information Detection, Extraction and Summarization) Program. This release contains the complete set of English, Arabic and Chinese news text (broadcast news transcripts and newswire data) used in the 2002 and 2003 Topic Detection and Tracking technology evaluations, along with topic annotations created for those evaluations. The audio corresponding to the broadcast news transcripts contained in this release can be found in LDC Publication LDC2005S11, TDT4 Multilingual Broadcast News Speech Corpus. Topic Detection and Tracking (TDT) refers to automatic techniques for finding topically related material in streams of data such as newswire and broadcast news. Evaluation tasks in 2002 and 2003 included the segmentation of a news source into stories, the tracking of known topics, the detection of unknown topics, the detection of initial stories on unknown topics, and the detection of pairs of stories on the same topic. Complete documentation on the TDT evaluation program can be found on NIST's TDT website. For further information about corpora and annotations to support the TDT Program visit LDC's TDT information pages. Samples To see an example of this corpus, please examine this sample. This sample is an English translation from an Arabic news broadcast. The translation is the product of the IBM Arabic to English translation engine. Content Copyright Portions © 2000-2001: Xinhua News Agency, Agence France Presse, New York Times, The Associated Press, SPH AsiaOne Ltd, An Nahar, Al Hayat, Nile TV, Public Radio International, Cable News Network, LP, LLP, American Broadcasting Company, National Broadcasting Company, Inc., China National Radio, China Television System, China Central TV, China Broadcasting System, © 2002, 2003, 2005 Trustees of the University of Pennsylvania The World is a co-production of Public Radio International and the British Broadcasting Corporation and is produced at WGBH Boston.

Introduction

Samples

Content Copyright