Obtaining DataUsing DataProviding DataCreating Data
About LDCMembersCatalogProjectsPapersLDC OnlineSearchContact UsUPennHome

LDC Catalog | By Type and Source | By Year | Top Ten | Projects | Catalog Search


English Gigaword Fourth Edition

Item Name: English Gigaword Fourth Edition
Authors: Robert Parker, David Graff, Junbo Kong, Ke Chen and Kazuaki Maeda
LDC Catalog No.: LDC2009T13
ISBN: 1-58563-515-4
Release Date: May 22, 2009
Data Source(s): newswire
Application(s): information retrieval, language teaching, natural language processing
Language(s): English
Language ID(s): eng
Distribution: 2 DVD
Member fee: $0 for 2009 members
Non-member Fee: US$5000.00
Reduced-License Fee: N/A
Extra-Copy Fee: US$400.00
Non-member License: yes
Online documentation: yes
Licensing Instructions: Subscription Members, Standard Members, Non-Members
Citation: Robert Parker, et al.
2009
English Gigaword Fourth Edition
Linguistic Data Consortium, Philadelphia

Introduction

This file contains documentation for English Gigaword Fourth Edition, Linguistic Data Consortium (LDC) catalog number LDC2009T13 and isbn 1-58563-515-4.

English Gigaword, now being released in its fourth edition, is a comprehensive archive of newswire text data that has been acquired over several years by the LDC at the University of Pennsylvania. The fourth edition includes all of the contents in English Gigawaord Third Edition (LDC2007T07) plus new data covering the 24-month period of January 2007 through December 2008.

The six distinct international sources of English newswire included in this edition are the following:

  • Agence France-Presse, English Service (afp_eng)
  • Associated Press Worldstream, English Service (apw_eng)
  • Central News Agency of Taiwan, English Service (cna_eng)
  • Los Angeles Times/Washington Post Newswire Service (ltw_eng)
  • New York Times Newswire Service (nyt_eng)
  • Xinhua News Agency, English Service (xin_eng)

New in the Fourth Edition

  • Articles with significant Spanish language content have now been identified and documented.
  • Markup has been simplified and made consistent throughout the corpus.
  • Information structure has been simplified.
  • Character entities have been simplified.

Samples

For an example of the data in this corpus, please review this sample file.

Content Copyright

Portions © 1994-2008 Agence France Presse, © 1994-2008 The Associated Press, © 1997-2008 Central News Agency (Taiwan), © 1994-1998, 2003-2008 Los Angeles Times-Washington Post News Service, Inc., © 1994-2008 New York Times, © 1995-2008 Xinhua News Agency, © 2009 Trustees of the University of Pennsylvania

About LDC | Members | Catalog | Projects | Papers | LDC Online | Search / Help | Contact Us | UPenn | Home | Obtaining Data | Creating Data | Using Data | Providing Da ta

Contact: ldc@ldc.upenn.edu

(c) 1992-2008 Linguistic Data Consortium, University of Pennsylvania. All Rights Reserved.