Introduction
2009 CoNLL Shared Task Part 1, LDC Catalog Number LDC2012T03 and ISBN 1-58563-610-X,
contains the Catalan, Czech, German and Spanish trial corpora, training corpora,
development and test data for the 2009
CoNLL (Conference on Computational Natural Language Learning) Shared Task Evaluation.
The 2009 Shared Task developed syntactic dependency annotations, including the
semantic dependencies model roles of both verbal and nominal predicates.
The Conference on
Computational Natural Language Learning (CoNLL) is accompanied every year
by a shared task intended to promote natural language processing applications
and evaluate them in a standard setting. The 2004 and 2005 CoNLL shared tasks
were dedicated to semantic role labeling (SRL) in a monolingual setting (English).
In 2006 and 2007, the shared tasks were devoted to the parsing of syntactic
dependencies and used corpora from up to thirteen languages. In 2008, the shared
task focused on English and employed a unified dependency-based formalism and
merged the task of syntactic dependency parsing and the task of identifying
semantic arguments and labeling them with semantic roles; that data has been
released by LDC as 2008
CoNLL Shared Task Data ( LDC2009T12). The 2009 task extended the 2008 task
to several languages (English plus Catalan, Chinese, Czech, German, Japanese
and Spanish). Among the new features were comparison of time and space complexity
based on participants' input, and learning curve comparison for languages with
large datasets.
The 2009 shared task was divided into two subtasks:
- parsing syntactic dependencies
- identification of arguments and assignment of semantic roles for each
predicate
2009 CoNLL Shared Task Part 2 (LDC2012T04)
contains the English and Chinese task data and is also available through LDC.
Data
The materials in this release consist of excerpts from the following corpora:
- Ancora (Spanish
+ Catalan): 500,000 words each of annotated news text developed by the University
of Barcelona, Polytechnic University of Catalonia, the University of Alacante
and the University of the Basque Country
- Prague Dependency
Treebank 2.0 (Czech): approximately 2 million words of annotated news,
journal and magazine text developed by Charles University; also available
through LDC, LDC2006T01
- TIGER
Treebank + SALSA
Corpus (German): approximately 900,000 words of annotated news text and
FrameNet annotation developed by the University of Potsdam, Saarland University
and the University of Stuttgart
In addition, an archive of all of the uploaded data from the participants is
included in the eval-data folder. Users should note that not all data indicated
in the individual READMEs is included in this release and neither are some of
the corresponding DTDs for of the XML. Additionally, all data is presented in
its uncompressed form for ease of use. Within the user eval-data folder, the
two folders marked "bad" contain references to data from languages
included in Part 2 of this release as well as to Japanese data. Japanese data
is not included in this release.
Samples
For samples of documents from each language use the links below:
Updates
None at this time.
Content Copyright
Portions © 1991, 1994, 1995 Lidové noviny daily newspapers, ©
1992 Mladá fronta Dnes daily newspapers, © 1994 Ceskomorvsky Profit
business weekly, © 1992-1993 Vesmír scientific magazine, Academia
Publishers, © 1996-2005 Institute of Formal and Applied Linguistics and
Center for Computational Linguistics, Faculty of Mathematics and Physics, Charles
University, © 2006, 2012 Trustees of the University of Pennsylvania
|