Obtaining DataUsing DataProviding DataCreating Data
About LDCMembersCatalogProjectsPapersLDC OnlineSearchContact UsUPennHome

LDC Catalog | By Type and Source | By Year | Top Ten | Projects | Catalog Search



2001 Communicator Dialogue Act Tagged

Item Name: 2001 Communicator Dialogue Act Tagged
Authors: Rashmi Prasad and Marilyn Walker
LDC Catalog No.: LDC2004T16
ISBN: 1-58563-306-2
Release Date: Jun 15, 2004
Data Type: text
Data Source(s): telephone conversations
Project(s): Communicator
Application(s): nominal expression generation, speech recognition, spoken dialogue modeling, spoken dialogue systems, summarization, tagging, topic detection and tracking
Language(s): English
Language ID(s): ENG
Distribution: 1 CD
Member fee: $0 for 2004 members
Non-member Fee: US $800.00
Reduced-License Fee: US $400.00
Extra-Copy Fee: US $150.00
Non-member License: yes
Online documentation: yes
Licensing Instructions: Subscription Members, Standard Members, Non-Members
Citation: Rashmi Prasad and Marilyn Walker
2004
2001 Communicator Dialogue Act Tagged
Linguistic Data Consortium, Philadelphia

Introduction

2001 Communicator Dialogue Act Tagged was produced by Linguistic Data Consortium (LDC) catalog number LDC2004T16 and ISBN 1-58563-306-2.

This corpus is an addendum to the 2001 Communicator Evaluation corpus produced by the LDC in 2003. This addendum contains annotations on the transcriptions of the system and user utterances as taken from the corrected logfiles of the 2001 Communicator Evaluation corpus. Corrections were hand-done for missing or misaligned time-stamps on turn/utterance boundaries.

Dialogue Act Annotations are provided for system utterances in the dialogues. The dialogue act tags follow the DATE (Dialogue Act Tagging for Evaluation) scheme. In addition, both system and user utterances are tagged for named entities. For further description of the 2001 Communicator Evaluation corpus, please refer to the main publication from 2003 (LDC2003S01).

Data

The complete Dialogue Act annotated corpus is available as a single XML text file totalling approximately 67 MB.

The total number of dialogues is 1,683. There are 1,151,330 words (tokens) and 5,343,286 unique words.

Each dialogue is segmented into system and user turns. The total number of turns for the entire corpus is 78,718 (39,419 system turns and 39,299 user turns). Turns were further segmented into utterances in the system logfiles. The total number of utterances is 89,666 (39,417 system utterances and 50,249 user utterances). There are a total of 1,048,311 words in the system utterances and a total of 103,019 words in the user utterances.

The total number of tagged dialogue acts is 82,277 with 68 unique tags. Dialogue Act tagging was done automatically using pattern matching with human-labeled dialogue utterances used by the nine different participating Communicator Systems. Named entity tagging also followed the same methodology.

Sponsorship

This research was conducted using funding from the following grant number and funding agency: DARPA contract MDA972-99-3-0003.

Updates

There are no updates available at this time.

Content Copyright

Portions © 2004 Trustees of the University of Pennsylvania


About LDC | Members | Catalog | Projects | Papers | LDC Online | Search / Help | Contact Us | UPenn | Home | Obtaining Data | Creating Data | Using Data | Providing Data

Contact: ldc@ldc.upenn.edu

(c) 1992-2010 Linguistic Data Consortium, University of Pennsylvania. All Rights Reserved.