Resource: MWE-Aware English Dependency Corpus 2.0

Reference MWE-Aware English Dependency Corpus 2.0
Date of Submission Oct. 23, 2017, 3:59 p.m.
Status accepted
ISLRN 386-404-178-211-6
Resource Type Primary Text
Media Type Text
Source
Language English
Format/MIME Type text/plain
Size 63560
Access Medium Web Download
Description

*Introduction*

MWE-Aware English Dependency Corpus Version 2.0 was developed by the Nara Institute of Science and Technology Computational Linguistics Laboratory and consists of English compound function words annotated in dependency format. The data is derived from OntoNotes Release 5.0 (LDC2013T19).

Compound functions words are a type of multiword expression (MWE). MWEs are groups of tokens that can be treated as a single semantic or syntactic unit. Doing so facilitates natural language processing tasks such as constituency and dependency parsing.

Version 2.0 adds annotations of named entities (persons, locations, organizations) into dependency trees that are aware of compound function words. Version 1.0 is available from LDC as MWE-Aware English Dependency Corpus (LDC2017T01).

*Data*

MWE-Aware English Dependency Corpus Version 2.0 was derived from the Wall Street Journal portion of OntoNotes Release 5.0. MWEs were identified in OntoNotes' phrase structure trees and each MWE was established as a single subtree. Those phrase structure subtrees were then converted to a dependency structure (the Stanford dependencies) in CoNLL format.

The data is split into 1,728 phrase structure trees as *.parse files and a single 14-column tab separated dependency as a *.conll file. Both file types are encoded as UTF-8.

Version 2.0
Creator Akihiko Kato , Hiroyuki Shindo , Yuji Matsumoto
Distributor Linguistic Data Consortium
Rights Holder Portions © 1987-1989 Dow Jones & Company, Inc. © 2017 NAIST Computational Linguistics Laboratory, © 2007, 2008, 2009, 2011, 2013, 2017 Trustees of the University of Pennsylvania