Resource: Chinese Lexical Resources for Gender, Number, Animacy
|Reference||Chinese Lexical Resources for Gender, Number, Animacy|
|Date of Submission||Sept. 17, 2020, 8:13 p.m.|
|Access Medium||Web Download|
Chinese Lexical Resources for Gender, Number, Animacy was developed by the Linguistic Data Consortium (LDC) and consists of gender, number, and animacy lexicons produced in support of the DARPA DEFT program. Gender, number and animacy are lexical indicators useful for named entity tagging, including the detection of person mentions in text.
DARPA's Deep Exploration and Filtering of Text (DEFT) program aimed to address remaining capability gaps in state-of-the-art natural language processing technologies related to inference, causal relationships and anomaly detection. LDC supported the DEFT program by collecting, creating and annotating a variety of data sources.
This corpus was created by extracting information from newswire texts in Chinese Gigaword Fifth Edition (LDC2011T13) in the following steps: (1) segmenting source documents into sentences; (2) converting any traditional Chinese script to simplified Chinese; (3) tagging all sentences for parts-of-speech; (4) developing queries to detect patterns; and (5) building lexicons based on frequency counts and entity types.
The resulting resources include dictionaries of Chinese animate nominals and names; Chinese nominals and name with gender and number predicted; and other dictionaries of Chinese nominals, names, verbs and pronouns. Each dictionary contains frequency information as well as the features in question.
All lexical data is presented as UTF-8 encoded plain text.
This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.
|Creator||Xiaoyi Ma , Stephanie Strassel , Song Chen , Jiahong Yuan|
|Distributor||Linguistic Data Consortium|
|Rights Holder||Portions © 2000-2010 Agence France Presse, © 1991-2010 Central News Agency (Taiwan), © 2006-2010 China Military Online, © 2006-2010 Chinanews.com, © 2006-2010 Guangming Daily, © 2006-2010 Peoples Daily, © 1998, 2000-2003 SPH AsiaOne, Ltd., © 1990-2010 Xinhua News Agency, © 2003, 2005, 2007, 2009, 2011, 2020 Trustees of the University of Pennsylvania|