*About NLPContributionGraph was introduced as Task 11 at SemEval 2021 for the first time. This dataset resource was created to define the task system development and evaluation objectives. It contains Natural Language Processing (NLP) scholarly articles with annotations for their structured contributions to be integrable within Knowledge Graph infrastructures such as the Open Research Knowledge Graph orkg.org. The structured contribution annotations are provided as (1) Contribution sentences: a set of sentences about the contribution in the article; (2) Scientific terms and relations: a set of scientific terms and relational cue phrases extracted from the contribution sentences; and (3) Triples: semantic statements that pair scientific terms with a relation, modeled toward subject-predicate-object RDF statements for KG building. The Triples are organized under three (mandatory) or more of twelve total information units (viz., ResearchProblem, Approach, Model, Code, Dataset, ExperimentalSetup, Hyperparameters, Baselines, Results, Tasks, Experiments, and AblationAnalysis). *The Shared Task As a complete submission for the Task, given NLP scholarly articles in plaintext format, systems had to automatically extract the following information: contribution sentences; scientific term and predicate phrases from the sentences; and (subject,predicate,object) triple statements toward KG building organized under three or more of twelve total information units. The task has a never-ending official evaluation timeline online at https://competitions.codalab.org/competitions/25680. The dataset is pre-partitioned as training and test sets. *Useful Links NCG Task website https://ncg-task.github.io/ NCG Task competition site https://competitions.codalab.org/competitions/25680 NCG on Github https://github.com/ncg-task/ SemEval 2021 https://semeval.github.io/SemEval2021/ ORKG https://www.orkg.org/orkg/

Creator(s)

Jennifer D'Souza

Distributor(s)

TIB Leibniz Information Centre for Science and Technology

Right Holder(s)

TIB Leibniz Information Centre for Science and Technology