Document-level relation extraction aims to extract the relationship among the entities in a paragraph of text. Compared with sentence-level, the text in document-level relation extraction is much longer and contains many more entities. It makes the document-level relation extraction a harder task. The number and complexity of entities make it necessary to provide enough information about the entities for the models in document-level relation extraction. To solve this problem, we put forward a document-level entity mask method with type information (DEMMT), which masks each mention of the entities by special tokens. By using this entity mask method, the model can accurately obtain every mention and type of the entities. Based on DEMMT, we propose a BERT-based one-pass model, through which we can predict the relationships among the entities by processing the text once. We test the proposed model on the DocRED dataset, which is a large scale open-domain document-level relation extraction dataset. The results on the manually annotated part of DocRED show that our approach obtains 6% F1 improvement compared with the state-of-the-art models that do not use pre-trained models and has 2% F1 improvement than BERT which does not use the DEMMT. On the distant supervision generated part of DocRED, the improvement of F1 is 2% compared with no pre-trained models, and 5% compared with pure BERT.
Relation extraction is a vital task in natural language processing. It aims to identify the relationship between two specified entities in a sentence. Besides information contained in the sentence, additional information about the entities is verified to be helpful in relation extraction. Additional information such as entity type getting by NER (Named Entity Recognition) and description provided by knowledge base both have their limitations. Nevertheless, there exists another way to provide additional information which can overcome these limitations in Chinese relation extraction. As Chinese characters usually have explicit meanings and can carry more information than English letters. We suggest that characters that constitute the entities can provide additional information which is helpful for the relation extraction task, especially in large scale datasets. This assumption has never been verified before. The main obstacle is the lack of large-scale Chinese relation datasets. In this paper, first, we generate a large scale Chinese relation extraction dataset based on a Chinese encyclopedia. Second, we propose an attention-based model using the characters that compose the entities. The result on the generated dataset shows that these characters can provide useful information for the Chinese relation extraction task. By using this information, the attention mechanism we used can recognize the crucial part of the sentence that can express the relation. The proposed model outperforms other baseline models on our Chinese relation extraction dataset.
Open data sources regarding conflicts are increasingly enriched by broad social media; these yield a volume of information that exceeds our process capabilities. One of the critical factors is that knowledge extraction from mixed data formats requires systematic, sophisticated modeling. Here, we propose using text mining modeling tools for building associations of heterogeneous semi-structured data to enhance decision-making. Using narrative plots, text representation, and cluster analysis, we provide a data association framework that can mine spatiotemporal data that occur in similar contexts. The framework contains the following steps: (1) a novel text representation is presented to vectorize the textual semantics by learning both co-word features and word orders in a unified form; (2) text clustering technology is employed to associate events of interest with similar events in historical logs, based solely on narrative plots of the events; and (3) the inferred activity procedure is visualized via an evolving spatiotemporal map through the Kriging algorithm. Our results demonstrate that the approach enables deeper discrimination into the trends underlying conflicts and possesses a narrative reasoning forward prediction with a precision of 0.4817, in addition to a high consistency with the conclusions of existing studies.