15 May 2019 in IEEE Access
Named entity recognition (NER) is one of the basic techniques in natural language processing tasks. Chinese NER is complicated and difficult which remains a major challenge. One of the main reasons is that the boundaries of entities in Chinese are blurred and closely related to word segmentation results. Previous studies for this task have broadly divided into two categories, word-based and character-based methods. However, the former class suffers from the word segmentation errors, and the latter cannot make full use of the information on multiple granularities. To address these problems, we investigate a new dynamic meta-embeddings method and apply it to Chinese NER task, which utilizes attention mechanism to combine features of both character and word granularity in embedding layer. The meta-embeddings created by our method are dynamic, data-specific and task-specific, since the meta-embeddings for same characters in different sentence sequences are distinct. The experiments on MSRA and LiteratureNER datasets validate the effectiveness of our model, and this method achieves the state-of-the-art results on LiteratureNER.
13 December 2019 in IEEE Access
Chinese Named Entity Recognition (Chinese NER) is an important task in Chinese natural language processing field. It is difficult to identify the boundary of entities because Chinese texts lack natural delimiters to separate words. For this task, two major methods can be distinguished by the model inputs, i.e., word-based model and character-based model. However, the word-based model relies on the result of the Chinese Word Segmentation (CWS), and the character-based model cannot utilize enough word-level information. In this paper, we propose a multi-granularity information fusion model (MIFM) for the Chinese NER task. We introduce a novel multi-granularity embedding layer that utilizes the attention mechanism and an information gate to fuse the character and word level features. The results of this embedding method are dynamic and data-specific because they are calculated based on different contexts. Moreover, we apply the reverse stacked LSTM layer to gain deep semantic information for a sequence. Experiments on two benchmark datasets, MSRA and ResumeNER, show that our approach can effectively improve the performance of Chinese NER.