Negation and speculation are universal linguistic phenomena that affect the performance of Natural Language Processing (NLP) applications, such as those for opinion mining and information retrieval, especially in biomedical data. In this article, we review the corpora annotated with negation and speculation in various natural languages and domains. Furthermore, we discuss the ongoing research into recent rule-based, supervised, and transfer learning techniques for the detection of negating and speculative content. Many English corpora for various domains are now annotated with negation and speculation; moreover, the availability of annotated corpora in other languages has started to increase. However, this growth is insufficient to address these important phenomena in languages with limited resources. The use of cross-lingual models and translation of the well-known languages are acceptable alternatives. We also highlight the lack of consistent annotation guidelines and the shortcomings of the existing techniques, and suggest alternatives that may speed up progress in this research direction. Adding more syntactic features may alleviate the limitations of the existing techniques, such as cue ambiguity and detecting the discontinuous scopes. In some NLP applications, inclusion of a system that is negation- and speculation-aware improves performance, yet this aspect is still not addressed or considered an essential step.
16 July 2024 in IEEE Open Journal of the Computer Society
Colorectal cancer (CRC) is the second leading cause of cancer-related mortality. Precise diagnosis of CRC plays a crucial role in increasing patient survival rates and formulating effective treatment strategies. Deep learning algorithms have demonstrated remarkable proficiency in the precise categorization of histopathology images. In this paper, we introduce a novel deep learning model, termed DeepCon which incorporates the divide-and-conquer principle into the classification task. DeepCon has been methodically conceived to scrutinize the influence of acquired composition on the learning process, with a specific application to the classification of histology images related to CRC. Our model harnesses pre-trained networks to extract features from both the source and target domains, employing a two-stage transfer learning approach encompassing multiple loss functions. Our transfer learning strategy exploits a learned composition of decomposed images to enhance the transferability of extracted features. The efficacy of the proposed model was assessed using a clinically valid dataset of 5000 CRC images. The experimental results reveal that DeepCon when coupled with the Xception network as the backbone model and subjected to extensive fine-tuning, achieved a remarkable accuracy rate of 98.4% and an F1 score of 98.4%
The research in detecting the negation in Arabic is limited due to the unavailability of Arabic corpora targeting this phenomenon. The negation detection affects a set of subfields in the Arabic Natural Language Processing (ANLP), including sentiment analysis and medical information retrieval. Therefore, a corpus is manually annotated with negation for targeting this deficiency in the Modern Standard Arabic (MSA) and Classical Arabic (CA) texts. This corpus is collected from various sources, including King Saud University Corpus of Classical Arabic (KSUCCA) and Wikipedia. It includes texts from various topics, like religion, sports, science, biography, health, technology, education, and history. In addition, we propose a supervised-based learning system for the problem of negation scope detection in Arabic texts. Our system depends on Word2Vec and FastText word embeddings with two different classifiers: the Bidirectional Long Short-Term Memory (BiLSTM) and the Support Vector Machined (SVM) as a baseline system. The results show that one of the FastText-BiLSTM based models achieved a classification accuracy of 93% with F1 score of 89%. The fact that the results of the supervised learning are encouraging further proves the point that the treatment of the negation phenomenon is tractable.
7 March 2023 in International Journal of Intelligent Computing and Information Sciences
Detecting the negation and speculation linguistic phenomena is vital for the performance of Arabic Natural Language Processing (ANLP) tasks. The negation and speculation scope detection problems have been addressed in a number of studies where most of them focused on the English and Spanish languages. This is due to the lack of corpora annotated for negation and speculation. In this work, the ArNeg corpus, annotated with negation, is extended by annotating it for the speculation to build the ArNegSpec corpus. In addition, we propose a transformer-based learning approach for detecting both the negation and speculation in Arabic texts. The AraBERT models with a Bidirectional Long Short-Term Memory and a Conditional Random Field (BiLSTM-CRF) as a sequence classification layer to achieve this goal. The results reached an F1 measure of 98% for cue identification for both negation and speculation. The proposed approach enhanced the evaluation results of the negation scope detection by 6% in terms of the F1 measure compared to the previous study. Furthermore, it achieved a 95% F1 measure for the speculation scope detection and a PCS value of 96% for both the negation and speculation scope. This approach shows the feasibility of transformer-based learning models in the sequence classification tasks as the detection of the negation and speculation in Arabic.
24 August 2019 in Advances in Intelligent Systems and Computing