Word embeddings that provide continuous low-dimensional vector representations of words have been extensively used for various natural language processing tasks. However, existing context-based word embeddings such as Word2vec and GloVe typically fail to capture sufficient sentiment information, which may result in words with similar vector representations having an opposite sentiment polarity (e.g., good and bad), thus degrading sentiment analysis performance. To tackle this problem, recent studies have suggested learning sentiment embeddings to incorporate the sentiment polarity (positive and negative) information from labeled corpora. This study adopts another strategy to learn sentiment embeddings. Instead of creating a new word embedding from labeled corpora, we propose a word vector refinement model to refine existing pretrained word vectors using real-valued sentiment intensity scores provided by sentiment lexicons. The idea of the refinement model is to improve each word vector such that it can be closer in the lexicon to both semantically and sentimentally similar words (i.e., those with similar intensity scores) and further away from sentimentally dissimilar words (i.e., those with dissimilar intensity scores). An obvious advantage of the proposed method is that it can be applied to any pretrained word embeddings. In addition, the intensity scores can provide more fine-grained (real-valued) sentiment information than binary polarity labels to guide the refinement process. Experimental results show that the proposed refinement model can improve both conventional word embeddings and previously proposed sentiment embeddings for binary, ternary, and fine-grained sentiment classification on the SemEval and Stanford Sentiment Treebank datasets.
11 December 2019 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Dimensional sentiment analysis aims to recognize continuous numerical values in multiple dimensions such as the valence-arousal (VA) space. Compared to the categorical approach that focuses on sentiment classification such as binary classification (i.e., positive and negative), the dimensional approach can provide a more fine-grained sentiment analysis. This study proposes a tree-structured regional CNN-LSTM model consisting of two parts: regional CNN and LSTM to predict the VA ratings of texts. Unlike a conventional CNN which considers a whole text as input, the proposed regional CNN uses a part of the text as a region, dividing an input text into several regions such that the useful affective information in each region can be extracted and weighted according to their contribution to the VA prediction. Such regional information is sequentially integrated across regions using LSTM for VA prediction. By combining the regional CNN and LSTM, both local (regional) information within sentences and long-distance dependencies across sentences can be considered in the prediction process. To further improve performance, a region division strategy is proposed to discover task-relevant phrases and clauses to incorporate structured information into VA prediction. Experimental results on different corpora show that the proposed method outperforms lexicon-, regression-, conventional NN and other structured NN methods proposed in previous studies.
Massive open online courses (MOOCs) have recently gained worldwide attention from educational institutes. MOOCs provide a new option for learning, yet measurable learning benefits of MOOCs still need to be investigated. Collecting data of three MOOCs at Yuan Ze University (YZU), this paper intended to classify learning behaviors among 1489 students on the MOOC platform at YZU. This study further examined learning outcomes in MOOCs by different types of learners. The Ward’s hierarchical and k-means non-hierarchical clustering methods were employed to classify types of learners’ behavior while they engaged in learning activities on the MOOC platform. Three types of MOOC learners were classified—active learner, passive learner, and bystander. Active learners who submitted assignments on time and frequently watched lecture videos showed a higher completion rate and a better grade in the course. MOOC learners who participated in online discussion forum reported a higher rate of passing the course and a better score than those inactive classmates. The finding of this study suggested that the first 2 weeks was a critical point of time to retain students in MOOCs. MOOC instructors need to carefully design course and detect risk behaviors of students in early of the classes to prevent students from dropping out of the course. The feature design of discussion forum is to provide peer interaction and facilitate online learning. Our results suggested that timely feedback by instructors or facilitators on discussion forum could enhance students’ engagement in MOOCs.
This paper presents an epidemiologic study of appendicitis in Taiwan over a twelve-year period. An analysis of the incidence in the low-income population (LIP) is included to explore the effects of lower socioeconomic status on appendicitis. We analyzed the epidemiological features of appendicitis in Taiwan using data from the National Health Insurance Research Database (NHIRD) from 2000 to 2011. All cases diagnosed as appendicitis were enrolled. The overall incidences of appendicitis, primary appendectomy, and perforated appendicitis were 107.76, 101.58, and 27.20 per 100,000 per year, respectively. The highest incidence of appendicitis was found in persons aged 15 to 29 years; males had higher rates of appendicitis than females at all ages except for 70 years and older. Appendicitis rates were 11.76 % higher in the summer than in the winter months. A multilevel analysis with hierarchical linear modeling (HLM) revealed that male patients, younger patients (aged ≤14 years), and elderly patients (aged ≥60 years) had a higher risk of perforated appendicitis; among adults, the incidence increased with age. Moreover, the risk of perforation was higher in patients with one or more comorbidities. LIP patients comprised 1.25 % of the total number of patients with appendicitis from 2000 to 2011. The overall incidence of appendicitis was 34.99 % higher in the LIP than in the normal population (NP), and the incidence of perforated appendicitis was 40.40 % higher in the LIP than in the NP. After multivariate adjustment, the adjusted hospital costs and length of hospital stay (LOS) for the LIP patients were higher than those for the NP patients. Appendicitis and appendectomy in Taiwan had similar overall incidences, seasonality patterns, and declining trends compared to numerous previous studies. Compared to NP patients, LIP patients had a higher risk of appendicitis, longer LOS and higher hospital costs as a result of appendectomy.