20 February 2018 in IEEE Transactions on Learning Technologies
In recent years, computerized adaptive testing (CAT) has gained popularity as an important means to evaluate students' ability. Assigning tags to test questions is crucial in CAT. Manual tagging is widely used for constructing question banks; however, this approach is time-consuming and might lead to consistency issues. Automatic question tagging, an alternative, has not been studied extensively. In this paper, we propose a position-based attention model and keywords-based model to automatically tag questions with knowledge units. With regard to multiple-choice questions, the proposed models employ mechanisms to capture useful information from keywords to enhance tagging performance. Unlike traditional machine learning-based tagging methods, our models utilize deep neural networks to represent questions using contextual information. The experimental results show that our proposed models outperform some traditional classification and topic methods by a large margin on an English question bank dataset.
27 April 2020 in IEEE Transactions on Learning Technologies
Reading comprehension tasks are commonly used for developing students' reading ability. In order to adaptively recommend reading comprehension materials to students engaged in computerized testing, the information in an item bank (a collection of test items stored in a dataset) must be effectively indexed. Familiarity with the topics present in the documents influences students' reading performance. As different question types require different skills, we tag documents with topics and questions with their corresponding types to measure the students' abilities and subsequently recommend relevant materials to them. However, automatic tagging has not been extensively studied in this field. In this paper, we propose a document extraction attention network (DEAN) to accomplish the two aforementioned tasks. For topic tagging, DEAN utilizes questions to increase the sample size of documents implicitly through multi-task learning (MTL). For type tagging, DEAN leverages the information gathered from documents, which aids in the task of prediction. Experiments demonstrate the effectiveness of our mutual use of information obtained from documents and questions. Results indicate that DEAN outperforms commonly used text classification methods when tested on a reading comprehension dataset.