2 January 2023 in Assessment in Education: Principles, Policy & Practice
With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning.
11 March 2019 in Information and Learning Sciences
Purpose: Many higher education institutions are investigating the possibility of developing predictive student success models that use different sources of data available to identify students that might be at risk of failing a course or program. The purpose of this paper is to review the methodological components related to the predictive models that have been developed or currently implemented in learning analytics applications in higher education. Design/methodology/approach: Literature review was completed in three stages. First, the authors conducted searches and collected related full-text documents using various search terms and keywords. Second, they developed inclusion and exclusion criteria to identify the most relevant citations for the purpose of the current review. Third, they reviewed each document from the final compiled bibliography and focused on identifying information that was needed to answer the research questions Findings: In this review, the authors identify methodological strengths and weaknesses of current predictive learning analytics applications and provide the most up-to-date recommendations on predictive model development, use and evaluation. The review results can inform important future areas of research that could strengthen the development of predictive learning analytics for the purpose of generating valuable feedback to students to help them succeed in higher education. Originality/value: This review provides an overview of the methodological considerations for researchers and practitioners who are planning to develop or currently in the process of developing predictive student success models in the context of higher education.
1 December 2023 in Computers in Human Behavior
1 May 2008 in Journal of Modern Applied Statistical Methods
The attribute hierarchy method (AHM) applied to assessment engineering is described. It is a psychometric method for classifying examinees’ test item responses into a set of attribute mastery patterns associated with different components in a cognitive model of task performance. Attribute probabilities, computed using a neural network, can be estimated for each examinee thereby providing specific information about the examinee’s attribute-mastery level. The pattern recognition approach described in this study relies on an explicit cognitive model to produce the expected response patterns. The expected response patterns serve as the input to the neural network. The model also yields the cognitive test specifications. These specifications identify the examinees’ attribute patterns which are used as output for the neural network. The purpose of the statistical pattern recognition analysis is to estimate the probability that an examinee possess specific attribute combinations based on their observed item response patterns. Two examples using student response data from a sample of algebra items on the SAT illustrate our pattern recognition approach.
4 June 2008 in BMC Medical Research Methodology
Symptoms tend to occur in what have been called symptom clusters. Early symptom cluster research was imprecise regarding the causal foundations of the coordinations between specific symptoms, and was silent on whether the relationships between symptoms remained stable over time. This study develops a causal model of the relationships between symptoms in cancer palliative care patients as they approach death, and investigates the changing associations among the symptoms and between those symptoms and well-being.