The research presented in this paper shows how lab work can be organized into three phases: prelab, lab, and postlab, all supported by a Web-based experimental portal and a set of tools, some of which are connected to real lab devices. Different online tools and simulators are used in a flexible and configurable way that can be adapted to student curricula and course needs. This scenario is based upon real cases in distance learning courses in the Industrial Engineering School at the Universidad Nacional de Educacion (The Spanish Open University), Madrid, Spain. The details of the combined real and simulated activities are discussed and some conclusions and lessons learned from this work are presented.
16 October 2018 in IEEE Transactions on Learning Technologies
This article presents an innovative method to tackle the automatic evaluation of programming assignments with an approach based on well-founded assessment theories (Classical Test Theory (CTT) and Item Response Theory (IRT)) instead of heuristic assessment as in other systems. CTT and/or IRT are used to grade the results of different items of evidence obtained from students' results. The methodology consists in considering program proofs as items, calibrating them and obtaining the score using CTT and/or IRT procedures. These procedures measure overall validity reliability as well as diagnose the quality of each proof (item). The evidence is obtained through program proofs. The SIETTE system collects and processes all data to calculate the student knowledge level. This innovative method for programming task evaluation makes it possible to deploy the whole artillery developed in this research field over the last few decades. To the best of our knowledge, this is a new and original contribution in the area of programming assessment.
Students interact with each other in order to solve computer science programming assignments. Group work is encouraged because it has been proven to be beneficial to the learning process. However, sometimes, collaboration might be confused with dishonest behaviours. This article aimed to quantitatively discern between both cases. We collected code similarity measures from students over four academic years and analysed them using statistical and social network analyses. Three studies were carried out: an analysis of the knowledge flow to identify dishonest behaviour, an analysis of the structure of the social organisation of study groups and an assessment of the relationship between successful students and social behaviour. Continuous dishonest behaviour in students is not as alarming as many studies suggest, probably due to the strict control, automatic plagiarism detection and high penalties for unethical behaviour. The boundary between both is given by the amount of similar content and regularity along the course. Three types of study groups were identified. We also found that the best performing groups were not made up of the best individual students but of students with different levels of knowledge and stronger relationships. The best students were usually the central nodes of those groups.
This article describes a methodology for analysing the diffusion of scientific information into the social sphere, termed the ‘scientific knowledge percolation process’. The methodology was built using automated data collection and lexicon-based data mining techniques. We analysed literature from the scientific biotechnology community (158 journals in 2011; 29,892 articles generating 50,591 different keywords) and how it is perceived by users of the social media site Twitter (375,660 tweets with a subset classified by sentiment (positive, negative, and neutral) for a total of 33,900 tweets for 2012). We show that our method is able to provide data from which we can draw robust conclusions concerning the relationship between scientific and social media information. The study shows that the scientific production of our subset is socially perceived in a neutral manner although it is skewed towards the negative. Because sentiments are relevant for explaining the sharing behaviour of social media users, the results suggest that more attention needs to be paid towards the social perceptions of scientific research. We found that similar scientific concepts can be socially perceived in different ways, which may suggest that there is room for scientists to choose more ‘socially friendly’ descriptions.
28 May 2024 in IEEE Transactions on Learning Technologies
Automatic question generation and the assessment of procedural knowledge is still a challenging research topic. This article focuses on case of it, the techniques of parsing grammars for compiler construction. There are two well-known techniques for parsing: top-down parsing with LL(1) and bottom-up with LR(1). Learning these techniques and learning to design grammars that can be parsed with these techniques requires practice. This article describes an application that covers all the tasks needed to automatise the learning and assessment process: (1) automatically generate context-free languages and grammars of different complexity; (2) pose different types of questions to the student with an appropriate response interface; (3) automatically correct the student answer, including grammar design for a given language; (4) provide feedback on errors. The application has been implemented as a plug-in of the SIETTE assessment system that in addition, can provide adaptive behaviour for question selection. It has been successfully used by more than a thousand students for formative and summative assessment.
1 March 2016 in International Journal of Artificial Intelligence in Education
We review our research with DEGREE and analyse how our work has impacted the collaborative learning community since 2000. Our research is framed within the context of computer-based interaction analysis and the development of computer-supported collaborative learning (CSCL) tools. We identify some aspects of our work which have been followed up by other researchers and highlight some issues that remain pending. Finally we present a perspective of computer-based interaction analysis evolution in relation to a wider technological enhanced learning context.