This study explores the potential of the large language model GPT-4 as an automated tool for qualitative data analysis by educational researchers, exploring which techniques are most successful for different types of constructs. Specifically, we assess three different prompt engineering strategies — Zero-shot, Few-shot, and Few-shot with contextual information — as well as the use of embeddings. We do so in the context of qualitatively coding three distinct educational datasets: Algebra I semi-personalized tutoring session transcripts, student observations in a game-based learning environment, and debugging behaviours in an introductory programming course. We evaluated the performance of each approach based on its inter-rater agreement with human coders and explored how different methods vary in effectiveness depending on a construct’s degree of clarity, concreteness, objectivity, granularity, and specificity. Our findings suggest that while GPT-4 can code a broad range of constructs, no single method consistently outperforms the others, and the selection of a particular method should be tailored to the specific properties of the construct and context being analyzed. We also found that GPT-4 has the most difficulty with the same constructs than human coders find more difficult to reach inter-rater reliability on.
Monitoring variables such as dissolved oxygen, pH, and pond temperature is a key aspect of high-quality fish farming. Machine learning (ML) techniques have been proposed to model the dynamics of such variables to improve the fish farmer’s decision-making. Most of the research on ML in aquaculture has focused on scenarios where devices for real-time data acquisition, storage, and remote monitoring are available, making it easy to develop accurate ML techniques. However, fish farmers do not necessarily have access to such devices. Many of them prefer to use equipment to manually measure these variables limiting the amount of available data to process. In this work, we study the use of random forests, multivariate linear regression, and artificial neural networks in scenarios with limited amount of measurements to analyze data from water-quality variables that are commonly measured in fish farming. We propose a methodology to build models in two scenarios: i) estimation of unobserved variables based on the observed ones, and ii) forecasting when a low amount of data is available for training. We show that random forests can be used to forecast dissolved oxygen, pond temperature, pH, ammonia, and ammonium when the water pond variables are measured only twice per day. Moreover, we showed that these prediction models can be implemented on a mobile-based information system and run in an average smartphone that fish farmers can afford.