While visual literacy has been identified as a foundational skill in life science education, there are many challenges in teaching and assessing biomolecular visualization skills. Among these are the lack of consensus about what constitutes competence and limited understanding of student and instructor perceptions of visual literacy tasks. In this study, we administered a set of biomolecular visualization assessments, developed as part of the BioMolViz project, to both students and instructors at multiple institutions and compared their perceptions of task difficulty. We then analyzed our findings using a mixed-methods approach. Quantitative analysis was used to answer the following research questions: (1) Which assessment items exhibit statistically significant disparities or agreements in perceptions of difficulty between instructors and students? (2) Do these perceptions persist when controlling for race/ethnicity and gender? and (3) How does student perception of difficulty relate to performance? Qualitative analysis of open-ended comments was used to identify predominant themes related to visual problem solving. The results show that perceptions of difficulty significantly differ between students and instructors and that students’ performance is a significant predictor of their perception of difficulty. Overall, this study underscores the need to incorporate deliberate instruction in visualization into undergraduate life science curricula to improve student ability in this area. Accordingly, we offer recommendations to promote visual literacy skills in the classroom.
14 July 2024 in Biochemistry and Molecular Biology Education
A critical skill that biochemistry students must develop is the interpretation of molecular images, ranging from macromolecular representations to the chemical structures of the building blocks that comprise them. Such analysis requires biomolecular visual literacy, which is not often explicitly taught, and can be challenging for instructors to assess. In this work, we examine student responses to assessments designed to probe biomolecular visual literacy. Analysis of sets of assessments with classical test theory indicates that items which have undergone an iterative validation process, including expert review, perform well in classroom testing. However, the evaluation of multiple-choice and multiple-select assessment items based on classroom testing alone has limitations. Therefore, semistructured student interviews were used to explore student approaches to molecular visualization problem solving. Qualitative analysis of interview transcripts identified several common strategies among students when solving image-based questions, including relying on color in the images to answer questions, drawing on familiar terminology in the prompt, and using process-of-elimination to identify the best answer. Image complexity was identified as a common challenge for students. Instructors can craft more effective assessments by paying careful attention to the use of color in images, using terminology students are familiar with, carefully creating distractors, and using images with complexity appropriate to the learner level. This work underscores the importance of the student perspective in the design of assessments used by educators to evaluate learning.