31 March 2021 in British Journal of Educational Technology
3 January 2023 in Creativity Research Journal
Digital sandbox games such as Minecraft can be used to assess and support creativity. Doing so, however, requires an understanding of what is deemed creative in this game context. One approach is to understand how Minecrafters describe creativity in their communities, and how much those descriptions overlap with the established definitions of creativity in the literature. Based on prior work, we used a modified rubric for assessing a creative product in this study. We investigated the evaluation of a total of 52 Minecraft builds (i.e., structures that are created by the Minecrafters) from five YouTube videos. In addition to qualitatively coding the video transcripts, we also used natural language processing (NLP) for automatic coding of our data at scale. Our qualitative analysis of the YouTube transcripts revealed evidence for all but one dimension (i.e., humor) of the creativity rubric we used in our dataset. In addition, two new dimensions of creativity emerged in our qualitative coding process (i.e., realism and effort). Finally, the NLP model that we developed achieved about 80% accuracy in distinguishing the sentences that showed evidence of creativity. This study provides insights for research and educational practices of creativity in Minecraft or similar game or simulation environments.
8 May 2019 in Interactive Learning Environments
Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students used to capture the process of creating of an electronic textile mural project. While students’ understanding of computational concepts were only partially captured within the portfolios, their engagements with computational practices – such as debugging and iteration – were better highlighted. Much of this was due to the students’ existing communicative strategies themselves, both in terms of how precise they were in describing issues, as well as how they leveraged images and code to explain their process. Recommendations for designing more effective portfolio assessments are discussed, which include greater emphasis on creating shared classroom discourse, and leveraging students’ existing experiences with multimedia.
14 January 2021 in Computer Science Education
Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention. Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects. Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described. Findings: Students demonstrated stronger abilities to communicate about computation using text than visuals. They also reported under-assessed CT practices like debugging, iterating, and collaborating. Students of experienced e-textile teachers performed substantially better than those with novice e-textile teachers. Implications: Portfolios provide a viable addition to traditional performance or survey assessments and meet a need to promote communication skills.
31 March 2021 in British Journal of Educational Technology