6 January 2019 in Journal of Open Source Education
Nbgrader is a flexible tool for creating and grading assignments in the Jupyter Notebook (Kluyver et al., 2016). nbgrader allows instructors to create a single, master copy of an assignment, including tests and canonical solutions. From the master copy, a student version is generated without the solutions, thus obviating the need to maintain two separate versions. nbgrader also automatically grades submitted assignments by executing the notebooks and storing the results of the tests in a database. After auto-grading, instructors can manually grade free responses and provide partial credit using the formgrader Jupyter Notebook extension. Finally, instructors can use nbgrader to leave personalized feedback for each student's submission, including comments as well as detailed error information.
1 July 2021 in Journal of Experimental Psychology: General
The explosion of data generated during human interactions online presents an opportunity for psychologists to evaluate cognitive models outside the confines of the laboratory. Moreover, the size of these online data sets can allow researchers to construct far richer models than would be feasible with smaller in-lab behavioral data. In the current article, we illustrate this potential by evaluating 3 popular psychological models of generalization on 2 web-scale online data sets typically used to build automated recommendation systems. We show that each psychological model can be efficiently implemented at scale and in certain cases can capture trends in human judgments that standard recommendation systems from machine learning miss. We use these results to illustrate the opportunity Internet-scale data sets offer to psychologists and to underscore the importance of using insights from cognitive modeling to supplement the standard predictive-analytic approach taken by many existing machine learning approaches. (PsycInfo Database Record (c) 2020 APA, all rights reserved).