Generative artificial intelligence poses new challenges around assessment, increasingly driving introductory programming educators to employ invigilated exams. But exams do not afford more authentic programming experiences that involve planning, implementing, and debugging programs with computer interaction. In this experience report, we describe code interviews: a more authentic assessment method for take-home programming assignments. Through action research, we experimented with the number and type of questions as well as whether interviews were conducted individually or with groups of students. To scale the program, we converted most of our weekly teaching assistant (TA) sections to conduct code interviews on 5 major weekly take-home programming assignments. By triangulating data from 5 sources, we identified 4 themes. Code interviews (1) pushed students to discuss their work, motivating more nuanced but sometimes repetitive insights; (2) enabled peer learning, reducing stress in some ways but increasing stress in other ways; (3) scaled with TA-led sections, replacing familiar practice with an unfamiliar assessment; (4) focused on student contributions, limiting opportunities for TAs to give guidance and feedback. We reflect on the design of code interviews for student experience, academic integrity, and teacher workload.
Why do instructors have the grading policies they do (e.g., rigid assignment deadlines, curved grading, exams with no "clobber" where a high performance on a later exam overwrites an earlier poor score, etc.)? Chances are, it's because that was the way (a) they were graded as a student, (b) the department expected, or (c) the previous instructor did it before they took over. Joe Feldman, in his outstanding book Grading for Equity, clearly articulates that the grading policies we employ have significant equity implications. Students whose pace of learning differs from the norm, or who are juggling a part-time job, family commitments, or a long commute sometimes need flexibility in their assignment deadlines to handle what life throws at them. Grading on a curve in introductory classes means that privileged students with prior preparation have a significant advantage. A clobber policy proudly declares that it's what you know at the end of the term that matters, not how you were able to perform at the early exam checkpoints, which favor students of privilege who may have seen some of the material before. There are other great suggestions-start thinking of "units of learning" instead of fungible "points", don't use grades to drive behavior, eliminate extra credit opportunities, etc. This panel brings together four educators who have restructured their classes through activities and grading policies in an attempt to achieve equitable outcomes. This forum will allow them to share their best practices, and encourage the audience to do the same.
Prior work has argued for a more justice-centered approach to postsecondary computing education by emphasizing ethics, identity, and political vision. In this experience report, we examine how postsecondary students of diverse gender and racial identities experience a justice-centered Data Structures and Algorithms designed for undergraduate non-computer science majors. Through a quantitative and qualitative analysis of two quarters of student survey data collected at the start and end of each quarter, we report on student attitudes and expectations. Across the class, we found a significant increase in the following attitudes: computing confidence and sense of belonging. While women, non-binary, and other students not identifying as men (WNB+) also increased in these areas, they still reported significantly lower confidence and sense of belonging than men at the end of the quarter. Black, Latinx, Middle Eastern and North African, Native American, and Pacific Islander (BLMNPI) students had no significant differences compared to white and Asian students. We also analyzed end-of-quarter student self-reflections on their fulfillment of expectations prior to taking the course. While the majority of students reported a positive overall sentiment about the course and many students specifically appreciated the justice-centered approach, some desired more practice with program implementation and interview preparation. We discuss implications for practice and articulate a political vision for holding both appreciation for computing ethics and a desire for professional preparation together through iterative design.
Elglaly et al. [2] argue for teaching accessible design not only in human–computer interaction courses but across the undergraduate computing curriculum. This poster provides a description and preliminary evaluation of a pedagogical approach to teaching accessible design in an undergraduate advanced Data Structures and Algorithms (DSA) course. Inspired by the idea that all technology is assistive, our approach aims to empower students to utilize their DSA content knowledge and skills to redesign software features to address design assumptions and improve technologies for all. Our approach uses the CIDER technique [1, 3] to identify a design assumption; design and implement an abstract data type to address the assumption; evaluate the abstract data type and implementations; before repeating this process to further improve the design. In our pilot offering of the course during Spring 2024, we integrated accessible design skills into 4 discussion sections led by teaching assistants as well as 2 multi-week software design and analysis projects. By the end of the course, we hoped students would feel more comfortable to: We chose to integrate this approach during discussion sections and projects rather than lecture because we viewed accessible design work in software engineering as integrating knowledge from across multiple lessons: section provided an opportunity for students to review all the concepts introduced in the preceding week while projects required students to practice applying it to real-world problems. The 4 discussion sections applied DSA content knowledge to implement accessibility features: a disability access service, augmentative and alternative communication, screen reader website navigation, and accessible shortest paths using data from Project Sidewalk [4]. The 2 multi-week software design and analysis projects also incorporated accessibility as a context. The first project utilized a dataset of website accessibility reports: students wrote code to identify the most common Web Content Accessibility Guidelines (WCAG) to address and then created a randomized testing framework to stress-test their data structures when given a large number of WCAG. The second project extended the discussion section on accessible shortest paths with algorithm engineering by engaging students to explain how they could redesign the project to allow users to choose whether to use the Project Sidewalk access scores when generating shortest paths navigation directions. This work-in-progress research aims to identify the elements of DSA content knowledge and accessible design skills that support critical student reflection on the impacts of their designs. We conducted pre- and post-surveys with 225 non-major students enrolled in the pilot offering of the course during Spring 2024. Data analysis is planned to begin after the conclusion of the course with preliminary insights expected by the time of poster presentation.
Traditional points-based grading can have negative impacts. As a result, many educators are experimenting with alternative grading practices that are more equitable for students. However, educators often face challenges in implementing equitable grading practices due to a lack of clear, practical descriptions of techniques and the fact that not all techniques are universally applicable. This working group addresses this problem using a three-pronged strategy: conducting a systematic literature review to gather documented techniques, compiling "recipes" or concrete descriptions of these techniques, and publishing them in an open-source, online "playbook" of equitable grading practices as a community resource for educators. This approach aims to make such practices more accessible and adaptable to various classroom situations.