Peter W. Foltz

Peter W. Foltz

Auto-generated profile, based on publicly available information

Peter W. Foltz

University of Colorado

Research Focus & Metrics

Academic Career Length

33Years (1994-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

26 May 2022 in Schizophrenia Bulletin
Verified
Journal Article
Open access
PDF file
CCChelsea Chandler
Chelsea Chandler
PFPeter W Foltz
Peter W Foltz
BEBrita Elvevåg
Brita Elvevåg
Objectives: Machine learning (ML) and natural language processing have great potential to improve efficiency and accuracy in diagnosis, treatment recommendations, predictive interventions, and scarce resource allocation within psychiatry. Researchers often conceptualize such an approach as operating in isolation without much need for human involvement, yet it remains crucial to harness human-in-the-loop practices when developing and implementing such techniques as their absence may be catastrophic. We advocate for building ML-based technologies that collaborate with experts within psychiatry in all stages of implementation and use to increase model performance while simultaneously increasing the practicality, robustness, and reliability of the process.Methods: We showcase pitfalls of the traditional ML framework and explain how it can be improved with human-in-the-loop techniques. Specifically, we applied active learning strategies to the automatic scoring of a story recall task and compared the results to a traditional approach.Results: Human-in-the-loop methodologies supplied a greater understanding of where the model was least confident or had knowledge gaps during training. As compared to the traditional framework, less than half of the training data were needed to reach a given accuracy.Conclusions: Human-in-the-loop ML is an approach to data collection and model creation that harnesses active learning to select the most critical data needed to increase a model’s accuracy and generalizability more efficiently than classic random sampling would otherwise allow. Such techniques may additionally operate as safeguards from spurious predictions and can aid in decreasing disparities that artificial intelligence systems otherwise propagate.

28 September 2024
Verified
Book Chapter
Closed access
PDF file
KŁKacper Łodzikowski
Kacper Łodzikowski
PFPeter W. Foltz
Peter W. Foltz
JBJohn T. Behrens
John T. Behrens

1 January 2021
Verified
Conference Paper
Open access
PDF file
SSSagarika Shreevastava
Sagarika Shreevastava
PFPeter Foltz
Peter Foltz
Sagarika Shreevastava, Peter Foltz. Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access. 2021.

22 September 2022 in Schizophrenia Research
Verified
Journal Article
Open access
PFPeter W. Foltz
Peter W. Foltz
CCChelsea Chandler
Chelsea Chandler
CDCatherine Diaz-Asper
Catherine Diaz-Asper
ACAlex S. Cohen
Alex S. Cohen
ZRZachary Rodriguez
Zachary Rodriguez
BEBrita Elvevåg
Brita Elvevåg
Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions that we want to assess. In this paper we reflect on two decades of experience with the application of language-based assessment to patients' mental state and cognitive function by addressing the questions of what we are measuring, how it should be measured and why we are measuring the phenomena. We address the questions by advocating for a principled framework for aligning computational models to the constructs being assessed and the tasks being used, as well as defining how those constructs relate to patient clinical states. We further examine the assumptions that go into the computational models and the effects that model design decisions may have on the accuracy, bias and generalizability of models for assessing clinical states. Finally, we describe how this principled approach can further the goal of transitioning language-based computational assessments to part of clinical practice while gaining the trust of critical stakeholders.

14 October 2023
Verified
Conference Paper
Open access
TBThomas Breideband
Thomas Breideband
JBJeffrey Bush
Jeffrey Bush
CCChelsea Chandler
Chelsea Chandler
MCMichael Chang
Michael Chang
RDRachel Dickler
Rachel Dickler
SDSidney D'MEllo
Sidney D'MEllo
The use of Artificial Intelligence (AI) in K-12 education is showing considerable promise to enhance student learning, yet existing tools continue to situate AI tutoring firmly within the context of one-on-one instruction and personalized learning. As HCI, learning science, and team science researchers we envision AI to help students become better collaborators—a highly valued skill for their lives after school. In this demonstration we present “CoBi”—a multi-party AI partner that focuses on the relationship dimension of collaboration. CoBi helps students to co-negotiate classroom agreements along four dimensions: respect, equity, community, and thinking. CoBi then uses state-of-the-art speech and language technologies to look for and visualize evidence of these agreements as they occur during small group student talk. Through these feedback visualizations, students can hone collaboration skills, collaboratively reflect about and identify areas for improvement, and develop critical AI literacy skills.