Hadley Stevens Smith

Dr. Hadley Stevens Smith

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 October 2021 in The Patient - Patient-Centered Outcomes Research
Verified
Journal Article
Closed access
PDF file
HSHadley Stevens Smith
Hadley Stevens Smith
SMStephanie R. Morain
Stephanie R. Morain
JRJill Oliver Robinson
Jill Oliver Robinson
ICIsabel Canfield
Isabel Canfield
JMJanet Malek
Janet Malek
AMAmy L. McGuire
Amy L. McGuire

7 March 2022 in Nature Genetics
Verified
Journal Article
Closed access
PDF file
MHMeghan C. Halley
Meghan C. Halley
HSHadley Stevens Smith
Hadley Stevens Smith
EAEuan A. Ashley
Euan A. Ashley
AGAaron J. Goldenberg
Aaron J. Goldenberg
HTHolly K. Tabor
Holly K. Tabor

16 September 2024 in The American Journal of Human Genetics
Verified
Journal Article
Closed access
HSHadley Stevens Smith
Hadley Stevens Smith
BZBethany Zettler
Bethany Zettler
CGCasie A. Genetti
Casie A. Genetti
MHMadison R. Hickingbotham
Madison R. Hickingbotham
TCTanner F. Coleman
Tanner F. Coleman
RGRobert C. Green
Robert C. Green

27 April 2020 in Genetics in Medicine
Verified
Journal Article
Closed access
PDF file
HSHadley Stevens Smith
Hadley Stevens Smith
JSJohn M. Swint
John M. Swint
SLSeema R. Lalani
Seema R. Lalani
MOMarcia C. de Oliveira Otto
Marcia C. de Oliveira Otto
JYJose-Miguel Yamal
Jose-Miguel Yamal
BLBrendan H. Lee
Brendan H. Lee

10 June 2025 in JMIR Cancer
Verified
Journal Article
Open access
ECEmma Coen
Emma Coen
GFGuilherme Del Fiol
Guilherme Del Fiol
KKKimberly A. Kaphingst
Kimberly A. Kaphingst
EBEmerson Borsato
Emerson Borsato
JSJackilen Shannon
Jackilen Shannon
CACaitlin Allen
Caitlin Allen
The increasing demand for population-wide genomic screening and the limited availability of genetic counseling resources have created a pressing need for innovative service delivery models. Chatbots powered by large language models (LLMs) have shown potential in genomic services, particularly in pretest counseling, but their application in returning positive population-wide genomic screening results remains underexplored. Leveraging advanced LLMs like GPT-4 offers an opportunity to address this gap by delivering accurate, contextual, and user-centered communication to individuals receiving positive genetic test results. This project aimed to design, implement, and evaluate a chatbot integrated with GPT-4, tailored to support the return of positive genomic screening results in the context of South Carolina’s In Our DNA SC program. This initiative offers free genetic screening to 100,000 individuals, with over 33,000 results returned and numerous positive findings for conditions such as Lynch syndrome, hereditary breast and ovarian cancer syndrome, and familial hypercholesterolemia. A 3-step prompt engineering process using retrieval-augmented generation and few-shot techniques was used to create the chatbot. Training materials included patient frequently asked questions, genetic counseling scripts, and patient-derived queries. The chatbot underwent iterative refinement based on 13 training questions, while performance was evaluated through expert ratings on responses to 2 hypothetical patient scenarios. The 2 scenarios were intended to represent common but distinct patient profiles in terms of gender, race, ethnicity, age, and background knowledge. Domain experts rated the chatbot using a 5-point Likert scale across 8 predefined criteria: tone, clarity, program accuracy, domain accuracy, robustness, efficiency, boundaries, and usability. The chatbot achieved an average score of 3.86 (SD 0.89) across all evaluation metrics. The highest-rated criteria were tone (mean 4.25, SD 0.71) and usability (mean 4.25, SD 0.58), reflecting the chatbot’s ability to communicate effectively and provide a seamless user experience. Boundary management (mean 4.0, SD 0.76) and efficiency (mean 3.88, SD 1.08) also scored well, while clarity and robustness received ratings of 3.81 (SD 1.05) and 3.81 (SD 0.66), respectively. Domain accuracy was rated 3.63 (SD 0.96), indicating satisfactory performance in delivering genetic information, whereas program accuracy received the lowest score of 3.25 (SD 1.39), highlighting the need for improvements in delivering program-specific details. This project demonstrates the feasibility of using LLM-powered chatbots to support the return of positive genomic screening results. The chatbot effectively handled open-ended patient queries, maintained conversational boundaries, and delivered user-friendly responses. However, enhancements in program-specific accuracy are essential to maximize its utility. Future research will explore hybrid chatbot designs that combine the strengths of LLMs with rule-based components to improve scalability, accuracy, and accessibility in genomic service delivery. The findings underscore the potential of generative artificial intelligence tools to address resource limitations and improve the accessibility of genomic health care services.

1 November 2021 in The American Journal of Human Genetics
Verified
Journal Article
Closed access
HSHadley Stevens Smith
Hadley Stevens Smith
KBKyle B. Brothers
Kyle B. Brothers
SKSara J. Knight
Sara J. Knight
SASara L. Ackerman
Sara L. Ackerman
CRChristine Rini
Christine Rini
JMJanet Malek
Janet Malek