Nina Singh

Ms. Nina Singh

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 July 2023 in JMIR Medical Education
Verified
Journal Article
Open access
ONOded Nov
Oded Nov
NSNina Singh
Nina Singh
DMDevin Mann
Devin Mann
Background: Chatbots are being piloted to draft responses to patient questions, but patients’ ability to distinguish between provider and chatbot responses and patients’ trust in chatbots’ functions are not well established. Objective: This study aimed to assess the feasibility of using ChatGPT (Chat Generative Pre-trained Transformer) or a similar artificial intelligence–based chatbot for patient-provider communication. Methods: A survey study was conducted in January 2023. Ten representative, nonadministrative patient-provider interactions were extracted from the electronic health record. Patients’ questions were entered into ChatGPT with a request for the chatbot to respond using approximately the same word count as the human provider’s response. In the survey, each patient question was followed by a provider- or ChatGPT-generated response. Participants were informed that 5 responses were provider generated and 5 were chatbot generated. Participants were asked—and incentivized financially—to correctly identify the response source. Participants were also asked about their trust in chatbots’ functions in patient-provider communication, using a Likert scale from 1-5. Results: A US-representative sample of 430 study participants aged 18 and older were recruited on Prolific, a crowdsourcing platform for academic studies. In all, 426 participants filled out the full survey. After removing participants who spent less than 3 minutes on the survey, 392 respondents remained. Overall, 53.3% (209/392) of respondents analyzed were women, and the average age was 47.1 (range 18-91) years. The correct classification of responses ranged between 49% (192/392) to 85.7% (336/392) for different questions. On average, chatbot responses were identified correctly in 65.5% (1284/1960) of the cases, and human provider responses were identified correctly in 65.1% (1276/1960) of the cases. On average, responses toward patients’ trust in chatbots’ functions were weakly positive (mean Likert score 3.4 out of 5), with lower trust as the health-related complexity of the task in the questions increased. Conclusions: ChatGPT responses to patient questions were weakly distinguishable from provider responses. Laypeople appear to trust the use of chatbots to answer lower-risk health questions. It is important to continue studying patient-chatbot interaction as chatbots move from administrative to more clinical roles in health care.

6 September 2017 in The Journal of Antibiotics
Verified
Journal Article
Closed access
PDF file
NSNina Singh
Nina Singh
PYPamela J Yeh
Pamela J Yeh

3 September 2018 in npj Systems Biology and Applications
Verified
Journal Article
Open access
PDF file
ETElif Tekin
Elif Tekin
CWCynthia White
Cynthia White
TKTina Manzhu Kang
Tina Manzhu Kang
NSNina Singh
Nina Singh
MCMauricio Cruz-Loya
Mauricio Cruz-Loya
PYPamela J. Yeh
Pamela J. Yeh
Interactions and emergent processes are essential for research on complex systems involving many components. Most studies focus solely on pairwise interactions and ignore higher-order interactions among three or more components. To gain deeper insights into higher-order interactions and complex environments, we study antibiotic combinations applied to pathogenic Escherichia coli and obtain unprecedented amounts of detailed data (251 two-drug combinations, 1512 three-drug combinations, 5670 four-drug combinations, and 13608 five-drug combinations). Directly opposite to previous assumptions and reports, we find higher-order interactions increase in frequency with the number of drugs in the bacteria’s environment. Specifically, as more drugs are added, we observe an elevated frequency of net synergy (effect greater than expected based on independent individual effects) and also increased instances of emergent antagonism (effect less than expected based on lower-order interaction effects). These findings have implications for the potential efficacy of drug combinations and are crucial for better navigating problems associated with the combinatorial complexity of multi-component systems.

13 February 2025 in Journal of Medical Internet Research
Verified
Journal Article
Open access
TMTamir Mendel
Tamir Mendel
NSNina Singh
Nina Singh
DMDevin M Mann
Devin M Mann
BWBatia Wiesenfeld
Batia Wiesenfeld
ONOded Nov
Oded Nov
Background: Laypeople have easy access to health information through large language models (LLMs), such as ChatGPT, and search engines, such as Google. Search engines transformed health information access, and LLMs offer a new avenue for answering laypeople’s questions. Objective: We aimed to compare the frequency of use and attitudes toward LLMs and search engines as well as their comparative relevance, usefulness, ease of use, and trustworthiness in responding to health queries. Methods: We conducted a screening survey to compare the demographics of LLM users and nonusers seeking health information, analyzing results with logistic regression. LLM users from the screening survey were invited to a follow-up survey to report the types of health information they sought. We compared the frequency of use of LLMs and search engines using ANOVA and Tukey post hoc tests. Lastly, paired-sample Wilcoxon tests compared LLMs and search engines on perceived usefulness, ease of use, trustworthiness, feelings, bias, and anthropomorphism. Results: In total, 2002 US participants recruited on Prolific participated in the screening survey about the use of LLMs and search engines. Of them, 52% (n=1045) of the participants were female, with a mean age of 39 (SD 13) years. Participants were 9.7% (n=194) Asian, 12.1% (n=242) Black, 73.3% (n=1467) White, 1.1% (n=22) Hispanic, and 3.8% (n=77) were of other races and ethnicities. Further, 1913 (95.6%) used search engines to look up health queries versus 642 (32.6%) for LLMs. Men had higher odds (odds ratio [OR] 1.63, 95% CI 1.34-1.99; P<.001) of using LLMs for health questions than women. Black (OR 1.90, 95% CI 1.42-2.54; P<.001) and Asian (OR 1.66, 95% CI 1.19-2.30; P<.01) individuals had higher odds than White individuals. Those with excellent perceived health (OR 1.46, 95% CI 1.1-1.93; P=.01) were more likely to use LLMs than those with good health. Higher technical proficiency increased the likelihood of LLM use (OR 1.26, 95% CI 1.14-1.39; P<.001). In a follow-up survey of 281 LLM users for health, most participants used search engines first (n=174, 62%) to answer health questions, but the second most common first source consulted was LLMs (n=39, 14%). LLMs were perceived as less useful (P<.01) and less relevant (P=.07), but elicited fewer negative feelings (P<.001), appeared more human (LLM: n=160, vs search: n=32), and were seen as less biased (P<.001). Trust (P=.56) and ease of use (P=.27) showed no differences. Conclusions: Search engines are the primary source of health information; yet, positive perceptions of LLMs suggest growing use. Future work could explore whether LLM trust and usefulness are enhanced by supplementing answers with external references and limiting persuasive language to curb overreliance. Collaboration with health organizations can help improve the quality of LLMs’ health output.

5 July 2020 in Ecology Letters
Verified
Journal Article
Closed access
ETElif Tekin
Elif Tekin
EDEleanor S Diamant
Eleanor S Diamant
MCMauricio Cruz-Loya
Mauricio Cruz-Loya
VEVivien Enriquez
Vivien Enriquez
NSNina Singh
Nina Singh
PYPamela J Yeh
Pamela J Yeh

27 July 2023 in JMIR Human Factors
Verified
Journal Article
Open access
KLKatharine Lawrence
Katharine Lawrence
NSNina Singh
Nina Singh
ZJZoe Jonassen
Zoe Jonassen
LGLisa L Groom
Lisa L Groom
VAVeronica Alfaro Arias
Veronica Alfaro Arias
GDGraham Dove
Graham Dove
Background: Remote patient monitoring (RPM) technologies can support patients living with chronic conditions through self-monitoring of physiological measures and enhance clinicians’ diagnostic and treatment decisions. However, to date, large-scale pragmatic RPM implementation within health systems has been limited, and understanding of the impacts of RPM technologies on clinical workflows and care experience is lacking. Objective: In this study, we evaluate the early implementation of operational RPM initiatives for chronic disease management within the ambulatory network of an academic medical center in New York City, focusing on the experiences of “early adopter” clinicians and patients. Methods: Using a multimethod qualitative approach, we conducted (1) interviews with 13 clinicians across 9 specialties considered as early adopters and supporters of RPM and (2) speculative design sessions exploring the future of RPM in clinical care with 21 patients and patient representatives, to better understand experiences, preferences, and expectations of pragmatic RPM use for health care delivery. Results: We identified themes relevant to RPM implementation within the following areas: (1) data collection and practices, including impacts of taking real-world measures and issues of data sharing, security, and privacy; (2) proactive and preventive care, including proactive and preventive monitoring, and proactive interventions and support; and (3) health disparities and equity, including tailored and flexible care and implicit bias. We also identified evidence for mitigation and support to address challenges in each of these areas. Conclusions: This study highlights the unique contexts, perceptions, and challenges regarding the deployment of RPM in clinical practice, including its potential implications for clinical workflows and work experiences. Based on these findings, we offer implementation and design recommendations for health systems interested in deploying RPM-enabled health care.