Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Conversational assistants, such as Apple’s Siri, Amazon’s Alexa, and Google Assistant, are ubiquitous, and are beginning to be used as portals for medical services. However, the potential safety issues of using conversational assistants for medical information by patients and consumers are not understood. Objective: To determine the prevalence and nature of harm that could result from patients or consumers using conversational assistants for medical information. Methods: Participants were given medical problems to pose to Siri, Alexa, or Google Assistant, and asked to determine an action to take based on information from the system. Assignment of tasks and systems were randomized across participants, and participants queried the conversational assistants in their own words, making as many attempts as needed, until they either reported an action to take or gave up. Participant reported actions for each medical task were rated for patient harm using an AHRQ harm scale. Results: Fifty-four (54) subjects completed the study. Subjects were on average 41.5±17.7 years old, 53.7% female, 57.4% Caucasian, 50.0% college educated. Only 14.8% reported using a conversational assistant regularly, 40.7% had never used one, and 44.4% had tried one “a few times”, while 81.5% reported using computers regularly. Subjects were only able to complete 42.6% (168) of their 394 tasks, but of those, 29.2% (49) of reported actions could have resulted in some degree of patient harm, including 16.1% (27) that could have resulted in death. Conclusions: Reliance on conversational assistants for actionable medical information represents a safety risk for patients and consumers. Patients should be cautioned to not use these technologies for answers to medical questions they intend to act on without further consultation from a healthcare provider. Clinical Trial: N/A