9 February 2024 in Journal of Bone and Joint Surgery
Background: In today’s digital age, patients increasingly rely on online search engines for medical information. The integration of large language models such as GPT-4 into search engines such as Bing raises concerns over the potential transmission of misinformation when patients search for information online regarding spine surgery. Methods: SearchResponse.io, a database that archives People Also Ask (PAA) data from Google, was utilized to determine the most popular patient questions regarding 4 specific spine surgery topics: anterior cervical discectomy and fusion, lumbar fusion, laminectomy, and spinal deformity. Bing’s responses to these questions, along with the cited sources, were recorded for analysis. Two fellowship-trained spine surgeons assessed the accuracy of the answers on a 6-point scale and the completeness of the answers on a 3-point scale. Inaccurate answers were re-queried 2 weeks later. Cited sources were categorized and evaluated against Journal of the American Medical Association (JAMA) benchmark criteria. Interrater reliability was measured with use of the kappa statistic. A linear regression analysis was utilized to explore the relationship between answer accuracy and the type of source, number of sources, and mean JAMA benchmark score. Results: Bing’s responses to 71 PAA questions were analyzed. The average completeness score was 2.03 (standard deviation [SD], 0.36), and the average accuracy score was 4.49 (SD, 1.10). Among the question topics, spinal deformity had the lowest mean completeness score. Re-querying the questions that initially had answers with low accuracy scores resulted in responses with improved accuracy. Among the cited sources, commercial sources were the most prevalent. The JAMA benchmark score across all sources averaged 2.63. Government sources had the highest mean benchmark score (3.30), whereas social media had the lowest (1.75). Conclusions: Bing’s answers were generally accurate and adequately complete, with incorrect responses rectified upon re-querying. The plurality of information was sourced from commercial websites. The type of source, number of sources, and mean JAMA benchmark score were not significantly correlated with answer accuracy. These findings underscore the importance of ongoing evaluation and improvement of large language models to ensure reliable and informative results for patients seeking information regarding spine surgery online amid the integration of these models in the search experience.
6 April 2023 in North American Spine Society Journal (NASSJ)
Google's People Also Ask feature uses various machine learning algorithms to distill the most frequently asked questions and link users to potential answers. The aim of this study is to investigate the most frequently asked questions related to commonly performed spine surgeries. This is an observational study utilizing Google's People Also Ask feature. A variety of search terms were entered into Google for anterior cervical discectomy and fusion (ACDF), discectomy, and lumbar fusion. Frequently asked questions and linked websites were extracted. Questions were categorized by topic based on Rothwell's Classification system, and websites were categorized by type. Pearson's chi-squared and Student t tests were performed as appropriate. A total of 576 unique questions (181 ACDF, 148 discectomy, 309 lumbar fusion) were extracted with 372 unique websites and 177 domains. The most common website types were medical practice (41%), social media (22%), and academic (15%). The most popular question topics were specific activities & restrictions (22%), technical details (23%), and evaluation of surgery (17%). Questions related to technical details were more common in discectomy vs lumbar fusion (33% vs 24%, p=.03) and lumbar fusion vs ACDF (24% vs 14%, p=.01). Questions related to specific activities & restrictions were more common in ACDF vs discectomy (17% vs 8%, p=.02) and ACDF vs lumbar fusion (28% vs 19%, p=.016). Questions related to risks & complications were more common in ACDF vs lumbar fusion (10% vs 4%, p=.01). The most frequently asked questions on Google regarding spine surgery are related to technical details and activity restrictions. Surgeons may emphasize these domains in consultations and direct patients to reputable sources of further information. Much of the linked information provided originates from nonacademic and nongovernment sources (72%), with 22% from social media websites.
22 August 2023 in The Spine Journal
29 October 2023 in The Spine Journal
10 January 2024 in Journal of Human Rights Practice
The Brown Human Rights Asylum Clinic (BHRAC) is a medical-student-run asylum clinic which provides pro-bono medical and psychological affidavits for people in immigration proceedings. At the time of the evaluations for affidavits, a BHRAC student administers a Social Determinants of Health (SDoH) screener, evaluating clients for access to healthcare and social needs such as assistance with utilities payments and housing. Medical students follow up later and connect clients with trusted resources. This descriptive analysis reviews the population demographics; demonstrates common resource requests within our population before and after the start of COVID-19; and suggests possible improvements to our clinic model. Of clients who completed the SDoH screening, 89 per cent requested at least one form of assistance; their most common request was for mental health services, followed by English classes and medical services. No change to community resource request trends appeared before and after the start of COVID-19. Barriers encountered included delays and difficulty administering the survey to clients who did not speak English or Spanish, the ethical concern of the evaluation team also offering community resources for future care, and the changes resulting from annual rotation in BHRAC student leadership.