Artificial intelligence (AI) broadly describes a branch of computer science focused on developing machines capable of performing tasks typically associated with human intelligence. Those who connect AI with the world of science fiction may meet its growing rise with hesitancy or outright skepticism. However, AI is becoming increasingly pervasive in our society, from algorithms helping to sift through airline fares to substituting words in emails and SMS text messages based on user choices. Data collection is ongoing and is being leveraged by software platforms to analyze patterns and make predictions across multiple industries. Health care is gradually becoming part of this technological transformation, as advancements in computational power and storage converge with the rapid expansion of digitized medical information. Given the growing and inevitable integration of AI into health care systems, it is our viewpoint that pediatricians urgently require training and orientation to the uses, promises, and pitfalls of AI in medicine. AI is unlikely to solve the full array of complex challenges confronting pediatricians today; however, if used responsibly, it holds great potential to improve many aspects of care for providers, children, and families. Our aim in this viewpoint is to provide clinicians with a targeted introduction to the field of AI in pediatrics, including key promises, pitfalls, and clinical applications, so they can play a more active role in shaping the future impact of AI in medicine.
Background: The Extension for Community Health Outcomes (ECHO) Autism Program trains clinicians to screen, diagnose, and care for children with autism spectrum disorder (ASD) in primary care settings. This study will assess the feasibility and impact of integrating an artificial intelligence (AI)–based ASD diagnosis aid (the device) into the existing ECHO Autism Screening Tool for Autism in Toddlers and Young Children (STAT) diagnosis model. The prescription-only Software as a Medical Device, designed for use in children aged 18 to 72 months at risk for developmental delay, produces ASD diagnostic recommendations after analyzing behavioral features from 3 distinct inputs: a caregiver questionnaire, 2 short home videos analyzed by trained video analysts, and a health care provider questionnaire. The device is not a stand-alone diagnostic and should be used in conjunction with clinical judgment. Objective: This study aims to assess the feasibility and impact of integrating an AI-based ASD diagnosis aid into the ECHO Autism STAT diagnosis model. The time from initial ECHO Autism clinician concern to ASD diagnosis is the primary end point. Secondary end points include the time from initial caregiver concern to ASD diagnosis, time from diagnosis to treatment initiation, and clinician and caregiver experience of device use as part of the ASD diagnostic journey. Methods: Research participants for this prospective observational study will be patients suspected of having ASD (aged 18-72 months) and their caregivers and up to 15 trained ECHO Autism clinicians recruited by the ECHO Autism Communities research team from across rural and suburban areas of the United States. Clinicians will provide routine clinical care and conduct best practice ECHO Autism diagnostic evaluations in addition to prescribing the device. Outcome data will be collected via a combination of electronic questionnaires, reviews of standard clinical care records, and analysis of device outputs. The expected study duration is no more than 12 months. The study was approved by the institutional review board of the University of Missouri-Columbia (institutional review board–assigned project number 2075722). Results: Participant recruitment began in April 2022. As of June 2022, a total of 41 participants have been enrolled. Conclusions: This prospective observational study will be the first to evaluate the use of a novel AI-based ASD diagnosis aid as part of a real-world primary care diagnostic pathway. If device integration into primary care proves feasible and efficacious, prolonged delays between the first ASD concern and eventual diagnosis may be reduced. Streamlining primary care ASD diagnosis could potentially reduce the strain on specialty services and allow a greater proportion of children to commence early intervention during a critical neurodevelopmental window. Trial Registration: ClinicalTrials.gov NCT05223374; https://clinicaltrials.gov/ct2/show/NCT05223374 International Registered Report Identifier (IRRID): PRR1-10.2196/37576
Rapidly rising demand for pediatric autism evaluations has outpaced specialist capacity and created a crisis of delayed diagnoses and treatment. Streamlining the diagnostic process could reduce wait times and optimize use of limited specialist resources. Following strong clinical trial results, Canvas Dx, an AI-based diagnostic, was FDA authorized to support accurate diagnosis or rule-out of autism in children 18–72 months with caregiver or healthcare provider concern for developmental delay. To gain insight into real-world device performance, a de-identified aggregate data analysis of the initial 254 Canvas Dx prescriptions fulfilled post-market authorization was conducted to determine: accuracy of autism predictions compared to clinical reference standard diagnosis and prior clinical trial data, key real-world prescriber and patient characteristics, proportion of determinate device outputs (positive or negative for autism) and impact of decision threshold settings on device performance. In this sample of 254 children with a 54.7% autism prevalence rate (29.1% female, average age 39.99 months), Canvas Dx had a NPV of 97.6% (CI- 92.8% -100.0%) and a PPV of 92.4% (CI-87.7%-97.2%). A majority of cases (63.0%) received a determinate result. Sensitivity and specificity of determinate results were 99.1% (CI-97.3%-100.0%) and 81.6% (CI-70.8%-92.5%) respectively. The median age of children who received a positive for autism output was 37.2 months, which is more than 2 years earlier than the current median age of autism diagnosis. No performance differences were noted based on patients’ sex. Compared to clinical trial results, real world performance was equivalent for all key metrics, with the exception of the determinate rate and the PPV which were significantly improved in real world performance. Analysis of real-world Canvas Dx data highlights its feasibility and utility in supporting accurate, equitable and early diagnosis or rule out of autism. With medical coverage and broader clinical adoption, innovative solutions such as Canvas Dx can play an important role in helping to address the growing specialist waitlist crisis, ensuring that more children gain access to targeted therapies during the critical window of neurodevelopment where they have the greatest life-changing impact.
Background: Pediatric specialist shortages and rapidly rising autism prevalence rates have compelled primary care clinicians to consider playing a greater role in the autism diagnostic process. The ECHO Autism: Early Diagnosis Program (EDx) prepares clinicians to screen, evaluate, differentiate, diagnose, and provide longitudinal care for children with autism in primary care settings. Canvas Dx is a prescription-only Software as a Medical Device designed to support clinical diagnosis or rule out of autism, including in primary care settings. It is authorized by the Food and Drug Administration for use, in conjunction with clinical judgment, in 18‐ to 72-month-olds with indicators of developmental delay. Objective: This study aims to assess the feasibility and impact of integrating the device into the ECHO Autism: EDx workflow. Time from the first clinical question of developmental delay to autism diagnosis is the primary endpoint. Secondary endpoints explore clinician and caregiver experience of device use. Methods: Children aged 18 to 72 months with concern for developmental delay indicated by either a caregiver or health professionals were eligible to participate in this prospective observational study. Experienced ECHO Autism: EDx clinicians were recruited to evaluate the inclusion of the device as part of their diagnostic evaluations. Outcome data were collected via a combination of electronic questionnaires, standard clinical care record reviews, and analysis of device outputs. Institutional review board approval was provided by the University of Missouri-Columbia (project number 2075722). Results: Eighty children and 7 clinicians completed the study. On average, time from clinical concern at study enrollment to final autism diagnosis was 39.22 days, compared to 180‐ to 264-day waits at adjacent specialist referral centers. The vast majority (93%, 50/54) of caregivers reported being satisfied with the ECHO Autism: EDx plus device evaluation their child received and endorsed that they would recommend it to others and that they felt comfortable using the device. The device produced determinate autism predictions or rule-outs for 52.5% of participants, and in all cases, these were consistent with the final clinical determination. Participating clinicians reported that device use was feasible and reduced several challenges associated with their previous diagnostic process; however, they noted it did not obviate the need for additional structured observation in every case. Conclusions: The ECHO Autism: EDx plus device workflow offers considerable time savings compared to specialty center referral and was strongly endorsed by caregiver participants. Embedding the device into the ECHO Autism: EDx workflow was feasible and helped streamline several workflow efficiencies. Clinicians still utilized their training and application and interpretation of Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, criteria when formulating the diagnosis for indeterminate cases.