Qandeel Tariq

Qandeel Tariq

Auto-generated profile, based on publicly available information

Qandeel Tariq

Department of Pediatrics Stanford University Stanford, CA United States

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 November 2018 in PLOS Medicine
Verified
Journal Article
Open access
PDF file
QTQandeel Tariq
Qandeel Tariq
JDJena Daniels
Jena Daniels
JSJessey Nicole Schwartz
Jessey Nicole Schwartz
Peter WashingtonPeter Washington
Peter Washington
HKHaik Kalantarian
Haik Kalantarian
DWDennis Wall
Dennis Wall
The standard approaches to diagnosing autism spectrum disorder (ASD) evaluate between 20 and 100 behaviors and take several hours to complete. This has in part contributed to long wait times for a diagnosis and subsequent delays in access to therapy. We hypothesize that the use of machine learning analysis on home video can speed the diagnosis without compromising accuracy. We have analyzed item-level records from 2 standard diagnostic instruments to construct machine learning classifiers optimized for sparsity, interpretability, and accuracy. In the present study, we prospectively test whether the features from these optimized models can be extracted by blinded nonexpert raters from 3-minute home videos of children with and without ASD to arrive at a rapid and accurate machine learning autism classification. We created a mobile web portal for video raters to assess 30 behavioral features (e.g., eye contact, social smile) that are used by 8 independent machine learning models for identifying ASD, each with >94% accuracy in cross-validation testing and subsequent independent validation from previous work. We then collected 116 short home videos of children with autism (mean age = 4 years 10 months, SD = 2 years 3 months) and 46 videos of typically developing children (mean age = 2 years 11 months, SD = 1 year 2 months). Three raters blind to the diagnosis independently measured each of the 30 features from the 8 models, with a median time to completion of 4 minutes. Although several models (consisting of alternating decision trees, support vector machine [SVM], logistic regression (LR), radial kernel, and linear SVM) performed well, a sparse 5-feature LR classifier (LR5) yielded the highest accuracy (area under the curve [AUC]: 92% [95% CI 88%–97%]) across all ages tested. We used a prospectively collected independent validation set of 66 videos (33 ASD and 33 non-ASD) and 3 independent rater measurements to validate the outcome, achieving lower but comparable accuracy (AUC: 89% [95% CI 81%–95%]). Finally, we applied LR to the 162-video-feature matrix to construct an 8-feature model, which achieved 0.93 AUC (95% CI 0.90–0.97) on the held-out test set and 0.86 on the validation set of 66 videos. Validation on children with an existing diagnosis limited the ability to generalize the performance to undiagnosed populations. These results support the hypothesis that feature tagging of home videos for machine learning classification of autism can yield accurate outcomes in short time frames, using mobile devices. Further work will be needed to confirm that this approach can accelerate autism diagnosis at scale.

24 April 2019 in Journal of Medical Internet Research
Verified
Journal Article
Open access
QTQandeel Tariq
Qandeel Tariq
SFScott Lanyon Fleming
Scott Lanyon Fleming
JSJessey Nicole Schwartz
Jessey Nicole Schwartz
KDKaitlyn Dunlap
Kaitlyn Dunlap
CCConor Corbin
Conor Corbin
DWDennis Wall
Dennis Wall
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet

1 April 2020 in JMIR Mental Health
Verified
Journal Article
Open access
HKHaik Kalantarian
Haik Kalantarian
KJKhaled Jedoui
Khaled Jedoui
KDKaitlyn Dunlap
Kaitlyn Dunlap
JSJessey Schwartz
Jessey Schwartz
Peter WashingtonPeter Washington
Peter Washington
DWDennis Wall
Dennis Wall
Background: Autism spectrum disorder (ASD) is a developmental disorder characterized by deficits in social communication and interaction, and restricted and repetitive behaviors and interests. The incidence of ASD has increased in recent years; it is now estimated that approximately 1 in 40 children in the United States are affected. Due in part to increasing prevalence, access to treatment has become constrained. Hope lies in mobile solutions that provide therapy through artificial intelligence (AI) approaches, including facial and emotion detection AI models developed by mainstream cloud providers, available directly to consumers. However, these solutions may not be sufficiently trained for use in pediatric populations. Objective: Emotion classifiers available off-the-shelf to the general public through Microsoft, Amazon, Google, and Sighthound are well-suited to the pediatric population, and could be used for developing mobile therapies targeting aspects of social communication and interaction, perhaps accelerating innovation in this space. This study aimed to test these classifiers directly with image data from children with parent-reported ASD recruited through crowdsourcing. Methods: We used a mobile game called Guess What? that challenges a child to act out a series of prompts displayed on the screen of the smartphone held on the forehead of his or her care provider. The game is intended to be a fun and engaging way for the child and parent to interact socially, for example, the parent attempting to guess what emotion the child is acting out (eg, surprised, scared, or disgusted). During a 90-second game session, as many as 50 prompts are shown while the child acts, and the video records the actions and expressions of the child. Due in part to the fun nature of the game, it is a viable way to remotely engage pediatric populations, including the autism population through crowdsourcing. We recruited 21 children with ASD to play the game and gathered 2602 emotive frames following their game sessions. These data were used to evaluate the accuracy and performance of four state-of-the-art facial emotion classifiers to develop an understanding of the feasibility of these platforms for pediatric research. Results: All classifiers performed poorly for every evaluated emotion except happy. None of the classifiers correctly labeled over 60.18% (1566/2602) of the evaluated frames. Moreover, none of the classifiers correctly identified more than 11% (6/51) of the angry frames and 14% (10/69) of the disgust frames. Conclusions: The findings suggest that commercial emotion classifiers may be insufficiently trained for use in digital approaches to autism treatment and treatment tracking. Secure, privacy-preserving methods to increase labeled training data are needed to boost the models’ performance before they can be used in AI-enabled approaches to social therapy of the kind that is common in autism treatments.

23 May 2019 in Journal of Medical Internet Research
Verified
Journal Article
Open access
Peter WashingtonPeter Washington
Peter Washington
HKHaik Kalantarian
Haik Kalantarian
QTQandeel Tariq
Qandeel Tariq
JSJessey Schwartz
Jessey Schwartz
KDKaitlyn Dunlap
Kaitlyn Dunlap
DWDennis Wall
Dennis Wall
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Obtaining a diagnosis of neuropsychiatric disorders such as autism requires long waiting times often exceeding a year. Furthermore, obtaining a professional diagnosis is often prohibitively expensive for much of the global population. Crowdsourcing provides a cheap and possibly free alternative that can allow underserved populations to obtain an accurate diagnosis. Objective: To determine whether paid crowd workers on Amazon Mechanical Turk (AMT) as well as citizen crowd workers on a public website shared on social media can provide accurate online screening for autism from watching a short video clip. Methods: Three online studies: (1) a paid crowdsourcing task on AMT (N=55) where crowd workers were asked to rate ten short video clips of children as having “autism” or “no autism”, (2) a follow-up, more complex paid crowdsourcing task on AMT (N=27) with only those raters who correctly rated 8 or more of the 10 videos during the first study, and (3) a public unpaid “citizen healthcare” study (N=71) with the same task as in the first study. 50% of the videos in all studies contained children with autism, 50% of videos contained females, and the age range of children in the videos ranged from 2 to 5 years. Results: Study 1: The mean score of the participants who completed all questions was 7.50 (SD = 1.46) out of 10. When only analyzing the workers who scored reasonably well (scored 8 out of 10 or higher; n=27 out of 55), there was a weak negative correlation between the time spent rating the videos and the sensitivity (r = -0.44, p = 0.02). Study 2: The mean score of the participants rating new videos was 6.76 (SD = 0.59) out 10. Across all videos, the average deviation between the average crowdsourced answers and gold standard ratings provided by two expert clinical research coordinators was 0.557, with a standard deviation of 0.51 (the maximum possible deviation is 3). All paid crowdworkers who scored an 8 out of 10 in Study 1 either enjoyed performing the task in Study 2 or provided no negative comments. Study 3: There was a negative correlation between whether the rater is a parent and sensitivity (r = -0.26, p=0.02) as well as precision (r = -0.28, p=0.02). The mean score of the participants who completed all questions was 6.61 (SD = 1.60) out of 10. A two-tailed t-test between the scores of the paid workers in Study 1 and the unpaid workers in Study 3 showed significance in the difference (p=0.0009). Conclusions: (1) Many paid crowdworkers on AMT enjoy answering screening questions from videos, suggesting higher intrinsic motivation to make quality assessments.”). (2) Both paid crowdsourcing and citizen crowdsourcing provide promising screening assessments of pediatric autism comparable to that of professional raters. (3) Parents of children with autism likely overfit their intuition to their own affected child, which is problematic for a disorder such as autism which has a wide range of phenotypic manifestations. (4) Paid workers will outperform a general unpaid crowd of online citizen workers.

18 December 2018 in JMIR Preprints
Verified
Preprint
Open access
HKHaik Kalantarian
Haik Kalantarian
KJKhaled Jedoui
Khaled Jedoui
KDKaitlyn Dunlap
Kaitlyn Dunlap
JSJessey Schwartz
Jessey Schwartz
Peter WashingtonPeter Washington
Peter Washington
DWDennis Wall
Dennis Wall
BACKGROUND Autism spectrum disorder (ASD) is a developmental disorder characterized by deficits in social communication and interaction, and restricted and repetitive behaviors and interests. The incidence of ASD has increased in recent years; it is now estimated that approximately 1 in 40 children in the United States are affected. Due in part to increasing prevalence, access to treatment has become constrained. Hope lies in mobile solutions that provide therapy through artificial intelligence (AI) approaches, including facial and emotion detection AI models developed by mainstream cloud providers, available directly to consumers. However, these solutions may not be sufficiently trained for use in pediatric populations. OBJECTIVE Emotion classifiers available off-the-shelf to the general public through Microsoft, Amazon, Google, and Sighthound are well-suited to the pediatric population, and could be used for developing mobile therapies targeting aspects of social communication and interaction, perhaps accelerating innovation in this space. This study aimed to test these classifiers directly with image data from children with parent-reported ASD recruited through crowdsourcing. METHODS We used a mobile game called Guess What? that challenges a child to act out a series of prompts displayed on the screen of the smartphone held on the forehead of his or her care provider. The game is intended to be a fun and engaging way for the child and parent to interact socially, for example, the parent attempting to guess what emotion the child is acting out (eg, surprised, scared, or disgusted). During a 90-second game session, as many as 50 prompts are shown while the child acts, and the video records the actions and expressions of the child. Due in part to the fun nature of the game, it is a viable way to remotely engage pediatric populations, including the autism population through crowdsourcing. We recruited 21 children with ASD to play the game and gathered 2602 emotive frames following their game sessions. These data were used to evaluate the accuracy and performance of four state-of-the-art facial emotion classifiers to develop an understanding of the feasibility of these platforms for pediatric research. RESULTS All classifiers performed poorly for every evaluated emotion except happy. None of the classifiers correctly labeled over 60.18% (1566/2602) of the evaluated frames. Moreover, none of the classifiers correctly identified more than 11% (6/51) of the angry frames and 14% (10/69) of the disgust frames. CONCLUSIONS The findings suggest that commercial emotion classifiers may be insufficiently trained for use in digital approaches to autism treatment and treatment tracking. Secure, privacy-preserving methods to increase labeled training data are needed to boost the models’ performance before they can be used in AI-enabled approaches to social therapy of the kind that is common in autism treatments.

27 June 2019 in Journal of Medical Internet Research
Verified
Journal Article
Open access
Peter WashingtonPeter Washington
Peter Washington
HKHaik Kalantarian
Haik Kalantarian
QTQandeel Tariq
Qandeel Tariq
JSJessey Schwartz
Jessey Schwartz
KDKaitlyn Dunlap
Kaitlyn Dunlap
DWDennis Wall
Dennis Wall
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet