Frederick Matthew Howard

Frederick Matthew Howard

Auto-generated profile, based on publicly available information

Frederick Matthew Howard

Department of Medicine, University of Chicago, Chicago, IL, USA

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 April 2023 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
CGCatherine A. Gao
Catherine A. Gao
FHFrederick M. Howard
Frederick M. Howard
NMNikolay S. Markov
Nikolay S. Markov
EDEmma C. Dyer
Emma C. Dyer
SRSiddhi Ramesh
Siddhi Ramesh
APAlexander T. Pearson
Alexander T. Pearson
Large language models such as ChatGPT can produce increasingly realistic text, with unknown information on the accuracy and integrity of using these models in scientific writing. We gathered fifth research abstracts from five high-impact factor medical journals and asked ChatGPT to generate research abstracts based on their titles and journals. Most generated abstracts were detected using an AI output detector, ‘GPT-2 Output Detector’, with % ‘fake’ scores (higher meaning more likely to be generated) of median [interquartile range] of 99.98% ‘fake’ [12.73%, 99.98%] compared with median 0.02% [IQR 0.02%, 0.09%] for the original abstracts. The AUROC of the AI output detector was 0.94. Generated abstracts scored lower than original abstracts when run through a plagiarism detector website and iThenticate (higher scores meaning more matching text found). When given a mixture of original and general abstracts, blinded human reviewers correctly identified 68% of generated abstracts as being generated by ChatGPT, but incorrectly identified 14% of original abstracts as being generated. Reviewers indicated that it was surprisingly difficult to differentiate between the two, though abstracts they suspected were generated were vaguer and more formulaic. ChatGPT writes believable scientific abstracts, though with completely generated data. Depending on publisher-specific guidelines, AI output detectors may serve as an editorial tool to help maintain scientific standards. The boundaries of ethical and acceptable use of large language models to help scientific writing are still being discussed, and different journals and conferences are adopting varying policies.

20 July 2021 in Nature Communications
Verified
Journal Article
Open access
PDF file
FHFrederick M. Howard
Frederick M. Howard
JDJames Dolezal
James Dolezal
SKSara Kochanny
Sara Kochanny
JSJefree Schulte
Jefree Schulte
HCHeather Chen
Heather Chen
APAlexander T. Pearson
Alexander T. Pearson
The Cancer Genome Atlas (TCGA) is one of the largest biorepositories of digital histology. Deep learning (DL) models have been trained on TCGA to predict numerous features directly from histology, including survival, gene expression patterns, and driver mutations. However, we demonstrate that these features vary substantially across tissue submitting sites in TCGA for over 3,000 patients with six cancer subtypes. Additionally, we show that histologic image differences between submitting sites can easily be identified with DL. Site detection remains possible despite commonly used color normalization and augmentation methods, and we quantify the image characteristics constituting this site-specific digital histology signature. We demonstrate that these site-specific signatures lead to biased accuracy for prediction of features including survival, genomic mutations, and tumor stage. Furthermore, ethnicity can also be inferred from site-specific signatures, which must be accounted for to ensure equitable application of DL. These site-specific signatures can lead to overoptimistic estimates of model performance, and we propose a quadratic programming method that abrogates this bias by ensuring models are not trained and validated on samples from the same site.

1 January 2021 in The Cancer Journal
Verified
Journal Article
Closed access
FHFrederick M. Howard
Frederick M. Howard
OOOlufunmilayo I. Olopade
Olufunmilayo I. Olopade
Triple-negative breast cancer accounted for 12% of breast cancers diagnosed in the United States from 2012 to 2016, with a 5-year survival 8% to 16% lower than hormone receptor–positive disease. However, preventive and screening strategies remain tailored to the demographics of less lethal luminal cancers. This review examines the ethnic, genetic, and modifiable risk factors associated with triple-negative breast cancer, which providers must recognize to address the societal disparities of this deadly disease. Most notable is that triple-negative cancers disproportionately affect African American women and carriers of germline BRCA and PALB2 mutations. Even controlling for treatment delays, stage, and socioeconomic factors, African Americans with triple-negative breast cancer remain nearly twice as likely to die of their disease. To level the playing field, we must integrate genomic predictors of disease and epidemiologic characteristics of molecular breast cancer subtypes to provide personalized risk assessment, screening, and treatment for each patient.

27 December 2022 in bioRxiv
Verified
Preprint
Open access
PDF file
CGCatherine A. Gao
Catherine A. Gao
FHFrederick M. Howard
Frederick M. Howard
NMNikolay S. Markov
Nikolay S. Markov
EDEmma C. Dyer
Emma C. Dyer
SRSiddhi Ramesh
Siddhi Ramesh
APAlexander T. Pearson
Alexander T. Pearson
Background Large language models such as ChatGPT can produce increasingly realistic text, with unknown information on the accuracy and integrity of using these models in scientific writing. Methods We gathered ten research abstracts from five high impact factor medical journals (n=50) and asked ChatGPT to generate research abstracts based on their titles and journals. We evaluated the abstracts using an artificial intelligence (AI) output detector, plagiarism detector, and had blinded human reviewers try to distinguish whether abstracts were original or generated. Results All ChatGPT-generated abstracts were written clearly but only 8% correctly followed the specific journal’s formatting requirements. Most generated abstracts were detected using the AI output detector, with scores (higher meaning more likely to be generated) of median [interquartile range] of 99.98% [12.73, 99.98] compared with very low probability of AI-generated output in the original abstracts of 0.02% [0.02, 0.09]. The AUROC of the AI output detector was 0.94. Generated abstracts scored very high on originality using the plagiarism detector (100% [100, 100] originality). Generated abstracts had a similar patient cohort size as original abstracts, though the exact numbers were fabricated. When given a mixture of original and general abstracts, blinded human reviewers correctly identified 68% of generated abstracts as being generated by ChatGPT, but incorrectly identified 14% of original abstracts as being generated. Reviewers indicated that it was surprisingly difficult to differentiate between the two, but that the generated abstracts were vaguer and had a formulaic feel to the writing. Conclusion ChatGPT writes believable scientific abstracts, though with completely generated data. These are original without any plagiarism detected but are often identifiable using an AI output detector and skeptical human reviewers. Abstract evaluation for journals and medical conferences must adapt policy and practice to maintain rigorous scientific standards; we suggest inclusion of AI output detectors in the editorial process and clear disclosure if these technologies are used. The boundaries of ethical and acceptable use of large language models to help scientific writing remain to be determined.

1 April 2023 in JAMA Oncology
Verified
Journal Article
Closed access
PDF file
DPDaniel S. Peiffer
Daniel S. Peiffer
FZFangyuan Zhao
Fangyuan Zhao
NCNan Chen
Nan Chen
OHOlwen M. Hahn
Olwen M. Hahn
RNRita Nanda
Rita Nanda
FHFrederick M. Howard
Frederick M. Howard
Importance: Given conflicting results regarding the prognosis of erb-b2 receptor tyrosine kinase 2 (ERBB2; formerly HER2 or HER2/neu)–low breast cancer, a large-scale, nationally applicable comparison of ERBB2-low vs ERBB2-negative breast cancer is needed.Objective: To investigate whether ERBB2-low breast cancer is a clinically distinct subtype in terms of epidemiological characteristics, prognosis, and response to neoadjuvant chemotherapy.Design/Participants/Setting: This retrospective cohort study was conducted using the National Cancer Database, including 1 136 016 patients in the US diagnosed with invasive breast cancer from January 1, 2010, to December 31, 2019, who had ERBB2-negative disease and had immunohistochemistry results available. ERBB2-low tumors were classified as having an immunohistochemistry score of 1+, or 2+ with a negative in situ hybridization test. Data were analyzed from November 1, 2021, through November 30, 2022.Exposures: Standard therapy according to routine clinical practice.Main Outcomes and Measures: The primary outcomes were overall survival (OS), reported as adjusted hazard ratios (aHRs), and pathologic complete response, reported as adjusted odds ratios (aORs), for ERBB2-negative vs ERBB2-low breast cancer, controlling for age, sex, race and ethnicity, Charlson-Deyo Comorbidity Index score, treatment facility type, tumor grade, tumor histology, hormone receptor status, and cancer stage.Results: The study identified 1 136 016 patients (mean [SD] age, 62.4 [13.1] years; 99.1% female; 78.6% non-Hispanic White), of whom 392 246 (34.5%) were diagnosed with ERBB2-negative and 743 770 (65.5%) with ERBB2-low breast cancer. The mean (SD) age of the ERBB2-negative group was 62.1 (13.2) years and 62.5 (13.0) years for the ERBB2-low group. Higher estrogen receptor expression was associated with increased rates of ERBB2-low disease (aOR, 1.15 per 10% increase). Compared with non-Hispanic White patients, of whom 66.1% were diagnosed with ERBB2-low breast cancer, fewer non-Hispanic Black (62.8%) and Hispanic (61.0%) patients had ERBB2-low disease, although in non-Hispanic Black patients this was mediated by differences in rates of triple-negative disease and other confounders. A slightly lower rate of pathologic complete response was seen in patients with ERBB2-low disease vs patients with ERBB2-negative disease on multivariable analysis (aOR, 0.89; 95% CI, 0.86-0.92; P < .001). ERBB2-low status was also associated with small improvements in OS for stage III (aHR, 0.92; 95% CI, 0.89-0.96; P < .001) and stage IV (aHR, 0.91; 95% CI, 0.87-0.96; P < .001) triple-negative breast cancer, although this amounted to only a 2.0% (stage III) and 0.4% (stage IV) increase in 5-year OS.Conclusions and Relevance: This large-scale retrospective cohort analysis found minimal prognostic differences between ERBB2-low and ERBB2-negative breast cancer. These findings suggest that, moving forward, outcomes in ERBB2-low breast cancer will be driven by ERBB2-directed antibody-drug conjugates, rather than intrinsic differences in biological characteristics associated with low-level ERBB2 expression. These findings do not support the classification of ERBB2-low breast cancer as a unique disease entity.

14 April 2023 in npj Breast Cancer
Verified
Journal Article
Open access
PDF file
FHFrederick M. Howard
Frederick M. Howard
JDJames Dolezal
James Dolezal
SKSara Kochanny
Sara Kochanny
GKGalina Khramtsova
Galina Khramtsova
JVJasmine Vickery
Jasmine Vickery
APAlexander T. Pearson
Alexander T. Pearson
Gene expression-based recurrence assays are strongly recommended to guide the use of chemotherapy in hormone receptor-positive, HER2-negative breast cancer, but such testing is expensive, can contribute to delays in care, and may not be available in low-resource settings. Here, we describe the training and independent validation of a deep learning model that predicts recurrence assay result and risk of recurrence using both digital histology and clinical risk factors. We demonstrate that this approach outperforms an established clinical nomogram (area under the receiver operating characteristic curve of 0.83 versus 0.76 in an external validation cohort,p = 0.0005) and can identify a subset of patients with excellent prognoses who may not need further genomic testing.