Melissa Estevez

Mrs. Melissa Estevez

Quantitative Sciences, Flatiron Health (United States), New York, USA
orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 January 2025 in ESMO Open
Verified
Journal Article
Open access
HRHope Rugo
Hope Rugo
RLRachel M Layman
Rachel M Layman
FLFilipa Lynce
Filipa Lynce
Xianchen LiuXianchen Liu
Xianchen Liu
BLB. Li
B. Li
ABAdam Brufsky
Adam Brufsky
Randomized controlled trials have shown inconsistent overall survival (OS) benefit among the three cyclin-dependent kinase 4/6 inhibitors (CDK4/6i) as first-line (1L) treatment of patients with hormone receptor-positive (HR+)/human epidermal growth factor receptor 2-negative (HER2-) metastatic breast cancer (mBC). Several real-world studies compared CDK4/6i effectiveness, with inconsistent findings. This study compared overall survival (OS) of patients with HR+/HER2- mBC receiving 1L palbociclib, ribociclib, or abemaciclib, in combination with an aromatase inhibitor (AI), in US clinical practice. This retrospective study used real-world data from the Flatiron Health electronic health record-derived deidentified longitudinal database. Patients with HR+/HER2- mBC aged ≥18 years at mBC diagnosis started 1L CDK4/6i therapy (index treatment) between February 2015 and November 2023, with a potential ≥6-month follow-up. OS was defined as months from start of index treatment to death. Stabilized inverse probability of treatment weighting (sIPTW; primary analysis) was used to balance baseline patient characteristics. Multivariable Cox proportional hazards model was carried out as a sensitivity analysis. Of 9146 eligible patients, 6831, 1279, and 1036 received palbociclib plus AI, ribociclib plus AI, or abemaciclib plus AI, respectively. After sIPTW, baseline characteristics were balanced between treatment groups. After sIPTW, no significant OS differences were found between treatment groups [ribociclib versus palbociclib: adjusted hazard ratio (aHR) 0.98, 95% confidence interval (CI) 0.87-1.10, P = 0.7531; abemaciclib versus palbociclib: aHR 0.95, 95% CI 0.84-1.08, P = 0.4292; abemaciclib versus ribociclib: aHR 0.97, 95% CI 0.82-1.14, P = 0.6956]. Sensitivity analysis including a subanalysis of patients who started index treatment in 2017 or later also showed no significant OS differences between treatment groups. This large real-world study suggested that there were no significant OS differences between 1L ribociclib, abemaciclib, and palbociclib in combination with an AI for patients with HR+/HER2- mBC. These findings together with other factors such as safety and quality of life are helpful in the selection of CDK4/6i combination therapy for patients with HR+/HER2- mBC.

20 March 2023 in Cancers
Verified
Journal Article
Open access
PDF file
CBCorey Benedum
Corey Benedum
ASArjun Sondhi
Arjun Sondhi
EFErin Fidyk
Erin Fidyk
ACAaron B. Cohen
Aaron B. Cohen
SNSheila Nemeth
Sheila Nemeth
Selen BozkurtSelen Bozkurt
Selen Bozkurt
Meaningful real-world evidence (RWE) generation requires unstructured data found in electronic health records (EHRs) which are often missing from administrative claims; however, obtaining relevant data from unstructured EHR sources is resource-intensive. In response, researchers are using natural language processing (NLP) with machine learning (ML) techniques (i.e., ML extraction) to extract real-world data (RWD) at scale. This study assessed the quality and fitness-for-use of EHR-derived oncology data curated using NLP with ML as compared to the reference standard of expert abstraction. Using a sample of 186,313 patients with lung cancer from a nationwide EHR-derived de-identified database, we performed a series of replication analyses demonstrating some common analyses conducted in retrospective observational research with complex EHR-derived data to generate evidence. Eligible patients were selected into biomarker- and treatment-defined cohorts, first with expert-abstracted then with ML-extracted data. We utilized the biomarker- and treatment-defined cohorts to perform analyses related to biomarker-associated survival and treatment comparative effectiveness, respectively. Across all analyses, the results differed by less than 8% between the data curation methods, and similar conclusions were reached. These results highlight that high-performance ML-extracted variables trained on expert-abstracted data can achieve similar results as when using abstracted data, unlocking the ability to perform oncology research at scale.

22 June 2022 in Cancers
Verified
Journal Article
Open access
PDF file
MEMelissa Estevez
Melissa Estevez
CBCorey Benedum
Corey Benedum
CJChengsheng Jiang
Chengsheng Jiang
ACAaron Benjamin Cohen
Aaron Benjamin Cohen
SPSharang Phadke
Sharang Phadke
Selen BozkurtSelen Bozkurt
Selen Bozkurt
A vast amount of real-world data, such as pathology reports and clinical notes, are captured as unstructured text in electronic health records (EHRs). However, this information is both difficult and costly to extract through human abstraction, especially when scaling to large datasets is needed. Fortunately, Natural Language Processing (NLP) and Machine Learning (ML) techniques provide promising solutions for a variety of information extraction tasks such as identifying a group of patients who have a specific diagnosis, share common characteristics, or show progression of a disease. However, using these ML-extracted data for research still introduces unique challenges in assessing validity and generalizability to different cohorts of interest. In order to enable effective and accurate use of ML-extracted real-world data (RWD) to support research and real-world evidence generation, we propose a research-centric evaluation framework for model developers, ML-extracted data users and other RWD stakeholders. This framework covers the fundamentals of evaluating RWD produced using ML methods to maximize the use of EHR data for research purposes.

1 July 2021 in The American Journal of Managed Care
Verified
Journal Article
Closed access
Blythe AdamsonBlythe Adamson
Blythe Adamson
ACAaron B. Cohen
Aaron B. Cohen
CGCary P. Gross
Cary P. Gross
MEMelissa Estevez
Melissa Estevez
FMFnp-Bc Kelly Magee
Fnp-Bc Kelly Magee
ADAmy J. Davidoff
Amy J. Davidoff
Medicaid expansion was associated with a reduction in the racial disparity in timely treatment of patients with advanced cancer in the United States.

1 January 2026 in JCO Clinical Cancer Informatics
Verified
Journal Article
Open access
MEMelissa Estevez
Melissa Estevez
NSNisha Singh
Nisha Singh
LDLauren Dyson
Lauren Dyson
Blythe AdamsonBlythe Adamson
Blythe Adamson
KKKonstantin Krismer
Konstantin Krismer
ACAaron Benjamin Cohen
Aaron Benjamin Cohen
Large language models (LLMs) are increasingly used to extract clinical data from electronic health records, offering significant improvements in scalability and efficiency for real-world data (RWD) curation in oncology. However, the adoption of LLMs introduces new challenges in ensuring the reliability, accuracy, and fairness of extracted data, which are essential for research, regulatory, and clinical applications. Existing quality assurance frameworks for RWD and artificial intelligence (AI) do not fully address the unique error modes and complexities associated with LLM-extracted data. In this paper, we propose a comprehensive framework for evaluating the quality of clinical data extracted by LLMs. The framework integrates variable-level performance benchmarking against expert human abstraction, verification checks for internal consistency and plausibility, and replication analyses comparing LLM-extracted data to human-abstracted data sets or external standards. This multidimensional approach enables the identification of variables most in need of improvement, systematic detection of latent errors, and confirmation of data set fitness-for-purpose in real-world research. Additionally, the framework supports bias assessment by stratifying across demographic subgroups. By providing a rigorous and transparent method for assessing LLM-extracted RWD, this framework advances industry standards and supports the trustworthy use of AI-powered evidence generation in oncology research and practice.

1 May 2019 in Value in Health
Verified
Journal Article
Closed access
GAG. Ambwani
G. Ambwani
ACA. Cohen
A. Cohen
MEMelissa Estevez
Melissa Estevez
NSN. Singh
N. Singh
BAB. Adamson
B. Adamson
BBB. Birnbaum
B. Birnbaum