Michelle Angrish

Michelle Angrish

Auto-generated profile, based on publicly available information

Michelle Angrish

Center for Public Health and Environmental Assessment, Chemical and Pollutant Assessment Division, US Environmental Protection Agency

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 May 2022 in Environmental Health Perspectives
Verified
Journal Article
Closed access
LCLaura M. Carlson
Laura M. Carlson
MAMichelle Angrish
Michelle Angrish
ASAvanti V. Shirke
Avanti V. Shirke
ERElizabeth G. Radke
Elizabeth G. Radke
BSBrittany Schulz
Brittany Schulz
KTKristina A. Thayer
Kristina A. Thayer

18 November 2020 in Toxicology and Applied Pharmacology
Verified
Journal Article
Closed access
SSSamantha J. Snow
Samantha J. Snow
AHAndres Henriquez
Andres Henriquez
JFJenifer Fenton
Jenifer Fenton
TGTravis Goeden
Travis Goeden
AFAnna Fisher
Anna Fisher
UKUrmila Kodavanti
Urmila Kodavanti

11 November 2024 in Evidence-Based Toxicology
Verified
Journal Article
Closed access
MAMichelle Angrish
Michelle Angrish
KTKristina A. Thayer
Kristina A. Thayer
BSBrittany Schulz
Brittany Schulz
ANArtur Nowak
Artur Nowak
APAmanda Persad
Amanda Persad
SWSean M. Watford
Sean M. Watford
Systematic review (SR) methods are relied upon to develop transparent, unbiased, and standardized human health chemical assessments. The expectation is that these assessments will have discovered and evaluated all of the available information in a trackable, transparent, and reproducible manner inherent to SR principles. The challenge is that chemical assessment development relies on mostly literature-based data using manual approaches that are not scalable. Various SR tools have increased the efficiency of assessment development by implementing semi-automated approaches (human in the loop) for data discovery (literature search and screening) and enhanced data repositories with standardized data collection and curation frameworks. Yet filling these repositories with data extractions has remained a manual process and connecting the various tools together in one interoperable workflow remains challenging. The objective of this protocol is to explore incorporation of a semi-automated data extraction tool (Dextr) into a chemical assessment workflow and understand if the new tool improves overall user experience. The workflow will use template systematic evidence map (SEM) methods developed by the Environmental Protection Agency for the identification of included studies. The methods described focus on the data extraction component of the workflow using a fully manual or a semi-automated (human in the loop) data extraction approach. Both the manual and semi-automated data extractions will occur in Dextr. The new data extraction tool will be evaluated for user experience and whether the data extracted using the automated approach meets or exceeds metrics (precision, recall, and F1 score) for a fully manual data extraction. Artificial intelligence (AI) and machine learning (ML) methods have rapidly advanced and show promise in achieving operational efficiencies in chemical assessment workflows by supporting automated or semi-automated SR methods, possibly improving the user experience. Yet incorporating advances into sustainable workflows has remained a challenge. Whether using a tool like Dextr improves operational efficiencies and the user experience remains to be determined.

22 April 2025 in Evidence-Based Toxicology
Verified
Journal Article
Closed access
MAMichelle Angrish
Michelle Angrish
SBScott Burns
Scott Burns
JCJoshua Cleland
Joshua Cleland
CFCaroline Foster
Caroline Foster
SKSamuel Kovach
Samuel Kovach
SWSean Watford
Sean Watford

8 April 2025 in Journal of Open Source Software
Verified
Journal Article
Open access
PDF file
CSChristopher G. Stahl
Christopher G. Stahl
KMKristan J. Markey
Kristan J. Markey
BJBrian C. Jewell
Brian C. Jewell
DSDahnish Shams
Dahnish Shams
MTMichele M. Taylor
Michele M. Taylor
MAMichelle Angrish
Michelle Angrish
While different text mining approaches - including the use of Artificial Intelligence (AI) and other machine based methods - continue to expand at a rapid pace, the tools used by researchers to create the labeled datasets required for training, modeling, and evaluation remain rudimentary. Labeled datasets contain the target attributes the machine is going to learn; for example, training an algorithm to delineate between images of a car or truck would generally require a set of images with a quantitative description of the underlying features of each vehicle type. Development of labeled textual data that can be used to build natural language machine learning models for scientific literature is not currently integrated into existing manual workflows used by domain experts. Published literature is rich with important information, such as different types of embedded text, plots, and tables that can all be used as inputs to train ML/natural language processing (NLP) models, when extracted and prepared in machine readable formats. Currently, both normalized data extraction of use to domain experts and extraction to support development of ML/NLP models are labor intensive and cumbersome manual processes. Automatic extraction of data and information from formats such as PDFs that are optimized for layout and human readability, not machine readability. The PDF (Portable Document Format) Entity Annotation Tool (PEAT) was developed with the goal of allowing users to annotate publications within their current print format, while also allowing those annotations to be captured in a machine-readable format. One of the main issues with traditional annotation tools is that they require transforming the PDF into plain text to facilitate the annotation process. While doing so lessens the technical challenges of annotating data, the user loses all structure and provenance that was inherent in the underlying PDF. Also, textual data extraction from PDFs can be an error prone process. Challenges include identifying sequential blocks of text and a multitude of document formats (multiple columns, font encodings, etc.). As a result of these challenges, using existing tools for development of NLP/ML models directly from PDFs is difficult because the generated outputs are not interoperable. We created a system that allows annotations to be completed on the original PDF document structure, with no plain text extraction. The result is an application that allows for easier and more accurate annotations. In addition, by including a feature that grants the user the ability to easily create a schema, we have developed a system that can be used to annotate text for different domain-centric schemas of relevance to subject matter experts. Different knowledge domains require distinct schemas and annotation tags to support machine learning.