17 January 2024 in Systematic Reviews
CSChristopher A. Sibrizzi
+1
Systematic review methods are recognized for their rigor and transparency and are widely adapted to frameworks that cover review types such as systematic reviews, scoping reviews, and systematic evidence maps. Reporting guidelines help promote better systematic review practices and detailed documentation of the review process for different types of health research (e.g., PRISMA—Preferred Reporting Items for Systematic Reviews and Meta-Analyses; CONSORT—Consolidated Standards of Reporting Trials; and STROBE—Strengthening the Reporting of Observational Studies in Epidemiology). Transparency in the systematic review process and reporting of results is one of the key advantages of the methods and particularly important for hazard and risk assessments due to the high level of scrutiny these reviews face from scientific, political, and public communities. Data visualizations are important to clearly convey information from a review by helping readers perceive, understand, and assess the displayed information easily and quickly. The study flow diagram is a required element of a systematic review and maps out the number of included and excluded records identified, and the reasons for exclusion. Static literature flow diagrams help viewers readily understand the general review methodology and summarize the number of records included or excluded at each stage of the review. However, such diagrams can be time-consuming to develop and maintain during a systematic review or scoping review, and they provide limited summary-level information. We explored how the use of online systematic review tools such as DistillerSR coupled with visualization software such as Tableau can efficiently generate an Interactive REFerence Flow (I-REFF) diagram that is linked to the literature screening data, thus requiring minimal preparation, and resulting in a simplified process for updating the diagram. Furthermore, I-REFF diagrams enhance transparency and traceability by not only summarizing the records in the review but also allowing viewers to follow specific records throughout the review process. We present an example I-REFF diagram and discuss recommendations for key interactive elements to include in these diagrams and how this workflow can improve efficiency and result in an accessible and transparent interactive literature flow diagram without advanced programming.
4 September 2025 in Evidence-Based Toxicology
8 April 2022 in Environment International
Widespread environmental contamination can directly interact with human immune system functions. Environmental effects on the immune system may influence human susceptibility to respiratory infections as well as the severity of infectious diseases, such as the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Furthermore, the efficacy of vaccines to respiratory diseases may be impacted by environmental exposures through immune perturbations. Given the quick pace of research about COVID-19 and associated risk factors, it is critical to identify and curate the streams of evidence quickly and effectively. We developed this systematic evidence map protocol to identify and organize existing human and animal literature on high-priority environmental chemical classes (Per- and polyfluoroalkyl substances, pesticides, phthalates, quaternary ammonium compounds, and air pollutants) and their potential to influence three key outcomes: (1) susceptibility to respiratory infection, including SARS-CoV-2 (2) severity of the resultant disease progression, and (3) impact on vaccine efficacy. The result of this project will be an online, interactive database which will show what evidence is currently available between involuntary exposures to select environmental chemicals and immune health effects, data gaps that require further research, and data rich areas that may support further analysis. We will search PubMed for epidemiological or toxicological literature on select toxicants from each of the chemical classes and each of the three outcomes listed above. For each study, two independent reviewers will conduct title and abstract screening as well as full text review for data extraction of study characteristics. Study quality will not be evaluated in this evidence mapping. The main findings from the systematic evidence map will be visualized using a publicly available and interactive database hosted on Tableau Public.
11 November 2024 in Evidence-Based Toxicology
Systematic review (SR) methods are relied upon to develop transparent, unbiased, and standardized human health chemical assessments. The expectation is that these assessments will have discovered and evaluated all of the available information in a trackable, transparent, and reproducible manner inherent to SR principles. The challenge is that chemical assessment development relies on mostly literature-based data using manual approaches that are not scalable. Various SR tools have increased the efficiency of assessment development by implementing semi-automated approaches (human in the loop) for data discovery (literature search and screening) and enhanced data repositories with standardized data collection and curation frameworks. Yet filling these repositories with data extractions has remained a manual process and connecting the various tools together in one interoperable workflow remains challenging. The objective of this protocol is to explore incorporation of a semi-automated data extraction tool (Dextr) into a chemical assessment workflow and understand if the new tool improves overall user experience. The workflow will use template systematic evidence map (SEM) methods developed by the Environmental Protection Agency for the identification of included studies. The methods described focus on the data extraction component of the workflow using a fully manual or a semi-automated (human in the loop) data extraction approach. Both the manual and semi-automated data extractions will occur in Dextr. The new data extraction tool will be evaluated for user experience and whether the data extracted using the automated approach meets or exceeds metrics (precision, recall, and F1 score) for a fully manual data extraction. Artificial intelligence (AI) and machine learning (ML) methods have rapidly advanced and show promise in achieving operational efficiencies in chemical assessment workflows by supporting automated or semi-automated SR methods, possibly improving the user experience. Yet incorporating advances into sustainable workflows has remained a challenge. Whether using a tool like Dextr improves operational efficiencies and the user experience remains to be determined.
13 November 2026 in Environment International