Tarek Azzam

Tarek Azzam

Auto-generated profile, based on publicly available information

Tarek Azzam

Department of Education, University of California, Santa Barbara, USA

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 October 2015 in American Journal of Evaluation
Verified
Journal Article
Closed access
CCChris L. S. Coryn
Chris L. S. Coryn
SOSatoshi Ozeki
Satoshi Ozeki
LWLyssa N. Wilson
Lyssa N. Wilson
GGGregory D. Greenman
Gregory D. Greenman
DSDaniela C. Schröter
Daniela C. Schröter
AVAnne T. Vo
Anne T. Vo
Research on evaluation theories, methods, and practices has increased considerably in the past decade. Even so, little is known about whether published findings from research on evaluation are read by evaluators and whether such findings influence evaluators’ thinking about evaluation or their evaluation practice. To address these questions, and others, a random sample of American Evaluation Association (AEA) members and a purposive sample of prominent evaluation theorists and scholars were surveyed. A majority of AEA members (80.95% ± 7.60%) and sampled theorists and scholars (84.21%) regularly read research on evaluation and indicate that research on evaluation has influenced their thinking about evaluation and their evaluation practice (97.00% ± 3.38% and 94.00% ± 4.79%, for AEA members, and 100% and 100%, for prominent theorists and scholars, respectively).

29 November 2024 in Journal of Medical Internet Research
Verified
Journal Article
Open access
PHPatricia M Herman
Patricia M Herman
MSMary E Slaughter
Mary E Slaughter
NQNabeel Qureshi
Nabeel Qureshi
TATarek Azzam
Tarek Azzam
DCDavid Cella
David Cella
RHRon D. Hays
Ron D. Hays
Background: Researchers have many options for web-based survey data collection, ranging from access to curated probability-based panels, where individuals are selectively invited to join based on their membership in a representative population, to convenience panels, which are open for anyone to join. The mix of respondents available also varies greatly regarding representation of a population of interest and in motivation to provide thoughtful and accurate responses. Despite the additional dataset-building labor required of the researcher, convenience panels are much less expensive than probability-based panels. However, it is important to understand what may be given up regarding data quality for those cost savings. Objective: This study examined the relative costs and data quality of fielding equivalent surveys on Amazon’s Mechanical Turk (MTurk), a convenience panel, and KnowledgePanel, a nationally representative probability-based panel. Methods: We administered the same survey measures to MTurk (in 2021) and KnowledgePanel (in 2022) members. We applied several recommended quality assurance steps to enhance the data quality achieved using MTurk. Ipsos, the owner of KnowledgePanel, followed their usual (industry standard) protocols. The survey was designed to support psychometric analyses and included >60 items from the Patient-Reported Outcomes Measurement Information System (PROMIS), demographics, and a list of health conditions. We used 2 fake conditions (“syndomitis” and “chekalism”) to identify those more likely to be honest respondents. We examined the quality of each platform’s data using several recommended metrics (eg, consistency, reliability, representativeness, missing data, and correlations) including and excluding those respondents who had endorsed a fake condition and examined the impact of weighting on representativeness. Results: We found that prescreening in the MTurk sample (removing those who endorsed a fake health condition) improved data quality but KnowledgePanel data quality generally remained superior. While MTurk’s unweighted point estimates for demographics exhibited the usual mismatch with national averages (younger, better educated, and lower income), weighted MTurk data matched national estimates. KnowledgePanel’s point estimates better matched national benchmarks even before poststratification weighting. Correlations between PROMIS measures and age and income were similar in MTurk and KnowledgePanel; the mean absolute value of the difference between each platform’s 137 correlations was 0.06, and 92% were <0.15. However, correlations between PROMIS measures and educational level were dramatically different; the mean absolute value of the difference across these 17 correlation pairs was 0.15, the largest difference was 0.29, and the direction of more than half of these relationships in the MTurk sample was the opposite from that expected from theory. Therefore, caution is needed if using MTurk for studies where educational level is a key variable. Conclusions: The data quality of our MTurk sample was often inferior to that of the KnowledgePanel sample but possibly not so much as to negate the benefits of its cost savings for some uses. International Registered Report Identifier (IRRID): RR2-10.1186/s12891-020-03696-2

21 June 2012 in Journal of Multidisciplinary Evaluation
Verified
Journal Article
Open access
PDF file
VJVanessa Jamieson
Vanessa Jamieson
TATarek Azzam
Tarek Azzam
Background: Evaluation practice is no longer limited to pencil and paper questionnaires, today technological advances allow evaluators to collect data with handheld devices, visualize information in interactive ways, and communicate instantaneously with stakeholders across the globe. These advances have changed how we conduct our practice and they will continue to redefine how we design our evaluations, interact with stakeholders, and communicate our findings. There are few published articles that examine the interface between evaluation and technology and this study represents an initial attempt at examining the technological tools that evaluators use in their practice, the reasons they are adopted, and future technological interest of practicing evaluators. Purpose: This research on evaluation study attempts to (1) identify the types of technology tools evaluators use in their practice, (2) describe the factors that predict technology adoption, and (3) understand the tools that evaluators are interested in learning more about. This inquiry offers the evaluation community a broader perspective on the technologies that evaluators are implementing in their practice, offers insights on future technological trends within the field, and introduces the evaluation community to tools that can potentially enhance practice. Setting: Virtual on-line community of evaluation practitioners. Intervention: This was an exploratory research on evaluation study with no intervention. Research Design: A panel of experts on technology and evaluation were recruited to brainstorm a comprehensive list of technologies that could be adopted by evaluators as part of their practice. The comprehensive list of technology tools was then embedded within a larger survey instrument that was distributed to a sample of evaluation practitioners from the American Evaluation Association. The survey asked evaluators to select the technology tools they have or currently use in their practice, how often each were used, their satisfaction with each tool, and why they were utilizing each tool in their practice. Data Collection and Analysis: Data were collected through a web-based survey from members of the American Evaluation Association. The analysis utilized descriptive statics to represent trends in technology use and adoption. Multiple statistical comparisons using ANOVA were also utilized to examine the relationship between technological adoption and use and evaluator background characteristics. Open-ended responses in the survey were also presented as part of the analysis. Findings: Analyses revealed that technological tools were adopted by evaluators because they helped to produce quality products, increased timeliness, reduced errors, and increased cost efficiencies, and the most adopted tools tended to aid in quantitative data analysis, project management, and productivity. Many evaluators expressed interest in learning more about the use of qualitative analysis tools, web-based data collection tools, and relational database creation and management.

1 October 2021 in Evaluation and Program Planning
Verified
Journal Article
Closed access
TATarek Azzam
Tarek Azzam
DWDana Linnell Wanzer
Dana Linnell Wanzer
CKCiara Knight
Ciara Knight
HCHeather Codd
Heather Codd

1 February 2018 in Evaluation and Program Planning
Verified
Journal Article
Closed access
EHElena Harman
Elena Harman
TATarek Azzam
Tarek Azzam

9 January 2025 in American Journal of Evaluation
Verified
Journal Article
Closed access
SDSarah Douville
Sarah Douville
PTPiper T. Grandjean Targos
Piper T. Grandjean Targos
NJNatalie D. Jones
Natalie D. Jones
CKCiara Knight
Ciara Knight
TATarek Azzam
Tarek Azzam
This qualitative study explores the lessons learned from experts who use data visualization in evaluation. Findings suggest that collaborative communication with stakeholders—such as identifying needs, managing expectations, and determining the story to tell—is important before initiating the visualization process. Additionally, evaluators are advised to consider audience culture(s), varying levels of visual literacy (visualcy), and accessibility requirements. Experts emphasized the importance of mastering core principles of data visualization over mastery of specific software and argued that no software tool is best for every visualization. Experts also noted that data visualization can facilitate stakeholder understanding by distilling complex information and telling a data-driven story about programs and policies. By applying these lessons, evaluators can enhance their ability to create data visualizations that are technically sound and tailored to audience needs and ability, ultimately improving communication and supporting informed decision-making.