Naser Al Madi

Dr. Naser Al Madi

Department of Computer Science, Colby College, Waterville, Maine, USA
orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 October 2022
Verified
Conference Paper
Open access
Naser Al MadiNaser Al Madi
Naser Al Madi
Background: Recent advancements in large language models have motivated the practical use of such models in code generation and program synthesis. However, little is known about the effects of such tools on code readability and visual attention in practice. Objective: In this paper, we focus on GitHub Copilot to address the issues of readability and visual inspection of model generated code. Readability and low complexity are vital aspects of good source code, and visual inspection of generated code is important in light of automation bias. Method: Through a human experiment (n=21) we compare model generated code to code written completely by human programmers. We use a combination of static code analysis and human annotators to assess code readability, and we use eye tracking to assess the visual inspection of code. Results: Our results suggest that model generated code is comparable in complexity and readability to code written by human pair programmers. At the same time, eye tracking data suggests, to a statistically significant level, that programmers direct less visual attention to model generated code. Conclusion: Our findings highlight that reading code is more important than ever, and programmers should beware of complacency and automation bias with model generated code.

30 May 2023
Verified
Conference Paper
Open access
OROwen Raymond
Owen Raymond
YMYelaman Moldagali
Yelaman Moldagali
Naser Al MadiNaser Al Madi
Naser Al Madi
A number of factors come together to limit the diversity of eye-tracking research, where the majority of papers are conducted with stimuli in the English language. Studying eye movement over other languages is important considering that each language provides unique insights into human cognition. Recently, there have been valued efforts to present datasets from other languages, yet these efforts focused mostly on European languages. In this paper we highlight issues that limit diversity in eye tracking research on reading, and we present our work in collecting an open-access multilingual reading dataset of underrepresented languages. Utilizing a high-frequency research eye tracker (EyeLink 1000 Plus), we record eye tracking data of native and second language readers of English, Spanish, Chinese, Hindi, Russian, Arabic, Japanese, Kazakh, Urdu, and Vietnamese. The dataset includes demographics, language proficiency self-reporting, and answers to comprehension questions. The current version of the dataset, which we make publicly available, consists of 97 trials by 40 participants. With the goal of increasing the number of participants and included languages, we aim to make studying underrepresented languages more accessible to researchers and tool makers.

24 January 2025 in Behavior Research Methods
Verified
Journal Article
Open access
PDF file
Naser Al MadiNaser Al Madi
Naser Al Madi
BTBrett Torra
Brett Torra
YLYixin Li
Yixin Li
NTNajam Tariq
Najam Tariq
In reading tasks, drift can move fixations from one word to another or even another line, invalidating the eye-tracking recording. Manual correction is time-consuming and subjective, while automated correction is fast – yet limited in accuracy. In this paper, we present Fix8 (Fixate), an open-source GUI tool that offers a novel semi-automated correction approach for eye-tracking data in reading tasks. The proposed approach allows the user to collaborate with an algorithm to produce accurate corrections faster without sacrificing accuracy. Through a usability study (N = 14) we assess the time benefits of the proposed technique, and measure the correction accuracy in comparison to manual correction. In addition, we assess subjective workload through the NASA Task Load Index, and user opinions through Likert-scale questions. Our results show that, on average, the proposed technique was 44% faster than manual correction without any sacrifice of accuracy. In addition, users reported a preference for the proposed technique, lower workload, and higher perceived performance compared to manual correction. Fix8 is a valuable tool that offers useful features for generating synthetic eye-tracking data, visualization, filters, data converters, and eye-movement analysis in addition to the main contribution in data correction.

Verified
Journal Article
Open access
Naser Al MadiNaser Al Madi
Naser Al Madi
Background: Automated eye tracking data correction algorithms such as Dynamic-Time Warp always made a trade-off between the ability to handle regressions (jumps back) and distortions (fixation drift). At the same time, eye movement in code reading is characterized by non-linearity and regressions. Objective: In this paper, we present a family of hybrid algorithms that aim to handles both regressions and distortions with high accuracy. Method: Through simulations with synthetic data we replicate known eye movement phenomena to assess our algorithms against Warp algorithm as a baseline. Furthermore, we utilize three real datasets to evaluate the algorithms in correcting data from reading source code and see if the proposed algorithms generalize to correcting data from reading natural language text. Results: Our results demonstrate that most proposed algorithms match or outperform baseline warp in correcting both synthetic and real data. Also, we show the prevalence of regressions in reading source code. Conclusion: Our results highlight our hybrid algorithms as an improvement to Dynamic-Time Warp in handling regressions with higher accuracy and better runtime.

10 October 2022
Verified
Conference Paper
Open access
Naser Al MadiNaser Al Madi
Naser Al Madi
Identifier naming is one of the main sources of information in program comprehension, where a significant portion of software development time is spent. Previous research shows that similarity in identifier names could potentially hinder code comprehension, and subsequently code maintenance and evolution. In this paper, we present an open-source tool for assessing confusing naming combinations in Python programs. The tool which we call Namesake, flags confusing identifier naming combinations that are similar in orthography (word form), phonology (pronunciation), or semantics (meaning). Our tool extracts identifier names from the abstract syntax tree of a program, splits compound names, and evaluates the similarity of each pair in orthography, phonology, and semantics. Problematic identifier combinations are flagged to programmers along with their line numbers. In combination with existing coding style checkers, Namesake can provide programmers with an additional resource to enhance identifier naming quality. The tool can be integrated easily in DevOps pipelines for automated checking and identifier naming appraisal.

2 June 2025
Verified
Conference Paper
Open access
LGLisa Grabinger
Lisa Grabinger
Naser Al MadiNaser Al Madi
Naser Al Madi
RBRoman Bednarik
Roman Bednarik
TBTeresa Busjahn
Teresa Busjahn
FEFabian Engl
Fabian Engl
JMJürgen Mottok
Jürgen Mottok