Layan Etaiwi

Layan Etaiwi

Auto-generated profile, based on publicly available information

Layan Etaiwi

Department of Computer Engineering and Software Engineering Polytechnique Montreal Montreal QC Canada

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 March 2026 in Journal of Artificial Intelligence Research
Verified
Journal Article
Open access
PDF file
Pascal SagerPascal Sager
Pascal Sager
BMBenjamin Meyer
Benjamin Meyer
PYPeng Yan
Peng Yan
RWRebekka Von Wartburg-Kottler
Rebekka Von Wartburg-Kottler
LELayan Etaiwi
Layan Etaiwi
Thilo StadelmannThilo Stadelmann
Thilo Stadelmann
Background: Agents for computer use (ACUs) are systems that execute complex tasks on digital devices – such as personal computers or mobile phones – given instructions in natural language. These agents automate tasks by controlling software through low-level actions like mouse clicks and touchscreen gestures. However, despite rapid progress, ACUs are not yet mature for everyday use. Objectives: This survey examines the current state-of-the-art, identifies trends, and points out research gaps in the development of practical ACUs. The goal is to provide a comprehensive review and analysis that helps advance general-purpose, robust, and scalable agents for real-world computer use. Methods: We introduce a multifaceted taxonomy of ACUs across three dimensions: (I) the domain perspective, characterizing the contexts in which agents operate; (II) the interaction perspective, describing observation modalities (e.g., screenshots, HTML) and action modalities (e.g., mouse, keyboard, code execution); and (III) the agent perspective, detailing how agents perceive, reason, and learn. We review 87 original research papers about ACUs and 33 relevant datasets, covering both foundation model-based and specialized approaches. Results: Our taxonomy comprehensively structures state-of-the-art approaches and establishes the groundwork for guiding future ACU research. We found that the field is transitioning from specialized agents toward foundation-model-based agents, a shift from text to image-based observation space, and an increasing adoption of behavior cloning methodologies. Furthermore, we identify six key research gaps: insufficient generalization, inefficient learning, limited planning, low task complexity in benchmarks, non-standardized evaluation, and a disconnect between research and practical conditions. Conclusions: To continue rapid improvements in the field, we recommend focusing on: (a) vision-based observations and low-level control to enhance generalization; (b) adaptive learning beyond static prompting; (c) effective planning and reasoning capabilities; (d) realistic, high-complexity benchmarks; (e) standardized evaluation criteria based on task success; and (f) aligning agent design with real-world deployment constraints. Collectively, our findings and proposed directions help develop more general-purpose agents for everyday digital tasks.

2 September 2024 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
LELayan Etaiwi
Layan Etaiwi
PSPascal Sager
Pascal Sager
Yann-Gaël GuéhéneucYann-Gaël Guéhéneuc
Yann-Gaël Guéhéneuc
SHSylvie Hamel
Sylvie Hamel

9 September 2025
Verified
Book Chapter
Closed access
PDF file
CUChoro Ulan Uulu
Choro Ulan Uulu
Mikhail KulyabinMikhail Kulyabin
Mikhail Kulyabin
LELayan Etaiwi
Layan Etaiwi
MPMartins Pacheco
Martins Pacheco
NMNuno Miguel
Nuno Miguel
HOHelena Holmström Olsson
Helena Holmström Olsson