Jennifer Joana Gago

Dr. Jennifer Joana Gago

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 January 2019 in Electronics
Verified
Journal Article
Open access
PDF file
JGJennifer Joana Gago
Jennifer Joana Gago
JVJuan G Victores
Juan G Victores
CBC. Balaguer
C. Balaguer
In this paper, we illustrate our work on improving the accessibility of Cyber–Physical Systems (CPS), presenting a study on human–robot interaction where the end-users are either deaf or hearing-impaired people. Current trends in robotic designs include devices with robotic arms and hands capable of performing manipulation and grasping tasks. This paper focuses on how these devices can be used for a different purpose, which is that of enabling robotic communication via sign language. For the study, several tests and questionnaires are run to check and measure how end-users feel about interpreting sign language represented by a humanoid robotic assistant as opposed to subtitles on a screen. Stemming from this dichotomy, dactylology, basic vocabulary representation and end-user satisfaction are the main topics covered by a delivered form, in which additional commentaries are valued and taken into consideration for further decision taking regarding robot-human interaction. The experiments were performed using TEO, a household companion humanoid robot developed at the University Carlos III de Madrid (UC3M), via representations in Spanish Sign Language (LSE), and a total of 16 deaf and hearing-impaired participants.

1 March 2022 in Cognitive Systems Research
Verified
Journal Article
Closed access
RFRaul Fernandez
Raul Fernandez
JVJuan G Victores
Juan G Victores
JGJennifer Joana Gago
Jennifer Joana Gago
DEDavid Estevez
David Estevez
CBCarlos Balaguer
Carlos Balaguer

9 July 2019 in arXiv
Verified
Preprint
Open access
PDF file
JGJennifer Joana Gago
Jennifer Joana Gago
VVValentina Vasco
Valentina Vasco
BŁBartek Łukawski
Bartek Łukawski
Ugo PattaciniUgo Pattacini
Ugo Pattacini
VTVadim Tikhanoff
Vadim Tikhanoff
CBCarlos Balaguer
Carlos Balaguer
This paper presents a study on natural language to sign language translation with human-robot interaction application purposes. By means of the presented methodology, the humanoid robot TEO is expected to represent Spanish sign language automatically by converting text into movements, thanks to the performance of neural networks. Natural language to sign language translation presents several challenges to developers, such as the discordance between the length of input and output data and the use of non-manual markers. Therefore, neural networks and, consequently, sequence-to-sequence models, are selected as a data-driven system to avoid traditional expert system approaches or temporal dependencies limitations that lead to limited or too complex translation systems. To achieve these objectives, it is necessary to find a way to perform human skeleton acquisition in order to collect the signing input data. OpenPose and skeletonRetriever are proposed for this purpose and a 3D sensor specification study is developed to select the best acquisition hardware.