Zhang Jiaming

Dr. Zhang Jiaming

orcid

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 February 2021 in Frontiers in Neurorobotics
Verified
Journal Article
Open access
ZLZhihao Li
Zhihao Li
YMYishan Mu
Yishan Mu
ZSZhenglong Sun
Zhenglong Sun
SSSifan Song
Sifan Song
JSJionglong Su
Jionglong Su
ZJZhang Jiaming
Zhang Jiaming
With the rapid development of robotic and AI technology in recent years, human–robot interaction has made great advancement, making practical social impact. Verbal commands are one of the most direct and frequently used means for human–robot interaction. Currently, such technology can enable robots to execute pre-defined tasks based on simple and direct and explicit language instructions, e.g., certain keywords must be used and detected. However, that is not the natural way for human to communicate. In this paper, we propose a novel task-based framework to enable the robot to comprehend human intentions using visual semantics information, such that the robot is able to satisfy human intentions based on natural language instructions (total three types, namely clear, vague, and feeling, are defined and tested). The proposed framework includes a language semantics module to extract the keywords despite the explicitly of the command instruction, a visual object recognition module to identify the objects in front of the robot, and a similarity computation algorithm to infer the intention based on the given task. The task is then translated into the commands for the robot accordingly. Experiments are performed and validated on a humanoid robot with a defined task: to pick the desired item out of multiple objects on the table, and hand over to one desired user out of multiple human participants. The results show that our algorithm can interact with different types of instructions, even with unseen sentence structures.

27 April 2022 in Computational Intelligence and Neuroscience
Verified
Journal Article
Open access
PDF file
GWGuobin Wan
Guobin Wan
FDFuhao Deng
Fuhao Deng
ZJZijian Jiang
Zijian Jiang
SSSifan Song
Sifan Song
DHDi Hu
Di Hu
ZJZhang Jiaming
Zhang Jiaming
Traditional training methods such as card teaching, assistive technologies (e.g., augmented reality/virtual reality games and smartphone apps), DVDs, human-computer interactions, and human-robot interactions are widely applied in autistic rehabilitation training in recent years. In this article, we propose a novel framework for human-computer/robot interaction and introduce a preliminary intervention study for improving the emotion recognition of Chinese children with an autism spectrum disorder. The core of the framework is the Facial Emotion Cognition and Training System (FECTS, including six tasks to train children with ASD to match, infer, and imitate the facial expressions of happiness, sadness, fear, and anger) based on Simon Baron-Cohen’s E-S (empathizing-systemizing) theory. Our system may be implemented on PCs, smartphones, mobile devices such as PADs, and robots. The training record (e.g., a tracked record of emotion imitation) of the Chinese autistic children interacting with the device implemented using our FECTS will be uploaded and stored in the database of a cloud-based evaluation system. Therapists and parents can access the analysis of the emotion learning progress of these autistic children using the cloud-based evaluation system. Deep-learning algorithms of facial expressions recognition and attention analysis will be deployed in the back end (e.g., devices such as a PC, a robotic system, or a cloud system) implementing our FECTS, which can perform real-time tracking of the imitation quality and attention of the autistic children during the expression imitation phase. In this preliminary clinical study, a total of 10 Chinese autistic children aged 3–8 are recruited, and each of them received a single 20-minute training session every day for four consecutive days. Our preliminary results validated the feasibility of the developed FECTS and the effectiveness of our algorithms based on Chinese children with an autism spectrum disorder. To verify that our FECTS can be further adapted to children from other countries, children with different cultural/sociological/linguistic contexts should be recruited in future studies.

1 July 2020 in International Journal of Machine Learning and Computing
Verified
Journal Article
Open access
XLXuan Li
Xuan Li
HZHuixin Zhong
Huixin Zhong
BZBin Zhang
Bin Zhang
ZJZhang Jiaming
Zhang Jiaming

1 March 2019 in Frontiers of Information Technology & Electronic Engineering
Verified
Journal Article
Closed access
PDF file
GWGuo-Bin Wan
Guo-Bin Wan
FDFu-Hao Deng
Fu-Hao Deng
ZJZi-Jian Jiang
Zi-Jian Jiang
SLSheng-Zhao Lin
Sheng-Zhao Lin
CZCheng-Lian Zhao
Cheng-Lian Zhao
ZJZhang Jiaming
Zhang Jiaming
There is an increasing need to introduce socially interactive robots as a means of assistance in autism spectrum disorder (ASD) treatment and rehabilitation, to improve the effectiveness of...

1 January 2011
Verified
Book Chapter
Closed access
PDF file
ZJZhang Jiaming
Zhang Jiaming
ASAmanda J. C. Sharkey
Amanda J. C. Sharkey

20 January 2021 in IEEE Access
Verified
Journal Article
Open access
SLShengzhao Lin
Shengzhao Lin
JSJionglong Su
Jionglong Su
SSSifan Song
Sifan Song
ZJZhang Jiaming
Zhang Jiaming
The social interaction is one of the necessary skills for social robots to better integrate into human society. However, current social robots interact mainly through audio and visual means with little reliance on haptic interaction. There still exist many obstacles for social robots to interact through touch: 1) the complex manufacturing process of the tactile sensor array is the main obstacle to lowering the cost of production; 2) the haptic interaction mode is complex and diverse. There are no social robot interaction standards and data sets for tactile interactive behavior in the public domain. In view of this, our research looks into the following aspects of tactile perception system: 1) Development of low-cost tactile sensor array, including sensor principle, simulation, manufacture, front-end electronics, examination, then applied to the social robot's whole body; 2) Establishment of the tactile interactive model and an event-triggered perception model in a social interactive application for the social robot, then design preprocessing and classification algorithm. In this research, we use k-nearest neighbors, tree, support vector machine and other classification algorithms to classify touch behaviors into six different classes. In particular, the cosine k-nearest neighbors and quadratic support vector machine achieve an overall mean accuracy rate of more than 68%, with an individual accuracy rate of more than 80%. In short, our research provides new directions in achieving low-cost intelligent touch interaction for social robots in a real environment. The low-cost tactile sensor array solution and interactive models are expected to be applied to social robots on a large scale.