Pekka Kallioniemi

Dr. Pekka Kallioniemi


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
Verified
Journal Article
Open access
PDF file
PKPekka Kallioniemi
Pekka Kallioniemi
ABAlisa Burova
Alisa Burova
JMJohn Mäkelä
John Mäkelä
TKTuuli Keskinen
Tuuli Keskinen
KRKimmo Ronkainen
Kimmo Ronkainen
MTMarkku Turunen
Markku Turunen
Developments in sensor technology, artificial intelligence, and network technologies like 5G has made remote operation a valuable method of controlling various types of machinery. The benefits of remote operations come with an opportunity to access hazardous environments. The major limitation of remote operation is the lack of proper sensory feedback from the machine, which in turn negatively affects situational awareness and, consequently, may risk remote operations. This article explores how to improve situational awareness via multimodal feedback (visual, auditory, and haptic) and studies how it can be utilized to communicate warnings to remote operators. To reach our goals, we conducted a controlled, within-subjects experiment in eight conditions with twenty-four participants on a simulated remote driving system. Additionally, we gathered further insights with a UX questionnaire and semi-structured interviews. Gathered data showed that the use of multimodal feedback positively affected situational awareness when driving remotely. Our findings indicate that the combination of added haptic and visual feedback was considered the best feedback combination to communicate the slipperiness of the road. We also found that the feeling of presence is an important aspect of remote driving tasks, and a requested one, especially by those with more experience in operating real heavy machinery.

Verified
Journal Article
Open access
PDF file
ABAlisa Burova
Alisa Burova
JMJohn Mäkelä
John Mäkelä
TKTuuli Keskinen
Tuuli Keskinen
PKPekka Kallioniemi
Pekka Kallioniemi
KRKimmo Ronkainen
Kimmo Ronkainen
MTMarkku Turunen
Markku Turunen
Remote operations have been greatly enhanced by advancements in technology, enabling remote control of machinery in hazardous environments. However, it is still a challenge to design remote control interfaces and provide feedback in a way that would enhance situational awareness without negatively affecting cognitive load. This study investigates how different audio feedback designs can support remote boom operation and, additionally, explores the potential impact of gamification elements on operator performance and motivation. Due to COVID-19 restrictions, this study was conducted remotely with 16 participants using a simulated environment featuring a virtual excavator. Participants performed digging tasks using two audio feedback designs: frequency-modulated beeping and realistic spatialized steam sounds. The findings indicate that both audio designs are beneficial for remote boom operations: the beeping sound was perceived as more comfortable and efficient in determining the proximity of a hidden object and helped in avoiding collisions, whereas spatial sounds enhanced the sense of presence. Therefore, we suggest combining both audio designs for optimal performance and emphasize the importance of customizable feedback in remote operations. This study also revealed that gamification elements could both positively and negatively affect performance and motivation, highlighting the need for careful design tailored to specific task requirements.

23 August 2019
Verified
Book Chapter
Closed access
PDF file
PKPekka Kallioniemi
Pekka Kallioniemi
KRKimmo Ronkainen
Kimmo Ronkainen
JKJussi Karhu
Jussi Karhu
SSSumita Sharma
Sumita Sharma
JHJaakko Hakulinen
Jaakko Hakulinen
MTMarkku Turunen
Markku Turunen