Hands-free computer interaction is a key topic in assistive technology, with camera-based and voice-based systems being the most common methods. Recent camera-based solutions leverage facial expressions or head movements to simulate mouse clicks or key presses, while voice-based systems enable control via speech commands, wake-word detection, and vocal gestures. However, existing systems often suffer from limitations in responsiveness and accuracy, especially under real-world conditions. In this paper, we present 3-Modal Human-Computer Interaction (3M-HCI), a novel interaction system that dynamically integrates facial, vocal, and eye-based inputs through a new signal processing pipeline and a cross-modal coordination mechanism. This approach not only enhances recognition accuracy but also reduces interaction latency. Experimental results demonstrate that 3M-HCI outperforms several recent hands-free interaction solutions in both speed and precision, highlighting its potential as a robust assistive interface.

The design and control of lower-limb rehabilitation robots for patients after a stroke has gained significant attention. This paper presents the dynamic analysis and control of a 3-degrees-of-freedom lower-limb rehabilitation robot using combined position–force control based on the force feed-forward and compensative gravity proportional derivative methods. In the lower-limb rehabilitation robot, the interaction force between the patient with the joints and links of the robot is uncertain and nonlinear due to the disturbance effect of Coriolis force, centrifugal force, gravitational force, and friction force. During recovery stages, the forces exerted by the patient’s lower limbs are also considered disturbances. Therefore, to meet the quality requirements in using the rehabilitation robot with different recovery stages of patient training, combining position control and force control is essential. In this paper, we proposed a combination of proportional–derivative gravity compensation motion control and force feed-forward control to form an advanced combined controller (position–force feed-forward control—PFFC) for a 3 DOF lower-limb functional rehabilitation robot. The forces can be sensed using a 3-axis force sensor. In addition, the robot’s position parameters are also measured by encoders. The control algorithm is implemented on the STM32F4 Discovery board. A verified test of the proposed control method is shown in the experiments, showing the good performance of the system.

Autonomous vehicles represent a transformative technology in modern transportation, promising enhanced safety, efficiency, and accessibility in mobility systems. This paper presents a comprehensive autonomous vehicle system designed specifically for Vietnam’s traffic conditions, featuring a multi-layered approach to perception, decision-making, and control. The system utilizes dual 2D LiDARs, camera vision, and GPS sensing to navigate complex urban environments. A key contribution is the development of a specialized segmentation model that accurately identifies Vietnam-specific traffic signs, lane markings, road features, and pedestrians. The system implements a hierarchical decision-making architecture, combining long-term planning based on GPS and map data with short-term reactive planning derived from a bird’s-eye view transformation of segmentation and LiDAR data. The control system modulates the speed and steering angle through a validated model that ensures stable vehicle operation across various traffic scenarios. Experimental results demonstrate the system’s effectiveness in real-world conditions, achieving a high accuracy rate in terms of segmentation and detection and an exact response in navigation tasks. The proposed system shows robust performance in Vietnam’s unique traffic environment, addressing challenges such as mixed traffic flow and country-specific road infrastructure.

Autonomous vehicles represent a transformative technology in modern transportation, promising enhanced safety, efficiency, and accessibility in mobility systems. This paper presents a comprehensive autonomous vehicle system designed specifically for Vietnam's traffic conditions, featuring a multi-layered approach to perception, decision-making, and control. The system utilizes dual 2D LiDARs, camera vision, and GPS sensing to navigate complex urban environments. A key contribution is the development of a specialized segmentation model that accurately identifies Vietnam-specific traffic signs, lane markings, road features, and pedestrians. The system implements a hierarchical decision-making architecture, combining long-term planning based on GPS and map data with short-term reactive planning derived from a bird's-eye view transformation of segmentation and LiDAR data. The control system modulates the speed and steering angle through a validated model that ensures stable vehicle operation across various traffic scenarios. Experimental results demonstrate the system's effectiveness in real-world conditions, achieving a high accuracy rate in terms of segmentation and detection, and exact response in navigation tasks. The proposed system shows robust performance in Vietnam's unique traffic environment, addressing challenges such as mixed traffic flow and country-specific road infrastructure.

The design and control of lower limb rehabilitation robots for patients after a stroke has gained significant attention. This paper presents the dynamic analysis and control of a 3-degree-of-freedom lower limb rehabilitation robot using combined position-force control based on the force feed-forward and compensate gravity proportional derivative method. In the lower limb rehabilitation robot, the interaction force between the patient with the joints and links of the robot is uncertain and nonlinear due to the disturbance effect of Coriolis force, centrifugal force, gravitational force, and friction force. During recovery stages, forces exerted by the patient's lower limb are considered disturbances. Therefore, to meet the quality requirements in using the rehabilitation robot with different recovery stages of patient training, combining position control and force control is essential. In this paper, we proposed a combinations of proportional-derivative gravity compensation motion control and force feed-forward control to form an advanced combined controller (Position-Force Feedforward Control - PFFC) for a 3 DOF lower limb functional rehabilitation robot. The forces can be sensed using a 3-axis force sensor. In addition, the robot's position parameters are also measured by encoders. The control algorithm is implemented on the STM32F4 Discovery board. Verified test of the proposed control method is shown in the experiments and shown good performance of the system.