The paper presents the possibility of using the Kinect v2 module to control an industrial robot by means of gestures and voice commands. It describes the elements of creating software for off-line and on-line robot control. The application for the Kinect module was developed in the C# language in the Visual Studio environment, while the industrial robot control program was developed in the RAPID language in the RobotStudio environment. The development of a two-threaded application in the RAPID language allowed separating two independent tasks for the IRB120 robot. The main task of the robot is performed in Thread No. 1 (responsible for movement). Simultaneously, Thread No. 2 ensures continuous communication with the Kinect system and provides information about the gesture and voice commands in real time without any interference in Thread No. 1. The applied solution allows the robot to work in industrial conditions without the negative impact of the communication task on the time of the robot’s work cycles. Thanks to the development of a digital twin of the real robot station, tests of proper application functioning in off-line mode (without using a real robot) were conducted. The obtained results were verified on-line (on the real test station). Tests of the correctness of gesture recognition were carried out, and the robot recognized all programmed gestures. Another test carried out was the recognition and execution of voice commands. A difference in the time of task completion between the actual and virtual station was noticed; the average difference was 0.67 s. The last test carried out was to examine the impact of interference on the recognition of voice commands. With a 10 dB difference between the command and noise, the recognition of voice commands was equal to 91.43%. The developed computer programs have a modular structure, which enables easy adaptation to process requirements.

The paper presents the identification process of the mathematical model parameters of a differential-drive two-wheeled mobile robot. The values of the unknown parameters of the dynamics model were determined by carrying out their identification offline with the Levenberg-Marguardt method and identification online with the Recursive least-squares method. The authors compared the parameters identified by offline and online methods and proposed to support the recursive least squares method with the results obtained by offline identification. The correctness of the identification process of the robot dynamics model parameters, and the operation of the control system was verified by comparing the desired trajectories and those obtained through simulation studies and laboratory tests. Then an analysis of errors defined as the difference between the values of reference position, orientation and velocity, and those obtained from simulations and laboratory tests was carried out. On itd basis, the quality of regulation in the proposed algorithm was determined.

The article presents the possibility of using a graphics tablet to control an industrial robot. The paper presents elements of software development for offline and online control of a robot. The program for the graphic tablet and the operator interface was developed in C# language in Visual Studio environment, while the program controlling the industrial robot was developed in RAPID language in the RobotStudio environment. Thanks to the development of a digital twin of the real robotic workstation, tests were carried out on the correct functioning of the application in offline mode (without using the real robot). The obtained results were verified in online mode (on a real production station). The developed computer programmes have a modular structure, which makes it possible to easily adapt them to one’s needs. The application allows for changing the parameters of the robot and the parameters of the path drawing. Tests were carried out on the influence of the sampling frequency and the tool diameter on the quality of the reconstructed trajectory of the industrial robot. The results confirmed the correctness of the application. Thanks to the new method of robot programming, it is possible to quickly modify the path by the operator, without the knowledge of robot programming languages. Further research will focus on analyzing the influence of screen resolution and layout scale on the accuracy of trajectory generation.

The paper presents the possibility of using KINECT v2 module to control an industrial robot by means of gestures and voice commands. It describes elements of creating software for off-line and on-line robot control. The application for KINECT module was developed in C# language in Visual Studio environment, while the industrial robot control program was developed in RAPID language in RobotStudio environment. The development of a two-threaded application in RAPID language allowed to separate two independent tasks for the IRB120 robot. The main task of the robot is performed in thread no. 1 (responsible for movement). Simultaneously working thread no. 2 ensures continuous communication with the KINECT system and provides information about the gesture and voice commands in real time without any interference in thread no. 1. The applied solution allows the robot to work in industrial conditions without negative impact of communication task on the time of robot’s work cycles. Thanks to the development of a digital twin of the real robot station, tests of proper application functioning in off-line mode (without using a real robot) were conducted. Obtained results were verified online (on the real test station). Tests of correctness of gesture recognition were carried out, the robot recognized all programmed gestures. Another test carried out was the recognition and execution of voice commands. A difference in the time of task completion between the actual and virtual station was noticed - the average difference was 0.67 s. The last test carried out was to examine the impact of interference on the recognition of voice commands. With a 10dB difference between the command and noise, the recognition of voice commands was equal to 91.43%. The developed computer programs have a modular structure, which enables easy adaptation to process requirements.

In the scientific literature focused on surface electromyography (sEMG) and functional near-infrared spectroscopy (fNIRS), which have been described together and separately many times, presenting different possible applications, researchers have explored a diverse range of topics related to these advanced physiological measurement techniques. However, the analysis of the two signals and their interrelationships continues to be a focus of study in both static and dynamic movements. The main purpose of this study was to determine the relationship between signals during dynamic movements. To carry out the analysis described, the authors of this research paper chose two sports exercise protocols: the Astrand–Rhyming Step Test and the Astrand Treadmill Test. In this study, oxygen consumption and muscle activity were recorded from the gastrocnemius muscle of the left leg of five female participants. This study found positive correlations between EMG and fNIRS signals in all participants: 0.343–0.788 (median-Pearson) and 0.192–0.832 (median-Spearman). On the treadmill, the signal correlations between the participants with the most active and least active lifestyle achieved the following medians: 0.788 (Pearson)/0.832 (Spearman) and 0.470 (Pearson)/0.406 (Spearman), respectively. The shapes of the changes in the EMG and fNIRS signals during exercise suggest a mutual relationship during dynamic movements. Furthermore, during the treadmill test, a higher correlation was observed between the EMG and NIRS signals in participants with a more active lifestyle. Due to the sample size, the results should be interpreted with caution.