Experiencing the flow of time is an important capacity of biological systems that is involved in many ways in the daily activities of humans and animals. However, in the field of robotics, the key role of time in cognition is not adequately considered in contemporary research, with artificial agents focusing mainly on the spatial extent of sensory information, almost always neglecting its temporal dimension. This fact significantly obstructs the development of high level robotic cognitive skills, as well as the autonomous and seamless operation of artificial agents in human environments. Taking inspiration from biological cognition, the present work puts forward time perception as a vital capacity of artificial intelligent systems and contemplates the research path for incorporating temporal cognition in the repertoire of robotic skills.

The sense of time is an essential capacity of humans, with a major role in many of the cognitive processes expressed in our daily lifes. So far, in cognitive science and robotics research, mental capacities have been investigated in a theoretical and modelling framework that largely neglects the flow of time. Only recently there has been a small but constantly increasing interest in the temporal aspects of cognition, integrating time into a range of different models of perceptuo-motor capacities. The current paper aims to review existing works in the field and suggest directions for fruitful future work. This is particularly important for the newly developed field of artificial temporal cognition that is expected to significantly contribute in the development of sophisticated artificial agents seamlessly integrated into human societies.

The detection and prevention of workers’ body straining postures and other stressing conditions within the work environment, supports establishing occupational safety and promoting well being and sustainability at work. Developed methods towards this aim typically rely on combining highly ergonomic workplaces and expensive monitoring mechanisms including wearable devices. In this work, we demonstrate how the input from low-cost sensors, specifically, passive camera sensors installed in a real manufacturing workplace, and smartwatches used by the workers can provide useful feedback on the workers’ conditions and can yield key indicators for the prevention of work-related musculo-skeletal disorders (WMSD) and physical fatigue. To this end, we study the ability to assess the risk for physical strain of workers online during work activities based on the classification of ergonomically sub-optimal working postures using visual information, the correlation and fusion of these estimations with synchronous worker heart rate data, as well as the prediction of near-future heart rate using deep learning-based techniques. Moreover, a new multi-modal dataset of video and heart rate data captured in a real manufacturing workplace during car door assembly activities is introduced. The experimental results show the efficiency of the proposed approach that exceeds 70% of classification rate based on the F1 score measure using a set of over 300 annotated video clips of real line workers during work activities. In addition a time lagging correlation between the estimated ergonomic risks for physical strain and high heart rate was assessed using a larger dataset of synchronous visual and heart rate data sequences. The statistical analysis revealed that imposing increased strain to body parts will results in an increase to the heart rate after 100–120 s. This finding is used to improve the short term forecasting of worker’s cardiovascular activity for the next 10 to 30 s by fusing the heart rate data with the estimated ergonomic risks for physical strain and ultimately to train better predictive models for worker fatigue.

Identifying the material composition of objects is crucial for many recycling sector applications. Traditionally, object classification relies either on hyperspectral imaging (HSI), which analyses the chemometric properties of objects to infer material types, or on RGB imaging, which captures an object’s visual appearance and compares it to a reference sample. While both approaches have their strengths, each also suffers from limitations, particularly in challenging scenarios such as robotic municipal waste sorting, where objects are often heavily deformed or contaminated with various forms of dirt, complicating material recognition. This work presents a novel method for material-based object classification that jointly exploits HSI and RGB imaging. The proposed approach aims to mitigate the weaknesses of each technique while amplifying their respective advantages. It involves the real-time alignment of HSI and RGB data streams to ensure reliable result correlation, alongside a machine learning framework that learns to exploit the strengths and compensate for the weaknesses of each modality across different material types. Experimental validation on a municipal waste sorting facility demonstrates that the combined HSI–RGB approach significantly outperforms the individual methods, achieving robust and accurate classification even in highly challenging conditions.