Classical imitation learning methods suffer substantially from the learning hierarchical policies when the imitative agent faces an unobserved state by the expert agent. To address these drawbacks, we propose an online active learning through active inference approach that encodes the expert’s demonstrations based on observation-action to improve the learner’s future motion prediction. For this purpose, we provide a switching Dynamic Bayesian Network based on the dynamic interaction between the expert agent and another object in its surrounding as a reference model, which we exploit to initialize an incremental probabilistic learning model. This learning model grows and matures based on the free-energy formulation and message passing of active inference dynamically at discrete and continuous levels in an online active learning phase. In this scheme, generalized states of the learning world are represented as distance-vector, where it is the learner’s observation concerning its interaction with a moving object. Considering the distance vector entail intentions, it enables action prediction evaluation in a prospective sense. We illustrate these points using simulations of driving intelligent agents. The learning agent is trained by using long-term predictions from the generative learning model to reproduce the expert’s motion while learning how to select a suitable action through new experiences. Our results affirm that a Dynamic Bayesian optimal approach provides a principled framework and outperforms conventional reinforcement learning methods. Furthermore, it endorses the general formulation of action prediction as active inference.

Equipping autonomous agents for dynamic interaction and navigation is a significant challenge in intelligent transportation systems. This study aims to address this by implementing a brain-inspired model for decision making in autonomous vehicles. We employ active inference, a Bayesian approach that models decision-making processes similar to the human brain, focusing on the agent’s preferences and the principle of free energy. This approach is combined with imitation learning to enhance the vehicle’s ability to adapt to new observations and make human-like decisions. The research involved developing a multi-modal self-awareness architecture for autonomous driving systems and testing this model in driving scenarios, including abnormal observations. The results demonstrated the model’s effectiveness in enabling the vehicle to make safe decisions, particularly in unobserved or dynamic environments. The study concludes that the integration of active inference with imitation learning significantly improves the performance of autonomous vehicles, offering a promising direction for future developments in intelligent transportation systems.

This paper explores the complex dynamics of Wi-Fi probe request frames, focusing on their transmission behaviors and the implications for user privacy. As mobile devices become increasingly sophisticated, their capacity for wireless communication presents both opportunities for enhanced connectivity and privacy-related challenges. This study examines critical features of probe request frames and their role in device fingerprinting. We highlight the challenges and advancements in communicating between mobile devices and nearby networks by analyzing the randomization policies employed by various operating systems and their effectiveness in masking device identities. Through comprehensive experiments conducted across multiple mobile devices and operating system versions, we capture and analyze probe request frames under different user-device interaction phases. Our findings indicate variations in transmission frequency and the impact of connection states on broadcasting characteristics. We also investigate the deployed randomization policies in different brands of mobile devices, uncovering their influence on privacy preservation. This research provides notable insights for developing more effective wireless communication approaches, contributing to the broader goal of enhancing user privacy in this field.

Being able to robustly interact with and navigate a dynamic environment has been a long-standing challenge in intelligent transportation systems. Autonomous agents can use models that mimic the human brain to learn how to respond to other participants’ actions in the environment and proactively coordinate with the dynamics. Modeling brain learning procedures is challenging for multiple reasons, such as stochasticity, multimodality, and unobservant intents. Active inference may be defined as the Bayesian modeling of a brain with a biologically plausible model of the agent. Its primary idea relies on the free energy principle and the prior preference of the agent. It enables the agent to choose an action that leads to its preferred future observations. An exploring action-oriented model is introduced to address the inference complexity and solve the exploration–exploitation dilemma in unobserved environments. It is conducted by adapting active inference to an imitation learning approach and finding a theoretical connection between them. We present a multimodal self-awareness architecture for autonomous driving systems where the proposed techniques are evaluated on their ability to model proper driving behavior. Experimental results provide the basis for the intelligent driving system to make more human-like decisions and improve agent performance to avoid a collision.

The use of Multiple Access protocols information in Internet of Things environments has gained significant interest over the past decade, particularly for crowd behavior monitoring. Due to its high data rates and low infrastructure requirements, Wi-Fi is considered one of the most promising wireless technologies for leveraging the explosive growth of transmitted data from mobile devices. However, with the introduction of MAC address randomization and the application of new randomization policies on assigning randomized sequence numbers to transmitted frames in mobile devices to enhance privacy, traditional approaches to device identification face significant challenges. To tackle this issue, we conduct a comprehensive analysis at the Multiple Access level and propose CrowdWatch which is an innovative framework designed to enhance the understanding and utilization of MAC randomization dynamics. Additionally, we introduce a novel approach that leverages multiple device-specific features to accurately associate frames with randomized MAC addresses to their corresponding devices. By integrating multi-modal fingerprints, the framework can effectively identify mobile devices and track their behavior. The presented approach ensures reliable detection even under the latest randomization policies. We examined the introduced framework through real-world experiments, and the findings prove that it is an effective solution for smart building management and occupancy estimation in dynamic environments.