Autonomous driving (AD), including single-vehicle intelligent AD and vehicle–infrastructure cooperative AD, has become a current research hot spot in academia and industry, and multi-sensor fusion is a fundamental task for AD system perception. However, the multi-sensor fusion process faces the problem of differences in the type and dimensionality of sensory data acquired using different sensors (cameras, lidar, millimeter-wave radar, and so on) as well as differences in the performance of environmental perception caused by using different fusion strategies. In this article, we study multiple papers on multi-sensor fusion in the field of AD and address the problem that the category division in current multi-sensor fusion perception is not detailed and clear enough and is more subjective, which makes the classification strategies differ significantly among similar algorithms. We innovatively propose a multi-sensor fusion taxonomy, which divides the fusion perception classification strategies into two categories—symmetric fusion and asymmetric fusion—and seven subcategories of strategy combinations, such as data, features, and results. In addition, the reliability of current AD perception is limited by its insufficient environment perception capability and the robustness of data-driven methods in dealing with extreme situations (e.g., blind areas). This article also summarizes the innovative applications of multi-sensor fusion classification strategies in AD cooperative perception.
18 October 2022 in IEEE Transactions on Computational Social Systems
Natural disasters are public emergencies characterized by suddenness, universality, and nonconventionality. Realizing the early warning, monitoring, and intervention of natural disasters and their derivative social impacts is significant for reducing the disasters’ damage and benefits the maintenance of social stability. Social sensors are ubiquitous sensors based on social network platforms. It uses the concepts and methods of physical space to mine social signals that integrate human perception and intelligence in cyberspace. Compared with traditional physical sensors, social sensors represent a crucial data acquisition channel in the emergency management of natural disasters and have the advantages of real time, comprehensive coverage, low cost, and flexible deployment. This article reviews the application of social sensors in natural disasters emergency management. We summarize the application functions of social sensors into three categories: natural disaster situation awareness and event detection, disaster information dissemination and communication, and disaster sentiment analysis and public opinion mining. Based on the above functions, this article analyzes the research status, data, technical methods, and application systems. Finally, this article proposes a research trend of applying social sensors in natural disaster emergency management according to the requirements of real scenarios.
8 November 2021 in IEEE Transactions on Knowledge and Data Engineering
Massive Open Online Courses (MOOCs) have received unprecedented attention, in which learners can obtain a large number of learning objects anytime and anywhere. However, the increasing information overload on MOOCs inhibits the appropriate choice of learning objects by learners, leading to a low efficiency and high dropout rates in the learning process of this human-computer interaction scenario. E-learning recommendation systems have been studied to present learning objects directly to learners, thereby relieving such problem. However, in MOOC platforms, recommendation network structures which can selectively extract implicit feature such as heterogeneous learning preference and knowledge organization of learning objects are still not comprehensively studied. To this end, we propose a learning object recommendation model based on heterogeneous learning behavior and knowledge graph. To generate a unified representation of each entity and relation, we first propose an Attentive Composition based Graph Convolutional Network (ACGCN). By introducing an attention mechanism, information is amplified when updating the representation of the heterogeneous graph, which eliminates the impact of noise and improves the robustness of the model. Then, a Dense Feature based Operation-Aware Network (DFOAN) is utilized to capture implicit and complex learners’ interactive behaviors, and to further provide a recommendation. Experimental results using two real-world datasets revealed that our proposed model has the best precision, recall, F1, and accuracy scores compared to those of several existing models.
10 March 2021 in IEEE Transactions on Computational Social Systems
Urban transportation systems are shaped by factors that include people, vehicles, roads, and the environment, forming a complex and giant system with dynamics, diversity, and uncertainty. Physical signal-driven intelligent transportation systems (ITSs) typically lack the ability to capture social behaviors or crowd willingness, and they achieve only information automation for transportation decision support. The crowdsourcing social signals consist of timely, extensive, comprehensive, and rich intelligence that concern urban dynamics, social behaviors, and traffic environments. Such social signals provide a new paradigm for operating ITS with unstructured semantic data, making knowledge automation for decision intelligence a possibility. This article reviews the knowledge automation paradigms for cyber-physical-social systems (CPSSs) compared with traditional information automation paradigms for cyber-physical systems (CPSs) in ITS, from the perspective of data-driven, modeling space, analytical methodologies, and decision support services. To investigate the key methodology in social spaces that enhance information automation into knowledge automation, we summarize the current research into a multisource heterogeneous social signal-based traffic decision knowledge automation framework and further exploit the computational paradigm and applications scenarios of this framework. Finally, we discuss future challenges for designing and realizing knowledge automation on CPSS in transportation.
Traffic situation awareness and alerting assisted by adverse weather conditions contributes to improve traffic safety, disaster coping mechanisms, and route planning for government agencies, business sectors, and individual travelers. However, at the city level, the physical sensor-generated data are partly held by different transportation and meteorological departments, which causes problems of “isolated information” for data fusion. Furthermore, it makes traffic situation awareness and estimation challenging and ineffective. In this paper, we leverage the power of crowdsourcing knowledge in social media and propose a novel way to forecast and generate alerts for city-level traffic incidents based on a social approach rather than traditional physical approaches. Specifically, we first collect adverse weather topics and reports of traffic incidents from social media. Then, we extract temporal, spatial, and meteorological features as well as labeled traffic reaction values corresponding to the social media “heat” for each city. Afterwards, the regression and alerting model is proposed to estimate the city-level traffic situation and give the suggestion of warning levels. The experiments show that the proposed model equipped with gcForest achieves the best root mean square error (RMSE) and mean absolute percentage error (MAPE) score on the social traffic incidents test dataset. Moreover, we consider the news report as an objective measurement to flexibly validate the feasibility of proposed model from social cyberspace to physical space. Finally, a prototype system was deployed and applied to government agencies to provide an intuitive visualization solution as well as decision support assistance.
28 February 2025 in Sensors and Actuators B: Chemical