Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention. Due to their powerful emergent abilities, recent LLMs are considered as a possible alternative to structured knowledge bases like knowledge graphs (KGs). However, while LLMs are proficient at learning probabilistic language patterns and engaging in conversations with humans, they, like previous smaller pre-trained language models (PLMs), still have difficulty in recalling facts while generating knowledge-grounded contents. To overcome these limitations, researchers have proposed enhancing data-driven PLMs with knowledge-based KGs to incorporate explicit factual knowledge into PLMs, thus improving their performance in generating texts requiring factual knowledge and providing more informed responses to user queries. This paper reviews the studies on enhancing PLMs with KGs, detailing existing knowledge graph enhanced pre-trained language models (KGPLMs) as well as their applications. Inspired by existing studies on KGPLM, this paper proposes enhancing LLMs with KGs by developing knowledge graph-enhanced large language models (KGLLMs). KGLLM provides a solution to enhance LLMs’ factual reasoning ability, opening up new avenues for LLM research.
28 January 2020 in IEEE Internet of Things Journal
Vehicles in Internet of Vehicles (IoV) exchange information about location, environment, infotainment, as well as social information with other units via vehicular communication networks. This makes IoV with key social entities in the human-vehicle-infrastructure-roadside units (RSU) as integrated intelligent transportation systems. Therefore, by identifying the cyber-physical-social features of IoV and presenting its complexity issues of both engineering and social dimensions, this paper proposes and introduces the concept, architecture, and applications of Parallel Internet of Vehicles (PIoV). Three main components of PIoV are demonstrated, which are artificial IoV to learn and describe the physical IoV, computation experiments to evaluate and predict the consequences and values of driving strategies, and parallel execution to prescribe the operation of the physical IoV. PIoV makes it possible to achieve safe, smart, effective, and efficient transportation management and control. The final objective of PIoV is to equip IoV with descriptive, predictive, and prescriptive intelligence based on the parallel intelligence approach.
1 September 2021 in IEEE Internet of Things Journal
In recent years, deep learning (DL) has been widely used in vehicle misbehavior detection and has attracted great attention due to its powerful nonlinear mapping ability. However, because of the large number of network parameters, the training processes of these methods are time consuming. Besides, the existing detection methods lack scalability; thus, they are not suitable for Internet of Vehicles (IoV) where new data are constantly generated. In this article, the concept of the broad learning system (BLS) is innovatively introduced into vehicle misbehavior detection. In order to make better use of vehicle information, key features are first extracted from the collected raw data. Then, a BLS is established, which is able to calculate the connection weight of the network efficiently and effectively by ridge regression approximation. Finally, the system can be updated and refined by an incremental learning algorithm based on the newly generated data in IoV. The experimental results show that the proposed method performs much better than DL or traditional classifiers, and could update and optimize the old model fastly and progressively while improving the system’s misbehavior detection accuracy.
31 March 2020 in IEEE Transactions on Computational Social Systems
Considering the distances to exits, exits' capacities, the sizes of queues at exits, distances to the nuclear power plant, as well as individual characteristics, the exit choice model for pedestrians in the plume planning area is established based on a random forest model. This model is trained and verified with the survey data of residents around the Daya Bay Nuclear Power Plant collected from a serious game-based questionnaire system. Combining the pedestrian choice with the agent-based pedestrian behavior simulation model, the evacuation process of a nuclear accident is simulated. Based on the detailed evacuation simulation model, a comparative experiment is performed to evaluate the staged evacuation strategy in such scenarios. Simulation results indicate that staged evacuation may not be the best strategy all the time, and the number of groups highly impacts its performance.
3 February 2022 in IEEE Transactions on Computational Social Systems
Network alignment (NA) that identifies equivalent nodes across networks is an effective tool for integrating knowledge from multiple networks. The state-of-the-art NA methods learn inter-network node similarities based on labeled anchor links, which are costly, time-consuming, and difficult to acquire. Therefore, a few unsupervised network alignment (UNA) methods propose solving NA problems without anchor links. However, most existing UNA methods rely on discriminative attributes to capture nodes' similarities and are hard to obtain optimal one-to-one alignments. Toward these issues, this article proposes a novel method named HackGAN to solve the UNA problem solely based on the structural information. Specifically, HackGAN represents nodes with embeddings based on an unsupervised graph neural network (GNN) to capture their global and local structural features. After that, it initializes mapping functions to transform the embedding spaces of different networks into the same vector space by iteratively solving the Wasserstein-Procrustes problem. The mapping functions are then refined by an adversarial model with cycle-consistency and Sinkhorn distance losses to obtain optimized one-to-one mappings. Based on the distances between mapped embeddings, accurate and robust results are obtained with a collective alignment algorithm. Experimental comparisons on both synthetic and real-world datasets demonstrate the superiority of HackGAN.