1 January 2019 in Neurocomputing
1 February 2020 in Neurocomputing
22 March 2026 in Data Science and Engineering
With the continued digitization of social and industrial processes, diverse and increasingly massive volumes of spatial-temporal data are being accumulated, which enable the use of data mining to fuel important applications. Thus, neural network-based techniques have been developed to capture spatial and temporal dependencies in spatial-temporal data. Most recently, the advances in generative techniques, including large language models, masked autoencoders, sequence-to-sequence models, diffusion models, and others, have led to their increased use in spatial-temporal data mining, thereby driving new advances in spatial-temporal data mining. This paper describes the general types of spatial-temporal data, all kinds of spatial-temporal data instances, and generative techniques, and it proposes a spatial-temporal data mining pipeline. Further, it delivers a structured overview of generative techniques for spatial-temporal data mining, grounded in a novel taxonomy. Moreover, by outlining promising research avenues enabled by generative techniques, the paper seeks to accelerate advances in spatial-temporal data mining.
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Factual error correction (FEC) aims to revise factual errors in false claims with minimal editing, making them faithful to the provided evidence. This task is crucial for alleviating the hallucination problem encountered by large language models. Given the lack of paired data (i.e., false claims and their corresponding correct claims), existing methods typically adopt the ‘mask-then-correct’ paradigm. This paradigm relies solely on unpaired false claims and correct claims, thus being referred to as distantly supervised methods. These methods require a masker to explicitly identify factual errors within false claims before revising with a corrector. However, the absence of paired data to train the masker makes accurately pinpointing factual errors within claims challenging. To mitigate this, we propose to improve FEC by Learning to Inject Factual Errors (LIFE), a three-step distantly supervised method: ‘mask-corrupt-correct’. Specifically, we first train a corruptor using the ‘mask-then-corrupt’ procedure, allowing it to deliberately introduce factual errors into correct text. The corruptor is then applied to correct claims, generating a substantial amount of paired data. After that, we filter out low-quality data, and use the remaining data to train a corrector. Notably, our corrector does not require a masker, thus circumventing the bottleneck associated with explicit factual error identification. Our experiments on a public dataset verify the effectiveness of LIFE in two key aspects: Firstly, it outperforms the previous best-performing distantly supervised method by a notable margin of 10.59 points in SARI Final (19.3% improvement). Secondly, even compared to ChatGPT prompted with in-context examples, LIFE achieves a superiority of 7.16 points in SARI Final.
15 November 2022 in arXiv
When users move in a physical space (e.g., an urban space), they would have some records called mobility records (e.g., trajectories) generated by devices such as mobile phones and GPS devices. Naturally, mobility records capture essential information of how users work, live and entertain in their daily lives, and therefore, they have been used in a wide range of tasks such as user profile inference, mobility prediction and traffic management. In this paper, we expand this line of research by investigating the problem of inferring user socioeconomic statuses (such as prices of users' living houses as a proxy of users' socioeconomic statuses) based on their mobility records, which can potentially be used in real-life applications such as the car loan business. For this task, we propose a socioeconomic-aware deep model called DeepSEI. The DeepSEI model incorporates two networks called deep network and recurrent network, which extract the features of the mobility records from three aspects, namely spatiality, temporality and activity, one at a coarse level and the other at a detailed level. We conduct extensive experiments on real mobility records data, POI data and house prices data. The results verify that the DeepSEI model achieves superior performance than existing studies. All datasets used in this paper will be made publicly available.