21 May 2021 in IEEE Transactions on Circuits and Systems for Video Technology
The strong demand of autonomous driving in the industry has led to vigorous interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data, ignoring the temporal clue in video sequence. In this work, we propose a new transformer, called Temporal-Channel Transformer (TCTR), to model the temporal-channel domain and spatial-wise relationships for video object detecting from Lidar data. As the special design of this transformer, the information encoded in the encoder is different from that in the decoder. The encoder encodes temporal-channel information of multiple frames while the decoder decodes the spatial-wise information for the current frame in a voxel-wise manner. Specifically, the temporal-channel encoder of the transformer is designed to encode the information of different channels and frames by utilizing the correlation among features from different channels and frames. On the other hand, the spatial decoder of the transformer decodes the information for each location of the current frame. Before conducting the object detection with detection head, a gate mechanism is further deployed for re-calibrating the features of current frame, which filters out the object-irrelevant information by repetitively refining the representation of target frame along with the up-sampling process. Experimental results reveal that TCTR achieves the state-of-the-art performance in grid voxel-based 3D object detection on the nuScenes benchmark.
3 July 2025 in Communications Earth & Environment
Given the complexity of the atmospheric system, current numerical weather prediction models struggle with accurate forecasts. Here we present FengWu, an Artificial-Intelligence-driven global medium-range forecasting system employing multi-modal and multi-task learning to simulate atmospheric dynamics at 0.25° spatial resolution across 13 pressure levels. To decrease the error accumulation problem, a replay buffer mechanism has been implemented with high computational efficiency. These enhancements allow FengWu to outperform deterministic forecasts produced by European Centre for Medium-Range Weather Forecasts High-Resolution Model, Pangu-Weather, and GraphCast. Additionally, to address predictive uncertainty, we develop FengWu-Ensemble, using conditional diffusion model that generates reliable multi-member forecasts based on deterministic predictions. Comparative evaluations against the Integrated Forecasting System Ensemble show that FengWu-Ensemble achieves superior performance across multiple meteorological variables and evaluation metrics. These results indicate that FengWu holds strong potential for improving both deterministic and probabilistic weather forecasting.
29 December 2020 in IEEE Transactions on Intelligent Transportation Systems
Understanding and forecasting mobility patterns and travel demand are fundamental and critical to efficient transport infrastructure planning and service operation. However, most existing studies focused on deterministic demand estimation/prediction/analytics. Differently, this study provides confidence interval based demand forecasting, which can help transport planning and operation authorities to better accommodate demand uncertainty/variability. The proposed Origin-Destination (OD) demand prediction approach well captures and utilizes the correlations among spatial and temporal information. In particular, the proposed Probabilistic Graph Convolution Model (PGCM) consists of two components: (i) a prediction module based on Graph Convolution Network and combined with the gated mechanism to predict OD demand by utilizing spatio-temporal relations; (ii) a Bayesian-based approximation module to measure the confidence interval of demand prediction by evaluating the graph-based model uncertainty. We use a large-scale real-world public transit dataset from the Greater Sydney area to test and evaluate the proposed approach. The experimental results demonstrate that the proposed method is capable of capturing the spatial-temporal correlations for more robust demand prediction against several established tools in the literature.
13 June 2024 in npj Climate and Atmospheric Science
As our planet is entering into the “global boiling” era, understanding regional climate change becomes imperative. Effective downscaling methods that provide localized insights are crucial for this target. Traditional approaches, including computationally-demanding regional dynamical models or statistical downscaling frameworks, are often susceptible to the influence of downscaling uncertainty. Here, we address these limitations by introducing a diffusion probabilistic downscaling model (DPDM) into the meteorological field. This model can efficiently transform data from 1° to 0.1° resolution. Compared with deterministic downscaling schemes, it not only has more accurate local details, but also can generate a large number of ensemble members based on probability distribution sampling to evaluate the uncertainty of downscaling. Additionally, we apply the model to generate a 180-year dataset of monthly surface variables in East Asia, offering a more detailed perspective for understanding local scale climate change over the past centuries.