Anomaly detection in video surveillance is challenging due to the variety of anomaly types and definitions, which limit the use of supervised techniques. As such, auto-encoder structures, a type of classical unsupervised method, have recently been utilized in this field. These structures consist of an encoder followed by a decoder and are typically adopted to restructure a current input frame or predict a future frame. However, regardless of whether a 2D or 3D autoencoder structure is adopted, only single-scale information from the previous layer is typically used in the decoding process. This can result in a loss of detail that could potentially be used to predict or reconstruct video frames. As such, this study proposes a novel spatio–temporal U-Net for frame prediction using normal events and abnormality detection using prediction error. This framework combines the benefits of U-Nets in representing spatial information with the capabilities of ConvLSTM for modeling temporal motion data. In addition, we propose a new regular score function, consisting of a prediction error for not only the current frame but also future frames, to further improve the accuracy of anomaly detection. Extensive experiments on common anomaly datasets, including UCSD (98 video clips in total) and CUHK Avenue (30 video clips in total), validated the performance of the proposed technique and we achieved 96.5% AUC for the Ped2 dataset, which is much better than existing autoencoder-based and U-Net-based methods.
The Antarctic ice sheet and the continent both play critical roles in global sea level rise and climate change but they remain poorly understood because data collection is greatly limited by the remote location and hostile conditions there. Airborne platforms have been extensively used in Antarctica due to their capabilities and flexibility and have contributed a great deal of knowledge to both the ice sheet and the continent. The Snow Eagle 601 fixed-wing airborne platform has been deployed by China for Antarctic expeditions since 2015. Scientific instruments on the airplane include an ice-penetrating radar, a gravimeter, a magnetometer, a laser altimeter, a camera and a Global Navigation Satellite System (GNSS). In the past five austral seasons, the airborne platform has been used to survey Princess Elizabeth Land, the largest data gap in Antarctica, as well as other critical areas. This paper reviews the scientific operations of Snow Eagle 601 including airborne and ground-based scientific instrumentation, aviation logistics, field data acquisition and processing and data quality control. We summarize the progress of airborne surveys to date, focusing on scientific motivations, data coverage and national and international collaborations. Finally, we discuss potential regions for applications of the airborne platform in Antarctica and developments of the airborne scientific system for future work.
Sea level rise, caused by the accelerated melting of glaciers in Greenland and Antarctica in recent decades, has become a major concern in the scientific, environmental, and political arenas. A comprehensive study of the properties of the ice subsurface targets is particularly important for a reliable analysis of their future evolution. Newer deep learning techniques greatly outperform the traditional techniques based on hand-crafted feature engineering. Therefore, we propose an efficient end-to-end network for the automatic classification of ice sheet subsurface targets in radar imagery. Our network uses bilateral filtering to reduce noise and consists of ResNet module, improved Atrous Spatial Pyramid Pooling (ASPP) module, and decoder module. With radar images provided by the Center of Remote Sensing of Ice Sheets (CReSIS) from 2009 to 2011 as our training and testing data, experimental results confirm the robustness and effectiveness of the proposed network in radargram.
11 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
The spatial correlation of ice-sounding data can be used to trace internal isochronic layers and synchronize the age–depth relationship between different ice core sites, which is difficult using existing imaging methods. In this study, we propose a new algorithm to address the opportunity that applying spatial correlation to ice-sheet imaging offers. The algorithm is a spatial-correlation-based ice-sounding imaging method using fast back projection (FBP) that successfully improves the spatial correlation of imaging results with high efficiency. We give the specific steps to implement the algorithm and apply it to simulate both point targets and ice-sounding radar data to demonstrate its validity in imaging ice sheets. Furthermore, compared with two previous methods, the proposed algorithm improves the spatial correlation without degrading the ability of signal-to-noise ratio (SNR) improvement and processing efficiency.
Bed topography and roughness play important roles in numerous ice-sheet analyses. Although the coverage of ice-penetrating radar measurements has vastly increased over recent decades, significant data gaps remain in certain areas of subglacial topography and need interpolation. However, the bed topography generated by interpolation such as kriging and mass conservation is generally smooth at small scales, lacking topographic features important for sub-kilometer roughness. DeepBedMap, a deep learning method combined with multiple surface observation inputs, can generate high-resolution (250 m) bed topography with realistic bed roughness but produces some unrealistic artifacts and higher bed elevation values in certain regions, which could bias ice-sheet models. To address these issues, we present MB_DeepBedMap, a multi-branch deep learning method to generate more realistic bed topography. The model improves upon DeepBedMap by separating inputs into two groups using a multi-branch network structure according to their characteristics, rather than fusing all inputs at an early stage, to reduce artifacts in the generated topography caused by earlier fusion of inputs. A direct upsampling branch preserves large-scale subglacial landforms while generating high-resolution bed topography. We use MB_DeepBedMap to generate a high-resolution (250 m) bed elevation grid product of Antarctica, MB_DeepBedMap_DEM, which can be used in high-resolution ice-sheet modeling studies. Moreover, we test the performance of MB_DeepBedMap model in Thwaites Glacier, Gamburtsev Subglacial Mountains, and several other regions, by comparing the qualitative topographic features and quantitative errors of MB_DeepBedMap, BEDMAP2, BedMachine Antarctica, and DeepBedMap. The results show that MB_DeepBedMap can provide more realistic small-scale topographic features and roughness compared to BEDMAP2, BedMachine Antarctica, and DeepBedMap.
8 August 2024 in IEEE Transactions on Geoscience and Remote Sensing
Among the inversion methods for airborne transient electromagnetic data, the hybrid inversion method integrates the iterative optimization framework with artificial neural networks (ANNs), ensuring inversion accuracy while enhancing the generalization capability of neural networks. However, this method faces challenges in terms of slow computation speeds due to its lower update step-length and the lack of consideration for electromagnetic response laws. Our method adopts supervised descent method (SDM) framework to supervise the artificial neural networks, obtaining a longer update step-length. On the basis of the SDM framework, we have considered the electromagnetic response laws and designed RNN-ResNet and 1D-Unet networks to update conductivity model, improving the computing speed. Through numerical ablation experiments, we validated the effectiveness of our proposed method and compared the inversion results with those obtained using the traditional hybrid method. Additionally, we conducted tests on bundle fringe distribution, inversion fitting loss, noise sensitivity, and inversion speed for both methods using measured data to evaluate their performance in practical applications. The experimental findings demonstrate that our method achieves the same level of inversion accuracy and generalization ability as the traditional hybrid method while enhancing inversion speed by up to 68.5%.