2 August 2023 in IEEE Transactions on Image Processing
Composing Text and Image to Image Retrieval (CTI-IR) aims at finding the target image, which matches the query image visually along with the query text semantically. However, existing works ignore the fact that the reference text usually serves multiple functions, e.g., modification and auxiliary. To address this issue, we put forth a unified solution, namely Hierarchical Aggregation Transformer incorporated with Cross Relation Network (CRN). CRN unifies modification and relevance manner in a single framework. This configuration shows broader applicability, enabling us to model both modification and auxiliary text or their combination in triplet relationships simultaneously. Specifically, CRN includes: 1) Cross Relation Network comprehensively captures the relationships of various composed retrieval scenarios caused by two different query text types, allowing a unified retrieval model to designate adaptive combination strategies for flexible applicability; 2) Hierarchical Aggregation Transformer aggregates top-down features with Multi-layer Perceptron (MLP) to overcome the limitations of edge information loss in a window-based multi-stage Transformer. Extensive experiments demonstrate the superiority of the proposed CRN over all three fashion-domain datasets. Code is available at github.com/yan9qu/crn.
18 May 2023 in The Journal of Supercomputing
6 January 2023 in The Journal of Supercomputing
18 July 2023 in IEEE Transactions on Instrumentation and Measurement
Nonintrusive load monitoring (NILM) is a process that monitors the aggregated power consumption data of customers measured by a single sensor and decomposes the real-time power consumption of each dedicated device. Recent research has been focused on in-depth learning. However, the expensive cost of training time and the huge model scale are not conducive to the realization of smart meters. It is still challenging to accurately predict the real-time power of high-frequency appliances. This paper uses the discrete wavelet transform (DWT) to preprocess the data, which divides the frequency of the training power data. The processed data will be transferred to the enhanced sequence-to-point network (en-S2P) for training. The en-S2P network is the promotion of a sequence-to-point model (S2P) optimized by the autoencoder and bidirectional long short-term memory (Bi-LSTM) layer. And it is compressed by a combined pruning algorithm after being trained. The proposed model method is tested on the UK-DALE and REDD datasets using db2 and sym5 wavelet transform and compared with the S2P. Extensive experiments show that the proposed model can obtain a more satisfactory decomposition performance of appliances, especially high-frequency. In addition, it has a more lightweight scale and maintains a certain degree of sparsity, which is friendly to electricity meters.