During the past ten years, the energy consumption problem in cloud-related environments has attracted substantial attention in research and industrial communities. Researchers have conducted many surveys on energy efficiency issues from different perspectives. All of the surveys can be classified into five categories: surveys on the energy efficiency of the whole cloud related system, surveys on the energy efficiency of a certain level or component of the cloud, surveys on all of the energy efficient strategies, surveys on a certain energy efficiency techniques, and other energy efficiency related surveys. However, to the best of our knowledge, surveys on energy-aware data management strategies in cloud-related environment are absent. In this paper, we conduct a comprehensive survey on energy saving-aware data management strategies in cloud-related environments, such as data classification, data placement and data replication strategies. Compared to current existing reviews on energy efficiency in cloud-related environments, we firstly conduct the survey on the energy consumption problem from the data management perspective. Furthermore, we classify the energy-aware data management strategies from different perspectives. This survey and the taxonomy of the energy-aware data management strategies demonstrate the potential for reducing the energy consumption at the data management level of a cloud storage system, which will compress more space for energy reduction and finally achieve energy proportionality. Moreover, this survey and taxonomy on the energy efficiency issue from the data management perspective is an important supplement to current existing surveys on energy efficiency in cloud-related environments.
The Multimodal Named Entity Recognition (MNER) task enhances the text representations and improves the accuracy and robustness of named entity recognition by leveraging visual information from images. However, previous methods have two limitations: (i) the semantic mismatch between text and image modalities makes it challenging to establish accurate internal connections between words and visual representations. Besides, the limited number of characters in social media posts leads to semantic and contextual ambiguity, further exacerbating the semantic mismatch between modalities. (ii) Existing methods employ cross-modal attention mechanisms to facilitate interaction and fusion between different modalities, overlooking fine-grained correspondences between semantic units of text and images. To alleviate these issues, we propose a graph neural network approach for MNER (GNN-MNER), which promotes fine-grained alignment and interaction between semantic units of different modalities. Specifically, to mitigate the issue of semantic mismatch between modalities, we construct corresponding graph structures for text and images, and leverage graph convolutional networks to augment text and visual representations. For the second issue, we propose a multimodal interaction graph to explicitly represent the fine-grained semantic correspondences between text and visual objects. Based on this graph, we implement deep-level feature fusion between modalities utilizing graph attention networks. Compared with existing methods, our approach is the first to extend graph deep learning throughout the MNER task. Extensive experiments on the Twitter multimodal datasets validate the effectiveness of our GNN-MNER.
4 November 2024 in Expert Systems with Applications