Vigilance estimation of drivers is a hot research field of current traffic safety. Wearable devices can monitor information regarding the driver’s state in real time, which is then analyzed by a data analysis model to provide an estimation of vigilance. The accuracy of the data analysis model directly affects the effect of vigilance estimation. In this paper, we propose a deep coupling recurrent auto-encoder (DCRA) that combines electroencephalography (EEG) and electrooculography (EOG). This model uses a coupling layer to connect two single-modal auto-encoders to construct a joint objective loss function optimization model, which consists of single-modal loss and multi-modal loss. The single-modal loss is measured by Euclidean distance, and the multi-modal loss is measured by a Mahalanobis distance of metric learning, which can effectively reflect the distance between different modal data so that the distance between different modes can be described more accurately in the new feature space based on the metric matrix. In order to ensure gradient stability in the long sequence learning process, a multi-layer gated recurrent unit (GRU) auto-encoder model was adopted. The DCRA integrates data feature extraction and feature fusion. Relevant comparative experiments show that the DCRA is better than the single-modal method and the latest multi-modal fusion. The DCRA has a lower root mean square error (RMSE) and a higher Pearson correlation coefficient (PCC).

For the building energy consumption models with complex scale sensitivity, it is difficult to achieve ideal prediction effect with single-granularity prediction model. Therefore, this paper proposed a multigranularity MgHa-LSTM model based on convolutional recurrent neural network, including a multigranularity feature extraction module and a long-term dependency capture module. Multigranularity feature extraction included granularity segmentation, feedback mechanism, and parallel convolutional modules, which can capture short-term scale sensitivity dependencies. Long-term dependency capture consists of a hybrid attention mechanism and long-short term memory layers, which are able to capture long-term dependencies. For building energy consumption patterns with different scale sensitivity, MgHa-LSTM, MLP, CNN, LSTM, and MsC-LSTM models were constructed on the IHEPC building energy consumption dataset used in this paper for comparative experiments. The experimental results showed that on the IHEPC dataset, the MSE of the building energy consumption prediction model is 0.2821 based on the MgHa-LSTM model proposed in this paper, which is equivalent to 93.72% of the MsC-LSTM model with the smallest MSE among other deep learning prediction models. Compared with other deep learning prediction models, the prediction results of the MgHa-LSTM building energy consumption prediction model are more accurate.

Introduction: The meta-learning methods have been widely used to solve the problem of few-shot learning. Generally, meta-learners are trained on a variety of tasks and then generalized to novel tasks.Methods: However, existing meta-learning methods do not consider the relationship between meta-tasks and novel tasks during the meta-training period, so that initial models of the meta-learner provide less useful meta-knowledge for the novel tasks. This leads to a weak generalization ability on novel tasks. Meanwhile, different initial models contain different meta-knowledge, which leads to certain differences in the learning effect of novel tasks during the meta-testing period. Therefore, this article puts forward a meta-optimization method based on situational meta-task construction and cooperation of multiple initial models. First, during the meta-training period, a method of constructing situational meta-task is proposed, and the selected candidate task sets provide more effective meta-knowledge for novel tasks. Then, during the meta-testing period, an ensemble model method based on meta-optimization is proposed to minimize the loss of inter-model cooperation in prediction, so that multiple models cooperation can realize the learning of novel tasks.Results: The above-mentioned methods are applied to popular few-shot character datasets and image recognition datasets. Furthermore, the experiment results indicate that the proposed method achieves good effects in few-shot classification tasks.Discussion: In future work, we will extend our methods to provide more generalized and useful meta-knowledge to the model during the meta-training period when the novel few-shot tasks are completely invisible.

A visual analytics system is proposed to reveal the lead/lag correlation when air pollution is detected. In this system, an Overview + Detail approach is utilized for analyzing the correlation of air quality under both the spatial and temporal dimensions and diffierent spatial-temporal scales. An annular container is proposed to preserve the context spatial information while the zoom level of the map changes. Based on the annular container, several analysis techniques such as STL decomposition view and correlation algorithm are integrated.