Vigilance estimation of drivers is a hot research field of current traffic safety. Wearable devices can monitor information regarding the driver’s state in real time, which is then analyzed by a data analysis model to provide an estimation of vigilance. The accuracy of the data analysis model directly affects the effect of vigilance estimation. In this paper, we propose a deep coupling recurrent auto-encoder (DCRA) that combines electroencephalography (EEG) and electrooculography (EOG). This model uses a coupling layer to connect two single-modal auto-encoders to construct a joint objective loss function optimization model, which consists of single-modal loss and multi-modal loss. The single-modal loss is measured by Euclidean distance, and the multi-modal loss is measured by a Mahalanobis distance of metric learning, which can effectively reflect the distance between different modal data so that the distance between different modes can be described more accurately in the new feature space based on the metric matrix. In order to ensure gradient stability in the long sequence learning process, a multi-layer gated recurrent unit (GRU) auto-encoder model was adopted. The DCRA integrates data feature extraction and feature fusion. Relevant comparative experiments show that the DCRA is better than the single-modal method and the latest multi-modal fusion. The DCRA has a lower root mean square error (RMSE) and a higher Pearson correlation coefficient (PCC).

For the building energy consumption models with complex scale sensitivity, it is difficult to achieve ideal prediction effect with single-granularity prediction model. Therefore, this paper proposed a multigranularity MgHa-LSTM model based on convolutional recurrent neural network, including a multigranularity feature extraction module and a long-term dependency capture module. Multigranularity feature extraction included granularity segmentation, feedback mechanism, and parallel convolutional modules, which can capture short-term scale sensitivity dependencies. Long-term dependency capture consists of a hybrid attention mechanism and long-short term memory layers, which are able to capture long-term dependencies. For building energy consumption patterns with different scale sensitivity, MgHa-LSTM, MLP, CNN, LSTM, and MsC-LSTM models were constructed on the IHEPC building energy consumption dataset used in this paper for comparative experiments. The experimental results showed that on the IHEPC dataset, the MSE of the building energy consumption prediction model is 0.2821 based on the MgHa-LSTM model proposed in this paper, which is equivalent to 93.72% of the MsC-LSTM model with the smallest MSE among other deep learning prediction models. Compared with other deep learning prediction models, the prediction results of the MgHa-LSTM building energy consumption prediction model are more accurate.