Rapid growth of diversity, uncertainty, and coupling effect of units in modern energy systems jointly challenges the traditional model-based situation awareness (SA) in Energy Internet of Things (EIoT). This work explores the digital twin of EIoT (EIoT-DT) and then provides a novel data-driven SA paradigm, named DT-SA, as a promising alternative. Based on the combination of the latest data technologies and machine learning algorithms, DT-SA transfers those stubborn SA challenges to digital space, and then addresses them by building a domain-specific and data-friendly digital twin (DT) model upon massive data. The established model can be quantitatively tested via iterative virtual–real interaction and, thus, be evaluated and updated through closed-loop feedback to improve its performance in the physical world. To this end, some engineering and scientific problems are raised: 1) virtual–real interaction mechanism relevant to resource flow and data flow; 2) unified modeling and analysis of heterogeneous spatial–temporal data; 3) DT configuration and evolution; and 4) domain-specific DT-SA characterization. To solve these problems, cloud-edge-terminal configuration, big data analytics (BDA), DT, and SA indicator systems are studied, respectively. Then, the random matrix theory (RMT) and overarching DT-SA framework are designed as a roadmap. Besides, some potential applications and undergoing projects on the terminal, edge, or cloud are discussed, e.g., condition assessment of equipment, digital monitoring and diagnosis of the power grid network, and EIoT construction in the smart city. Finally, some perspectives and recommendations are proposed in conclusion for future research. This research can be regarded as an efficient handbook for both energy engineering and data science, which may benefit enterprise digitization, smart city, etc.

The online monitoring data in distribution networks contain rich information on the running states of the networks. By leveraging the data, this paper proposes a spatio-temporal correlation analysis approach for anomaly detection and location in distribution networks. First, spatio-temporal matrix for each feeder line in a distribution network is formulated and the spectrum of its covariance matrix is analyzed. The spectrum is complex and exhibits two aspects: 1) bulk, which arises from random noise or fluctuations and 2) spikes, which represents factors caused by anomaly signals or fault disturbances. Then, by connecting the estimation of the number of factors to the limiting empirical spectral density of covariance matrices of residuals, the spatio-temporal parameters are accurately estimated, during which free random variable techniques are used. Based on the estimators, anomaly indicators are designed to detect and locate the anomalies by exploring the variations of spatio-temporal correlations in the data. The proposed approach is sensitive to the anomalies and robust to random fluctuations, which makes it possible for detecting early anomalies and reducing false alarming rate. Case studies on both synthetic data and real-world online monitoring data verify the effectiveness and advantages of the proposed approach.

Future power grids are fundamentally different from current ones, both in size and in complexity. This trend imposes challenges for situation awareness (SA) based on classical indicators, which are usually model-based and deterministic. As an alternative, this paper proposes a statistical indicator system based on linear eigenvalue statistics (LESs) of large random matrices: 1) from a data modeling viewpoint, we build, starting from power flows equations, the random matrix models (RMMs) only using the real-time data flow in a statistical manner; 2) for a data analysis that is fully driven from RMMs, we put forward the high-dimensional indicators, called LESs that have some unique statistical features such as Gaussian properties; and 3) we develop a 3-D power map to visualize the system, respectively, from a high-dimensional viewpoint and a low-dimensional one. Therefore, a statistical methodology of SA is employed; it conducts SA with a model-free and data-driven procedure, requiring no knowledge of system topologies, units operation/control models, causal relationship, and so on. This methodology has numerous advantages, such as sensitivity, universality, speed, and flexibility. In particular, its robustness against bad data is highlighted, with potential advantages in cyber security. The theory of big data-based stability for online operations may prove feasible along with this line of work, although this critical development will be reported elsewhere.

Data-driven approaches, when tasked with situation awareness, are suitable for complex grids with massive datasets. It is a challenge, however, to efficiently turn these massive datasets into useful big data analytics. To address such a challenge, this paper, based on random matrix theory (RMT), proposes a data-driven approach. The approach models massive datasets as large random matrices; it is model-free and requiring no knowledge about physical model parameters. In particular, the large data dimension N and the large time span T, from the spatial aspect and the temporal aspect respectively, lead to favorable results. The beautiful thing lies in that these linear eigenvalue statistics (LESs) built from data matrices follow Gaussian distributions for very general conditions, due to the latest breakthroughs in probability on the central limit theorems of those LESs. Numerous case studies, with both simulated data and field data, are given to validate the proposed new algorithms.

Cyber, especially false data injection attacks (FDIAs), are gradually becoming a kind of severe threat to modern power grids. This paper proposes a blind FDIA approach against the state estimation of power grids based on matrix reconstruction and subspace estimation. As a blind FDIA method, it requires no information about the system parameters and topology, but only needs a limited period of measurement data. In particular, this paper investigates the interference of random measurement noise for subspace based blind FDIA methods, and designs a scheme to alleviate the influence of this random noise in the process of FDIA. Compared with previous blind FDIA methods, the proposed method overcomes the shortcoming that measurement noise is difficult to address when data is not abundant. Thus the presented approach performs high successful rate of FDIA, and it is able to operate when measurement data is very limited. Besides, it performs great robustness to large-scale power grids and high-level measurement noise. Numerous cases demonstrate the effectiveness and advantages of the proposed method.

Invisible units mainly refer to small-scale units that are not monitored by, and thus are not visible to utilities. Integration of these invisible units into power systems does significantly affect the way in which a distribution grid is planned and operated. This paper, based on random matrix theory (RMT), proposes a statistical, data-driven framework to handle the massive grid data, in contrast to its deterministic, model-based counterpart. Combining the RMT-based data-mining framework with conventional techniques, some heuristics are derived as the solution to the invisible units detection and estimation task: linear eigenvalue statistic indicators (LESs) are suggested as the main ingredients of the solution; according to the statistical properties of LESs, the hypothesis testing is formulated to conduct change point detection in the high-dimensional space. The proposed method is promising for anomaly detection and pertinent to current distribution networks-it is capable of detecting invisible power usage and fraudulent behavior while even being able to locate the suspect's location. Case studies, using both simulated data and actual data, validate the proposed method.