In this paper we are concerned with the error-covariance lower-bounding problem in Kalman filtering: a sensor releases a set of measurements to the data fusion/estimation center, which has a perfect knowledge of the dynamic model, to allow it to estimate the states, while preventing it to estimate the states beyond a given accuracy. We propose a measurement noise manipulation scheme to ensure lower-bound on the estimation accuracy of states. Our proposed method ensures lower-bound on the steady state estimation error of Kalman filter, using mathematical tools from eigen value analysis.
State estimation is of considerable significance for the power system operation and control. However, well-designed false data injection attacks can utilize blind spots in conventional residual-based bad data detection methods to manipulate measurements in a coordinated manner and thus affect the secure operation and economic dispatch of grids. In this paper, we propose a detection approach based on an autoencoder neural network. By training the network on the dependencies intrinsic in 'normal' operation data, it effectively overcomes the challenge of unbalanced training data that is inherent in power system attack detection. To evaluate the detection performance of the proposed mechanism, we conduct a series of experiments on the IEEE 118-bus power system. The experiments demonstrate that the proposed autoencoder detector displays robust detection performance under a variety of attack scenarios.
Distributed renewable generation, elastic loads, and purposeful manipulation of meter readings challenge the monitoring and control of today's power systems (PS). In this context, to maintain a comprehensive view of the system in real time, fast and robust state estimation (SE) methods are urgently needed. Conventional PSSE solvers typically entail minimizing a nonlinear and nonconvex least-squares by e.g., the workhorse Gauss-Newton method. Those iterative solvers however, are sensitive to initialization and may get stuck in local minima. To overcome these hurdles and inspired by recent image denoising techniques, this paper advocates a learnable regularization term for PSSE that uses a deep neural network (DNN) prior. For the resultant regularized PSSE problem, a "Gauss-Newton-like" alternating minimization solver is first developed. To accommodate real-time monitoring, a novel end-to-end DNN is constructed by unrolling the proposed alternating minimization solver. Interestingly, the power network topology can be easily incorporated into the DNN by designing a graph neural network (GNN) based prior. To further endow the physics-based DNN with robustness against bad data, an adversarial DNN training method is discussed. Numerical tests using real load data on the IEEE $118$-bus benchmark system showcase the improved estimation and robustness performance of the proposed scheme compared with several state-of-the-art alternatives.
Time-synchronization attacks on phasor measurement units (PMU) pose a real threat to smart grids; it was shown that they are feasible in practice and that they can have a non-negligible negative impact on the state estimation, without triggering the bad-data detection mechanisms. Previous works identified vulnerability conditions when targeted PMUs measure a single phasor. Yet, PMUs are capable of measuring several quantities. We present novel vulnerability conditions in the general case where PMUs measure any number of phasors and can share the same time reference. One is a sufficient condition that does not depend on the measurement values. We propose a security requirement that prevents it and provide a greedy offline algorithm that enforces it. If this security requirement is satisfied, there is still a possibility that the grid can be attacked, although we conjecture that it is very unlikely. We identify two sufficient and necessary vulnerability conditions which depend on the measurement values. For each, we provide a metric that shows the distance between the observed and vulnerability conditions. We recommend their monitoring for security. Numerical results, on the IEEE-39 bus benchmark with real load profiles, show that the measurements of a grid satisfying our security requirement are far from vulnerable.
In this paper, we present a scheme of fully distributed resilient state estimation for linear dynamical systems under sensor attacks. The proposed state observer consists of a network of local observers, where each of them utilizes local measurements and information transmitted from the neighbors. As a fully distributed scheme, it does not necessarily collect a majority of sensing data for the sake of attack identification, while the compromised sensors are eventually identified by the distributed network and excluded from the observers. For this, the overall network (not the individual local observer) is assumed to have redundant sensors and assumed to be connected. The proposed scheme is based on a novel design of a distributed median solver, which approximately recovers the median value of local estimates.
In this paper, a novel linear algorithm is proposed for state estimation including bad data detection of power systems that are monitored both by conventional and synchrophasor measurements. Both types of data are treated simultaneously and the states are estimated in rectangular coordinates. The proposed estimator is based on the linear weighted least square method. To enable the derivation of linear measurement functions, the network is modelled in terms of voltages and currents in rectangular form and pseudo-measurements are used to represent conventional measurements. Furthermore, the largest normalized residual test is used to detect bad data. To validate the accuracy and robustness of the proposed algorithm, several test cases of different sizes are solved and the results are presented and discussed.
Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on (variational) free energy -- a measure of the fit between an internal (generative) model and sensory observations. The free energy gradient is a prediction error -- plausibly encoded in the average membrane potentials of neuronal populations. Conversely, the expected probability of a state can be expressed in terms of neuronal firing rates. We show that this is consistent with current models of neuronal dynamics and establish face validity by synthesising plausible electrophysiological responses. We then show that these neuronal dynamics approximate natural gradient descent, a well-known optimisation algorithm from information geometry that follows the steepest descent of the objective in information space. We compare the information length of belief updating in both schemes, a measure of the distance traveled in information space that has a direct interpretation in terms of metabolic cost. We show that neural dynamics under active inference are metabolically efficient and suggest that neural representations in biological agents may evolve by approximating steepest descent in information space towards the point of optimal inference.
This letter proposes a novel and highly efficient distribution system state estimation (DSSE) algorithm with nonlinear measurements from supervisory control and data acquisition (SCADA) systems. Conventional DSSE, i.e., a weighted least square (WLS)-based method, requires multiple Monte Carlo simulations for overall accuracy evaluation and has high calculation cost due to the nonlinear iterative process. The proposed method uses the Taylor series of voltages for constructing a linear DSSE model in the interval form and then solve this model by interval arithmetic. Compared with the nonlinear WLS-based method, the proposed method obtains accurate and robust estimates via a single random sampling of measurements and is computationally efficient. The comparative analysis of the IEEE 34-bus distribution system points to improved estimation results relative to the WLS-based method.
We present a model-based approach to wind velocity profiling using motion perturbations of a multirotor unmanned aircraft system (UAS) in both hovering and steady ascending flight. A state estimation framework was adapted to a set of closed-loop rigid body models identified for an off-the-shelf quadrotor. The quadrotor models used for wind estimation were characterized for hovering and steady ascending flight conditions ranging between 0 and 2 m/s. The closed-loop models were obtained using system identification algorithms to determine model structures and estimate model parameters. The wind measurement method was validated experimentally above the Virginia Tech Kentland Experimental Aircraft Systems Laboratory by comparing quadrotor and independent sensor measurements from a sonic anemometer and two SoDARs. Comparison results demonstrated quadrotor wind estimation in close agreement with the independent wind velocity measurements. Wind velocity profiles were difficult to validate using time-synchronized SoDAR measurements, however. Analysis of the noise intensity and signal-to-noise ratio of the SoDARs proved that close-proximity quadrotor operations can corrupt wind measurement from SoDARs.
Today's power generation and distribution networks are quickly moving toward automated control and integration of renewable resources - a complex, integrated system termed the Smart Grid. A key component in planning and managing of Smart Grids is State Estimation (SE). The state-of-the art SE technologies today operate on the basis of slow varying dynamics of the current network and make simplifying linearity assumptions. However, the integration of smart readers and green resources will result in significant non-linearity and unpredictability in the network. Therefore in future Smart Grids, there is need for ever more accurate and real-time algorithms. In this work, we propose and examine new SE methods that aim to achieve these measures by approximating the true distribution of the state variables, rather than a linearized version as done for instance in Kalman filtering. Through simulations we show that in the presence of non-linearities and non-Gaussian noise, our general SE framework improves accuracy where linear and Kalman-like filters exhibit impaired performance.
Recent studies have considered thwarting false data injection (FDI) attacks against state estimation in power grids by proactively perturbing branch susceptances. This approach is known as moving target defense (MTD). However, despite of the deployment of MTD, it is still possible for the attacker to launch stealthy FDI attacks generated with former branch susceptances. In this paper, we prove that, an MTD has the capability to thwart all FDI attacks constructed with former branch susceptances only if (i) the number of branches $l$ in the power system is not less than twice that of the system states $n$ (i.e., $l \geq 2n$, where $n + 1$ is the number of buses); (ii) the susceptances of more than $n$ branches, which cover all buses, are perturbed. Moreover, we prove that the state variable of a bus that is only connected by a single branch (no matter it is perturbed or not) can always be modified by the attacker. Nevertheless, in order to reduce the attack opportunities of potential attackers, we first exploit the impact of the susceptance perturbation magnitude on the dimension of the \emph{stealthy attack space}, in which the attack vector is constructed with former branch susceptances. Then, we propose that, by perturbing an appropriate set of branches, we can minimize the dimension of the \emph{stealthy attack space} and maximize the number of covered buses. Besides, we consider the increasing operation cost caused by the activation of MTD. Finally, we conduct extensive simulations to illustrate our findings with IEEE standard test power systems.
Many state estimation algorithms must be tuned given the state space process and observation models, the process and observation noise parameters must be chosen. Conventional tuning approaches rely on heuristic hand-tuning or gradient-based optimization techniques to minimize a performance cost function. However, the relationship between tuned noise values and estimator performance is highly nonlinear and stochastic. Therefore, the tuning solutions can easily get trapped in local minima, which can lead to poor choices of noise parameters and suboptimal estimator performance. This paper describes how Bayesian Optimization (BO) can overcome these issues. BO poses optimization as a Bayesian search problem for a stochastic ``black box'' cost function, where the goal is to search the solution space to maximize the probability of improving the current best solution. As such, BO offers a principled approach to optimization-based estimator tuning in the presence of local minima and performance stochasticity. While extended Kalman filters (EKFs) are the main focus of this work, BO can be similarly used to tune other related state space filters. The method presented here uses performance metrics derived from normalized innovation squared (NIS) filter residuals obtained via sensor data, which renders knowledge of ground-truth states unnecessary. The robustness, accuracy, and reliability of BO-based tuning is illustrated on practical nonlinear state estimation problems,losed-loop aero-robotic control.
Unmanned aerial vehicles (UAVs) suffer from sensor drifts in GPS denied environments, which can lead to potentially dangerous situations. To avoid intolerable sensor drifts in the presence of GPS spoofing attacks, we propose a safety constrained control framework that adapts the UAV at a path re-planning level to support resilient state estimation against GPS spoofing attacks. The attack detector is used to detect GPS spoofing attacks based on the resilient state estimation and provides a switching criterion between the robust control mode and emergency control mode. To quantify the safety margin, we introduce the escape time which is defined as a safe time under which the state estimation error remains within a tolerable error with designated confidence. An attacker location tracker (ALT) is developed to track the location of the attacker and estimate the output power of the spoofing device by the unscented Kalman filter (UKF) with sliding window outputs. Using the estimates from ALT, an escape controller (ESC) is designed based on the constrained model predictive controller (MPC) such that the UAV escapes from the effective range of the spoofing device within the escape time.
This paper presents a hybrid data-driven physics model-based framework for real time monitoring in smart grids. As the power grid transitions to the use of smart grid technology, it's real time monitoring becomes more vulnerable to cyber attacks like false data injections (FDI). Although smart grids cyber-physical security has an extensive scope, this paper focuses on FDI attacks, which are modeled as bad data. State of the art strategies for FDI detection in real time monitoring rely on physics model-based weighted least squares state estimation solution and statistical tests. This strategy is inherently vulnerable by the linear approximation and the companion statistical modeling error, which means it can be exploited by a coordinated FDI attack. In order to enhance the robustness of FDI detection, this paper presents a framework which explores the use of data-driven anomaly detection methods in conjunction with physics model-based bad data detection via data fusion. Multiple anomaly detection methods working at both the system level and distributed local detection level are fused. The fusion takes into consideration the confidence of the various anomaly detection methods to provide the best overall detection results. Validation considers tests on the IEEE 118 bus system.
Recent advances in the fields of robotics and automation have spurred significant interest in robust state estimation. To enable robust state estimation, several methodologies have been proposed. One such technique, which has shown promising performance, is the concept of iteratively estimating a Gaussian Mixture Model (GMM), based upon the state estimation residuals, to characterize the measurement uncertainty model. Through this iterative process, the measurement uncertainty model is more accurately characterized, which enables robust state estimation through the appropriate de-weighting of erroneous observations. This approach, however, has traditionally required a batch estimation framework to enable the estimation of the measurement uncertainty model, which is not advantageous to robotic applications. In this paper, we propose an efficient, incremental extension to the measurement uncertainty model estimation paradigm. The incremental covariance estimation (ICE) approach, as detailed within this paper, is evaluated on several collected data sets, where it is shown to provide a significant increase in localization accuracy when compared to other state-of-the-art robust, incremental estimation algorithms.
We consider the problem of controlling the voltage of a distribution feeder using the reactive power capabilities of inverters. On a real distribution grid, we compare the local Volt/VAr droop control recommended in recent grid codes, a centralized dispatch based on optimal power flow (OPF) programming, and a feedback optimization (FO) controller that we propose. The local droop control yields suboptimal regulation, as predicted analytically. The OPF-based dispatch strategy requires an accurate grid model and measurement of all loads on the feeder in order to achieve proper voltage regulation. However, in the experiment, the OPF-based strategy violates voltage constraints due to inevitable model mismatch and uncertainties. Our proposed FO controller, on the other hand, satisfies the constraints and does not require load measurements or any grid state estimation. The only needed model knowledge is the sensitivity of the voltages with respect to reactive power, which can be obtained from data. As we show, an approximation of these sensitivities is also sufficient, which makes the approach essentially model-free, easy to tune, compatible with the current sensing and control infrastructure, and remarkably robust to measurement noise. We expect these properties to be fundamental features of FO for power systems and not specific to Volt/VAr regulation or to distribution grids.
This paper considers the problem of online feedback optimization to solve the AC Optimal Power Flow in real-time in power grids. This consists in continuously driving the controllable power injections and loads towards the optimal set-points in time-varying conditions based on real-time measurements performed on the grid. However, instead of assuming noise-free full state measurement like recent feedback optimization approaches, we connect a dynamic State Estimation using available measurements, and study its dynamic interaction with the optimization scheme. We certify stability of this interconnection and the convergence in expectation of the state estimate and the control inputs towards the true state values and optimal set-points respectively. Additionally, we bound the resulting stochastic error. Finally, we show the effectiveness of the approach on a test case using high resolution consumption data.
Accurate and reliable dynamic state quantities of generators are very important for real-time monitoring and control of the power system. The emergence of cyber attacks has brought new challenges to the state estimation of generators. Especially, false data injection (FDI) attacks deteriorate the accuracy of state estimation by injecting the false data into the measurement device. In this regard, this paper proposes for the first time an FDI attack model based on the dynamic state estimation of generators. Firstly, Taylor's formula was used to linearize the generator's measurement equation. Secondly, according to the principle that the measurement residuals before and after the FDI attack are equal, the expressions of the attack vectors were established, and they were applied to the measurement quantities to avoid the conventional bad data detection. Thereby, the FDI attacks were successfully implemented. Then, three attack scenarios were set according to the degree of the FDI attacks, and they were tested by the cubature Kalman filter (CKF) and the robust cubature Kalman filter (RCKF). Finally, the simulation results of the IEEE 9-bus system and the New England 16-machine 68-bus system verify the effectiveness of the proposed FDI attacks.
A timely, accurate, and secure dynamic state estimation is needed for reliable monitoring and efficient control of microgrids. The synchrophasor technology enables us to obtain synchronized measurements in real-time and to develop dynamic state estimators for real-time monitoring and control of microgrids. In this study, we consider an AC microgrid comprising several synchronous generators and inverter-interface power supplies, and focus on securely estimating the dynamic states of the microgrid from a set of corrupted data. We propose a dynamic state estimator which enables the microgrid operator to reconstruct the dynamic states of the microgrid from a set of corrupted data. Finally, we consider an AC microgrid with the same topology as the IEEE 33-bus distribution system, and numerically show that the proposed secure estimation algorithm can accurately reconstruct the attack signals.
The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). One of the primary components of such a robotic platform is the state estimation engine, which enables the platform to reason about itself and the environment based upon sensor readings. When such sensor readings are degraded traditional state estimation approaches are known to breakdown. To overcome this issue, several robust state estimation frameworks have been proposed. One such method is the batch covariance estimation (BCE) framework. The BCE approach enables robust state estimation by iteratively updating the measurement error uncertainty model through the fitting of a Gaussian mixture model (GMM) to the measurement residuals. This paper extends upon the BCE approach by arguing that the uncertainty estimation process should be augmented to include metadata (e.g., the signal strength of the associated GNSS observation). The modification of the uncertainty estimation process to an augmented data space is significant because it increases the likelihood of a unique partitioning in the measurement residual domain and thus provides the ability to more accurately characterize the measurement uncertainty model. The proposed batch covariance estimation over an augmented data-space (BCE-AD) is experimentally validated on collected data where it is shown that a significant increase in state estimation accuracy can be granted compared to previously proposed robust estimation techniques.