The use of state estimation technique offers a means of inferring the rotor-effective wind speed based upon solely standard measurements of the turbine. For the ease of design and computational concerns, such estimators are typically built based upon simplified turbine models that characterise the turbine with rigid blades. Large model mismatch, particularly in the power coefficient, could lead to degradation in estimation performance. Therefore, in order to effectively reduce the adverse impact of parameter uncertainties in the estimator model, this paper develops a wind sped estimator based on the concept of interacting multiple-model adaptive estimation. The proposed estimator is composed of a bank of extended Kalman filters and each filter model is developed based on different power coefficient mapping to match the operating turbine parameter. Subsequently, the algorithm combines the wind speed estimates provided by each filter based on their statistical properties. In addition, the proposed estimator not only can infer the rotor-effective wind speed, but also the uncertain system parameters, namely, the power coefficient. Simulation results demonstrate the proposed estimator achieved better improvement in estimating the rotor-effective wind speed and power coefficient compared to the standard Kalman filter approach.
Time series with missing data are signals encountered in important settings for machine learning. Some of the most successful prior approaches for modeling such time series are based on recurrent neural networks that transform the input and previous state to account for the missing observations, and then treat the transformed signal in a standard manner. In this paper, we introduce a single unifying framework, Recursive Input and State Estimation (RISE), for this general approach and reformulate existing models as specific instances of this framework. We then explore additional novel variations within the RISE framework to improve the performance of any instance. We exploit representation learning techniques to learn latent representations of the signals used by RISE instances. We discuss and develop various encoding techniques to learn latent signal representations. We benchmark instances of the framework with various encoding functions on three data imputation datasets, observing that RISE instances always benefit from encoders that learn representations for numerical values from the digits into which they can be decomposed.
Time-synchronized state estimation for reconfigurable distribution networks is challenging because of limited real-time observability. This paper addresses this challenge by formulating a deep learning (DL)-based approach for topology identification (TI) and unbalanced three-phase distribution system state estimation (DSSE). Two deep neural networks (DNNs) are trained for time-synchronized DNN-based TI and DSSE, respectively, for systems that are incompletely observed by synchrophasor measurement devices (SMDs) in real-time. A data-driven approach for judicious SMD placement to facilitate reliable TI and DSSE is also provided. Robustness of the proposed methodology is demonstrated by considering non-Gaussian noise in the SMD measurements. A comparison of the DNN-based DSSE with more conventional approaches indicates that the DL-based approach gives better accuracy with smaller number of SMDs.
Limited measurement availability at the distribution grid presents challenges for state estimation and situational awareness. This paper combines the advantages of two sparsity-based state estimation approaches (matrix completion and compressive sensing) that have been proposed recently to address the challenge of unobservability. The proposed approach exploits both the low rank structure and a suitable transform domain representation to leverage the correlation structure of the spatio-temporal data matrix while incorporating the power-flow constraints of the distribution grid. Simulations are carried out on three phase unbalanced IEEE 37 test system to verify the effectiveness of the proposed approach. The performance results reveal - (1) the superiority over traditional matrix completion and (2) very low state estimation errors for high compression ratios representing very low observability.
The ionosphere is the propagation medium for radio waves transmitted by an over-the-horizon radar (OTHR). Ionospheric parameters, typically, virtual ionospheric heights (VIHs), are required to perform coordinate registration for OTHR multitarget tracking and localization. The inaccuracy of ionospheric parameters has a significant deleterious effect on the target localization of OTHR. Therefore, to improve the localization accuracy of OTHR, it is important to develop accurate models and estimation methods of ionospheric parameters and the corresponding target tracking algorithms. In this paper, we consider the variation of the ionosphere with location and the spatial correlation of the ionosphere in OTHR target tracking. We use a Gaussian Markov random field (GMRF) to model the VIHs, providing a more accurate representation of the VIHs for OTHR target tracking. Based on expectation-conditional maximization and GMRF modeling of the VIHs, we propose a novel joint optimization solution, called ECM-GMRF, to perform target state estimation, multipath data association and VIHs estimation simultaneously. In ECM-GMRF, the measurements from both ionosondes and OTHR are exploited to estimate the VIHs, leading to a better estimation of the VIHs which improves the accuracy of data association and target state estimation, and vice versa. The simulation indicates the effectiveness of the proposed algorithm.
recent literature has proposed various detection and identification methods for FDIAs, but few studies have focused on a solution that would prevent such attacks from occurring. However, great strides have been made using deep learning to detect attacks. Inspired by these advancements, we have developed a new methodology for not only identifying AC FDIAs but, more importantly, for correction as well. Our methodology utilizes a Long-Short Term Memory Denoising Autoencoder (LSTM-DAE) to correct attacked-estimated states based on the attacked measurements. The method was evaluated using the IEEE 30 system, and the experiments demonstrated that the proposed method was successfully able to identify the corrupted states and correct them with high accuracy.
In recent years, Bayes filter methods in the labeled random finite set formulation have become increasingly powerful in the multi-target tracking domain. One of the latest outcomes is the Generalized Labeled Multi-Bernoulli (GLMB) filter which allows for stable cardinality and target state estimation as well as target identification in a unified framework. In contrast to the initial context of the GLMB filter, this paper makes use of it in the Track-Before-Detect (TBD) scheme and thus, avoids information loss due to thresholding and other data preprocessing steps. This paper provides a TBD GLMB filter design under the separable likelihood assumption that can be applied to real world scenarios and data in the automotive radar context. Its applicability to real sensor data is demonstrated in an exemplary scenario. To the best of the authors' knowledge, the GLMB filter is applied to real radar data in a TBD framework for the first time.
The ever-increasing deployment of distributed resources and the opportunities offered to loads for more active roles has changed the previously unidirectional and relatively straight-forward operating profile of distribution systems (DS). DS will be required to be monitored closely for robustness and sufficient power quality. State estimation of transmission systems has consistently served as a monitoring tool, which drives system-wide control actions and, thus, ensures the operational integrity of the electric grid. An update to the classic state estimation for the case of DS is offered in this work, based on a power flow formulation for radial networks that does not require measurements or estimate of the voltage angles.
To obtain the accurate transient states of the big scale natural gas pipeline networks under the bad data and non-zero mean noises conditions, a robust Kalman filter-based dynamic state estimation method is proposed using the linearized gas pipeline transient flow equations in this paper. Firstly, the dynamic state estimation model is built. Since the gas pipeline transient flow equations are less than the states, the boundary conditions are used as supplementary constraints to predict the transient states. To increase the measurement redundancy, the zero mass flow rate constraints at the sink nodes are taken as virtual measurements. Secondly, to ensure the stability under bad data condition, the robust Kalman filter algorithm is proposed by introducing a time-varying scalar matrix to regulate the measurement error variances correctly according to the innovation vector at every time step. At last, the proposed method is applied to a 30-node gas pipeline networks in several kinds of measurement conditions. The simulation shows that the proposed robust dynamic state estimation can decrease the effects of bad data and achieve better estimating results.
The application of renewable energy sources in the power grid increases the necessity of tracking the system's state, especially in smart grids, where there is a bidirectional transfer of data and power. The complexity of coupling between communication and the electrical infrastructure in a smart grid will create a higher chance for security breach. Increasing the state estimation accuracy will help the smart grid operator efficiently manage the system. The paper proposes an integration of distributed state estimation with a blockchain designed communication platform. Additionally, the asynchronous manner for data transmission, which is more likely to happen in the real world, has been considered as the second task of this research. Finally, a detailed analysis of the blockchain-based application in distributed state estimation is provided. The numerical analysis shows that the proposed method meets real-world performance requirements and brings high security and reliability to the distributed state estimation process.
Distributed state estimation (DSE) is considered as a more robust and reliable alternative for centralized state estimation (CSE) in power system. Especially, taking into account the future power grid, so called smart grid in which bi-directional transfer of energy and information happens, and renewable energy sources with huge indeterminacy are applied more than before. Combining the mentioned features and complexity of the power network, there is a high probability that CSE face problems such as communication bottleneck or security/reliability issues. So, DSE has the potential to be considered as a solution to solve the mentioned issues. In this paper, first, a modified convergence criterion is proposed and has been tested for different approaches of DSE problem, considering the most important factors such as iteration number, convergence rate, and data needed to be transferred to/from each area. Then, an optimal partitioning technique has been implemented for clustering the system into different areas. Besides the detailed analysis and comparison of recent DSE methods, the proposed partitioning method's effectiveness has been shown in this paper.
Clustering is an unsupervised learning technique that is useful when working with a large volume of unlabeled data. Complex dynamical systems in real life often entail data streaming from a large number of sources. Although it is desirable to use all source variables to form accurate state estimates, it is often impractical due to large computational power requirements, and sufficiently robust algorithms to handle these cases are not common. We propose a hierarchical time series clustering technique based on symbolic dynamic filtering and Granger causality, which serves as a dimensionality reduction and noise-rejection tool. Our process forms a hierarchy of variables in the multivariate time series with clustering of relevant variables at each level, thus separating out noise and less relevant variables. A new distance metric based on Granger causality is proposed and used for the time series clustering, as well as validated on empirical data sets. Experimental results from occupancy detection and building temperature estimation tasks show fidelity to the empirical data sets while maintaining state-prediction accuracy with substantially reduced data dimensionality.
We investigate the stability conditions for remote state estimation of multiple linear time-invariant (LTI) systems over multiple wireless time-varying communication channels. We answer the following open problem: what is the fundamental requirement on the multi-sensor-multi-channel system to guarantee the existence of a sensor scheduling policy that can stabilize the remote estimation system? We propose a novel policy construction and analytical framework and derive the necessary-and-sufficient stability condition in terms of the LTI system parameters and the channel statistics.
System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem. Current approaches to such problems are limited in their ability to scale with many-parameter systems as often occurs in networks. In the current work, we present a new, computationally efficient approach to treat large dual-estimation problems. Our approach consists of directly integrating pseudo-optimal state estimation (the Extended Kalman Filter) into a dual-optimization objective, leaving a differentiable cost/error function of only in terms of the unknown system parameters which we solve using numerical gradient/Hessian methods. Intuitively, our approach consists of solving for the parameters that generate the most accurate state estimator (Extended Kalman Filter). We demonstrate that our approach is at least as accurate in state and parameter estimation as joint Kalman Filters (Extended/Unscented), despite lower complexity. We demonstrate the utility of our approach by inverting anatomically-detailed individualized brain models from human magnetoencephalography (MEG) data.
This contribution proposes a recursive, computationally efficient, ready-to-use, online method for the ellipsoidal state characterization for linear discrete-time models with additive unknown disturbances vectors (bounded by known possibly degenerate zonotopes) corrupting both the state difference equation and the sporadic measurement vectors, which are expressed as linear inequality and equality constraints on the state vector. The algorithm is decomposed into time updating and observation updating steps. In the latter, a suitable switching estimation gain is designed in such a way as to ensure the input-to-state stability of the estimation error.
We consider a power transmission system monitored with Phasor Measurement Units (PMUs) placed at significant, but not all, nodes of the system. Assuming that a sufficient number of distinct single-line faults, specifically pre-fault state and (not cleared) post-fault state, are recorded by the PMUs and are available for training, we, first, design a comprehensive sequence of Neural Networks (NNs) locating the faulty line. Performance of different NNs in the sequence, including Linear Regression, Feed-Forward NN, AlexNet, Graphical Convolutional NN, Neural Linear ODE and Neural Graph-based ODE, ordered according to the type and amount of the power flow physics involved, are compared for different levels of observability. Second, we build a sequence of advanced Power-System-Dynamics-Informed and Neural-ODE based Machine Learning schemes trained, given pre-fault state, to predict the post-fault state and also, in parallel, to estimate system parameters. Finally, third, and continuing to work with the first (fault localization) setting we design a (NN-based) algorithm which discovers optimal PMU placement.
As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a nonlinear particle model predictive control (PMPC) approach to control under uncertainty, which directly incorporates any particle-based uncertainty representation, such as those common in robotics. Our approach builds on scenario methods for MPC, but in contrast to existing approaches, which either constrain all or only the first timestep to share actions across scenarios, we investigate the impact of a \textit{partial consensus horizon}. Implementing this optimization for nonlinear dynamics by leveraging sequential convex optimization, our approach yields an efficient framework that can be tuned to the particular information gain dynamics of a system to mitigate both over-conservatism and over-optimism. We investigate our approach for two robotic systems across three problem settings: time-varying, partially observed dynamics; sensing uncertainty; and model-based reinforcement learning, and show that our approach improves performance over baselines in all settings.
This paper develops a robust extended Kalman filter to estimate the rotor angles and the rotor speeds of synchronous generators of a multimachine power system. Using a batch-mode regression form, the filter processes together predicted state vector and PMU measurements to track the system dynamics faster than the standard extended Kalman filter. Our proposed filter is based on a robust GM-estimator that bounds the influence of vertical outliers and bad leverage points, which are identified by means of the projection statistics. Good statistical efficiency under the Gaussian distribution assumption of the process and the observation noise is achieved thanks to the use of the Huber cost function, which is minimized via the iteratively reweighted least squares algorithm. The asymptotic covariance matrix of the state estimation error vector is derived via the covariance matrix of the total influence function of the GM-estimator. Simulations carried out on the IEEE 39-bus test system reveal that our robust extended Kalman filter exhibits good tracking capabilities under Gaussian process and observation noise while suppressing observation outliers, even in position of leverage. These good performances are obtained only under the validity of the linear approximation of the power system model.
We consider the problem of recovering random graph signals from nonlinear measurements. For this case, closed-form Bayesian estimators are usually intractable and even numerical evaluation of these estimators may be hard to compute for large networks. In this paper, we propose a graph signal processing (GSP) framework for random graph signal recovery that utilizes the information of the structure behind the data. First, we develop the GSP-linear minimum mean-squared-error (GSP-LMMSE) estimator, which minimizes the mean-squared error (MSE) among estimators that are represented as an output of a graph filter. The GSP-LMMSE estimator is based on diagonal covariance matrices in the graph frequency domain, and thus, has reduced complexity compared with the LMMSE estimator. This property is especially important when using the sample-mean versions of these estimators that are based on a training dataset. We then state conditions under which the low-complexity GSP-LMMSE estimator coincides with the optimal LMMSE estimator. Next, we develop the approximated parametrization of the GSP-LMMSE estimator by shift-invariant graph filters by solving a weighted least squared (WLS) problem. We present three implementations of the parametric GSP-LMMSE estimator for typical graph filters. Parametric graph filters are more robust to outliers and to network topology changes. In our simulations, we evaluate the performance of the proposed GSP-LMMSE estimators for the problem of state estimation in power systems, which can be interpreted as a graph signal recovery task. We show that the proposed sample-GSP estimators outperform the sample-LMMSE estimator for a limited training dataset and that the parametric GSP-LMMSE estimators are more robust to topology changes in the form of adding/removing vertices/edges.
We propose a new extension of Kalman filtering for continuous-discrete systems with nonlinear state-space models that we name as the level set Kalman filter (LSKF). The LSKF assumes the probability distribution can be approximated as a Gaussian, and updates the Gaussian distribution through a time-update step and a measurement-update step. The LSKF improves the time-update step when compared to existing methods, such as the continuous-discrete cubature Kalman filter (CD-CKF) by reformulating the underlying Fokker-Planck equation as an ordinary differential equation for the Gaussian, thereby avoiding expansion in time. Together with a carefully picked measurement-update method, numerical experiments show that the LSKF has a consistent performance improvement over CD-CKF for a range of parameters, while also simplifies the implementation, as no user-defined timestep subdivision between measurements is required, and the spatial derivatives of the drift function are not explicitly needed.