Adaptive model predictive control (MPC) methods using set-membership identification to reduce parameter uncertainty are considered in this work. Strong duality is used to reformulate the set-membership equations exactly within the MPC optimization. A predicted worst-case cost is then used to enable performance-oriented exploration. The proposed approach guarantees robust constraint satisfaction and recursive feasibility. It is shown that method can be implemented using homothetic tube and flexible tube parameterizations of state tubes, and a simulation study demonstrates performance improvement over state-of-the-art controllers.
Model predictive control (MPC) is an effective approach to control multivariable dynamic systems with constraints. Most real dynamic models are however affected by plant-model mismatch and process uncertainties, which can lead to closed-loop performance deterioration and constraint violations. Methods such as stochastic MPC (SMPC) have been proposed to alleviate these problems; however, the resulting closed-loop state trajectory might still significantly violate the prescribed constraints if the real system deviates from the assumed disturbance distributions made during the controller design. In this work we propose a novel data-driven distributionally robust MPC scheme for nonlinear systems. Unlike SMPC, which requires the exact knowledge of the disturbance distribution, our scheme decides the control action with respect to the worst distribution from a distribution ambiguity set. This ambiguity set is defined as a Wasserstein ball centered at the empirical distribution. Due to the potential model errors that cause off-sets, the scheme is also extended by leveraging an offset-free method. The favorable results of this control scheme are demonstrated and empirically verified with a nonlinear mass spring system and a nonlinear CSTR case study.
Recent advancements in reinforcement learning algorithms have opened doors for researchers to operate and optimize building energy management systems autonomously. However, the lack of an easily configurable building dynamical model and energy management task simulation and evaluation platform has arguably slowed the progress in developing advanced and dedicated reinforcement learning (RL) and control algorithms for building operation tasks. Here we propose "BEAR", a physics-principled Building Environment for Control And Reinforcement Learning. The platform allows researchers to benchmark both model-based and model-free controllers using a broad collection of standard building models in Python without co-simulation using external building simulators. In this paper, we discuss the design of this platform and compare it with other existing building simulation frameworks. We demonstrate the compatibility and performance of BEAR with different controllers, including both model predictive control (MPC) and several state-of-the-art RL methods with two case studies.
Recent years have witnessed substantial growth in adaptive traffic signal control (ATSC) methodologies that improve transportation network efficiency, especially in branches leveraging artificial intelligence based optimization and control algorithms such as reinforcement learning as well as conventional model predictive control. However, lack of cross-domain analysis and comparison of the effectiveness of applied methods in ATSC research limits our understanding of existing challenges and research directions. This chapter proposes a novel unified view of modern ATSCs to identify common ground as well as differences and shortcomings of existing methodologies with the ultimate goal to facilitate cross-fertilization and advance the state-of-the-art. The unified view applies the mathematical language of the Markov decision process, describes the process of controller design from both the world (problem) and solution modeling perspectives. The unified view also analyses systematic issues commonly ignored in existing studies and suggests future potential directions to resolve these issues.
Tube-based model predictive control (MPC) methods bound deviations from a nominal trajectory due to uncertainties in order to ensure constraint satisfaction. While techniques that compute the tubes online reduce conservativeness and increase performance, they suffer from high and potentially prohibitive computational complexity. This paper presents an asynchronous computation mechanism for system level tube-MPC (SLTMPC), a recently proposed tube-based MPC method which optimizes over both the nominal trajectory and the tubes. Computations are split into a primary and a secondary process, computing the nominal trajectory and the tubes, respectively. This enables running the primary process at a high frequency and moving the computationally complex tube computations to the secondary process. We show that the secondary process can continuously update the tubes, while retaining recursive feasibility of the primary process.
Nonlinear model predictive control (MPC) is a flexible and increasingly popular framework used to synthesize feedback control strategies that can satisfy both state and control input constraints. In this framework, an optimization problem, subjected to a set of dynamics constraints characterized by a nonlinear dynamics model, is solved at each time step. Despite its versatility, the performance of nonlinear MPC often depends on the accuracy of the dynamics model. In this work, we leverage deep learning tools, namely knowledge-based neural ordinary differential equations (KNODE) and deep ensembles, to improve the prediction accuracy of this model. In particular, we learn an ensemble of KNODE models, which we refer to as the KNODE ensemble, to obtain an accurate prediction of the true system dynamics. This learned model is then integrated into a novel learning-enhanced nonlinear MPC framework. We provide sufficient conditions that guarantees asymptotic stability of the closed-loop system and show that these conditions can be implemented in practice. We show that the KNODE ensemble provides more accurate predictions and illustrate the efficacy and closed-loop performance of the proposed nonlinear MPC framework using two case studies.
We propose a model-agnostic stochastic predictive control (MASMPC) algorithm for dynamical systems. The proposed approach first discovers \textit{interpretable} governing differential equations from data using a novel algorithm and blends it with a model predictive control algorithm. One salient feature of the proposed approach resides in the fact that it requires no input measurement (external excitation); the unknown excitation is instead treated as white noise, and a stochastic differential equation corresponding to the underlying system is identified. With the novel stochastic differential equation discovery framework, the proposed approach is able to generalize; this eliminates the repeated retraining phase -- a major bottleneck with other machine learning-based model agnostic control algorithms. Overall, the proposed MASMPC (a) is robust against measurement noise, (b) works with sparse measurements, (c) can tackle set-point changes, (d) works with multiple control variables, and (e) can incorporate dead time. We have obtained state-of-the-art results on several benchmark examples. Finally, we use the proposed approach for vibration mitigation of a 76-storey building under seismic loading.
In this paper, a safety-critical control strategy for a nonholonomic robot is developed to generate control signals that result in optimal, obstacle-free paths through dynamic environments. We formulate the control synthesis problem as an Optimal Control Problem (OCP) that enforces Control Lyapunov Function (CLF) constraints for system stability as well as safety-critical constraints using Control Barrier Function (CBF) with a relaxing decay rate of the barrier function. A Nonlinear Model Predictive Control (NMPC) integrates with CLF and CBF to ensure system safety and facilitate optimal performance within a short prediction horizon, reducing the computational burden in real-time implementation. Additionally, we incorporate an obstacle avoidance constraint based on the Euclidean norm into the NMPC framework, showcasing the CBF approach's superiority in addressing mobile robotic systems' point stabilisation and trajectory tracking challenges. Through extensive simulations, the proposed controller demonstrates proficiency in static and dynamic obstacle avoidance under various scenarios. Experimental validations conducted using the Husky A200 robot align with simulation results, reinforcing the applicability of our proposed approach in real-world scenarios, notably improving the computational efficiency and safety in practical mobile robot applications.
The recent advancement in vehicular networking technology provides novel solutions for designing intelligent and sustainable vehicle motion controllers. This work addresses a car-following task, where the feedback linearisation method is combined with a robust model predictive control (RMPC) scheme to safely, optimally and efficiently control a connected electric vehicle. In particular, the nonlinear dynamics are linearised through a feedback linearisation method to maintain an efficient computational speed and to guarantee global optimality. At the same time, the inevitable model mismatch is dealt with by the RMPC design. The control objective of the RMPC is to optimise the electric energy efficiency of the ego vehicle with consideration of a bounded model mismatch disturbance subject to satisfaction of physical and safety constraints. Numerical results first verify the validity and robustness through a comparison between the proposed RMPC and a nominal MPC. Further investigation into the performance of the proposed method reveals a higher energy efficiency and passenger comfort level as compared to a recently proposed benchmark method using the space-domain modelling approach.
Data-Driven Predictive Control (DDPC) has been recently proposed as an effective alternative to traditional Model Predictive Control (MPC), in that the same constrained optimization problem can be addressed without the need to explicitly identify a full model of the plant. However, DDPC is built upon input/output trajectories. Therefore, the finite sample effect of stochastic data, due to, e.g., measurement noise, may have a detrimental impact on closed-loop performance. Exploiting a formal statistical analysis of the prediction error, in this paper we propose the first systematic approach to deal with uncertainty due to finite sample effects. To this end, we introduce two regularization strategies for which, differently from existing regularization-based DDPC techniques, we propose a tuning rationale allowing us to select the regularization hyper-parameters before closing the loop and without additional experiments. Simulation results confirm the potential of the proposed strategy when closing the loop.
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first order energy balance for deriving the zone temperature dynamics, and (b) a neural network for modeling HVAC dynamics. State estimation and model identification are simultaneously performed using nonlinear moving horizon estimation (MHE) with physical constraints for system states. We leverage the identified model in model predictive control (MPC) for occupant comfort satisfaction and HVAC energy savings and verify the approach using simulations. Our system relies only on building management system data, does not require extensive data storage, and does not require a detailed building model. This can significantly aid the large scale adoption of MPC for future occupant-centric control of grid-interactive buildings.
In this paper, we investigate the problem of Model Predictive Control (MPC) of dynamic systems for high-level specifications described by Signal Temporal Logic (STL) formulae. Recent works show that MPC has the great potential in handling logical tasks in reactive environments. However, existing approaches suffer from the heavy computational burden, especially for tasks with large horizons. In this work, we propose a computationally more efficient MPC framework for STL tasks based on time interval decomposition. Specifically, we still use the standard shrink horizon MPC framework with Mixed Integer Linear Programming (MILP) techniques for open-loop optimization problems. However, instead of applying MPC directly for the entire task horizon, we decompose the STL formula into several sub-formulae with disjoint time horizons, and shrinking horizon MPC is applied for each short-horizon sub-formula iteratively. To guarantee the satisfaction of the entire STL formula and to ensure the recursive feasibility of the iterative process, we introduce new terminal constraints to connect each sub-formula. We show how these terminal constraints can be computed by an effective inner-approximation approach. The computational efficiency of our approach is illustrated by a case study.
In distributed model predictive control (MPC), the control input at each sampling time is computed by solving a large-scale optimal control problem (OCP) over a finite horizon using distributed algorithms. Typically, such algorithms require several (virtually, infinite) communication rounds between the subsystems to converge, which is a major drawback both computationally and from an energetic perspective (for wireless systems). Motivated by these challenges, we propose a suboptimal distributed MPC scheme in which the total communication burden is distributed also in time, by maintaining a running solution estimate for the large-scale OCP and updating it at each sampling time. We demonstrate that, under some regularity conditions, the resulting suboptimal MPC control law recovers the qualitative robust stability properties of optimal MPC, if the communication budget at each sampling time is large enough.
Medical drug infusion problems pose a combination of challenges such as nonlinearities from physiological models, model uncertainty due to inter- and intra-patient variability, as well as strict safety specifications. With these challenges in mind, we propose a novel real-time Nonlinear Model Predictive Control (NMPC) scheme based on projected gradient descent iterations. At each iteration, a small number of steps along the gradient of the NMPC cost is taken, generating a suboptimal input which asymptotically converges to the optimal input. We retrieve classical Lyapunov stability guarantees by performing a sufficient number of gradient iterations until fulfilling a stopping criteria. Such a real-time control approach allows for higher sampling rates and faster feedback from the system which is advantageous for the class of highly variable and uncertain drug infusion problems. To demonstrate the controller's potential, we apply it to hypnosis control in anesthesia of two interacting drugs. The controller successfully regulates hypnosis even under disturbances and uncertainty and fulfils benchmark performance criteria.
The development of electric and connected vehicles as well as automated driving technologies are key towards the smart city, with convenient urban mobility and high energy economy performance. However, the global rise in electricity price provokes renewed interest on CAVs with hybrid electric powertrains rather than considering battery electric powertrains. This paper provides a decentralized coordination strategy for a group of connected and autonomous vehicles (CAVs) with a series hybrid electric (sHEV) powertrain at signal-free intersections. The problem is formulated as a convex form with suitable relaxation and approximation of the powertrain model and solved by decentralized model predictive control, which is able to ensure a rapid search and unique solution in real time. Numerical examples validate the effectiveness of the proposed methods concerning physical and safety constraints. By utilizing the petrol fuel and battery charging prices over the last year, the performance of the proposed approach is evaluated against the optimal results produced by two benchmark solutions, conventional vehicles (CVs) and battery electric vehicles (BEVs). The comparison results show that the traveling cost of sHEVs approaches and even under some circumstances reaches the same level as for BEVs, which indicates the importance of hybridization, particularly under the current rising electricity price situation.
A stochastic model predictive control (MPC) framework is presented in this paper for nonlinear affine systems with stability and feasibility guarantee. We first introduce the concept of stochastic control Lyapunov-barrier function (CLBF) and provide a method to construct CLBF by combining an unconstrained control Lyapunov function (CLF) and control barrier functions. The unconstrained CLF is obtained from its corresponding semi-linear system through dynamic feedback linearization. Based on the constructed CLBF, we utilize sampled-data MPC framework to deal with states and inputs constraints, and to analyze stability of closed-loop systems. Moreover, event-triggering mechanisms are integrated into MPC framework to improve performance during sampling intervals. The proposed CLBF based stochastic MPC is validated via an obstacle avoidance example.
An important issue in model-based control design is that an accurate dynamic model of the system is generally nonlinear, complex, and costly to obtain. This limits achievable control performance in practice. Gaussian process (GP) based estimation of system models is an effective tool to learn unknown dynamics directly from input/output data. However, conventional GP-based control methods often ignore the computational cost associated with accumulating data during the operation of the system and how to handle forgetting in continuous adaption. In this paper, we present a novel Dual Gaussian Process (DGP) based model predictive control (MPC) strategy that enables efficient use of online learning based predictive control without the danger of catastrophic forgetting. The bio-inspired DGP structure is a combination of a long-term GP and a short-term GP, where the long-term GP is used to keep the learned knowledge in memory and the short-term GP is employed to rapidly compensate unknown dynamics during online operation. Furthermore, a novel recursive online update strategy for the short-term GP is proposed to successively improve the learnt model during online operation. Effectiveness of the proposed strategy is demonstrated via numerical simulations.
Although electric power networks and district heating networks are physically coupled, they are not operated in a coordinated manner. With increasing penetration of renewable energy sources, a coordinated market-based operation of the two networks can yield significant advantages, as reduced need for grid reinforcements, by optimizing the power flows in the coupled systems. Transactive control has been developed as a promising approach based on market and control mechanisms to coordinate supply and demand in energy systems, which when applied to power systems is being referred to as transactive energy. However, this approach has not been fully investigated in the context of market-based operation of coupled electric power and district heating networks. Therefore, this paper proposes a transactive control approach to coordinate flexible producers and consumers while taking into account the operational aspects of both networks, for the benefit of all participants and considering their privacy. A nonlinear model predictive control approach is applied in this work to maximize the social welfare of both networks, taking into account system operational limits, while reducing losses and considering system dynamics and forecasted power supply and demand of inflexible producers and consumers. A subtle approximation of the operational optimization problem is used to enable the practical application of the proposed approach in real time. The presented technique is implemented, tested, and demonstrated in a realistic test system, illustrating its benefits.
A new motion planning framework for automated highway merging is presented in this paper. To plan the merge and predict the motion of the neighboring vehicle, the ego automated vehicle solves a joint optimization of both vehicle costs over a receding horizon. The non-convex nature of feasible regions and lane discipline is handled by introducing integer decision variables resulting in a mixed integer quadratic programming (MIQP) formulation of the model predictive control (MPC) problem. Furthermore, the ego uses an inverse optimal control approach to impute the weights of neighboring vehicle cost by observing the neighbor's recent motion and adapts its solution accordingly. We call this adaptive interactive mixed integer MPC (aiMPC). Simulation results show the effectiveness of the proposed framework.
In this paper, a model predictive control (MPC) framework is employed to realize autonomous rendezvous and docking (AR&D) with a tumbling target, using the piecewise affine (PWA) model of the 3-D line-of-sight (LOS) dynamics and Euler attitude dynamics. Consider the error between the predictions obtained by the approximate linear model and the actual states of nonlinear dynamics, a sampling-based PWA MPC is proposed to sample the predictions in the closer neighborhood of the actual states. Besides, novel constructions of constraints are presented to reduce the on-board computation cost and time-delay. Furthermore, a singularity-free strategy is provided to realize crossing the singularity of angle states smoothly. Then, the mission is achieved by continuous 6-DOF pose (position and attitude) tracking of the target's docking port, with the coupling between the position and attitude of the target's docking port is taken into account. Finally, numerical results are presented to demonstrate the above theories.