Abstract
This overview paper reviews numerical methods for solution of optimal control problems in real-time, as they arise in nonlinear model predictive control (NMPC) as well as in moving horizon estimation (MHE). In the first part, we review numerical optimal control solution methods, focussing exclusively on a discrete time setting. We discuss several algorithmic ”building blocks” that can be combined to a multitude of algorithms. We start by discussing the sequential and simultaneous approaches, the first leading to smaller, the second to more structured optimization problems. The two big families of Newton type optimization methods, Sequential Quadratic Programming (SQP) and Interior Point (IP) methods, are presented, and we discuss how to exploit the optimal control structure in the solution of the linear-quadratic subproblems, where the two major alternatives are “condensing” and band structure exploiting approaches. The second part of the paper discusses how the algorithms can be adapted to the real-time challenge of NMPC and MHE. We recall an important sensitivity result from parametric optimization, and show that a tangential solution predictor for online data can easily be generated in Newton type algorithms. We point out one important difference between SQP and IP methods: while both methods are able to generate the tangential predictor for fixed active sets, the SQP predictor even works across active set changes. We then classify many proposed real-time optimization approaches from the literature into the developed categories.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bemporad, A., Borrelli, F., Morari, M.: Model predictive control based on linear programming - the explicit solution. IEEE Transactions on Automatic Control 47(12), 1974–1985 (2002)
Betts, J.T.: Practical Methods for Optimal Control Using Nonlinear Programming. SIAM, Philadelphia (2001)
Biegler, L.T.: Solution of dynamic optimization problems by successive quadratic programming and orthogonal collocation. Computers and Chemical Engineering 8, 243–248 (1984)
Biegler, L.T., Rawlings, J.B.: Optimization approaches to nonlinear model predictive control. In: Ray, W.H., Arkun, Y. (eds.) Proc. 4th International Conference on Chemical Process Control - CPC IV, pp. 543–571. AIChE, CACHE (1991)
Binder, T., Blank, L., Bock, H.G., Bulirsch, R., Dahmen, W., Diehl, M., Kronseder, T., Marquardt, W., Schlöder, J.P., Stryk, O.V.: Introduction to model based optimization of chemical processes on moving horizons. In: Grötschel, M., Krumke, S.O., Rambau, J. (eds.) Online Optimization of Large Scale Systems: State of the Art, pp. 295–340. Springer, Heidelberg (2001)
Bock, H.G.: Randwertproblemmethoden zur Parameteridentifizierung in Systemen nichtlinearer Differentialgleichungen. Bonner Mathematische Schriften, vol. 183. Universität Bonn, Bonn (1987)
Bock, H.G., Diehl, M., Kostina, E.A., Schlöder, J.P.: Constrained optimal feedback control of systems governed by large differential algebraic equations. In: Biegler, L., Ghattas, O., Heinkenschloss, M., Keyes, D., van Bloemen Waanders, S.B. (eds.) Real-Time and Online PDE-Constrained Optimization, pp. 3–22. SIAM, Philadelphia (2007)
Bock, H.G., Diehl, M., Leineweber, D.B., Schlöder, J.P.: Efficient direct multiple shooting in nonlinear model predictive control. In: Keil, F., Mackens, W., Voß, H., Werther, J. (eds.) Scientific Computing in Chemical Engineering II, vol. 2, pp. 218–227. Springer, Berlin (1999)
Bock, H.G., Plitt, K.J.: A multiple shooting algorithm for direct solution of optimal control problems. In: Proceedings 9th IFAC World Congress Budapest, pp. 243–247. Pergamon Press, Oxford (1984)
Boyd, S., Vandenberghe, L.: Convex Optimization. University Press, Cambridge (2004)
Bryson, A.E., Ho, Y.-C.: Applied Optimal Control. Wiley, New York (1975)
Büskens, C., Maurer, H.: Sqp-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control. Journal of Computational and Applied Mathematics 120, 85–108 (2000)
Deuflhard, P.: Newton Methods for Nonlinear Problems. Springer, New York (2004)
Diehl, M.: Real-Time Optimization for Large Scale Nonlinear Processes, VDI Verlag, Düsseldorf. Fortschr.-Ber. VDI Reihe 8, Meß-, Steuerungs- und Regelungstechnik, vol. 920 (2002), http://www.ub.uni-heidelberg.de/archiv/1659/
Diehl, M., Bock, H.G., Schlöder, J.P.: A real-time iteration scheme for nonlinear optimization in optimal feedback control. SIAM Journal on Control and Optimization 43(5), 1714–1736 (2005)
Diehl, M., Bock, H.G., Schlöder, J.P., Findeisen, R., Nagy, Z., Allgöwer, F.: Real-time optimization and nonlinear model predictive control of processes governed by differential-algebraic equations. J. Proc. Contr. 12(4), 577–585 (2002)
Diehl, M., Findeisen, R., Allgöwer, F.: A stabilizing real-time implementation of nonlinear model predictive control. In: Biegler, L., Ghattas, O., Heinkenschloss, M., Keyes, D., van Bloemen Waanders, S.B. (eds.) Real-Time and Online PDE-Constrained Optimization, pp. 23–52. SIAM, Philadelphia (2007)
Diehl, M., Findeisen, R., Allgöwer, F., Bock, H.G., Schlöder, J.P.: Nominal stability of the real-time iteration scheme for nonlinear model predictive control. IEE Proc.-Control Theory Appl. 152(3), 296–308 (2005)
Diehl, M., Magni, L., De Nicolao, G.: Online NMPC of unstable periodic systems using approximate infinite horizon closed loop costing. Annual Reviews in Control 28, 37–45 (2004)
Diehl, M., Walther, A., Bock, H.G., Kostina, E.: An adjoint-based SQP algorithm with quasi-newton jacobian updates for inequality constrained optimization. Technical Report Preprint MATH-WR-02-2005, TU Dresden (2005)
Diehl, M., Kühl, P., Bock, H.G., Schlöder, J.P.: Schnelle algorithmen für die zustands- und parameterschätzung auf bewegten horizonten. Automatisierungstechnik 54(12), 602–613 (2006)
Ferreau, H.J.: qpOASES User’s Manual (2007–2008), http://homes.esat.kuleuven.be/~optec/software/qpOASES/
Ferreau, H.J., Bock, H.G., Diehl, M.: An online active set strategy to overcome the limitations of explicit MPC. International Journal of Robust and Nonlinear Control 18(8), 816–830 (2008)
Findeisen, R., Allgöwer, F.: Computational delay in nonlinear model predictive control. In: Proc. Int. Symp. Adv. Control of Chemical Processes, ADCHEM (2003)
Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Chichester (1987)
Franke, R.: Integrierte dynamische Modellierung und Optimierung von Systemen mit saisonaler Wärmespeicherung. PhD thesis, Technische Universität Ilmenau, Germany (1998)
Gill, P.E., Murray, W., Saunders, M.A.: SNOPT: An SQP algorithm for large-scale constrained optimization. Technical report, Numerical Analysis Report 97-2, Department of Mathematics, University of California, San Diego, La Jolla, CA (1997)
Gill, P.E., Murray, W., Wright, M.H.: Practical optimization. Academic Press, London (1999)
Glad, T., Johnson, H.: A method for state and control constrained linear-quadratic control problems. In: Proceedings of the 9th IFAC World Congress, Budapest, Hungary, pp. 1583–1587 (1984)
Griewank, A.: Evaluating Derivatives, Principles and Techniques of Algorithmic Differentiation. Frontiers in Appl. Math, vol. 19. SIAM, Philadelphia (2000)
Griewank, A., Toint, P.L.: Partitioned variable metric updates for large structured optimization problems. Numerische Mathematik 39, 119–137 (1982)
Griewank, A., Walther, A.: On constrained optimization by adjoint based quasi-Newton methods. Optimization Methods and Software 17, 869–889 (2002)
Guddat, J., Guerra Vasquez, F., Jongen, H.T.: Parametric Optimization: Singularities, Pathfollowing and Jumps. Teubner, Stuttgart (1990)
Helbig, A., Abel, O., Marquardt, W.: Model predictive control for on-line optimization of semi-batch reactors. In: Proc. Amer. Contr. Conf, Philadelphia, pp. 1695–1699 (1998)
Jorgensen, J.B., Rawlings, J.B., Jorgensen, S.B.: Numerical methods for large-scale moving horizon estimation and control. In: Proceedings of Int. Symposium on Dynamics and Control Process Systems (DYCOPS) (2004)
Kang, W.: Moving horizon numerical observers of nonlinear control systems. IEEE Transactions on Automatic Control 51(2), 344–350 (2006)
Krämer-Eis, P., Bock, H.G.: Numerical treatment of state and control constraints in the computation of feedback laws for nonlinear control problems. In: Deuflhard, P., et al. (eds.) Large Scale Scientific Computing, pp. 287–306. Birkhäuser, Basel (1987)
Kraus, T., Kühl, P., Wirsching, L., Bock, H.G., Diehl, M.: A moving horizon state estimation algorithm applied to the tennessee eastman benchmark process. In: Proc. of IEEE Robotics and Automation Society conference on Multisensor Fusion and Integration for Intelligent Systems (2006)
Leineweber, D.B., Bauer, I., Schäfer, A.A.S., Bock, H.G., Schlöder, J.P.: An efficient multiple shooting based reduced SQP strategy for large-scale dynamic process optimization (Parts I and II). Computers and Chemical Engineering 27, 157–174 (2003)
Li, W.C., Biegler, L.T.: Multistep, Newton-type control strategies for constrained nonlinear processes. Chem. Eng. Res. Des. 67, 562–577 (1989)
Li, W.C., Biegler, L.T.: Newton-type controllers for constrained nonlinear processes with uncertainty. Industrial and Engineering Chemistry Research 29, 1647–1657 (1990)
Mayne, D.Q., Rawlings, J.B., Rao, C.V., Scokaert, P.O.M.: Constrained model predictive control: stability and optimality. Automatica 26(6), 789–814 (2000)
M’hamdi, A., Helbig, A., Abel, O., Marquardt, W.: Newton-type receding horizon control and state estimation. In: Proc. 13rd IFAC World Congress, San Francisco, pp. 121–126 (1996)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, Heidelberg (1999)
Ohtsuka, T.: A continuation/gmres method for fast computation of nonlinear receding horizon control. Automatica 40(4), 563–574 (2004)
Ohtsuka, T., Fujii, H.A.: Nonlinear receding-horizon state estimation by real-time optimization technique. Journal of Guidance, Control, and Dynamics 19(4) (1996)
Powell, M.J.D.: A fast algorithm for nonlinearly constrained optimization calculations. In: Watson, G.A. (ed.) Numerical Analysis, Dundee 1977. LNM, vol. 630, Springer, Berlin (1978)
Rao, C.V., Rawlings, J.B., Mayne, D.Q.: Constrained state estimation for nonlinear discrete-time systems: Stability and moving horizon approximations. IEEE Transactions on Automatic Control 48(2), 246–258 (2003)
Rao, C.V., Wright, S.J., Rawlings, J.B.: Application of interior-point methods to model predictive control. Journal of Optimization Theory and Applications 99, 723–757 (1998)
Sargent, R.W.H., Sullivan, G.R.: The development of an efficient optimal control package. In: Stoer, J. (ed.) Proceedings of the 8th IFIP Conference on Optimization Techniques, Springer, Heidelberg (1977) (Part 2, 1978)
Schäfer, A., Kühl, P., Diehl, M., Schlöder, J.P., Bock, H.G.: Fast reduced multiple shooting methods for nonlinear model predictive control. Chemical Engineering and Processing 46(11), 1200–1214 (2007)
Schäfer, A.A.S.: Efficient reduced Newton-type methods for solution of large-scale structured optimization problems with application to biological and chemical processes. PhD thesis, Universität Heidelberg (2005)
Schlöder, J.P.: Numerische Methoden zur Behandlung hochdimensionaler Aufgaben der Parameteridentifizierung. Bonner Mathematische Schriften, vol. 187. Universität Bonn, Bonn (1988)
Shimizu, Y., Ohtsuka, T., Diehl, M.: A real-time algorithm for nonlinear receding horizon control using multiple shooting and continuation/krylov method. International Journal of Robust and Nonlinear Control (accepted ) (2008)
Soneda, Y., Ohtsuka, T.: Nonlinear moving horizon state estimation for a hovercraft with continuation/gmres method. In: Proc. of IEEE Conf. on Control Applications (2002)
Steinbach, M.C.: A structured interior point sqp method for nonlinear optimal control problems. In: Bulirsch, R., Kraft, D. (eds.) Computation Optimal Control, pp. 213–222. Birkhäuser, Basel (1994)
Tenny, M.J., Rawlings, J.B.: Efficient moving horizon estimation and nonlinear model predictive control. In: Proceedings of the American Control Conference, Anchorage, AK (2002)
Tenny, M.J., Wright, S.J., Rawlings, J.B.: Nonlinear model predictive control via feasibility-perturbed sequential quadratic programming. Computational Optimization and Applications 28(1), 87–121 (2004)
Tsang, T.H., Himmelblau, D.M., Edgar, T.F.: Optimal control via collocation and non-linear programming. International Journal on Control 21, 763–768 (1975)
Wächter, A.: An Interior Point Algorithm for Large-Scale Nonlinear Optimization with Applications in Process Engineering. PhD thesis, Carnegie Mellon University (2002)
Wirsching, L.: An SQP algorithm with inexact derivatives for a direct multiple shooting method for optimal control problems. Master’s thesis, University of Heidelberg (2006)
Wirsching, L., Ferreau, H.J., Bock, H.G., Diehl, M.: An online active set strategy for fast adjoint based nonlinear model predictive control. In: Preprints of the 7th Symposium on Nonlinear Control Systems (NOLCOS), Pretoria (2007)
Wright, S.J.: Primal-Dual Interior-Point Methods. SIAM Publications, Philadelphia (1997)
Zavala, V.M., Biegler, L.T.: The advanced step nmpc controller: Optimality, stability and robustness. Automatica (accepted for publication) (2008)
Zavala, V.M., Biegler, L.T.: Nonlinear programming sensitivity for nonlinear state estimation and model predictive control. In: International Workshop on Assessment and Future Directions of Nonlinear Model Predictive Control (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Diehl, M., Ferreau, H.J., Haverbeke, N. (2009). Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation. In: Magni, L., Raimondo, D.M., Allgöwer, F. (eds) Nonlinear Model Predictive Control. Lecture Notes in Control and Information Sciences, vol 384. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01094-1_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-01094-1_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01093-4
Online ISBN: 978-3-642-01094-1
eBook Packages: EngineeringEngineering (R0)