Skip to main content
Log in

Reliable H Control on Stochastic Delayed Markovian Jump System with Asynchronous Jumped Actuator Failure

  • Regular Papers
  • Control Theory and Applications
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

This paper studies the reliable H control on stochastic delayed Markovian jump systems (SDMJSs) with asynchronous jumped actuator failure and uncertain transition rates (TRs). It is assumed that the actuator failure occurs randomly under a Markov process with its jumping mode different from the system’s one. A generalized functional Itô’s formula for the closed-loop SDMJSs with mixed asynchronous Markovian jump modes (AMJMs) is successfully established. By the generalized functional Itô’s formula and the mixed-mode-dependent Lyapunov functionals, a sufficient delay-dependent condition of the reliable H controller design for the SDMJSs with mixed AMJMs is proposed via matrix manipulation and a relaxation method. Finally, an example on VTOL (vertical take-off and landing) helicopter system is given to demonstrate the feasibility and effectiveness of the presented controller design scheme.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. V. Kolmanovskii and A. Myshkis, Introduction to the Theory and Applications of Functional Differential Equations, Kluwer, 1999.

  2. X. Mao, Stochastic Differential Equations and Applications, 2nd ed., Horwood Publishing, Chichester, UK, 2007.

    MATH  Google Scholar 

  3. X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, 2006.

  4. X. Zong, G. Yin, L. Y. Wang, T. Li, and J.-F. Zhang, “Stability of stochastic functional differential systems using degenerate Lyapunov functionals and applications,” Automatica, vol. 91, pp. 197–207, 2018.

    MathSciNet  MATH  Google Scholar 

  5. L. Huang and X. Mao, “Delay-dependent exponential stability of neutral stochastic delay systems,” IEEE Transactions on Automatic Control, vol. 54, no. 1, pp. 147–152, 2009.

    MathSciNet  MATH  Google Scholar 

  6. B. Dupire, “Functional Itô calculus,” Bloomberg portfolio research paper no. 2009-04-FRONTIERS, 2009. DOI: https://doi.org/10.2139/ssrn.1435551

  7. R. Cont and D.-A. Fournié, “Change of variable formulas for non-anticipative functionals on path space,” Journal of Functional Analysis, vol. 259, no. 4, pp. 1043–1072, 2010.

    MathSciNet  MATH  Google Scholar 

  8. D. H. Nguyen and G. Yin, “Stability of stochastic functional differential equations with regime-switching: Analysis using dupire’s functional Itô formula,” Potential Analysis, pp. 1–19, 2019.

  9. D. Applebaum, Lévy Processes and Stochastic Calculus, 2nd ed., Cambridge University Press, 2009.

  10. X. Mao, “Exponential stability of stochastic delay interval systems with Markovian switching,” IEEE Transactions on Automatic Control, vol. 47, no. 10, pp. 1604–1612, 2002.

    MathSciNet  MATH  Google Scholar 

  11. X. Mao, Y. Shen, and C. Yuan, “Almost surely asymptotic stability of neutral stochastic differential delay equations with Markovian switching,” Stochastic Processes & their Applications, vol. 118, no. 8, pp. 1385–1406, 2008.

    MathSciNet  MATH  Google Scholar 

  12. P. Shi and F. Li, “A survey on Markovian jump systems: modeling and design,” International Journal of Control, Automation and Systems, vol. 13, no. 1, pp. 1–16, 2015.

    MathSciNet  Google Scholar 

  13. W. Qi, G. Zong, and H. R. Karim, “Observer-based adaptive SMC for nonlinear uncertain singular semi-markov jump systems with applications to DC motor,” IEEE Transactions on Circuits & Systems I Regular Papers, vol. 65, no. 9, pp. 5251–5273, 2019.

    MathSciNet  Google Scholar 

  14. R. Sakthivel, H. R. Karimi, M. Joby, and S. Santra, “Resilient sampled-data control for Markovian jump systems with an adaptive fault-tolerant mechanism,” IEEE Transactions on Circuits & Systems II Express Briefs, vol. 64, no. 11, pp. 1312–1316, 2017.

    Google Scholar 

  15. W. C. Zou, P. Shi, Z. R. Xiang, and Y. Shi, “Consensus tracking control of switched stochastic nonlinear multiagent systems via event-triggered strategy,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 3, pp. 1036–1045, 2019.

    MathSciNet  Google Scholar 

  16. W. C. Zou, P. Shi, Z. R. Xiang, and Y. Shi, “Finite-time consensus of second-order switched nonlinear multiagent systems,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 5, pp. 1757–1762, 2019.

    Google Scholar 

  17. L. W. Li and G. H. Yang, “Stabilisation of Markov jump systems with input quantisation and general uncertain transition rates,” IET Control Theory & Applications, vol. 11, no. 4, pp. 516–523, 2016.

    MathSciNet  Google Scholar 

  18. Z. Chen, Z. Cao, Q. Huang, and S. L. Campbell, “Reliable control on saturated linear Markov jump system with uncertain transition rates and asynchronous jumped actuator failure,” Journal of the Franklin Institute, vol. 355, no. 9, pp. 3853–3872, 2018.

    MathSciNet  MATH  Google Scholar 

  19. M. Karan, P. Shi, and C. Y. Kaya, “Transition probability bounds for the stochastic stability robustness of continuous-and discrete-time Markovian jump linear systems,” Automatica, vol. 42, no. 12, pp. 2159–2168, 2006.

    MathSciNet  MATH  Google Scholar 

  20. J. Xiong and J. Lam, “Robust H2 control of Markovian jump systems with uncertain switching probabilities,” International Journal of Systems Science, vol. 40, no. 3, pp. 255–265, 2009.

    MathSciNet  MATH  Google Scholar 

  21. Y. Guo, “Improved synthesis method for Markov jump systems with uncertain transition rates,” Journal of the Franklin Institute, vol. 352, no. 12, pp. 6011–6018, 2015.

    MathSciNet  MATH  Google Scholar 

  22. E. Carlos, T. Alexandre, and A. Karina, “Mode-independent filter for Markovian jump linear systems,” IEEE Trans. Autom. Control, vol. 51, no. 11, pp. 1837–1841, 2006.

    MathSciNet  MATH  Google Scholar 

  23. Y. Ding and H. Liu, “Stability analysis of continuous-time Markovian jump time-delay systems with time-varying transition rates,” Journal of the Franklin Institute, vol. 353, no. 11, pp. 2418–2430, 2016.

    MathSciNet  MATH  Google Scholar 

  24. Y. Guo and Z. Wang, “Stability of Markovian jump systems with generally uncertain transition rates,” Journal of the Franklin Institute, vol. 350, no. 9, pp. 2826–2836, 2013.

    MathSciNet  MATH  Google Scholar 

  25. Y. Kao, J. Xie, and C. Wang, “Stabilization of singular Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 59, no. 9, pp. 2604–2610, 2014.

    MathSciNet  MATH  Google Scholar 

  26. N. K. Kwon, I. S. Park, and P. Park, “ control for singular Markovian jump systems with incomplete knowledge of transition probabilities,” Applied Mathematics and Computation, vol. 295, pp. 126–135, 2017.

    MathSciNet  MATH  Google Scholar 

  27. B. Jiang, Y. Kao, H. R. Karimi, and C. Gao, “Stability and stabilization for singular switching semi-Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 63, no. 11, pp. 3919–3926, 2018.

    MathSciNet  MATH  Google Scholar 

  28. Z. Yan, Y. Song, and X. Liu, “Finite-time stability and stabilization for Itô-type stochastic Markovian jump systems with generally uncertain transition rates,” Applied Mathematics and Computation, vol. 321, pp. 512–525, 2018.

    MathSciNet  MATH  Google Scholar 

  29. I. S. Park, N. K. Kwon, and P. Park, “Dynamic outputfeedback control for singular Markovian jump systems with partly unknown transition rates,” Nonlinear Dynamics, vol. 95, no. 4, pp. 3149–3160, 2019.

    MATH  Google Scholar 

  30. H. Shen, L. Su, and J. H. Park, “Reliable mixed /passive control for T-S fuzzy delayed systems based on a semi-Markov jump model approach,” Fuzzy Sets and Systems, vol. 314, pp. 79–98, 2017.

    MathSciNet  MATH  Google Scholar 

  31. J. Cheng, B. Wang, J. H. Park, and W. Kang, “Sampleddata reliable control for T-S fuzzy semi-Markovian jump system and its application to single-link robot arm model,” IET Control Theory & Applications, vol. 11, no. 12, pp. 1904–1912, 2017.

    MathSciNet  Google Scholar 

  32. Y. Wei, J. Qiu, H.-K. Lam, and L. Wu, “Approaches to T-S fuzzy-affine-model-based reliable output feedback control for nonlinear Itô stochastic systems,” IEEE Transactions on Fuzzy Systems, vol. 25, no. 3, pp. 569–583, 2016.

    Google Scholar 

  33. D. Zhai, L. An, D. Ye, and Q. Zhang, “Adaptive reliable static output feedback control against Markovian jumping sensor failures,” IEEE Transactions on Neural Networks & Learning Systems, vol. 29, no. 3, pp. 631–644, 2018.

    MathSciNet  Google Scholar 

  34. Y. M. Fu and C. J. Li, “Parametric method for spacecraft trajectory tracking control problem with stochastic thruster fault,” IET Control Theory & Applications, vol. 10, no. 17, pp. 2331–2338, 2016.

    MathSciNet  Google Scholar 

  35. X. Yao, L. Wu, and W. X. Zheng, “Fault detection filter design for Markovian jump singular systems with intermittent measurements,” IEEE Transactions on Signal Processing, vol. 59, no. 7, pp. 3099–3109, 2011.

    MathSciNet  MATH  Google Scholar 

  36. L. Zhang, “ estimation for discrete-time piecewise homogeneous Markov jump linear systems,” Automatica, vol. 45, no. 11, pp. 2570–2576, 2009.

    MathSciNet  MATH  Google Scholar 

  37. Z. Gu, J. Liu, C. Peng, and E. Tian, “Reliable control for interval time-varying delay systems subjected to actuator saturation and stochastic failure,” Optimal Control Applications and Methods, vol. 33, no. 6, pp. 739–750, 2012.

    MathSciNet  MATH  Google Scholar 

  38. Z.G. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous l2-l filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,” Automatica, vol. 50, no. 1, pp. 180–186, 2014.

    MathSciNet  MATH  Google Scholar 

  39. Z. Xu, H. Su, P. Shi, and Z. G. Wu, “Asynchronous control of semi-Markov jump linear systems,” Applied Mathematics and Computation, vol. 349, pp. 270–280, 2019.

    MathSciNet  MATH  Google Scholar 

  40. Y. Y. Cao and J. Lam, “Robust control of uncertain Markovian jump systems with time-delay,” IEEE Transactions on Automatic Control, vol. 45, no. 1, pp. 77–83, 2000.

    MathSciNet  MATH  Google Scholar 

  41. W. H. Chen, J. X. Xu, and Z. H. Guan, “Guaranteed cost control for uncertain Markovian jump systems with mode-dependent time-delays,” IEEE Transactions on Automatic Control, vol. 48, no. 12, pp. 2270–2277, 2003.

    MathSciNet  MATH  Google Scholar 

  42. S. Xu, J. Lam, and X. Mao, “Delay-dependent control and filtering for uncertain Markovian jump systems with time-varying delays,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 54, no. 9, pp. 2070–2077, 2007.

    MathSciNet  MATH  Google Scholar 

  43. X. Mao, “Stabilization of continuous-time hybrid stochastic differential equations by discrete-time feedback control,” Automatica, vol. 49, no. 12, pp. 3677–3681, 2013.

    MathSciNet  MATH  Google Scholar 

  44. P. Shi, E. K. Boukas, and R. K. Agarwal, “Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,” IEEE Transactions on Automatic Control, vol. 44, no. 8, pp. 1592–1597, 1999.

    MathSciNet  MATH  Google Scholar 

  45. S. H. Kim, “Stochastic stability and stabilization conditions of semi-Markovian jump systems with mode transition-dependent sojourn-time distributions,” Information Sciences, vol. 385, pp. 314–324, 2017.

    MATH  Google Scholar 

  46. A. Skorokhod, Asymptotic Methods in the Theory of Stochastic Differential Equations, American Mathematical Soc., 1989.

  47. M. K. Ghosh and A. Goswami, “Risk minimizing option pricing in a semi-Markov modulated market,” SIAM Journal on Control and Optimization, vol. 48, no. 3, pp. 1519–1541, 2009.

    MathSciNet  MATH  Google Scholar 

  48. D. R. Baños, F. Cordoni, G. Di Nunno, L. Di Persio, and E. Røse, “Stochastic systems with memory and jumps,” Journal of Differential Equations, vol. 266, no. 9, pp. 5772–5820, 2019.

    MathSciNet  MATH  Google Scholar 

  49. B. Song, J. H. Park, Z. G. Wu, and X. Li, “New results on delay-dependent stability analysis and stabilization for stochastic time-delay systems,” International Journal of Robust and Nonlinear Control, vol. 24, no. 16, pp. 2546–2559, 2014.

    MATH  Google Scholar 

  50. Y. Kao, J. Xie, and C. Wang, “Stabilisation of mode-dependent singular Markovian jump systems with generally uncertain transition rates,” Applied Mathematics and Computation, vol. 245, pp. 243–254, 2014.

    MathSciNet  MATH  Google Scholar 

  51. Y. Guo, “A convex method of robust controller design for Markovian jump systems with uncertain transition rates,” Asian Journal of Control, vol. 16, no. 3, pp. 928–935, 2014.

    MathSciNet  MATH  Google Scholar 

  52. G. Zhuang and Y. Wei, “Non-fragile filter design for uncertain stochastic nonlinear time-delay Markovian jump systems,” Circuits, Systems, and Signal Processing, vol. 33, no. 11, pp. 3389–3419, 2014.

    MATH  Google Scholar 

  53. H. Ren, G. Zong, and H. R. Karimi, “Asynchronous finite-time filtering of Markov jump nonlinear systems and its applications,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019. DOI: https://doi.org/10.1109/TSMC.2019.2899733

  54. B. P. Jiang, Y. G. Kao, H. R. Karimi, and C. C. Gao, “Stability and stabilization for singular switching semi-Markovian jump systems with generally uncertain transition rates,” IEEE Transactions on Automatic Control, vol. 63, no. 11, pp. 3919–3926, 2018.

    MathSciNet  MATH  Google Scholar 

  55. G. Zong and H. Ren, “Guaranteed cost finite-time control for semi-Markov jump systems with event-triggered scheme and quantization input,” International Journal of Robust and Nonlinear Control, vol. 29, no. 15, pp. 5251–5273, 2019.

    MathSciNet  MATH  Google Scholar 

  56. G. Zong, W. Qi, and H. R. Karimi, “L1 control of positive semi-Markov jump systems with state delay,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020. DOI: https://doi.org/10.1109/TSMC.2020.2980034

  57. G. Zong, Y. Li, and H. Sun, “Composite anti-disturbance resilient control for Markovian jump nonlinear systems with general uncertain transition rate,” Science China Information Sciences, vol. 62, pp. 022205:1–18, 2019.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun Yang.

Additional information

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Recommended by Associate Editor Guangdeng Zong under the direction of Editor Hamid Reza Karimi. This work was supported by the Fundamental Research Funds for the Central Universities of the Southwest Minzu University (Grant no. 2018NQN03). The authors are truly grateful to the editor and the anonymous reviewers for their valuable suggestions.

Wenpin Luo received her B.S. degree from Sichuan Normal University, Chengdu, China, in 2004 and an M.S. degree from University of Electronic Science and Technology of China, Chengdu, China, in 2007, all in applied mathematics. She is currently an Associate Professor with the Department of Arts and Sciences, Chengdu College of University of Electronic Science and Technology of China, Chengdu, China. From 2018 to 2019, she was a visiting scholar at the University of Waterloo. Her current research interests include neural networks and stochastic control systems.

Jun Yang received his B.S. degree from Leshan Normal University, Leshan, China, in 2004 and a Ph.D. degree from University of Electronic Science and Technology of China, Chengdu, China, in 2009, all in applied mathematics. He is currently a Professor with the College of Electrical and Information Engineering, Southwest Minzu University, Chengdu, China. From 2018 to 2019, he was a visiting scholar at the University of Waterloo. His current research interests include fuzzy and stochastic control systems. He is an active reviewer for many international journals.

Xinzhi Liu received his B.Sc. degree in mathematics from Shandong Normal University, Jinan, China, in 1982, and his M.Sc. and Ph.D. degrees, in applied mathematics, from the University of Texas, Arlington, Texas, USA, in 1987 and 1988, respectively. He was a Post-Doctoral Fellow at the University of Alberta, Edmonton, Alberta, Canada, from 1988 to 1990. He joined the Department of Applied Mathematics, University of Waterloo, Waterloo, Canada, as an Assistant Professor in 1990, where he became an Associate Professor and a Full Professor, in 1994 and 1997, respectively. His research areas include systems analysis, stability theory, hybrid dynamical systems, impulsive control, complex dynamical networks, and communication security. He is the author or coauthor of over 300 research articles and two research monographs and twenty edited books.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, W., Yang, J. & Liu, X. Reliable H Control on Stochastic Delayed Markovian Jump System with Asynchronous Jumped Actuator Failure. Int. J. Control Autom. Syst. 19, 618–631 (2021). https://doi.org/10.1007/s12555-020-0154-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-020-0154-x

Keywords

Navigation