Abstract
The main problem concerning model free learning controllers in particular BELBIC (Brain Emotional Learning Based Intelligent controller), is attributed to initial steps of learning process since the system performance is dramatically low, because they produce inappropriate control commands. In this paper a new approach is proposed in order to control unstable systems or systems with unstable equilibrium. This method is combination of one imitation phase to imitate a basic solution through a basic controller and two optimization phases based on PSO (Particle Swarm Optimization) which are employed to find a new solution for stress generation and to improve control signal gradually in reducing error. An inverted pendulum system is opted as the test bed for evaluation. Evaluation measures in simulation results show the improvement of error reduction and more robustness than a basic tuned double-PID controller for this task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balkenius, C., Moren, J.: A computational model of emotional conditioning in the brain. In: Proceedings of the Workshop on Grounding Emotions in Adaptive Systems, Zurich (1998)
van den Bergh, F.: An analysis of particle swarm optimizers. Ph.D. thesis, University of Pretoria (2001)
Blondin, J.: Particle swarm optimization: A tutorial (2009)
Custodio, L., Ventura, R., Pinto-Ferreira, C.: Artificial emotions and emotion-based control systems. In: 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation Proceedings (ETFA 1999), Barcelona, Spain (1999)
Damasio, A.R.: Descartes Error: Emotion, Reason and the Human Brain. G.P. Putnams Sons, New York (1994)
El-Nasr, M., Yen, J.: Agents, emotional intelligence and fuzzy logic. In: Proc. 1998 Conference of the North American Fuzzy Information Processing Society (NAFIPS), Pensacola Beach, FL, USA, pp. 301–305 (1998)
Fatoorechi, M.: Deveolpement of emotional learning methods for multi modal and multi variable problem. Master’s thesis, ECE Department, University of Tehran
Hwang, K.S., Tan, S., Tsai, M.C.: Reinforcement learning to adaptive control of nonlinear systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 33(3), 514–521 (2004)
Jalili-Kharaajoo, M.: Application of brain emotional learning based intelligent controller (belbic) to active queue management. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2004. LNCS, vol. 3037, pp. 662–665. Springer, Heidelberg (2004)
Jamali, M.R., Arami, A., Hosseini, B., Moshiri, B., Lucas, C.: Real time emotional control for anti-swing and positioning control of simo overhead traveling crane. International Journal of Innovative Computing, Information and Control 4(9), 2333–2344 (2008)
Javan-Roshtkhari, M., Arami, A., Lucas, C.: Emotional control of inverted pendulum system: A soft switching from imitative to emotional learning. In: Proceedings of the 4th International Conference on Autonomous Robots and Agents, Wellington, New Zealand, pp. 651–656 (2009)
Jazbi, A.: Development of reinforcement learning in intelligent controllers and its applications in industries and laboratories. Master’s thesis, ECE Department, University of Tehran (1998)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)
Lucas, C., Milasi, R.M., Araabi, B.N.: Intelligent modeling and control of washing machine using llnf modeling and modified belbic. Asian Journal of Control 8(4), 393–400 (2005)
Lucas, C., Shahmirzadi, D., Sheikholeslami, N.: Introducing belbic: Brain emotional learning based intelligent controller. Intelligent Automation and Soft Computing 10(1), 11–22 (2004)
Milasi, R.M., Lucas, C., Araabi, B.N.: Intelligent modeling and control of washing machines using llnf modeling and modified belbic. In: Proc. of International Conference on Control and Automation (ICCA 2005), Budapest, vol. 2, pp. 812–817 (2005)
Milasi, R.M., Lucas, C., Arrabi, B.N., Radwan, T.S., Rahman, M.A.: Implementation of emotional controller for interior permanent magnet synchronous motor drive. In: Proc. of IEEE / IAS 41st Annual Meeting: Industry Applications, Tampa, Florida, USA (2006)
Moren, J.: Emotion and learning: A computational model of the amygdale. Ph.D. thesis, Lund university, Lund, Sweden (2002)
Moren, J., Balkenius, C.: A computational model of emotional learning in the amygdala: From animals to animals. In: Proc. of 6th International Conference on the Simulation of Adaptive Behavior, pp. 383–391. MIT Press, Cambridge (2000)
Rashidi, F., Rashidi, M., Hashemi-Hosseini, A.: Speed regulation of dc motors using intelligent controllers. In: Proceedings of 2003 IEEE Conference on Control Applications (CCA 2003), vol. 2, pp. 925–930 (2003)
Seif El-Nasr, M., Skubic, M.: A fuzzy emotional agent for decision-making in a mobile robot. In: The 1998 IEEE International Conference on Fuzzy Systems Proceedings, IEEE World Congress on Computational Intelligence, Anchorage, AK, USA, pp. 135–140 (1998)
Shahidi, N., Esmaeilzadeh, H., Abdollahi, M., Lucas, C.: Memetic algorithm based path planning for a mobile robot. International Journal of Information Technology 1(2) (2004)
Shahidi, N., Gheiratmand, M., Lucas, C., Esmadizade, H.: Utmac: A c ++ library for multi-agent controller design. In: World Automation Congress Proceedings, pp. 287–292 (2004)
Sharbafi, M.A., Lucas, C.: Designing a football team of robots from beginning to end. International Journal of Information Technology 3(2), 101–108 (2006)
Sharbafi, M.A., Lucas, C., Toroghi Haghighat, A., Amirghiasvand, O., Aghazade, O.: Using emotional learning in rescue simulation environment. Transactions of Engineering, Computing and Technology (2006)
Sheikholeslami, N., Shahmirzadi, D., Semsar, E., Lucas, C., Yazdanpanah, M.J.: Applying brain emotional learning algorithm for multivariable control of hvac systems. J. Intell. Fuzzy Syst. 17(1), 35–46 (2006)
Ventura, R.M.M., Pinto-Ferreira, C.A.: Emotion-based control systems. In: Proceedings of the 1999 IEEE International Symposium on Intelligent Control/Intelligent Systems and Semiotics, Cambridge, MA, USA, pp. 64–66 (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Valipour, M.H., Maleki, K.N., Ghidary, S.S. (2015). Optimization of Emotional Learning Approach to Control Systems with Unstable Equilibrium. In: Lee, R. (eds) Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing. Studies in Computational Intelligence, vol 569. Springer, Cham. https://doi.org/10.1007/978-3-319-10389-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-10389-1_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10388-4
Online ISBN: 978-3-319-10389-1
eBook Packages: EngineeringEngineering (R0)