International Journal of Fuzzy Logic and Intelligent Systems

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

BOXES-based Cooperative Fuzzy Control for Cartpole System

  • Kwon, Sung-Gyu (Faculty of Mechanical and Automotive Engineering Keimyung University)
  • Published : 2007.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

Two fuzzy controllers defined by 2 input variables cooperate to control a cartpole system in terms of balancing as well as centering. The cooperation is due to the BOXES scheme that selects one of the fuzzy controllers for each time step according to the content of box that is established through the critic of the control action by the fuzzy controllers. It is found that the control scheme is good at controlling the cartpole system so that the system is stabilized fast while the BOXES develops its ability to select proper fuzzy controller through experience.

Keywords

References

  1. Geva, S. and Sitte, J. A. 'Cartpole Experiment Benchmark for Trainable Controllers,' IEEE Control Systems Magazine, 13(5),40-51,1993
  2. Lee, C.-C. 'A Self-Learning Rule-Based Controller Employing Approximate Reasoning and Neural Net Concepts,' International Journal of Intelligent Systems, 6, 71-93, 1991 https://doi.org/10.1002/int.4550060105
  3. Deng, Z., Zhang, Z., and Jia, P. 'A Neural-Fuzzy BOXES Control System with Reinforcement Learning and its Application to Inverted Pendulum,' IEEE International Conference on Intelligent Systems for the 21st Century, Oct. 22-25, Vol. 2, pp. 1250-1254,1995
  4. Michie, D. and Chambers, R. A. ''BOXES' as a model of Pattern-formation,' in Towards a Theoretical Biology, Vol. 1, Prolegomena, C. H. Waddington, Ed., Edinburgh: Edinburgh Univ. Press, 206-215,1968
  5. Lin, C. and Sheu, Y. 'A Hybrid-Control Approach for Pendulum-Car Control,' IEEE Transactions on Industrial Electronics, 39(3), 208-214,1992 https://doi.org/10.1109/41.141622
  6. Li, T. and Shieh, M. 'Switching-type Fuzzy Sliding Mode Control of a Cart-Pole System,' Mechatronics, 10,91-109, 2000 https://doi.org/10.1016/S0957-4158(99)00053-7
  7. Yi, J. and Yubazaki, N. 'Stabilization Fuzzy Control of Inverted Pendulum Systems,' Artificial Intelligence in Engineering, 14, 153-163,2000 https://doi.org/10.1016/S0954-1810(00)00007-8
  8. Berenji, H. R. and Khedkar, P. 'Learning and Tuning Fuzzy Logic Controllers Through Reinforcements,' IEEE Transactions on Neural Networks, 3(5), 724-740, 1992 https://doi.org/10.1109/72.159061
  9. Jun, H. B., Lee, D. W., Kim, D. J. and Sim, K. B. 'Fuzzy Inference-based Reinforcement Learning of Dynamic Recurrent Neural Networks,' Proceedings of the 36th SICE Annual Conference, International Session papers, 29-31 July, pp. 1083-1088, 1997
  10. Kwon, S. 'A Fuzzy BOXES Scheme for the Cartpole System,' Proceedings of International Conference on Control, Automation, and Systems, June 2-5, 1710-1715, 2005
  11. Passino, K. M. Biomimicryfor Optimization, Control, and Automation, Springer-Verlag London Limited, pp. 222-223, 2005
  12. Barto, A. G., Sutton, R. S. and Anderson, C. W. 'Neuronlike Adaptive Elements that can Solve Difficult Learning Control Problems,' IEEE Transactions on Systems, Man, and Cybernetics, 13(5), 834-846, 1983
  13. Guez, A. and Selinsky J. A. 'Trainable Neuromorphic Controller,' Journal of Robotic Systems, 5(4), 363-388, 1988
  14. Albus, J. S. 'A New Approach to Manipulator Control; The Cerebellar Model Articulation Controller(CMAC),' Journal of Dynamic Systems, Measurement, and Control, Transactions of the ASME, Series G, Vol. 97, No.3, pp. 220-227, September 1975 https://doi.org/10.1115/1.3426922
  15. Kwon, S. 'A Reinforcement Learning with CMAC,' International Journal of Fuzzy Logic and Intelligent Systems, Vol. 6, No.4, pp. 271-276, December 2006 https://doi.org/10.5391/IJFIS.2006.6.4.271

Cited by

  1. Two Fuzzy Controllers Alternating for Cartpole System vol.9, pp.2, 2009, https://doi.org/10.5391/IJFIS.2009.9.2.154