Browse > Article
http://dx.doi.org/10.5391/IJFIS.2007.7.1.022

BOXES-based Cooperative Fuzzy Control for Cartpole System  

Kwon, Sung-Gyu (Faculty of Mechanical and Automotive Engineering Keimyung University)
Publication Information
International Journal of Fuzzy Logic and Intelligent Systems / v.7, no.1, 2007 , pp. 22-29 More about this Journal
Abstract
Two fuzzy controllers defined by 2 input variables cooperate to control a cartpole system in terms of balancing as well as centering. The cooperation is due to the BOXES scheme that selects one of the fuzzy controllers for each time step according to the content of box that is established through the critic of the control action by the fuzzy controllers. It is found that the control scheme is good at controlling the cartpole system so that the system is stabilized fast while the BOXES develops its ability to select proper fuzzy controller through experience.
Keywords
BOXES; inverted pendulum; cartpole system; cooperative fuzzy control;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Deng, Z., Zhang, Z., and Jia, P. 'A Neural-Fuzzy BOXES Control System with Reinforcement Learning and its Application to Inverted Pendulum,' IEEE International Conference on Intelligent Systems for the 21st Century, Oct. 22-25, Vol. 2, pp. 1250-1254,1995
2 Michie, D. and Chambers, R. A. ''BOXES' as a model of Pattern-formation,' in Towards a Theoretical Biology, Vol. 1, Prolegomena, C. H. Waddington, Ed., Edinburgh: Edinburgh Univ. Press, 206-215,1968
3 Berenji, H. R. and Khedkar, P. 'Learning and Tuning Fuzzy Logic Controllers Through Reinforcements,' IEEE Transactions on Neural Networks, 3(5), 724-740, 1992   DOI   ScienceOn
4 Kwon, S. 'A Fuzzy BOXES Scheme for the Cartpole System,' Proceedings of International Conference on Control, Automation, and Systems, June 2-5, 1710-1715, 2005
5 Barto, A. G., Sutton, R. S. and Anderson, C. W. 'Neuronlike Adaptive Elements that can Solve Difficult Learning Control Problems,' IEEE Transactions on Systems, Man, and Cybernetics, 13(5), 834-846, 1983
6 Lin, C. and Sheu, Y. 'A Hybrid-Control Approach for Pendulum-Car Control,' IEEE Transactions on Industrial Electronics, 39(3), 208-214,1992   DOI   ScienceOn
7 Passino, K. M. Biomimicryfor Optimization, Control, and Automation, Springer-Verlag London Limited, pp. 222-223, 2005
8 Guez, A. and Selinsky J. A. 'Trainable Neuromorphic Controller,' Journal of Robotic Systems, 5(4), 363-388, 1988
9 Kwon, S. 'A Reinforcement Learning with CMAC,' International Journal of Fuzzy Logic and Intelligent Systems, Vol. 6, No.4, pp. 271-276, December 2006   과학기술학회마을   DOI   ScienceOn
10 Jun, H. B., Lee, D. W., Kim, D. J. and Sim, K. B. 'Fuzzy Inference-based Reinforcement Learning of Dynamic Recurrent Neural Networks,' Proceedings of the 36th SICE Annual Conference, International Session papers, 29-31 July, pp. 1083-1088, 1997
11 Lee, C.-C. 'A Self-Learning Rule-Based Controller Employing Approximate Reasoning and Neural Net Concepts,' International Journal of Intelligent Systems, 6, 71-93, 1991   DOI
12 Yi, J. and Yubazaki, N. 'Stabilization Fuzzy Control of Inverted Pendulum Systems,' Artificial Intelligence in Engineering, 14, 153-163,2000   DOI   ScienceOn
13 Geva, S. and Sitte, J. A. 'Cartpole Experiment Benchmark for Trainable Controllers,' IEEE Control Systems Magazine, 13(5),40-51,1993
14 Albus, J. S. 'A New Approach to Manipulator Control; The Cerebellar Model Articulation Controller(CMAC),' Journal of Dynamic Systems, Measurement, and Control, Transactions of the ASME, Series G, Vol. 97, No.3, pp. 220-227, September 1975   DOI
15 Li, T. and Shieh, M. 'Switching-type Fuzzy Sliding Mode Control of a Cart-Pole System,' Mechatronics, 10,91-109, 2000   DOI   ScienceOn