(e-commerce Agents using Reinforcement Learning)

강화 학습을 이용한 전자 상거래 에이전트

  • 윤지현 (경북대학교 컴퓨터과학과) ;
  • 김일곤 (경북대학교 컴퓨터과학과)
  • Published : 2003.06.01

Abstract

Agents are well fitted to e-commerce applicable area because they pursuit an autonomy and interact with dynamic environment. In this paper we propose an e-commerce agents using reinforcement learning. We modify a reinforcement teaming algorithm for agents to have an intelligent feature and to make a transaction as practical business body in behalf of a person. To show the validity of this approach, we classify agents into buying agents and soiling agents, give characters of level according to the degree of learning and communication. Finally we implement an e-commerce framework and show the result. In this paper we show a design of e-commerce agents which is based on the proposed learning algorithm and present that the agents have enough possibility of doing a transaction in practical e-commerce.

에이전트는 동적인 환경과 상호 작용하고 자치성을 추구하기 때문에 전자상거래 적용 분야로 적합하다. 본 논문은 강화 학습을 이용한 전자상거래 에이전트를 제안한다. 에이전트가 지능적인 특성을 가지고 사람을 대신하여 전자상거래에서 거래의 실질적 객체로써 거래를 담당하도록 하기 위해 강화학습 알고리즘을 적용하였다. 이러한 접근방식의 타당성을 입증하기 위해 본 논문에서는 구매 에이전트와 판매 에이전트로 구분하고, 학습과 통신의 정도에 따라 단계적 특성을 부여하여 에이전트 프레임워크를 구현하였고 그 결과를 보인다. 본 논문은 학습 알고리즘에 기초한 전자상거래 에이전트의 디자인을 보이고, 이 에이전트들은 실제 전자상거래에서 거래 처리 역할의 가능성이 충분함을 보인다.

Keywords

References

  1. D. Jin and K. Lee, 'Impacts and Limitations of Intelligent Agents in Electronic Commerce', First International Conference, Human Society@Internet 2001 Seoul, Korea, July 2001 Proceedings
  2. Hanson, J., 'Cultivating the Agent Economy', Proceedings of the Fifth International Symposium on Autonomous Decentralized Systems(ISDAS-Ol), 2001 https://doi.org/10.1109/ISADS.2001.917408
  3. Gerhard Weiss editors, Multiagent systems : a modern approach to distributed artifical intelligece. MIT Press, 2000, pp. 259-260
  4. Charles, L. I., and Christian, R. S., 'A Social reinforcement learning agent', Proceedings of the fifth international conference on Autonomous agents, 2001
  5. Michael, N. H., and Munindar P. S., Readings In Agents, Morgan Kaufmann Publishers, Inc. San Francisco, California, 1998, p. 488
  6. Kevin, L. C, and John, S. B., 'Task Decomposition and Dynamic Policy Merging in the Distributed Q-learning Classifier System', Proceedings of the 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation(CIRA '97)
  7. http://www.fipa.org
  8. Guttman, R, Moukas, A., and Maes, P., Agent- mediated Electronic Commerce: A Survey, Knowledge Engineering Review, June 1998 https://doi.org/10.1017/S0269888998002082
  9. www.fipa.org/specs/fipa00025/
  10. www.fipa.org/specs/fipa00030/
  11. Simon St.Laurent and Ethan Cerami, Building XML Applications, MacGraw-Hill, 1999
  12. Kennard Scribner, Mark C. Stiver, Understanding soap, Sams pulishing, July 2000