Browse > Article
http://dx.doi.org/10.13088/jiis.2012.18.2.157

A Study on the Performance Evaluation of G2B Procurement Process Innovation by Using MAS: Korea G2B KONEPS Case  

Seo, Won-Jun (Hanyang University)
Lee, Dae-Cheor (The School of Management, Kyunghee University)
Lim, Gyoo-Gun (School of Business, Hanyang University)
Publication Information
Journal of Intelligence and Information Systems / v.18, no.2, 2012 , pp. 157-175 More about this Journal
Abstract
It is difficult to evaluate the performance of process innovation of e-procurement which has large scale and complex processes. The existing evaluation methods for measuring the effects of process innovation have been mainly done with statistically quantitative methods by analyzing operational data or with qualitative methods by conducting surveys and interviews. However, these methods have some limitations to evaluate the effects because the performance evaluation of e-procurement process innovation should consider the interactions among participants who are active either directly or indirectly through the processes. This study considers the e-procurement process as a complex system and develops a simulation model based on MAS(Multi-Agent System) to evaluate the effects of e-procurement process innovation. Multi-agent based simulation allows observing interaction patterns of objects in virtual world through relationship among objects and their behavioral mechanism. Agent-based simulation is suitable especially for complex business problems. In this study, we used Netlogo Version 4.1.3 as a MAS simulation tool which was developed in Northwestern University. To do this, we developed a interaction model of agents in MAS environment. We defined process agents and task agents, and assigned their behavioral characteristics. The developed simulation model was applied to G2B system (KONEPS: Korea ON-line E-Procurement System) of Public Procurement Service (PPS) in Korea and used to evaluate the innovation effects of the G2B system. KONEPS is a successfully established e-procurement system started in the year 2002. KONEPS is a representative e-Procurement system which integrates characteristics of e-commerce into government for business procurement activities. KONEPS deserves the international recognition considering the annual transaction volume of 56 billion dollars, daily exchanges of electronic documents, users consisted of 121,000 suppliers and 37,000 public organizations, and the 4.5 billion dollars of cost saving. For the simulation, we analyzed the e-procurement of process of KONEPS into eight sub processes such as 'process 1: search products and acquisition of proposal', 'process 2 : review the methods of contracts and item features', 'process 3 : a notice of bid', 'process 4 : registration and confirmation of qualification', 'process 5 : bidding', 'process 6 : a screening test', 'process 7 : contracts', and 'process 8 : invoice and payment'. For the parameter settings of the agents behavior, we collected some data from the transactional database of PPS and some information by conducting a survey. The used data for the simulation are 'participants (government organizations, local government organizations and public institutions)', 'the number of bidding per year', 'the number of total contracts', 'the number of shopping mall transactions', 'the rate of contracts between bidding and shopping mall', 'the successful bidding ratio', and the estimated time for each process. The comparison was done for the difference of time consumption between 'before the innovation (As-was)' and 'after the innovation (As-is).' The results showed that there were productivity improvements in every eight sub processes. The decrease ratio of 'average number of task processing' was 92.7% and the decrease ratio of 'average time of task processing' was 95.4% in entire processes when we use G2B system comparing to the conventional method. Also, this study found that the process innovation effect will be enhanced if the task process related to the 'contract' can be improved. This study shows the usability and possibility of using MAS in process innovation evaluation and its modeling.
Keywords
Multi-Agent System; e-Procurement; Evaluation; Process Innovation; MAS; Simulation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 김경주, 교통 혼잡도를 고려한 멀티에이전트 기반 건설공정 시뮬레이션 시스템, 중앙대학교 박사학위논문, 2008.
2 김영배, 하성욱, "우리나라 벤처기업의 성장단계에 대한 실증조사 : 핵심성공요인, 환경특성, 최고 경영자 역할과 외부자원 활용", 기술혁신연구, 8권 1호(2000), 125-153.
3 맹보학, "G2B 정부전자조달사업의 효과 분석", 2002 한국정책학회 하계학술대회, 2002.
4 박병주, 최형림, 강무홍, "유전 알고리즘에 기반한 동적 공급사슬 통합계획을 위한 멀티에이전트시스템", 한국지능정보학회, 13권 3호(2007), 47-61.
5 박상문, 이병헌, "외부자원 활용이 벤처기업의 기술혁신에 미치는 영향", 중소기업연구, 28권2호(2006), 181-206.
6 서원준, 임규건, 이대철, "멀티에이전트시스템(MAS)을 활용한 공공조달 프로세스 혁신의 효과평가에 관한 연구", 2011 한국지능정보학회 추계학술대회, (2011), 207-211.
7 송대희, 우리나라 중앙조달제도의 국민경제적 역할, 한국개발연구원, 1990.
8 송용욱, 홍준석, 김우주, "소비자간 전자상거래를 위한 속성효용기반 자동협상 방법론의 개발", 한국지능정보시스템학회논문지, 10권 3호(2004), 73-89.
9 임규건, 이재규, 이대철, "전자정부 G2B 시스템의 성과평가 분석을 위한 새로운 평가 모델 및 방법론 개발", Information Systems Review, 10권 2호(2008), 269-289.
10 조달청, http://www.pps.go.kr.
11 지애띠, 연철, 이승훈, 조근식, 김흥남, "분산 환경에서의 협력적 여과를 위한 멀티에이전트 프레임워크", 지능정보연구, 13권 3호(2007), 119- 140.
12 황종근, 김인철, "L-CAA : 행위 기반 강화학습 에이전트 구조", 지능정보연구, 14권 3호(2008), 56-76.
13 Chaffey, D., E-Business and E-Commerce Management, Prentice Hall, Great Britain, 2002.
14 Cho, N. J., G. G. Lim, and D. C. Lee., "An Analysis of the Time-Lag Effects on the Investment of G4C E-Government system by analysing DB data", Journal of Information Technology Application and Management, Vol.16, No.4(2009), 205-222.
15 Conte, R. and G. N. Gilbert, Artificial Societies : Computer simulation of social life, UCL Press, Great Britain, 1995.
16 Coulthard, D. and T. Castleman, Electronic Procurement in Government More Complicated than Just Good Business, Deakin University Working Paper, 2001.
17 Dawcs, S. S. and L. Prefontaine, "Understanding New Models of Collaboration for Delivering Government Services", Communications of the ACM, Vol.46(2003), 40-42.
18 Freel, M. S., "Do small innovating firms outperform non-innovators?", Small Business Economics, Vol.14(2000), 195-210.   DOI   ScienceOn
19 Genesereth, M. and S. Katchpel, "Software Agents", Communications of the ACM, Vol.37, No.7(1995), 48-53.
20 Geroski, P., S. Machin, and J. V. Reenen, "The profitability of innovating firms", RAND Journal of Economics, Vol.24(1993), 198-211.   DOI   ScienceOn
21 Kim, Y. B., K. S. Song, and J. J. Lee, "Determinants of Technological Innovation in the Small Firms of Korea", R&D Management, Vol.23, No.3(1993), 215-226.   DOI   ScienceOn
22 Lim, G. G. and J. Y. Lee, "e-Government Case : The Korean Government's E-Procurement System (GePS)", proc. Of NCEC, (2006), 204- 211.
23 Lim, G. G., K. C. Lee, W. J. Seo and D. C. Lee, "Multi-Agent Based Simulation for Evaluation of Mobile Business Models", Information, Information : An International Interdisciplinary Journal, Vol.14, No.9(2011), 3063- 3080.
24 Marquis, D. G., "The Anatomy of Successful Innovations", Innovation, No.1(1969), 28-37.
25 Neef, D., e-procurement : From strategy to implementation, Prentice Hall, United States, 2001.
26 Nwana, H., "Software agents : An Overview", The Knowledge Engineering Review, Vol.11, No.3(1996), 205-244.
27 OECD, Oslo Manual, 3nd edition. DSTI, OECD, Paris, 2005.
28 Paulk, M. C., B. Curtis, M. B. Chrissis, and C. V. Weber, "Capability maturity model for Software, version 1.1", IEEE, Vol.10(1993), 18-27.
29 Raffo, D. M., Modeling software processes quantitatively and assessing the impact of potential process changes on process performance, Ph. D Dissertation, Carnegie Mellon University, Pittsburgh, Pennsylvania, 1996.
30 Rayport, J. and B. Jaworski, Introduction to ecommerce, McGraw-Hill/Irwin MarketspaceU, New York, 2002.
31 Roper, S., "Product innovation and small business growth : A comparison of the strategies of German, U. K. and Irish companies", Small Business Economics, Vol.9(1997), 523- 537
32 Seong, S. K. and J. Y. Lee, "Developing e-procurement systems : A case study on the Korea ON-line E-Procurement Systems in Korea", Public Finance and Management, Vol.4, No.2(2004), 151-152.
33 Thomson, D. and M. Singh, "e-Procurement Model for B2B Exchanges : An Australian Example", Proceeding of 15th Bled Electronic Commerce Conference, (2002), 293-307.
34 Turban, E., J. K. Lee., D. King and Chung, H. M., Electronic Commerce A Managerial Perspective, 2nd edition, Prentice Hall International Inc., New Jersey, United States, 2002.
35 Zaltman, G., R. Duncan, and J. Holbeck, Innovations and Organizations, Wiley, New York, 1973.