• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.5
• /
• pp.1036-1057
• /
• 2013

Wireless body area network (WBAN) is a promising candidate for future health monitoring system. Nevertheless, the path to mature solutions is still facing a lot of challenges that need to be overcome. Energy efficient scheduling is one of these challenges given the scarcity of available energy of biosensors and the lack of portability. Therefore, researchers from academia, industry and health sectors are working together to realize practical solutions for these challenges. The main difficulty in WBAN is the uncertainty in the state of the monitored system. Intelligent learning approaches such as a Markov Decision Process (MDP) were proposed to tackle this issue. A Markov Decision Process (MDP) is a form of Markov Chain in which the transition matrix depends on the action taken by the decision maker (agent) at each time step. The agent receives a reward, which depends on the action and the state. The goal is to find a function, called a policy, which specifies which action to take in each state, so as to maximize some utility functions (e.g., the mean or expected discounted sum) of the sequence of rewards. A partially Observable Markov Decision Processes (POMDP) is a generalization of Markov decision processes that allows for the incomplete information regarding the state of the system. In this case, the state is not visible to the agent. This has many applications in operations research and artificial intelligence. Due to incomplete knowledge of the system, this uncertainty makes formulating and solving POMDP models mathematically complex and computationally expensive. Limited progress has been made in terms of applying POMPD to real applications. In this paper, we surveyed the existing methods and algorithms for solving POMDP in the general domain and in particular in Wireless body area network (WBAN). In addition, the papers discussed recent real implementation of POMDP on practical problems of WBAN. We believe that this work will provide valuable insights for the newcomers who would like to pursue related research in the domain of WBAN.

• KIPS Transactions on Computer and Communication Systems
• /
• v.9 no.8
• /
• pp.171-180
• /
• 2020

Smart Factory consists of digital automation solutions throughout the production process, including design, development, manufacturing and distribution, and it is an intelligent factory that installs IoT in its internal facilities and machines to collect process data in real time and analyze them so that it can control itself. The smart factory's equipment works in a physical combination of numerous hardware, rather than a virtual character being driven by a single object, such as a game. In other words, for a specific common goal, multiple devices must perform individual actions simultaneously. By taking advantage of the smart factory, which can collect process data in real time, if reinforcement learning is used instead of general machine learning, behavior control can be performed without the required training data. However, in the real world, it is impossible to learn more than tens of millions of iterations due to physical wear and time. Thus, this paper uses simulators to develop grid sortation systems focusing on transport facilities, one of the complex environments in smart factory field, and design cooperative multi-agent-based reinforcement learning to demonstrate efficient behavior control.

• Proceedings of the Korea Contents Association Conference
• /
• 2005.11a
• /
• pp.219-222
• /
• 2005

E-commercial transaction that use Internet, because can overcome space limit, and connect all the world by real time one if is huge market offer can. Therefore, travel goods purchase action through internet increased too explosively. Did travel agencies which float here upon and is operated and goods that offer negotiation agent in www to consumer and want to consumer to increase authoritativeness for relevant signtseeing goods efficiently buys.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2009.01a
• /
• pp.451-454
• /
• 2009

현재와 미래 정보통신 기술의 눈부신 발달에 따라 흥 네트워킹 산업의 발전과 에너지 시장 환경의 변화가 소비자 중심으로 이루어지고 있는 향후 미래 디지털 사회에서는 부하관리와, 정전이나 과부하같은 응급 상황을 대처할 수 있는 지능형 에너지 관리 시스템 개발이 필요하다. 따라서 많은 인공지능 기법을 이용해 에너지 관리 시스템 개발이 진행중이다. 그러나 대부분의 시스템은 에너지 관리 시스템에서 발생되는 대용량의 정보들을 고려하여 개발한 시스템은 거의 이루어지고 있지 않다. 이에 본 논문에서는 지능형 실시간 에이전트를 이용해 정기적으로 에너지 정보를 요구하는 이벤트와 비정기적으로 데이터를 요구하는 이벤트 및 계절별, 시간대별 및 요일별등으로 나누어, 요구되는 에너지 정보를 보다 효율적으로 처리할 수 있는 가법을 적용한 지능형 원격 에너지 관리 시스템을 설계하고 개발하였다.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2000.04a
• /
• pp.337-341
• /
• 2000

In recent years, electronic commerce (EC) business has shown a tremendous growth, which put additional cognitive and time-consuming loads on the human users. Intelligent software agents are one key technology to support users doing real EC-business.We propose an Agent-based Business-to-Business(B2B) Marketplace on Internet, where constituent members cooperate or compete in order to get the best possible deals, with the aim of reducing user loads.In case of B2B deals, the good itself shows a complicated behaviour, e.g.price discounts depending o the lot, discounts for cross-buying and so on. It is impractical to concentrate all the knowledge about the goods and the trading strategies at the buyer/seller side. Instead, we include such information in the good itself, which allow us to model the goods as being agents.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1995.04b
• /
• pp.457-462
• /
• 1995

This paper describes diagnosis strategy of the Flexible Multiple Fault Diagnosis Module for forecasting faults in system and deciding current machine state form sensor information. Most studydeal with diagnosis control stategy about single fault in a system, this studies deal with multiple fault diagnosis. This strategy is consist of diagnosis control module such as backward tracking expert system shell, various neural network, numerical model to predict machine state and communication module for information exchange and cooperate between each model. This models are used to describe structure, function and behavior of subsystem, complex component and total system. Hierarchical structure is very efficient to represent structural, functional and behavioral knowledge. FT(Fault Tree). ST(Symptom Tree), FCD(Fault Consequence Diagrapy), SGM(State Graph Model) and FFM(Functional Flow Model) are used to represent hierachical structure. In this study, IA(Intelligent Agent) concept is introduced to match FT component and event symbol in diagnosed system and to transfer message between each event process. Proposed diagnosis control module is made of IPC(Inter Process Communication) method under UNIX operating system.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2010.07a
• /
• pp.393-396
• /
• 2010

생산자로부터 고객에 이르는 상품 공급 활동을 관리하는 경영기법인 공급사슬관리(SCM)는 기존의 폐쇄적이고 정적인 환경에서 개방적이고 동적인 환경으로 변화하고 있다. 이러한 변화에 대응하기 위한 실험이나 연구는 부족한 상황이다. TAC SCM은 동적인 SCM 환경에서 다른 경쟁자들과의 경쟁을 통하여 다양한 SCM 전략을 시험할 수 있다. 본 연구에서는 실시간 SCM 환경에서 능동적 할인 전략을 적용한 에이전트를 설계 및 구현하였다. 능동적 할인은 입찰 성공률에 따라 할인율을 변경하여 적용하여 항상 일정한 생산량을 보유할 수 있도록 한다. 본 연구의 실험 결과에서 제안한 에이전트가 서버에서 제시한 Dummy 에이전트보다도 높은 수익과 안정된 생산을 할 수 있음을 보였다.

• Journal of KIISE:Computing Practices and Letters
• /
• v.7 no.5
• /
• pp.522-538
• /
• 2001

This paper presents a cal center which is a subsystem of a web-based real time monitoring system of intensive care units. Based on Computer-Telephony Integration (CTI) technology, the call center attempts to efficiently and automatically send messages to patients\` families, doctors, and other staffs in hospital via communication media suitable to the occasion. The problem of determining appropriate media can be very complicated by the urgency of a message, calling time, and communication media available to the target person. We use the Dempster-Shafer theory, one of the uncertainty handling methods, to determine the most suitable communication media that will transmit a message rapidly and safely. In addition, we use agent technology to perform the calling process without requiring the intervention of the user of the call center. this call center enables message transfer through various communication media in an integrated environment, and relieves medical staff from the calling process, which in turn will make a contribution toward enhancing medical service.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.14 no.5
• /
• pp.153-159
• /
• 2014

In this paper, we propose the Distributed Power Saving Control System that enables the active and intelligent control(on/off and/or dimming control) of the lightning device using sensors and mobile agents. The proposed system is effective for energy saving and induces cost reductions in design and development of power saving control system as adding remote-monitoring or controlling functions is easier with the application of a variety of active rules. Moreover, the system improves the effectiveness of the acquired sensing data by real-time event handling and device controlling using a mobile agent based sensor network middleware that regularize the contextual information or a user's emotion. The results of this paper present the potential applicability of the proposed distributed control system using mobile agent in various active sensor network applications.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.27 no.4C
• /
• pp.282-294
• /
• 2002

The modern telecommunication networks are composed of various network-type and are managed by various management technologies, such as TMN, SNMP, TINA etc. Furthermore, the network user's needs of real-time multimedia services are rapidly increasing. In order to guarantee the user-requested quality-of-service(QoS) and keep the network utilization at maximum, it is required to manage the network performance continuously after the network is deployed. The performance management function should provide the useful information for the network expansion and the capacity reallocation in the future. In this paper, we propose a DPE-based performance management architecture for the integrated management of the heterogeneous network elements with TMN and SNMP. We propose an approach to provide the Intranet traffic monitoring and analysis function using layered network management concept and distributed processing technology. The proposed architecture has been designed and implemented based on multiprocess and multithread structure to support concurrent processing. To manage the traffic according to the Intranet service categories, we implemented an ITMA(Intelligent Traffic Monitoring Agent) with packet capture library. With the proposed architecture, we could measure and analyze the real Intranet traffic of Yeungnam University.