• 제목/요약/키워드: Agent architecture

검색결과 430건 처리시간 0.041초

스마트 TMD 제어를 위한 강화학습 알고리즘 성능 검토 (Performance Evaluation of Reinforcement Learning Algorithm for Control of Smart TMD)

  • 강주원;김현수
    • 한국공간구조학회논문집
    • /
    • 제21권2호
    • /
    • pp.41-48
    • /
    • 2021
  • A smart tuned mass damper (TMD) is widely studied for seismic response reduction of various structures. Control algorithm is the most important factor for control performance of a smart TMD. This study used a Deep Deterministic Policy Gradient (DDPG) among reinforcement learning techniques to develop a control algorithm for a smart TMD. A magnetorheological (MR) damper was used to make the smart TMD. A single mass model with the smart TMD was employed to make a reinforcement learning environment. Time history analysis simulations of the example structure subject to artificial seismic load were performed in the reinforcement learning process. Critic of policy network and actor of value network for DDPG agent were constructed. The action of DDPG agent was selected as the command voltage sent to the MR damper. Reward for the DDPG action was calculated by using displacement and velocity responses of the main mass. Groundhook control algorithm was used as a comparative control algorithm. After 10,000 episode training of the DDPG agent model with proper hyper-parameters, the semi-active control algorithm for control of seismic responses of the example structure with the smart TMD was developed. The simulation results presented that the developed DDPG model can provide effective control algorithms for smart TMD for reduction of seismic responses.

감성 에이전트를 위한 퍼지 정서 모델 (Fuzzy Emotion Model for Affective Computing Agents)

  • 윤현중;정성엽
    • 산업경영시스템학회지
    • /
    • 제37권4호
    • /
    • pp.1-11
    • /
    • 2014
  • This paper addresses the emotion computing model for software affective agents. In this paper, emotion is represented in valence-arousal-dominance dimensions instead of discrete categorical representation approach. Firstly, a novel emotion model architecture for affective agents is proposed based on Scherer's componential theories of human emotion, which is one of the well-known emotion models in psychological area. Then a fuzzy logic is applied to determine emotional statuses in the emotion model architecture, i.e., the first valence and arousal, the second valence and arousal, and dominance. The proposed methods are implemented and tested by applying them in a virtual training system for children's neurobehavioral disorders.

Heterarchical SFCS를 위한 ICPL 개발에 관한 연구 (Development of ICPL for Heterarchical SFCS)

  • 권성필;조현보;정무영
    • 대한산업공학회지
    • /
    • 제25권2호
    • /
    • pp.150-161
    • /
    • 1999
  • This paper deals with the design and development of a real-time integrated communication architecture for heterarchical SFCS(Shop Floor Control System). In autonomous agent-based heterarchical SFCS, each functional unit of parts and resources is equipped with an intelligent controller (agent) that acts as the representative of the entity. The controllers communicate and negotiate with other controllers on a real-time basis through message passing and bidding protocol to achieve mutual agreements for task sharing. ICPL(Integrated Communication Protocol and Language) is proposed for this purpose. ICPL is a language and a protocol for supporting communication among intelligent controllers. Based on the speech act theory, this paper proposes a semantic description for ICPL that associates the description of the cognitive states of controllers with the use of language primitives (message_type). Semantics for the basic set of ICPL messages is described. Eventually, an ICPL-based communication architecture can provide the implementation of the distributed and heterarchical SFCS, and makes the intelligent controller transparent to the negotiation problem.

  • PDF

A New Dynamic Auction Mechanism in the Supply Chain: N-Bilateral Optimized Combinatorial Auction (N-BOCA)

  • 최진호;장용식;한인구
    • 한국지능정보시스템학회:학술대회논문집
    • /
    • 한국지능정보시스템학회 2005년도 공동추계학술대회
    • /
    • pp.379-390
    • /
    • 2005
  • In this paper, we introduce a new combinatorial auction mechanism - N-Bilateral Optimized Combinatorial Auction (N-BOCA). N-BOCA is a flexible iterative combinatorial auction model that offers optimized trading for multi-suppliers and multi-purchasers in the supply chain. We design the N-BOCA system from the perspectives of architecture, protocol, and trading strategy. Under the given N-BOCA architecture and protocol, auctioneers and bidders have diverse decision strategies for winner determination. This needs flexible modeling environments. Hence, we propose an optimization modeling agent for bid and auctioneer selection. The agent has the capability to automatic model formulation for Integer Programming modeling. Finally, we show the viability of N-BOCA through prototype and experiments. The results say both higher allocation efficiency and effectiveness compared with I-to-N general combinatorial auction mechanisms.

  • PDF

Two Level Architecture를 이용한 Mobile IP QoS 보장 기법 (Mobile IP QoS Provisioning in Two Level Architecture)

  • 서정현;김기일;김상하
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2001년도 춘계학술발표논문집 (상)
    • /
    • pp.487-490
    • /
    • 2001
  • Mobile IP는 HA(Home Agent)와 FA(Foreign Agent)간의 터널링을 이용하여 IP망에서 단말기의 이동성을 지원하는 표준 프로토콜이다. 하지만 이러한 터널링 방법은 현재 제안되고 있는 인터넷 서비스 연구 즉 통합 서비스(Integrated Service) 및 차별화 서비스(Differentiated Service) 등을 적용하기 위해서는 많은 문제점을 가진다. 대표적인 문제점은 통신망에서는 전송되는 IP 패킷의 헤더에 의해서 세션을 구별하게 되는데 터널링 패킷의 경우 실제 세션과 다른 헤더를 사용하므로 망에서 세션에 대한 처리를 하기 위해서는 내재된 패킷의 정보가 터널링 패킷의 헤더에 반영되어야 한다. 본 논문은 이러한 문제점을 도메인 게이트웨이 라우터에 HA/FA 기능을 추가하는 동시에 RSVP(Resource Reservation Protocol) 플로우를 군집하는 도메인 레벨 QoS(Quality of Service)와 이동성 지원 프로토콜에 QoS를 의존하는 마이크로 레벨 QoS를 분리하는 이단계 구조를 통해 단-대-단 QoS를 보장할 수 있는 방안을 제안한다.

  • PDF

네트워크를 이용한 에이젼트 기반 설계 환경 구축 (A Construction Agent-based Design Environment using a Network)

  • 안상준;이수홍
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 1995년도 추계학술대회 논문집
    • /
    • pp.697-701
    • /
    • 1995
  • The network encironment includes a number of autonomous agents which are widely distributed, have different platforms, and change very dynamically. The information system operated on this environment must solve some basic problems; restrictive client-server models, heterogeneous systems, and intellignet agents. We are using KQML for knowledge management. Java language provides solutions against a strong server dependency and a heterogenous troubles. We introduce KQML as an agent communication language and JATLite as a java agent template. these increase an efficiency of communication on network and enable us to use resources distributed in world wide web. Also, we describe a new agent system architecture and implement it through an example scenario

  • PDF

Applying Mobile Agent for Internet-based Distributed Speech Recognition

  • Saaim, Emrul Hamide Md;Alias, Mohamad Ashari;Ahmad, Abdul Manan;Ahmad, Jamal Nasir
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2005년도 ICCAS
    • /
    • pp.134-138
    • /
    • 2005
  • There are several application have been developed on internet-based speech recognition. Internet-based speech recognition is a distributed application and there were various techniques and methods have been using for that purposed. Currently, client-server paradigm was one of the popular technique that been using for client-server communication in web application. However, there is a new paradigm with the same purpose: mobile agent technology. Mobile agent technology has several advantages working on distributed internet-based system. This paper presents, applying mobile agent technology in internet-based speech recognition which based on client-server processing architecture.

  • PDF

Seamless Games 에서의 부하 분산을 위한 MigAgent 시스템 설계 (Degine of MigAgent System for Load Balancing in Seamless Game)

  • 원동기;이정진;황호전;두길수;김법균;안동언;정성종
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2005년도 학술대회 논문집 정보 및 제어부문
    • /
    • pp.466-468
    • /
    • 2005
  • MMORPG enables thousands of players to play in an evolving virtual world at the same time over the internet. So, the load of this kind of games is heavier than that of any other precedents. One of load balancing methods is map-partition to divide the load of entire system which is vulnerable to delay message between clients and servers. In this paper, we propose a game architecture using MigAgent to help migration of player character between field servers and to reduce message traffic between clients and field servers.

  • PDF

광역 분산 처리 환경에서의 모바일 에이전트 시스템 분석 (The Analysis of Mobile Agent System for the Wide Distributed Processing)

  • 방정원
    • 한국컴퓨터정보학회논문지
    • /
    • 제8권4호
    • /
    • pp.132-137
    • /
    • 2003
  • 인터넷 기술과 웹 기반 응용 프로그램의 발전으로 광역 분산처리에 대한 요구가 기하급수적으로 증대되고 있다. 이러한 광역 분산처리 환경의 요구사항에 적용할 수 있는 모델로 모바일 에이전트를 들 수 있다. 그러나 현재의 모바일 에이전트 모델은 여러 가지 기술적 제약점들을 가지고 있다. 모바일 에이전트가 광역 분산 처리 환경에서 사용되기 위하여 필요한. 모바일 에이전트 시스템의 구조와 사용되는 프로그래밍 패러다임과 사용 기술 등에 있어서의 문제점들을 분석하였다.

  • PDF

Blackboard를 이용한 침입 탐지 Agent간의 커뮤니케이션 (Communication between Autonomous Agents using Blackboard for Intrusion Detection System)

  • 신우철;정길호;최종욱
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 1998년도 가을 학술발표논문집 Vol.25 No.2 (2)
    • /
    • pp.111-113
    • /
    • 1998
  • 최근의 업무 환경은 네트워크를 이용한 다자간의 통신을 바탕으로 하고 있다. 조직의 주요한 정보 자산들은 다양한 내부 통제(Internal Control)와 각종 보안 시스템을 통해 보호 받고 있으며, 이들에 대한 침입(Intrusion)을 탐지해내고 자산을 보호할 수 있는 방안에 대한 계속적인 연구가 이루어지고 있다. 이러한 침입 탐지(Intrusion Detection)를 위한 소프트웨어 기술의 한 방안으로써 Agent에 대한 논의가 이루어지고 있으나, 이들 Agent간의 통신과 시스템 전체적인 측면에서의 조율(Coordinate) 및 관리에 대한 연구 성과는 아직 까지는 미약하다고 할 수 있다. 따라서 본 연구에서는 이러한 Intrusion Detection Agent들간의 조율을 담당할 수 있는 구조(Architecture)로서 Blackboard 시스템을 제안하며, 소규모 프로그램을 작성하여 침입 시나리오에 대한 탐지 과정의 시뮬레이션을 통해 본 모델을 평가해보도록 한다.

  • PDF