• Title/Summary/Keyword: 적응 강인제어

Search Result 176, Processing Time 0.019 seconds

A Node Scheduling Control Scheme with Time Delay Requirement in Wireless Sensor Actuator Networks (무선 센서 엑츄에이터 네트워크에서의 시간지연을 고려한 노드 스케줄링 제어 기법)

  • Byun, Heejung
    • Journal of Internet Computing and Services
    • /
    • v.17 no.5
    • /
    • pp.17-23
    • /
    • 2016
  • Wireless sensor-actuator networks (WSANs) enhance the existing wireless sensor networks (WSNs) by equipping sensor nodes with an actuator. The actuators work with the sensor nodes and perform application-specific operations. The WSAN systems have several applications such as disaster relief, intelligent building, military surveillance, health monitoring, and infrastructure security. These applications require capability of reliable data transfer to act responsively and accurately. Biologically inspired modeling techniques have received considerable attention for achieving robustness, scalability, and adaptability, while retaining individual simplicity. In this paper, an epidemic-inspired algorithm for data dissemination with delay constraints while minimizing energy consumption in WSAN is proposed. The steady states and system stability are analyzed using control theory. Also, simulation results indicate that the proposed scheme provides desirable dissemination delay and energy saving.

Evaluating SR-Based Reinforcement Learning Algorithm Under the Highly Uncertain Decision Task (불확실성이 높은 의사결정 환경에서 SR 기반 강화학습 알고리즘의 성능 분석)

  • Kim, So Hyeon;Lee, Jee Hang
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.8
    • /
    • pp.331-338
    • /
    • 2022
  • Successor representation (SR) is a model of human reinforcement learning (RL) mimicking the underlying mechanism of hippocampal cells constructing cognitive maps. SR utilizes these learned features to adaptively respond to the frequent reward changes. In this paper, we evaluated the performance of SR under the context where changes in latent variables of environments trigger the reward structure changes. For a benchmark test, we adopted SR-Dyna, an integration of SR into goal-driven Dyna RL algorithm in the 2-stage Markov Decision Task (MDT) in which we can intentionally manipulate the latent variables - state transition uncertainty and goal-condition. To precisely investigate the characteristics of SR, we conducted the experiments while controlling each latent variable that affects the changes in reward structure. Evaluation results showed that SR-Dyna could learn to respond to the reward changes in relation to the changes in latent variables, but could not learn rapidly in that situation. This brings about the necessity to build more robust RL models that can rapidly learn to respond to the frequent changes in the environment in which latent variables and reward structure change at the same time.

Effective Method of Video Services over QoS Controlled Network (QoS 서비스 모델에서의 비디오 서비스의 효과적 적용 기법)

  • Jeong, Jun-Ho;Suh, Doug-Young;Shin, Ji-Tae;Seok, Joo-Myoung;Lee, Kyou-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.39 no.6
    • /
    • pp.672-686
    • /
    • 2002
  • 현재 단대단(End-to-End) 비디오 서비스의 질을 높이기 위해 많은 연구가 각 계층별로 진행되고 있다. 전송계층에서의 오류 제어(Error Control), 네트워크계층에서의 QoS (Quality of Service)모델, 표현 및 응용계층에서의 오류 강인성(Error resilience)/오류 은닉(Error concealment) 등이 연구 개발되고 있다. 그러나 계층 간의 연관성이 높은 부분에서의 통합을 통한 성능향상에 관한 연구는 그 필요성과 효율에 비해 아직도 미흡하다. 본 논문은 QoS 서비스 모델하에서의 적응적 FEC(Forward Error Correction) 적용 및 우선순위에 따른 비디오패킷(VP ,VideoPacket)을 통하여 효율적인 계층화 비디오 스트리밍을 단대단 QoS성능의 향상에 관점을 맞추어 제안한다. 제안하는 방식은 최소 화질 보장과 같은 효율에서 보다 적은 가격에서의 서비스를 제공할 수 있다. 이를 위하여 통합형 서비스(IntServ, IS, Integrated Service) 의 자원예약을 사용하는 방법과 높은 가격의 자원 예약을 사용하지 않는 차별화 서비스(DiffServ, DS, Differentiated Service)를 적용했으며 이에 보장형 서비스의 특징을 공통을 가지기 위해 계층화 FEC를 적용하였으며 적절한 가격의 조절을 위하여 비디오패킷을 통한 데이터 분할을 적용하였다. 본 논문은 또한 최종 사용자의 만족도를 PSNR(Picture Signal to Noise Ration)과 PSNR에서 표현하지 못하는 부분의 평가를 위해 손상프레임율(DFR, Damaged Frame Ratio)과 오류프레임율(EFR,Error Frame Ratio)을 제안 이를 통해 평가하고자 한다. 제안하는 방식의 실험 결과는 비디오 코딩계층과 전송 계층, 네트워크 계층의 결합된 성능이며 이는 또한 화질의 개선뿐만 아니라 사용자의 가격문제에 대하여서도 비교 분석하였다.

Design of Distributed Node Scheduling Scheme Inspired by Gene Regulatory Networks for Wireless Sensor Networks (무선 센서 망에서 생체 유전자 조절 네트워크를 모방한 분산적 노드 스케줄링 기법 설계)

  • Byun, Heejung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.40 no.10
    • /
    • pp.2054-2061
    • /
    • 2015
  • Biologically inspired modeling techniques have received considerable attention for their robustness, scalability, and adaptability with simple local interactions and limited information. Among these modeling techniques, Gene Regulatory Networks (GRNs) play a central role in understanding natural evolution and the development of biological organisms from cells. In this paper, we apply GRN principles to the WSN system and propose a new GRN model for decentralized node scheduling design to achieve energy balancing while meeting delay requirements. Through this scheme, each sensor node schedules its state autonomously in response to gene expression and protein concentration, which are controlled by the proposed GRN-inspired node scheduling model. Simulation results indicate that the proposed scheme achieves superior performance with energy balancing as well as desirable delay compared with other well-known schemes.

Harmonic Estimation of Power Signal Based on Time-varying Optimal Finite Impulse Response Filter (시변 최적 유한 임펄스 응답 필터 기반 전력 신호 고조파 검출)

  • Kwon, Bo-Kyu
    • The Journal of Korean Institute of Information Technology
    • /
    • v.16 no.11
    • /
    • pp.97-103
    • /
    • 2018
  • In this paper, the estimation method for the power signal harmonics is proposed by using the time-varying optimal finite impulse response (FIR) filter. To estimate the magnitude and phase-angle of the harmonic components, the time-varying optimal FIR filter is designed for the state space representation of the noisy power signal which the magnitude and phase is considered as a stochastic process. Since the time-varying optimal FIR filter used in the proposed method does not use any priori information of the initial condition and has FIR structure, the proposed method could overcome the demerits of Kalman filter based method such as poor estimation and divergence problem. Due to the FIR structure, the proposed method is more robust against to the model uncertainty than the Kalman filter. Moreover, the proposed method gives more general solution than the time-invariant optimal FIR filter based harmonic estimation method. To verify the performance and robustness of the proposed method, the proposed method is compared with time-varying Kalman filter based method through simulation.

Robust Speech Recognition Algorithm of Voice Activated Powered Wheelchair for Severely Disabled Person (중증 장애우용 음성구동 휠체어를 위한 강인한 음성인식 알고리즘)

  • Suk, Soo-Young;Chung, Hyun-Yeol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.26 no.6
    • /
    • pp.250-258
    • /
    • 2007
  • Current speech recognition technology s achieved high performance with the development of hardware devices, however it is insufficient for some applications where high reliability is required, such as voice control of powered wheelchairs for disabled persons. For the system which aims to operate powered wheelchairs safely by voice in real environment, we need to consider that non-voice commands such as user s coughing, breathing, and spark-like mechanical noise should be rejected and the wheelchair system need to recognize the speech commands affected by disability, which contains specific pronunciation speed and frequency. In this paper, we propose non-voice rejection method to perform voice/non-voice classification using both YIN based fundamental frequency(F0) extraction and reliability in preprocessing. We adopted a multi-template dictionary and acoustic modeling based speaker adaptation to cope with the pronunciation variation of inarticulately uttered speech. From the recognition tests conducted with the data collected in real environment, proposed YIN based fundamental extraction showed recall-precision rate of 95.1% better than that of 62% by cepstrum based method. Recognition test by a new system applied with multi-template dictionary and MAP adaptation also showed much higher accuracy of 99.5% than that of 78.6% by baseline system.