• Title/Summary/Keyword: learning automata

Search Result 24, Processing Time 0.037 seconds

A Study on the Application of S Model Automata for Multiple Objective Optimal Operation of Power Systems (다목적을 고려한 전력 시스템의 최적운용을 위한 S 모델 Automata의 적용 연구)

  • Lee, Byeong-Ha;Park, Jong-Geun
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.49 no.4
    • /
    • pp.185-194
    • /
    • 2000
  • The learning automaton is an automaton to update systematically the strategy for enhancing the performance in response to the output results, and several schemes of learning automata have been presented. In this paper, S-model learning automata are applied in order to achieve the best compromise solution between an optimal solution for economic operation and an optimal solution for stable operation of the power system under the circumstance that the loads vary randomly. It is shown that learning automata are applied satisfactorily to the multiobjective optimization problem for obtaining the best tradeoff among the conflicting economy and stability objectives of power systems.

  • PDF

Priority-based learning automata in Q-learning random access scheme for cellular M2M communications

  • Shinkafi, Nasir A.;Bello, Lawal M.;Shu'aibu, Dahiru S.;Mitchell, Paul D.
    • ETRI Journal
    • /
    • v.43 no.5
    • /
    • pp.787-798
    • /
    • 2021
  • This paper applies learning automata to improve the performance of a Q-learning based random access channel (QL-RACH) scheme in a cellular machine-to-machine (M2M) communication system. A prioritized learning automata QL-RACH (PLA-QL-RACH) access scheme is proposed. The scheme employs a prioritized learning automata technique to improve the throughput performance by minimizing the level of interaction and collision of M2M devices with human-to-human devices sharing the RACH of a cellular system. In addition, this scheme eliminates the excessive punishment suffered by the M2M devices by controlling the administration of a penalty. Simulation results show that the proposed PLA-QL-RACH scheme improves the RACH throughput by approximately 82% and reduces access delay by 79% with faster learning convergence when compared with QL-RACH.

A study on the application of S model automata for multiple objective optimal operation of Power systems (다목적 전력 시스템 최적운용을 위한 S 모델 Automata의 적용 연구)

  • Lee, Yong-Seon;Lee, Byung-Ha
    • Proceedings of the KIEE Conference
    • /
    • 1999.07c
    • /
    • pp.1279-1281
    • /
    • 1999
  • The learning automaton is an automaton to update systematically the strategy for enhancing the performance in response to the output results, and several schemes of learning automata have been presented. In this paper, S-model learning automata are applied to achieving a best compromise solution between an optimal solution for economic operation and an optimal solution for stable operation of the power system under the circumstance that the loads vary randomly. It is shown that learning automata are applied satisfactorily to the multiobjective optimization problem for obtaining the best tradeoff among the conflicting economy and stability objectives of power systems.

  • PDF

Decentralized learning automata for control of unknown markov chains

  • Hara, Motoshi;Abe, Kenichi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10b
    • /
    • pp.1234-1239
    • /
    • 1990
  • In this paper, we propose a new type of decentralized learning automata for the control finite state Markov chains with unknown transition probabilities and rewards. In our scheme a .betha.-type learning automaton is associated with each state in which two or more actions(desisions) are available. In this decentralized learning automata system, each learning automaton operates, requiring only local information, to improve its performance under local environment. From simulation results, it is shown that the decentralized learning automata will converge to the optimal policy that produces the most highly total expected reward with discounting in all initiall states.

  • PDF

Development of Finite State Automata Learning Materials for Elementary School Students (초등학생을 위한 유한상태 오토마타 교육자료 개발)

  • Go, Hyungchul;Kim, Chongwoo
    • Journal of The Korean Association of Information Education
    • /
    • v.20 no.4
    • /
    • pp.401-408
    • /
    • 2016
  • CS Unplugged education is emphasized as the component of the basic principles of Elementary SW education. This document produced by two other Timbell presents the contents in a variety of topics about computer science. One of the main components is the finite Automata, and this requires the development of educational materials for teaching our situation. So We'll present the finite Automata learning materials for elementary school classes. Learning model that we have presented is a process of self-directed and activity-based learning. For verification of this experiment was the validation of the expert group and was concluded that adequate through the analysis of the diagnostic tests.

A new method to detect attacks on the Internet of Things (IoT) using adaptive learning based on cellular learning automata

  • Dogani, Javad;Farahmand, Mahdieh;Daryanavard, Hassan
    • ETRI Journal
    • /
    • v.44 no.1
    • /
    • pp.155-167
    • /
    • 2022
  • The Internet of Things (IoT) is a new paradigm that connects physical and virtual objects from various domains such as home automation, industrial processes, human health, and monitoring. IoT sensors receive information from their environment and forward it to their neighboring nodes. However, the large amounts of exchanged data are vulnerable to attacks that reduce the network performance. Most of the previous security methods for IoT have neglected the energy consumption of IoT, thereby affecting the performance and reducing the network lifetime. This paper presents a new multistep routing protocol based on cellular learning automata. The network lifetime is improved by a performance-based adaptive reward and fine parameters. Nodes can vote on the reliability of their neighbors, achieving network reliability and a reasonable level of security. Overall, the proposed method balances the security and reliability with the energy consumption of the network.

A Learning Automata-based Algorithm for Area Coverage Problem in Directional Sensor Networks

  • Liu, Zhimin;Ouyang, Zhangdong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.10
    • /
    • pp.4804-4822
    • /
    • 2017
  • Coverage problem is a research hot spot in directional sensor networks (DSNs). However, the major problem affecting the performance of the current coverage-enhancing strategies is that they just optimize the coverage of networks, but ignore the maximum number of sleep sensors to save more energy. Aiming to find an approximate optimal method that can cover maximum area with minimum number of active sensors, in this paper, a new scheduling algorithm based on learning automata is proposed to enhance area coverage, and shut off redundant sensors as many as possible. To evaluate the performance of the proposed algorithm, several experiments are conducted. Simulation results indicate that the proposed algorithm have effective performance in terms of coverage enhancement and sleeping sensors compared to the existing algorithms.

A Channel Selection Algorithm Based on Fuzzy Logic and Learning Automata for Cognitive Radio Sensor Networks (무선 인지 센서 네트워크를 위한 퍼지 및 러닝 오토메타 기반의 채널 선택 기법)

  • Truong, Anh Tuan;Koo, In-Soo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.11 no.1
    • /
    • pp.23-28
    • /
    • 2011
  • In this paper, we propose a channel selection scheme for secondary users in cognitive radio sensor networks, which includes learning automata and fuzzy logic system (FLS). In the proposed scheme, FLS is used as the channel selection mechanism while the learning automata algorithm is being used to learn the radio environment such as channel link quality. Signal to noise ratio of the link between primary user (PU) and secondary user (SU), the probability of choosing channel, and signal to noise ratio of the link between secondary users are chosen as input parameters for the FLS to decide one data channel among multiple channels. Simulation results show that the proposed scheme does indeed provide advantages in improving the throughput of CR networks, in comparison with some other previous schemes.

Mathematical Model for File Migration and Load Balancing in Distributed Systemsc (분산 시스템에서 파일 이전과 부하 균등을 위한 수학적 모델)

  • Moon, Wonsik
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.13 no.4
    • /
    • pp.153-162
    • /
    • 2017
  • Advances in communication technologies and the decreasing cost of computers have made distributed computer systems an attractive alternative for satisfying the information needs of large organizations. This paper presents a distributed algorithm for performance improvement through load balancing and file migration in distributed systems. We employed a sender initiated strategy for task migration and used learning automata with several internal states for file migration. A task can be migrated according to the load information of a computer. A file is migrated to the destination processor when it is in the right boundary state. We also described an analytical model for load balancing with file migration to verify the proposed algorithm. Analytical and simulation results show that our algorithm is very well-suited for distributed system environments.