• Title/Summary/Keyword: RL

Search Result 442, Processing Time 0.021 seconds

Expressed Sequence Tags of the Wheat-rye Translocation Line Possessing 2BS/2RL

  • Jang, Cheol-Seong;Hong, Byung-Hee;Seo, Yong-Weon
    • 한국작물학회지
    • /
    • 제44권3호
    • /
    • pp.302-307
    • /
    • 1999
  • Hamlet (PI549276) possessing 2RL was obtained by cross between a wheat cultivar ND7532 (Froid/Centurk) and a rye cultivar Chaupon. Chaupon was known to have resistant gene to biotype L of Hessian fly [Mayetiola destructor (Say)] larvae. The wheat-rye translocation line (Coker797*4/Hamlet) was also known to be resistant to biotype L of Hessian fly larvae. We analysed a set of 96 ESTs from the wheat-rye translocation line (2BS/2RL). ESTs were classified by various physiological processings, such as primary metabolism, secondary metabolism, transcription, translation, transport, signal transduction, defense, transposable element, and others. Three sequences encoding thioredoxin peroxidase, 26S rRNA, and rubisco small subunits were homologous to registered genes in rye. Although limited number of clones were used to develop ESTs, these clones and their sequence information may be useful for researchers studying general physiology and molecular biology on the translocation line.

  • PDF

Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks

  • Cho, Soohyun
    • Journal of Information Processing Systems
    • /
    • 제16권5호
    • /
    • pp.1048-1063
    • /
    • 2020
  • In this study, we propose a reinforcement learning agent to control the data transmission rates of nodes in carrier sensing multiple access with collision avoidance (CSMA/CA)-based wireless networks. We design a reinforcement learning (RL) agent, based on Q-learning. The agent learns the environment using the timeout events of packets, which are locally available in data sending nodes. The agent selects actions to control the data transmission rates of nodes that adjust the modulation and coding scheme (MCS) levels of the data packets to utilize the available bandwidth in dynamically changing channel conditions effectively. We use the ns3-gym framework to simulate RL and investigate the effects of the parameters of Q-learning on the performance of the RL agent. The simulation results indicate that the proposed RL agent adequately adjusts the MCS levels according to the changes in the network, and achieves a high throughput comparable to those of the existing data transmission rate adaptation schemes such as Minstrel.

인덕티브 센서 응용을 위한 시간 영역 리드아웃 회로 (Time-Domain Read-Out Circuit for Inductive Sensor Applications)

  • 오종엽;조성훈
    • 한국전자통신학회논문지
    • /
    • 제18권4호
    • /
    • pp.625-640
    • /
    • 2023
  • 본 논문에서는 IoT 응용에서 사용되는 인덕티브한 센서의 인덕턴스를 측정할 수 있는 회로를 제안하였다. RL 저역 통과 필터 회로, 비교기, 전류 제어 스위치, 커패시터의 특성을 이용하여 회로를 구성하였으며, RL 저역 통과 필터 회로의 출력 전압이 기준 전압보다 큰 duration time을 통해 1nH-1H 범위 내의 인덕턴스 값을 도출 할 수 있다.

Comparative analysis of activation functions within reinforcement learning for autonomous vehicles merging onto highways

  • Dongcheul Lee;Janise McNair
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제16권1호
    • /
    • pp.63-71
    • /
    • 2024
  • Deep reinforcement learning (RL) significantly influences autonomous vehicle development by optimizing decision-making and adaptation to complex driving environments through simulation-based training. In deep RL, an activation function is used, and various activation functions have been proposed, but their performance varies greatly depending on the application environment. Therefore, finding the optimal activation function according to the environment is important for effective learning. In this paper, we analyzed nine commonly used activation functions for RL to compare and evaluate which activation function is most effective when using deep RL for autonomous vehicles to learn highway merging. To do this, we built a performance evaluation environment and compared the average reward of each activation function. The results showed that the highest reward was achieved using Mish, and the lowest using SELU. The difference in reward between the two activation functions was 10.3%.

Collision Prediction based Genetic Network Programming-Reinforcement Learning for Mobile Robot Navigation in Unknown Dynamic Environments

  • Findi, Ahmed H.M.;Marhaban, Mohammad H.;Kamil, Raja;Hassan, Mohd Khair
    • Journal of Electrical Engineering and Technology
    • /
    • 제12권2호
    • /
    • pp.890-903
    • /
    • 2017
  • The problem of determining a smooth and collision-free path with maximum possible speed for a Mobile Robot (MR) which is chasing a moving target in a dynamic environment is addressed in this paper. Genetic Network Programming with Reinforcement Learning (GNP-RL) has several important features over other evolutionary algorithms such as it combines offline and online learning on the one hand, and it combines diversified and intensified search on the other hand, but it was used in solving the problem of MR navigation in static environment only. This paper presents GNP-RL based on predicting collision positions as a first attempt to apply it for MR navigation in dynamic environment. The combination between features of the proposed collision prediction and that of GNP-RL provides safe navigation (effective obstacle avoidance) in dynamic environment, smooth movement, and reducing the obstacle avoidance latency time. Simulation in dynamic environment is used to evaluate the performance of collision prediction based GNP-RL compared with that of two state-of-the art navigation approaches, namely, Q-Learning (QL) and Artificial Potential Field (APF). The simulation results show that the proposed GNP-RL outperforms both QL and APF in terms of smooth movement and safer navigation. In addition, it outperforms APF in terms of preserving maximum possible speed during obstacle avoidance.

$Eudragit^{\circledR}$ 마이크로캅셀화에 의한 ${\beta}$-락탐계 항생물질의 방출제어제제 개발 (Preparation and Evaluation of Sustained-Release $Eudragit^{\circledR}$ Microcapsules Containing ${\beta}-Lactam$ Antibiotics)

  • 한건;신도수;지웅길;정연복
    • Journal of Pharmaceutical Investigation
    • /
    • 제22권4호
    • /
    • pp.267-279
    • /
    • 1992
  • Microencapsulations of amoxicillin and cephalexin, using Eudragit RS, RL, E, S and L were investigated. The microcapsules were prepared by the solvent evaporation process in liquid paraffin phase, which is based on dispersion of acetone/isopropanol containing the drug in liquid paraffin. Aluminium tristearate was used as an additive for the preparation of microcapsules. The size distribution, dissolution test and observation by SEM were examined. Good reproducibility in microcapsule preparation was observed. The microcapsules obtained were spherical and free-flowing particles. The dissolution rates of amoxicillin and cephalexin from the microcapsules were considerably decreased as compared with those from amoxicillin and cephalexin powder, respectively. As the dispersing agents (aluminium tristearate) increased, the particle size of microcapsules decreased and the dissolution rate increased. In order to control the release rate of drugs, microcapsules were prepared by mixing Eudragit RS/RL or Eudragit S/L. As Eudragit RL ratio in microcapsule of Eudragit RS/RL increased, the dissolution rate increased. As Eudragit L ratio in microcapsule of Eudragit S/L increased, the dissolution rate increased. Furthermore, the release rates of drugs from Eudragit RS/L or RS/polyelthylene glycol 1540 (PEG 1540) were examined. The dissolution rate of drugs increased with increasing of Eudragit L or PEG 1540 ratio. In conclusion, the release rates of drugs from Eudragit RS/RL or RS/PEG 1540 microcapsule could be controlled, and these microcapsules will be convenient for reducing frequency of administration.

  • PDF

Metabolic Profiling and Biological Activities of Bioactive Compounds Produced by Pseudomonas sp. Strain ICTB-745 Isolated from Ladakh, India

  • Kama, Ahmed;Shaik, Anver Basha;Kumar, C. Ganesh;Mongolla, Poornima;Rani, P. Usha;Krishna, K.V.S. Rama;Mamidyala, Suman Kumar;Joseph, Joveeta
    • Journal of Microbiology and Biotechnology
    • /
    • 제22권1호
    • /
    • pp.69-79
    • /
    • 2012
  • In an ongoing survey of the bioactive potential of microorganisms from Ladakh, India, the culture medium of a bacterial strain of a new Pseudomonas sp., strain ICTB-745, isolated from an alkaline soil sample collected from Leh, Ladakh, India, was found to contain metabolites that exhibited broad-spectrum antimicrobial and biosurfactant activities. Bioactivity-guided purification resulted in the isolation of four bioactive compounds. Their chemical structures were elucidated by $^1H$ and $^{13}C$ NMR, 2D-NMR (HMBC, HSQC, $^1H$,$^1H$-COSY, and DEPT-135), FT-IR, and mass spectroscopic methods, and were identified as 1-hydroxyphenazine, phenazine-1-carboxylic acid (PCA), rhamnolipid-1 (RL-1), and rhamnolipid-2 (RL-2). These metabolites exhibited various biological activities like antimicrobial and efficient cytotoxic potencies against different human tumor cell lines such as HeLa, HepG2, A549, and MDA MB 231. RL-1 and RL-2 exhibited a dose-dependent antifeedant activity against Spodoptera litura, producing about 82.06% and 73.66% antifeedant activity, whereas PCA showed a moderate antifeedant activity (63.67%) at 60 ${\mu}g/cm^2$ area of castor leaf. Furthermore, PCA, RL-1, and RL-2 exhibited about 65%, 52%, and 47% mortality, respectively, against Rhyzopertha dominica at 20 ${\mu}g/ml$. This is the first report of rhamnolipids as antifeedant metabolites against Spodoptera litura and as insecticidal metabolites against Rhyzopertha dominica. The metabolites from Pseudomonas sp. strain ICTB-745 have interesting potential for use as a biopesticide in pest control programs.

다중 에이전트 시스템의 컨센서스를 위한 슬라이딩 기법 강화학습 (A slide reinforcement learning for the consensus of a multi-agents system)

  • 양장훈
    • 한국항행학회논문지
    • /
    • 제26권4호
    • /
    • pp.226-234
    • /
    • 2022
  • 자율주행체와 네트워크기반 제어 기술의 발달에 따라서, 하나의 에이전트를 제어하는 것을 넘어서 다수의 이동체를 분산 제어하는데 사용 가능한 다중 에이전트의 컨센서스 제어에 대한 관심과 연구가 증가하고 있다. 컨센서스 제어는 분산형 제어이기 때문에, 정보 교환은 실제 시스템에서 지연을 가지게 된다. 또한, 시스템에 대한 모델을 정확히 수식적으로 표현하는데 있어서 한계를 갖는다. 이런 한계를 극복하는 방법 중에 하나로서 강화 학습 기반 컨센서스 알고리즘이 개발되었지만, 불확실성이 큰 환경에서 느린 수렴을 갖는 경우가 자주 발생하는 특징을 보이고 있다. 따라서, 이 논문에서는 불확실성에 강인한 특성을 갖는 슬라이딩 모드제어를 강화학습과 결합한 슬라이딩 강화학습 알고리즘을 제안한다. 제안 알고리즘은 기존의 강화학습 기반 컨센서스 알고리즘의 제어 신호에 슬라이딩 모드 제어 구조를 추가하고, 시스템의 상태 정보를 슬라이딩 변수를 추가하여 확장한다. 모의실험 결과 다양한 시변 지연과 왜란에 대한 정보가 주어지지 않았을 때에 슬라이딩 강화학습 알고리즘은 모델기반의 알고리즘과 유사한 성능을 보이면서, 기존의 강화학습에 비해서 안정적이면서 우수한 성능을 보여준다.

Association between food consumption and serum aryl hydrocarbon receptor ligand activity among middle-aged Korean adults

  • Kyungho Ha;Hoonsung Choi;Youngmi Kim Pak ;Hong Kyu Lee ;Hyojee Joung
    • Nutrition Research and Practice
    • /
    • 제18권5호
    • /
    • pp.711-720
    • /
    • 2024
  • BACKGROUND/OBJECTIVES: The diet is an important route of exposure to endocrine-disrupting chemicals (EDCs). However, few studies have investigated the association between dietary intake and EDC exposure levels among Koreans. In an earlier study, we showed that the bioactivity of serum aryl hydrocarbon receptor ligands (AhRLs) could be a surrogate biomarker to indicate exposure to EDCs and that they inhibit mitochondrial function. We also found that the mitochondria-inhibiting substances (MIS) in serum ascertained by intracellular adenosine triphosphate (MIS-ATP) and reactive oxygen species (MIS-ROS) levels could be biomarkers of exposure to EDCs, as they showed a strong correlation with AhRL and the levels of EDCs in the blood. Here, we investigated the association between the consumption of specific foods and surrogate serum biomarkers for EDCs, namely AhRL, MIS-ATP, and MIS-ROS, among middle-aged Korean adults. SUBJECTS/METHODS: A total of 1,466 participants aged 45-76 yrs from the Ansung cohort of the Korean Genome and Epidemiology Study were included. Food consumption, including that of meat, fish, vegetables, and fruits, was measured using a semiquantitative food frequency questionnaire. RESULTS: Fish intake was positively associated with AhRL (β = 0.0035, P = 0.0166), whereas cruciferous vegetable intake was negatively associated with AhRL (β = -0.0007, P = 0.0488). Cruciferous vegetable intake was positively associated with the MIS-ATP levels (β = 0.0051, P = 0.0420). A higher intake of fish was significantly associated with an increased risk of high AhRL (tertile: odds ratio [OR], 1.49; 95% confidence intervals (CIs), 1.08-2.06; P for trend = 0.0305). In addition, the second-highest tertile of cruciferous vegetable intake had lower odds of high AhRL than the lowest tertile (OR, 0.73; 95% CIs, 0.54-0.97), although no significant linear trend was observed. CONCLUSION: Consumption of different types of foods may be differentially associated with EDC exposure in middle-aged Korean adults.

지역주민의 환경축제 충성도와 그 영향요인 간의 인과관계 - 함평나비축제를 중심으로 - (The Causality among Residents' Loyalty to an Environmental Festival and Its Influential Factors: With Special Reference to Hampyung Butterfly Festival)

  • 이경진;송명규
    • 환경영향평가
    • /
    • 제23권5호
    • /
    • pp.337-352
    • /
    • 2014
  • 본 연구의 목적은 우리나라의 대표적 환경축제인 함평나비축제를 대상으로 환경축제가 지역주민의 충성도 제고라는 측면에서 지향해야 할 방향과 과제를 모색하는 것이다. 이에 지역주민을 대상으로 지역사회 애착도와 같은 축제의 외생적 요인과 축제의 경제 효과, 개최자와 지역주민 간의 의사소통, 그리고 지역주민의 축제 참여의사 같은 내생적 요인이 축제의 만족도 및 충성도에 미치는 영향과 경로를 구조 방정식모형을 통해 분석하였다. 분석 결과 애착도, 참여의사, 의사소통은 축제의 만족도에 정(+)의 영향을 미치고, 이 중 애착도는 충성도에도 정(+)의 영향을 미치며, 만족도는 충성도에 정(+)의 영향을 미칠 것이라는 본 연구의 가설은 유의수준 0.05에서 통계적으로 유의한 것으로 판명되었다. 다만 경제 효과는 연구가설과는 달리 만족도에 별다른 영향을 주지 않는 것으로 분석되었다. 한편 충성도에 미치는 총 영향력은 애착도, 의사소통, 참여의사 보다 만족도가 월등히 높은 것으로 나타났다. 그러므로 충성도 제고를 위해서는 원천적으로 애착도 제고, 의사소통 활성화, 참여의사 제고가 긴요하겠지만 이는 장기적으로 꾸준히 추진해야 할 과제일 것이며 단기적으로는 무엇보다도 만족도 제고에 노력하여야 한다.