• Title/Summary/Keyword: RL13

Search Result 39, Processing Time 0.029 seconds

Formal Model of Extended Reinforcement Learning (E-RL) System (확장된 강화학습 시스템의 정형모델)

  • Jeon, Do Yeong;Song, Myeong Ho;Kim, Soo Dong
    • Journal of Internet Computing and Services
    • /
    • v.22 no.4
    • /
    • pp.13-28
    • /
    • 2021
  • Reinforcement Learning (RL) is a machine learning algorithm that repeat the closed-loop process that agents perform actions specified by the policy, the action is evaluated with a reward function, and the policy gets updated accordingly. The key benefit of RL is the ability to optimze the policy with action evaluation. Hence, it can effectively be applied to developing advanced intelligent systems and autonomous systems. Conventional RL incoporates a single policy, a reward function, and relatively simple policy update, and hence its utilization was limited. In this paper, we propose an extended RL model that considers multiple instances of RL elements. We define a formal model of the key elements and their computing model of the extended RL. Then, we propose design methods for applying to system development. As a case stud of applying the proposed formal model and the design methods, we present the design and implementation of an advanced car navigator system that guides multiple cars to reaching their destinations efficiently.

Effect of Suckling on Progesterone Secretion during Lactation in the Rat (포유중인 Rat 의 Progesterone 분비에 대한 포유 효과)

  • 오석두;성환후;민관식;윤창현
    • Korean Journal of Animal Reproduction
    • /
    • v.23 no.2
    • /
    • pp.95-103
    • /
    • 1999
  • This experiment was conducted to investigate how the lactation regulation such as restricted-lactation and early weaning during the suckling period influences on ovarian functions and change in serum levels of progesterone in primiparous rats. All the rats were raised in the individual cage from a few days before parturition through the suckling period. The normal lactation(NL) groups were controled 8 pups. The restricted-lactation(RL) and weaned(W) groups were subdivided into 5 subgroups as RL0, RL5, RL10, RL15 and RL20 as well as W0, W5, W10, W15, and W20 according to the day of onset of suckling. The number of pups were regulated from 8 to 4 on experimental strating day in RL gropus, and also perfectly weaned on the each on-set day in W groups. The results obtained were summarized as follows: 1. During the whole suckling period of 25 days the pups in RL group grew significantly(P<005) faster than those in normal-lactation(NL) group. The pups in earlier RL group grew significantly(P<0.05) faster than those in later RL rats, and there was no found any significant difference in body weight of pups between RL20 and NL group. The gestation period and litter size were found to be 21.53$\pm$0.04 days and 13.75$\pm$0.07, respectively. 2. The estrous cycle was not expressed in the NL group through the whole suckling period. An irregular estrous cycle was found around day 20 in RL0 group, and the regular estrous cycles were exhibited continuously from day 10 in the day 0 weaned rats. 3. In the rats of NL group the serum progesterone concentration increased from 33.16$\pm$2.64ng/$m\ell$ on day 0 to 122.5$\pm$53.68 ng/$m\ell$ on day 10, and then decreased slightly to 97.30$\pm$3.21 ng/$m\ell$ on day 20, but then decreased abruptly. However, the serum level of progesterone decreased greatly(P<0.05) in 5 to 10 days following suckling restriction in the rats from which suckling began to be under restriction on day 0 or day 15. In the early weaning group the significant ( (P<0.05) decrease in progesterone concentration was found similarly in 48 hours following weaning in all the rats weaned on day 0 through day 20. It was suggested that lactation stimulation is a very pivotal on the function of ovary.

  • PDF

Flow Condensation Heat Transfer Coefficients of Pure Refrigerants (순수냉매의 흐름응축 열전달계수)

  • 김신종;송길홍;정동수
    • Korean Journal of Air-Conditioning and Refrigeration Engineering
    • /
    • v.14 no.2
    • /
    • pp.175-183
    • /
    • 2002
  • Flow Condensation heat transfer coefficients (HTCs) of Rl2, R22, R32, Rl23, Rl25, R134a, R142b were measured experimentally on a horizontal plain tube. The experi- mental apparatus was composed of three main parts; a refrigerant loop, a water loop and a water-glycol loop. The test section in a refrigerant loop was made of a copper tube of 8.8 mm inner diameter and 1000 mm length respectively. The refrigerant was cooled by passing cold water through an annulus surrounding the test section. All tests were performed at a filed refrigerant saturation temperature of 4$0^{\circ}C$ with mass fluxes of 100, 200, 300 kg/$m^2$s. The experimental result showed that flow condensation HTCs increase as the quality, mass flux, and latent heat of condensation increase. At the same mass flux, the HTCs of R32 and R142b were higher than those of R22 by 35~45% and 7~14% respectively while HTCs of R134a and Rl23 were similar to those of R22. On the other hand, HTCs of Rl25 and Rl2 were lower than those of R22 by 28 ~30% and 15 ~25% respectively Finally, a new correlation for flow condensation HTCs was developed by modifying Dobson and Chato's correlation with the latent heat of condensation considered. The correlaton showed an average deviation of 13.1% for all pure fluids data indicating an excellent agreement.

Hyperin Extracted from Manchurian Rhododendron Leaf Induces Apoptosis in Human Endometrial Cancer Cells Through a Mitochondrial Pathway

  • Li, Fu-Rong;Yu, Feng-Xiu;Yao, Shu-Tong;Si, Yan-Hong;Zhang, Wei;Gao, Lin-Lin
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.13 no.8
    • /
    • pp.3653-3656
    • /
    • 2012
  • Background: A number of effective prevention measures have been introduced in attempts to substantially reduce both the incidence and mortality due to many kinds of cancer. The search for new anti-cancer compounds in foods or in plant medicines is one realistic and promising approach to prevention. Chinese medicines provide a rich pool of novel and efficacious agents for cancer prevention and treatment. Previously it was demonstratrated that hyperin extracted from the Manchurian rhododendron leaf reduces the proliferation of many cancer cells. The present study was carried out to evaluate its effects on human endometrial cancer cell viability and apoptosis and to investigate its mechanisms of action in RL952 cells. Methods: Cell viability was measured using the MTT assay. Intracellular calcium ions were detected using laser-scanning confocal microscopy. The effects of hyperin on apoptosis related proteins in RL952 cells were examined using Western blot analysis. Results: The growth of RL952 cells was inhibited by treatment with hyperin. OD values of caspase-3 and caspase-9 were increased and expression of bcl-2 was increased and bax was decreased in protein levels in RL952 cells after 24 h of hyperin treatment, Moreover, intracellular calcium accumulation occurred in hyperin-treated cells. Conclusion: These results suggest that hyperin may play an important role in tumor growth suppression by inducing apoptosis in human endometrial cells via a $Ca^{2+}$-related mitochondrion apoptotic pathway in RL952 cells.

Restless Legs Syndrome in Children and Adolescents with Type 1 Diabetes (제 1형 당뇨병 소아 청소년의 하지불안증후군)

  • Yang, Woo Seok;Yoo, Jae Ho;Cheon, Sang-Myung;Kim, Seong Hwan;Choe, Byeong Moo;Kim, Woo Jin;Bang, Young Rong;Park, Jae Hong
    • Sleep Medicine and Psychophysiology
    • /
    • v.22 no.1
    • /
    • pp.20-24
    • /
    • 2015
  • Objectives: Restless legs syndrome (RLS) is a common sleep disorder in adults with diabetes. This study investigated the frequency of RLS and clinical correlations in children and adolescents with type 1 diabetes. Methods: This study included 55 consecutive patients (21 males, age $12.6{\pm}3.4years$) with type I diabetes that were regularly treated at the Department of Pediatric Endocrinology. RLS was diagnosed by intensive interviews which also included the Epworth Sleepiness Scale (ESS) and International RLS Rating Scale (IRLSRS). Patients also received neurological examinations and laboratory tests for diabetes, iron metabolism and renal function. Results: Thirteen patients (23.6%, 6 males) were compatible for the diagnostic criteria of RLS. None of the RLS patients showed abnormal findings in neurological evaluations and 7 patients had familial history of RLS. Demographic and laboratory findings were not different between the patients with or without RLS. The RLS group showed significantly increased ESS and IRLSRS scores. Conclusion: RLS was prevalent in children and adolescents with type 1 diabetes. The association between RLS and diabetes-related laboratory findings requires further investigation.

Metabolic Profiling and Biological Activities of Bioactive Compounds Produced by Pseudomonas sp. Strain ICTB-745 Isolated from Ladakh, India

  • Kama, Ahmed;Shaik, Anver Basha;Kumar, C. Ganesh;Mongolla, Poornima;Rani, P. Usha;Krishna, K.V.S. Rama;Mamidyala, Suman Kumar;Joseph, Joveeta
    • Journal of Microbiology and Biotechnology
    • /
    • v.22 no.1
    • /
    • pp.69-79
    • /
    • 2012
  • In an ongoing survey of the bioactive potential of microorganisms from Ladakh, India, the culture medium of a bacterial strain of a new Pseudomonas sp., strain ICTB-745, isolated from an alkaline soil sample collected from Leh, Ladakh, India, was found to contain metabolites that exhibited broad-spectrum antimicrobial and biosurfactant activities. Bioactivity-guided purification resulted in the isolation of four bioactive compounds. Their chemical structures were elucidated by $^1H$ and $^{13}C$ NMR, 2D-NMR (HMBC, HSQC, $^1H$,$^1H$-COSY, and DEPT-135), FT-IR, and mass spectroscopic methods, and were identified as 1-hydroxyphenazine, phenazine-1-carboxylic acid (PCA), rhamnolipid-1 (RL-1), and rhamnolipid-2 (RL-2). These metabolites exhibited various biological activities like antimicrobial and efficient cytotoxic potencies against different human tumor cell lines such as HeLa, HepG2, A549, and MDA MB 231. RL-1 and RL-2 exhibited a dose-dependent antifeedant activity against Spodoptera litura, producing about 82.06% and 73.66% antifeedant activity, whereas PCA showed a moderate antifeedant activity (63.67%) at 60 ${\mu}g/cm^2$ area of castor leaf. Furthermore, PCA, RL-1, and RL-2 exhibited about 65%, 52%, and 47% mortality, respectively, against Rhyzopertha dominica at 20 ${\mu}g/ml$. This is the first report of rhamnolipids as antifeedant metabolites against Spodoptera litura and as insecticidal metabolites against Rhyzopertha dominica. The metabolites from Pseudomonas sp. strain ICTB-745 have interesting potential for use as a biopesticide in pest control programs.

Integer Factorization for Decryption (암호해독을 위한 소인수분해)

  • Lee, Sang-Un;Choi, Myeong-Bok
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.6
    • /
    • pp.221-228
    • /
    • 2013
  • It is impossible directly to find a prime number p,q of a large semiprime n = pq using Trial Division method. So the most of the factorization algorithms use the indirection method which finds a prime number of p = GCD(a-b, n), q=GCD(a+b, n); get with a congruence of squares of $a^2{\equiv}b^2$ (mod n). It is just known the fact which the area that selects p and q about n=pq is between $10{\cdots}00$ < p < $\sqrt{n}$ and $\sqrt{n}$ < q < $99{\cdots}9$ based on $\sqrt{n}$ in the range, [$10{\cdots}01$, $99{\cdots}9$] of $l(p)=l(q)=l(\sqrt{n})=0.5l(n)$. This paper proposes the method that reduces the range of p using information obtained from n. The proposed method uses the method that sets to $p_{min}=n_{LR}$, $q_{min}=n_{RL}$; divide into $n=n_{LR}+n_{RL}$, $l(n_{LR})=l(n_{RL})=l(\sqrt{n})$. The proposed method is more effective from minimum 17.79% to maxmimum 90.17% than the method that reduces using $\sqrt{n}$ information.

A Comparison between Low- and High-Passage Strains of Human CytomegalovirusS

  • Wang, Wen-Dan;Lee, Gyu-Cheol;Kim, Yu Young;Lee, Chan Hee
    • Journal of Microbiology and Biotechnology
    • /
    • v.26 no.10
    • /
    • pp.1800-1807
    • /
    • 2016
  • To understand how human cytomegalovirus (HCMV) might change and evolve after reactivation, it is very important to understand how the nucleotide sequence of cultured HCMV changes after in vitro passaging in cell culture, and how these changes affect the genome of HCMV and the consequent variation in amino acid sequence. Strain JHC of HCMV was propagated in vitro for more than 40 passages and its biological and genetic changes were monitored. For each passage, real-time PCR was performed in order to determine the genome copy number, and a plaque assay was employed to get virus infection titers. The infectious virus titers gradually increased with passaging in cell culture, whereas the number of virus genome copies remained relatively unchanged. A linear correlation was observed between the passage number and the log10 infectious virus titer per virus genome copy number. To understand the genetic basis underlying the increase in HCMV infectivity with increasing passage, the whole-genome DNA sequence of the high-passage strain was determined and compared with the genome sequence of the low-passage strain. Out of 100 mutations found in the high-passage strain, only two were located in an open reading frame. A G-T substitution in the RL13 gene resulted in a nonsense mutation and caused an early stop. A G-A substitution in the UL122 gene generated an S-F nonsynonymous mutation. The mutations in the RL13 and UL122 genes might be related to the increase in virus infectivity, although the role of the mutations found in noncoding regions could not be excluded.

Microhardness of resin cements after light activation through various translucencies of monolithic zirconia

  • Pechteewang, Sawanya;Salimee, Prarom
    • The Journal of Advanced Prosthodontics
    • /
    • v.13 no.4
    • /
    • pp.246-257
    • /
    • 2021
  • PURPOSE. This study aimed to investigate the Vickers Hardness Number (VHN) of light- and dual cured resin cements cured through monolithic zirconia specimens (VITA YZ) of various translucencies: translucent (T); high translucent (HT); super translucent (ST); and extra translucent (XT) at 0, 24, and 48 h after curing. MATERIALS AND METHODS. Four zirconia specimens from each translucency were prepared. Two light-cured resin cements (Variolink N LC; VL and RelyX Veneer; RL) and two dual-cured resin cements (Variolink N DC; VD and RelyX U200; RD) were used. The cement was mixed and loaded in a mold and cured for 20 s through the zirconia specimen. The upper surface of cements was tested for VHN using a microhardness tester at 0, 24, and 48 h after curing. The VHN were analyzed using two-way repeated, Brown-Forsythe ANOVA with Games Howell post-hoc analysis and independent t-tests (P < .05). RESULTS. All cements showed significantly higher VHN from 0 h to 24 h (P < .001). At 48 h, the VHN of light-cured cements were significantly lower when cured under the T groups than under XT groups (P = .001 in VL, P = .014 in RL). At each post curing time of each translucency, VD showed higher VHN than VL (P < .05), and RD also showed higher VHN than RL (P < .05). CONCLUSION. The translucency of zirconia has an effect on the VHN for light-cured resin cements, but has no effect on dual-cured resin cements. Dual-cured resin cement exhibited higher VHN than the light-cured resin cement from the same manufacturer. All resin cements showed significantly higher VHN from 0 h to 24 h.

Scalable Extension of HEVC for Flexible High-Quality Digital Video Content Services

  • Lee, Hahyun;Kang, Jung Won;Lee, Jinho;Choi, Jin Soo;Kim, Jinwoong;Sim, Donggyu
    • ETRI Journal
    • /
    • v.35 no.6
    • /
    • pp.990-1000
    • /
    • 2013
  • This paper describes the scalable extension of High Efficiency Video Coding (HEVC) to provide flexible high-quality digital video content services. The proposed scalable codec is designed on multi-loop decoding architecture to support inter-layer sample prediction and inter-layer motion parameter prediction. Inter-layer sample prediction is enabled by inserting the reconstructed picture of the reference layer (RL) into the decoded picture buffer of the enhancement layer (EL). To reduce the motion parameter redundancies between layers, the motion parameter of the RL is used as one of the candidates in merge mode and motion vector prediction in the EL. The proposed scalable extension can support scalabilities with minimum changes to the HEVC and provide average Bj${\o}$ntegaard delta bitrate gains of about 24% for spatial scalability and of about 21% for SNR scalability compared to simulcast coding with HEVC.