• 제목/요약/키워드: Free agent

검색결과 681건 처리시간 0.025초

Implementation of the Agent using Universal On-line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning (강화 학습에서의 탐색과 이용의 균형을 통한 범용적 온라인 Q-학습이 적용된 에이전트의 구현)

  • 박찬건;양성봉
    • Journal of KIISE:Software and Applications
    • /
    • 제30권7_8호
    • /
    • pp.672-680
    • /
    • 2003
  • A shopbot is a software agent whose goal is to maximize buyer´s satisfaction through automatically gathering the price and quality information of goods as well as the services from on-line sellers. In the response to shopbots´ activities, sellers on the Internet need the agents called pricebots that can help them maximize their own profits. In this paper we adopts Q-learning, one of the model-free reinforcement learning methods as a price-setting algorithm of pricebots. A Q-learned agent increases profitability and eliminates the cyclic price wars when compared with the agents using the myoptimal (myopically optimal) pricing strategy Q-teaming needs to select a sequence of state-action fairs for the convergence of Q-teaming. When the uniform random method in selecting state-action pairs is used, the number of accesses to the Q-tables to obtain the optimal Q-values is quite large. Therefore, it is not appropriate for universal on-line learning in a real world environment. This phenomenon occurs because the uniform random selection reflects the uncertainty of exploitation for the optimal policy. In this paper, we propose a Mixed Nonstationary Policy (MNP), which consists of both the auxiliary Markov process and the original Markov process. MNP tries to keep balance of exploration and exploitation in reinforcement learning. Our experiment results show that the Q-learning agent using MNP converges to the optimal Q-values about 2.6 time faster than the uniform random selection on the average.

Antimicrobial Agent and Chlorine Susceptibility of E. coli Group Isolated from Natural Drinking Water in Northern Gyeongbuk Area (경북북부지역 먹는물에서 분리된 대장균군의 항균제 및 염소소독제 감수성)

  • Sohn, Chang-Kyu;Lee, Chun-Woo;Kim, Tae-Bun;Park, Soon-Geel;Jeon, Chan-Jun;Lee, Chang-Il;Park, Ja-Young;Song, Sung-Bok;Huh, Wan
    • Journal of environmental and Sanitary engineering
    • /
    • 제23권2호
    • /
    • pp.71-79
    • /
    • 2008
  • We examined 165 unchlorinated natural drinking water samples for the presence of E. coli group resistant to antimicrobial agent and chlorine in nothern Gyeongbuk area in 2007. Among 165 water samples, 21 samples(12.7%) were positive to total coliforms and Six genus, 16 strains of E. coli groups isolated from 16 samples showed resistance against more than one antimicrobial agent such as Ampicillin, Tetracycline and Chloroamphenicol. Among 16 strains, 14 strains resistant to Ampicillin, 9 strains resistant to Tetracycline and one strain resistant to Chloroampenicol. but all 16 strains did not contain any integron gene cassettes, which contribute to the spread of antimicrobial resistance alleles by lateral gene transfer of gene cassettes in a variety of enteric bacteria. The minimal inhibitory concentration(MIC) of 14 strains which showed resistant to Ampicillin was between $12{\mu}g/m{\ell}$ and $32{\mu}g/m{\ell}$, Nine strains resistant to Tetracycline showed between $32{\mu}g/m{\ell}$ and $128{\mu}g/m{\ell}$ and one strain resistant to Chloroampenicol showed $128{\mu}g/m{\ell}$. The chlorine sensitivity of 16 strains isolated from unchlorinated natural water sample did not show any difference among strains by the concentration of initial free chlorine and elapsed time after chlorine treatment. All 16 strains were killed after 1hr. exposure at $0.2mg/m{\ell}$ of free chlorine per liter or 30minutes exposure at $0.4mg/m{\ell}$ of free chlorine per liter.

Effects of the Grapevine Shoot Extract on Free Radical Scavenging Activity and Inhibition of Pro-inflammatory mediator Production in RAW264.7 Macrophages (포도나무가지 추출물의 프리라디칼 소거 작용 및 염증 발현 매개인자 생성 억제 효과)

  • 허선경;이상국;김선숙;허연회;안수미
    • Biomolecules & Therapeutics
    • /
    • 제9권3호
    • /
    • pp.188-193
    • /
    • 2001
  • Free radical scavengers or quenching agents for reactive oxygen species (ROS) present in consumable fruits, vegetables, and beverages have received considerable attention as potential antioxidants, and thus uses for treatment of several human diseases. In this study, grapevine shoot extract (GSE) containing high concentration of resveratrol and viniferine was evaluated for antioxidant potential and inhibition of pro-inflam-matory mediator production. Utilizing 1,1-diphenyl-2-picrylhydrazyl (DPPH) scavenging activity and xanthine oxidase (XOD) inhibition assay the GSE showed inhibitory effects of DPPH radical scavenging and XOD activity with the $IC_{50}$/ values of 34.5 and 155 $\mu\textrm{g}$/ml, respectively. In addition, GSE also exhibited the inhibition of prostaglandin E$_2$ (PGE$_2$) and nitric oxide (NO) production in lipopolysaccharide (LPS)-induced mouse macrophage RAW264.7 cells with the $IC_{50}$/ value of 6.4 and 14.5 $\mu\textrm{g}$/ml, respectively. This result suggests that grapevine shoot extract has the potential activity as a natural antioxidant or antiinflammatory agent.

  • PDF

Comparative Analysis of IoT Enabled Multi Scanning Parking Model for Prediction of Available Parking Space with Existing Models

  • Anchal, Anchal;Mittal, Pooja
    • International Journal of Computer Science & Network Security
    • /
    • 제22권8호
    • /
    • pp.404-412
    • /
    • 2022
  • The development in the field of the internet of things (IoT) have improved the quality of the life and also strengthened different areas in the society. All cities across the world are seeking to become smarter. The creation of a smart parking system is the essential use case in smart cities. In recent couple of years, the number of vehicles has increased significantly. As a result, it is critical to make the use of technology that enables hassle-free parking in both public and private spaces. In conventional parking systems, drivers are not able to find free parking space. Conventional systems requires more human interference in a parking lots. To manage these circumstances there is an intense need of IoT enabled parking solution that includes the well defined architecture that will contain the following components such as smart sensors, communication agreement and software solution. For implementing such a smart parking system in this paper we proposed a design of smart parking system and also compare it with convetional system. The proposed design utilizes sensors based on IoT and Data Mining techniques to handle real time management of the parking system. IoT enabled smart parking solution minimizes the human interference and also saves energy, money and time.

Antioxidative Activity and Protection of Oxidative Chromosomal Damage by Vegetables, Fruits Extract and Their Functional Liquid Formulation (야채 및 과일추출물의 항산화작용과 산화적 염색체손상에 대한 억제효과)

  • 이승철;허찬;이승현;김현표;허문영
    • YAKHAK HOEJI
    • /
    • 제48권2호
    • /
    • pp.111-116
    • /
    • 2004
  • The ethanol extracts of mixed vegetables (Bioactive Vegetables, BV), mixed fruits (Bioactive Fruits, BF) and their liquid formulation (Chungpae Plus , CP) were evaluated for their antioxidative and antigenotoxic activities. They were shown to possess the significant free radical scavenging effect against 1,1-diphenyl-2-picryl hydrazine (DPPH) radical generation and were revealed to show the inhibitory effect of lipid peroxidation as measured by malondialdehyde (MDA) formation although the potencies were not higher than those of vitamin C. They did not possess any pro-oxidant effect on bleomycin-Fe(III) dependent DNA degradation, whereas vitamin C showed strong pro-oxidant effect. Furthermore, oral administration of BV and BF inhibited micronucleated reticulocyte (MNRET) formation of mouse peripheral blood induced by KBrO3 treatment in vivo. CP also showed significant inhibition under same experimental condition. Therefore, the liquid formulation (CP) containing BV and BF may be a useful natural antioxidative and antigenotoxic agent by scavenging free radicals, inhibition of lipid peroxidation and protecting chromosomal damage.

Biological Control of Powdery Mildew by Antibiotic-producing Microorganisms Antagonistic to Erysiphe graminis

  • Lee, Yong-Se;Wolf, G.
    • Journal of Microbiology and Biotechnology
    • /
    • 제5권6호
    • /
    • pp.341-345
    • /
    • 1995
  • Seventy four microorganisms, which have antagonistic activity against to Fusarium culmorum, were tested for their inhibitory effect on colony development of obligate biotroph Erysiphe graminis f. sp. hordei Marchal, the causal agent of powdery mildew on barley plants. Of these, 13 actinomycetes isolates were shown to reduce the colony development of mildew completely by application of their 10% cell-free culture filtrates on barley leaves. An Isolate, A252, was the most powerful antagonist and its antifungal activity was further assessed. The colony development of mildew was significantly reduced by application of the 1% cell-free culture filtrate of isolate A252. In comparison to the control, the protective and curative application of 10% cell-free culture filtrate from A252 showed 88.5% and 96.1% reduction of colony numbers respectively. By the protective application, 68.3% of the inhibition was observed after 9 days of treatment, thus showed prolonged inhibitory effect. In vitro test, complete inhibition of the mycelial growth of Microdochium nivale was achieved by the treatment of 1% A252 culture filtrate and 80.2% of inhibition was observed by the 0.1% treatment.

  • PDF

Chromate-free Hybrid Coating for Corrosion Protection of Electrogalvanized Steel Sheets

  • Jo, Du-Hwan;Kwon, Moonjae;Kim, Jong-Sang
    • Corrosion Science and Technology
    • /
    • 제11권1호
    • /
    • pp.15-19
    • /
    • 2012
  • Both electrogalvanized and hot-dip galvanized steel sheets have been finally produced via organic-inorganic surface coating process on the zinc surface to enhance corrosion resistance and afford additional functional properties. Recently, POSCO has been developed a variety of chromate-free coated steels that are widely used in household, construction and automotive applications. New organic-inorganic hybrid coating solutions as chromate alternatives are comprised of surface modified silicate with silane coupling agent and inorganic corrosion inhibitors as an aqueous formulation. In this paper we have prepared new type of hybrid coatings and evaluated quality performances such as corrosion resistance, spot weldability, thermal tolerance, and paint adhesion property etc. The electrogalvanized steels with these coating solutions exhibit good anti-corrosion property compared to those of chromate coated steels. Detailed components composition of coating solutions and experimental results suggest that strong binding between organic-inorganic hybrid coating layer and zinc surface plays a key role in the advanced quality performances.

Conformational Analysis of Sulfonylureas : Acetohexamide and Tolazamide (Sulfonylurea 유도체들의 구조분석 : Acetohexamide와 Tolazamide)

  • 정우태;강기롱;이성희
    • YAKHAK HOEJI
    • /
    • 제39권3호
    • /
    • pp.329-336
    • /
    • 1995
  • Conformational free energy calculations using an empirical potential function and a hydration shell model(program CONBIO) were carried out on hypoglycemic agent acetohexamide and tolazamide in the unhydrated and hydrated states. The initial geometry of sulfonylureas was obtained from X-ray crystallographieal data and homologous molecular fragments. In both states, the feasible conformations were obtained from the calculations of conformational energy, conformational entropy, and hydration free energy by varying all the torsion angles of the molecules. From the calculation results, it is known that the conformations] entropy is the major contribution to stabflize the low-free-energy conformations of two sulfonylureas in both states. But, in hydrated state, the hydration does not directly affect each conformations. The intramolecular hydrogen bonding of sulfonylurea hydrogen and 7-membered nitrogen appeared to the conformations of tolazamide in both states. It is thought that the hydrogen bonding decrease steric hindrance on the receptor binding direction. The substitution of alicyclic or N-heterocyclic ring than that of carbons chain of urea moiety may be properly interaction between sulfonylureas and the putative pancreatic receptor.

  • PDF

A Study on the Application of Sulfur-Free Odorant for LPG Fuel (LPG 연료용 비황분계 부취제의 적용성 연구)

  • Kim, Jae-Kon;Yim, Eui Soon;Jung, Choong-Sub
    • Journal of the Korean Institute of Gas
    • /
    • 제18권5호
    • /
    • pp.52-59
    • /
    • 2014
  • In general, sulfur containing odorants are added to fuel gases, such as LPG, and city gas, to prevent gas poisoning, ignition, explosion, or other accident caused by fuel gases, and to enable immediate and easy detection of fuel-gas leakage by emitting an offensive smell. In this study, sulfur free odorant for low sulfur fuel and prevention of metal corrosion were developed to replace current sulfur containing odorant for gas fuel. They were selected from 12 odorant containing non-sulfur organic compounds and evaluated by odor olfactory method (odor quality, odor intensity). Finally, selected mixture odorants were methyl isovalerate, methyl acrylate, 2-ethyl-3-methyl pyrazine with blending ratio of 50% : 40% : 10%. Final Sulfur free odorant was added 40 wt ppm in LPG fuels and evaluated fuel quality characteristics, metal corrosion test and long term stability of LPG fuel. It were limit in current LPG fuel standard in fuel quality characteristics. Final Sulfur free odorant also had no influence on metal corrosion and long term stability test with 60 days by adding in LPG fuels. Finally, they were shown to be warning agent candidates to reduce sulfur content and metal corrosion for LPG fuel.

FORMULATION AND STABILITY TEST OF ANTIAGING CREAM CONTAINING METHANOL FRACTION OIL OF PANGIUM EDULE.REINW. AS A RADICAL SCAVENGER AGENT

  • Djajadisastra, J.;Anwar, E.;Milani, E.
    • Proceedings of the SCSK Conference
    • /
    • 대한화장품학회 2003년도 IFSCC Conference Proceeding Book II
    • /
    • pp.303-306
    • /
    • 2003
  • Indonesia is a tropical country having a temperature range of 25-35$^{\circ}C$ which can affect the skin and causes damages like aging. This aging process is due, at least, to free radical reactions. For this reason, many attempts had been done to find out creams containing natural antioxidant compound which have a potential of free radical scavenger. Kluwek, a fermented form of foot ball fruit or picung (Pangium edule.Reinw), had been proved to contain antioxidant compound in its methanol fraction oil to which antiaging cream was formulated. Stability evaluation was conducted for cream with Kluwek oil compared to base cream, including organoleptic (colour and odour), pH, viscosity, particle size, centrifugation test and flow characteristics either in room temperature (27$^{\circ}C$) or stress condition (4$^{\circ}C$ and 5$0^{\circ}C$) for 8 weeks continuously, and six times cycling test at 4$^{\circ}C$ and 5$0^{\circ}C$ every 24 hours. The results showed that cream with Kluwek oil and base cream were stable at temperature 27 and 4$^{\circ}C$, cycling test and centrifugation test, but not stable at 5$0^{\circ}C$. Free radical evaluation was done by Electron Spin Resonance and the result showed that cream with Kluwek oil had less free radicals compared to base cream.

  • PDF