• Title/Summary/Keyword: Q+

Search Result 13,787, Processing Time 0.035 seconds

Implementation of the Agent using Universal On-line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning (강화 학습에서의 탐색과 이용의 균형을 통한 범용적 온라인 Q-학습이 적용된 에이전트의 구현)

  • 박찬건;양성봉
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.7_8
    • /
    • pp.672-680
    • /
    • 2003
  • A shopbot is a software agent whose goal is to maximize buyer´s satisfaction through automatically gathering the price and quality information of goods as well as the services from on-line sellers. In the response to shopbots´ activities, sellers on the Internet need the agents called pricebots that can help them maximize their own profits. In this paper we adopts Q-learning, one of the model-free reinforcement learning methods as a price-setting algorithm of pricebots. A Q-learned agent increases profitability and eliminates the cyclic price wars when compared with the agents using the myoptimal (myopically optimal) pricing strategy Q-teaming needs to select a sequence of state-action fairs for the convergence of Q-teaming. When the uniform random method in selecting state-action pairs is used, the number of accesses to the Q-tables to obtain the optimal Q-values is quite large. Therefore, it is not appropriate for universal on-line learning in a real world environment. This phenomenon occurs because the uniform random selection reflects the uncertainty of exploitation for the optimal policy. In this paper, we propose a Mixed Nonstationary Policy (MNP), which consists of both the auxiliary Markov process and the original Markov process. MNP tries to keep balance of exploration and exploitation in reinforcement learning. Our experiment results show that the Q-learning agent using MNP converges to the optimal Q-values about 2.6 time faster than the uniform random selection on the average.

CACB-Q2AM Modulation for High Bandwidth Efficiency and Constant Amplitude Signal Transmission (높은 대역폭 효율과 정진폭 신호 전송을 위한 CACB-Q2AM 변조)

  • Hong, Dae-Ki;Kang, Sung-Jin
    • Journal of Internet Computing and Services
    • /
    • v.9 no.1
    • /
    • pp.21-32
    • /
    • 2008
  • In this paper, we propose new modulation schemes using the conventional CACB (Constant Amplitude Coded Multicode Biorthogonal) modulation with constant amplitude property. Also the proposed modulation schemes supports high transmission data rate by increasing the spectral efficiency, In order to obtain the high spectral efficiency, the $Q^2$AM (Quadrature-Quadrature Amplitude Modulation) and CA-$Q^2$AM (Constant Amplitude-$Q^2$AM) are used. We explain the simplest combining modulation scheme of CACB and $Q^2$AM (i.e., CACB-$Q^2$AM). However, this modulation scheme cannot support the constant amplitude property. Hence the first CACB-CA-$Q^2$AM (or CACB-CA-$Q^2$AM I) modulation scheme is proposed for the constant amplitude property. In the modulation scheme, the redundant constant amplitude encoding (spectral efficiency decrease) is required. Therefore, the second CACB-CA-$Q^2$AM (or CACB-CA-$Q^2$AM II) modulation scheme is proposed retaining the constant amplitude and the spectral efficiency. Computer simulations show that the proposed CACB-CA-$Q^2$AM II is the efficient modulation scheme.

  • PDF

A study on the characteristic of Pockel cell Q-switch for Nd:YAG laser (Nd:YAG Laser를 위한 포켓셀 Q-스위치특성 연구)

  • Kim, Whi-Young
    • Journal of Digital Contents Society
    • /
    • v.10 no.2
    • /
    • pp.199-207
    • /
    • 2009
  • The Q-switching the shutter or the different optical science element puts in within the laser light resonator and the storehouse departs from the within the resonator it loses the mortar and the reversal distribution which when is sufficient creates from within the active medium, opens the shutter instantaneously and it is to do to be made to emit with the light where the energy which is accumulated within the resonator is strong very. Like this Q-switching of laser resonator--It decreases factor increasing suddenly to make. To method of Laser Q-switching mechanical switching methods, electro-optic switching methods and switching by saturable absorber methods, acousto-optic switching method etc. 4 kind are being used on a large scale. In these people the conversion which is electric in compliance with the effect which is electrooptics is widely being used the Q-switching pulse of short pulse width because being it will be able to create. Consequently, Pockel cell where it has the quality of electrooptics effect) the Q-it is become known that it is suitable it uses with switch. From the research which it sees FET and one-chip microprocessor where it is a switching element and pulse transfomer to plan and produce pockel cell Q-switch driving gears, pulse style Nd: It applied in YAG Laser system and it investigated and researched the operating characteristic of the Q-switch. Also, the Q-switch leads and Nd where it is output: YAG with forecast in compliance with a theoretical calculation it comes to buy laser beam side politics it compared and laser beam qualities which had become Q-switching it analyzed.

  • PDF

Relationships between job stress and caffeine intake in industrial workers (산업체 근로자의 직무스트레스와 카페인 섭취의 상관성)

  • Yim, Ji-Suk;Lee, Jae-Joon
    • Journal of Nutrition and Health
    • /
    • v.49 no.5
    • /
    • pp.367-377
    • /
    • 2016
  • Purpose: This study analyzed the degree of job stress and caffeine intake in workers in industrial positions in order to determine the relationships between job stress and caffeine intake. Methods: For this purpose, this study conducted a survey targeting 361 blue collar workers working for K manufacturing company, Gwangju. Results: The total score for job stress in subjects was $72.7{\pm}6.8points$/100points. According to job stress, subjects were categorized as follows: Q1 for the group who had the least stress; Q2 for the group who had little stress; Q3 for the group who had a lot of stress, and Q4 for the group who had the most stress. As for the effects of caffeine on health, 57.1% thought that caffeine is helpful and not harmful if taken properly while 17.3% responded that less caffeine consumption is better. Daily intake of caffeine according to stress was presented as: $172.0{\pm}85.3mg$ in Q1, $179.0{\pm}83.7mg$ in Q2, $187.9{\pm}81.4mg$ in Q3, and $214.2{\pm}147.3mg$ in Q4 (p < 0.05). The percentages of caffeine consumption compared to the daily safe limit in subjects were: $43.0{\pm}21.3$, $44.8{\pm}20.9$, $47.1{\pm}20.4$, and $53.6{\pm}36.8%$ in Q1, Q2, Q3, and Q4, respectively (p < 0.05). Adverse effects such as nausea or vomiting from caffeine were most common in Q4 (p < 0.05). Conclusion: As a result, higher stress in blue collar workers working for K manufacturing company was associated with more caffeine consumption. Groups with a lot of stress (Q4) consumed approximately 50% of daily safe limit of caffeine. Considering the results above, this study suggests that further research on more precise caffeine intake and its effects is needed.

MORE GENERALIZED FUZZY SUBSEMIGROUPS/IDEALS IN SEMIGROUPS

  • Khan, Muhammad Sajjad Ali;Abdullah, Saleem;Jun, Young Bi;Rahman, Khaista
    • Honam Mathematical Journal
    • /
    • v.39 no.4
    • /
    • pp.527-559
    • /
    • 2017
  • The main motivation of this article is to generalized the concept of fuzzy ideals, (${\alpha},{\beta}$)-fuzzy ideals, (${\in},{\in}{\vee}q_k$)-fuzzy ideals of semigroups. By using the concept of $q^{\delta}_K$-quasi-coincident of a fuzzy point with a fuzzy set, we introduce the notions of (${\in},{\in}{\vee}q^{\delta}_k$)-fuzzy left ideal, (${\in},{\in}{\vee}q^{\delta}_k$)-fuzzy right ideal of a semigroup. Special sets, so called $Q^{\delta}_k$-set and $[{\lambda}^{\delta}_k]_t$-set, condition for the $Q^{\delta}_k$-set and $[{\lambda}^{\delta}_k]_t$-set-set to be left (resp. right) ideals are considered. We finally characterize different classes of semigroups (regular, left weakly regular, right weakly regular) in term of (${\in},{\in}{\vee}q^{\delta}_k$)-fuzzy left ideal, (${\in},{\in}{\vee}q^{\delta}_k$)-fuzzy right ideal and (${\in},{\in}{\vee}q^{\delta}_k$)-fuzzy ideal of semigroup S.

A Function Approximation Method for Q-learning of Reinforcement Learning (강화학습의 Q-learning을 위한 함수근사 방법)

  • 이영아;정태충
    • Journal of KIISE:Software and Applications
    • /
    • v.31 no.11
    • /
    • pp.1431-1438
    • /
    • 2004
  • Reinforcement learning learns policies for accomplishing a task's goal by experience through interaction between agent and environment. Q-learning, basis algorithm of reinforcement learning, has the problem of curse of dimensionality and slow learning speed in the incipient stage of learning. In order to solve the problems of Q-learning, new function approximation methods suitable for reinforcement learning should be studied. In this paper, to improve these problems, we suggest Fuzzy Q-Map algorithm that is based on online fuzzy clustering. Fuzzy Q-Map is a function approximation method suitable to reinforcement learning that can do on-line teaming and express uncertainty of environment. We made an experiment on the mountain car problem with fuzzy Q-Map, and its results show that learning speed is accelerated in the incipient stage of learning.

A Novel Compensation Scheme for I/Q Mismatch in an OFDM Direct-Conversion Architecture (OFDM 전송방식 기반의 Direct-Conversion 수신기에서 I/Q 불균형 보상을 위한 새로운 방법 제안)

  • Bae, Jung-Hwa;Park, Jin-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.12C
    • /
    • pp.1265-1272
    • /
    • 2006
  • This paper proposes a compensation method that can alleviate the problem of I/Q mismatch generated in the direct-conversion receiver of OFDM systems. In the proposed method, the amount of I/Q mismatch is estimated using null-carriers in transmitted signals, and it is subtracted from received symbols to suppress I/Q mismatch effects. Simulations show experiments that the proposed method can effectively eliminate the I/Q mismatch effects.

An Experimental Study on the Comparison of the Establishment and Growth of Seedlings among Three Oak Species (참나무속 3종의 유식물 정착과 생장의 비교에 대한 실험적 연구)

  • Baek, Myeong-Su;Do-Soon Cho
    • The Korean Journal of Ecology
    • /
    • v.19 no.2
    • /
    • pp.125-139
    • /
    • 1996
  • The relationships between environmental factors and the establishment and growth of oak seelings were studied in the greenhouse. The early seedling performances of three oak species (Quercus mongolica, Quercus serrata, Quercus variabilis) were compared. Mean seed weight was the biggest in Q. variabilis, and the smallest in Q. serrata, and the germination rate was higher in Q. variabilis than in Q. mongolica and Q. serrata. The germination rate was significantly affected by seed weight class in Q. serrata, but not in Q. mongolica. Emergence of oak seedlings was similar in all three oak species, and especially the first leaf emergence increased about twenty days after germination. An experiment was designed using three environmental factors (light, soil moisture, fertilizer) to compare the response of the three oak species. Light and soil moisture significantly affected the seedling height growth of Q. variabilis, but the effect was marginal in Q. mongolica and Q. serrata. However, growth of seedling biomass was significant in all three oak species. In contrast, fertilizer did not affect seedling growth of any of the oak species. Q. variabilis is expected to grow well in large gaps because it is very sensitive and responds well to high light and high moisture conditions. Q. mongolica and Q. serrata are relatively tolerant to shade but may need gaps for the seelings to grow into saplings.

  • PDF

The Design and Implementation of Library for RTOS Q+ (실시간 운영체제 Q+를 위한 라이브러리 설계 및 구현)

  • Kim, Do-Hyeong;Park, Seung-Min
    • The KIPS Transactions:PartD
    • /
    • v.9D no.1
    • /
    • pp.153-160
    • /
    • 2002
  • This paper describes the design and implementation of library for real-time operating system Q+, that was developed for the internet appliance. The library in the real-time operating system should be defined according to the standard interface and support the functions that are adequate to the real-time application. To ensure the compatibility between application programs, the Q+ library follows industrial and international standards, such as POSIX.1, ISO 7942 GKS. And, to support the Q+ application, library provides C standard functions, graphic/window functions, network functions, security support functions, file system functions. The Q+ library was implemented using the Q+ kernel, Digital TV set-top box, and KBUG debugging tool.