• Title/Summary/Keyword: Primitive Action

Search Result 27, Processing Time 0.028 seconds

A Method for Learning Macro-Actions for Virtual Characters Using Programming by Demonstration and Reinforcement Learning

  • Sung, Yun-Sick;Cho, Kyun-Geun
    • Journal of Information Processing Systems
    • /
    • v.8 no.3
    • /
    • pp.409-420
    • /
    • 2012
  • The decision-making by agents in games is commonly based on reinforcement learning. To improve the quality of agents, it is necessary to solve the problems of the time and state space that are required for learning. Such problems can be solved by Macro-Actions, which are defined and executed by a sequence of primitive actions. In this line of research, the learning time is reduced by cutting down the number of policy decisions by agents. Macro-Actions were originally defined as combinations of the same primitive actions. Based on studies that showed the generation of Macro-Actions by learning, Macro-Actions are now thought to consist of diverse kinds of primitive actions. However an enormous amount of learning time and state space are required to generate Macro-Actions. To resolve these issues, we can apply insights from studies on the learning of tasks through Programming by Demonstration (PbD) to generate Macro-Actions that reduce the learning time and state space. In this paper, we propose a method to define and execute Macro-Actions. Macro-Actions are learned from a human subject via PbD and a policy is learned by reinforcement learning. In an experiment, the proposed method was applied to a car simulation to verify the scalability of the proposed method. Data was collected from the driving control of a human subject, and then the Macro-Actions that are required for running a car were generated. Furthermore, the policy that is necessary for driving on a track was learned. The acquisition of Macro-Actions by PbD reduced the driving time by about 16% compared to the case in which Macro-Actions were directly defined by a human subject. In addition, the learning time was also reduced by a faster convergence of the optimum policies.

A Study on the Contents and Sentences of Korean Abstract (한국어(韓國語) 초록문(抄錄文)의 문장(文章)과 내용(內容)에 대한 연구(硏究))

  • Lee, Tae-Young
    • Journal of Information Management
    • /
    • v.21 no.1
    • /
    • pp.1-33
    • /
    • 1990
  • This paper examines the English and Korean abstracts using the part of speech, case, primitive action. primitive state, measures the length of abstracts and individual sentences and analyzes the structures of sentences. In turn, the possible frames of abstract sentences are suggested.

  • PDF

Representation of 'Walk' for Quadruped Animal Based on Primitive Action and Class Inherit (기본 동작들과 클래스 상속에 기초한 4족 동물의 다양한 '보행' 표현)

  • Park Jong-Hee;Lee In-Kyun
    • The Journal of the Korea Contents Association
    • /
    • v.6 no.5
    • /
    • pp.85-95
    • /
    • 2006
  • In this paper, we propose a method for simplifying the modeling of 'walk' for various instances of quadruped and easily extending the model of 'walk' for the instance of new subordinate class which is not defined in the original class hierarchy by using the sophisticatedly modeled 'walk' of quadruped. To achieve this method, we apply the analyzed pattern of walk and classification according to the structural similarity of quadruped studied in the previous researches to the class hierarchy and propose a method for inheriting the actions of super class. This paper model the 'walk' of quadruped by concertizing the characteristics of quadruped and defining the necessary factors and appropriate domains in terms of parameters of 'walk' and apply the model to the horse and cow, typical instances of quadruped.

  • PDF

Antagonists of Both D1 and D2 Mammalian Dopamine Receptors Block the Effects of Dopamine on Helix aspersa Neurons

  • Kim, Young-Kee;Woodruff, Michael L.
    • BMB Reports
    • /
    • v.28 no.3
    • /
    • pp.221-226
    • /
    • 1995
  • Dopamine mediates inhibitory responses in Helix aspersa neurons from the right parietal lobe ("F-lobe") of the circumoesophageal ganglia. The effects appeared as a dose-dependent hyperpolarization of the plasma membrane and a decrease in the occurrence of spontaneous action potentials. The average hyperpolarization with 5 ${\mu}m$ dopamine was -12 mV (${\pm}1.5$mV, S.D., n=12). Dopamine also modulated the currents 'responsible for shaping the action potentials in these neurons. When dopamine was added and action potentials were triggered by an injection of current, the initial depolarization was slowed, the amplitude and the duration of action potentials were decreased, and the after-hyperpolarization was more pronounced. The amplitude and the duration of action potential were reduced about 15 mV and about 13% by 5 ${\mu}m$ dopamine, respectively. The effects of dopamine on the resting membrane potentials and the action potentials of Helix neurons were dose-dependent in the concentration range 0.1 ${\mu}m$ to 50 ${\mu}m$. In order to show 1) that the effects of dopamine were mediated by dopamine receptors rather than by direct action on ionic channels and 2) which type of dopamine receptor might be responsible for the various effects, we assayed the ability of mammalian dopamine receptor antagonists, SCH-23390 (antagonist of D1 receptor) and spiperone (antagonist of D2 receptor), to block the dopamine-dependent changes. The D1 and D2 antagonists partially inhibited the dopamine-dependent hyperpolarization and the decrease in action potential amplitude. They both completely blocked the decrease in action potential duration and the increase in action potential after-hyperpolarization. The dopamine-induced slowdown of the depolarization in the initial phase of the action potentials was less effected by SCH-23390 and spiperone. From the results we suggest 1) that Helix F-lobe neurons may have a single type of dopamine receptor that binds both SCH-23390 and spiperone and 2) that the dopamine receptor of Helix F-lobe neurons may be homologous with and primitive to the family of mammalian dopamine receptors.

  • PDF

Human Primitive Motion Recognition Based on the Hidden Markov Models (은닉 마르코프 모델 기반 동작 인식 방법)

  • Kim, Jong-Ho;Yun, Yo-Seop;Kim, Tae-Young;Lim, Cheol-Su
    • Journal of Korea Multimedia Society
    • /
    • v.12 no.4
    • /
    • pp.521-529
    • /
    • 2009
  • In this paper, we present a vision-based human primitive motion recognition method. It models the reference motion patterns, recognizes a user's motion, and measures the similarity between the reference action and the user's one. In order to recognize a motion, we provide a pattern modeling method based on the Hidden Markov Models. In addition, we provide a similarity measurement method between the reference motion and the user's one using the editing distance algorithm. Experimental results show that the recognition rate of ours is above 93%. Our method can be used in the motion recognizable games, the motion recognizable postures, and the rehabilitation training systems.

  • PDF

Study on the activation of ceramic culture education (도자문화 교육의 활성화 방안 연구)

  • Kim, Sung-Min
    • Journal of Digital Convergence
    • /
    • v.12 no.3
    • /
    • pp.377-382
    • /
    • 2014
  • Culture of Latin cultura culture derived from a translation of the original meaning of words was farming and cultivation, culture, art and later became the will of. British anthropologist E. B. Tyler book "primitive cultures, Primitive Culture" (1871) Culture in the "knowledge. Beliefs Arts. Morality. Law. Practices, including as a member of human society acquired the totality of skills or habits," he gave the definition. Culture can be seen in the human reason, of the form of action, not genetic thing by playing by learning to learn from the community and received the whole thing says. Thus, the prevalence of active cultural power of vigorous training is possible can. In this sense, our ceramic culture also reaffirming the importance of education and the reorganization is needed. Culture and what it takes to become a force larger than the act of teaching. Who supply the consumer with the culture and the sharing of feelings that can be read properly considering the skater to the consumer unless the formation of culture is impossible. In this regard, this study realized the importance of education and culture, as the current situation in our country and the activation of ceramic craft education is to provide.

Treatment for Sport Disability by Proprioceptive Neuromuscular Facilitation Technique (고유수용성 신경근 촉진법에 의하 Sport 장해 환자의 치료)

  • Kim, Tae-Yoon
    • Journal of Korean Physical Therapy Science
    • /
    • v.3 no.4
    • /
    • pp.189-196
    • /
    • 1996
  • The purpose of this review are that what is the concept of sport P. N. F and to give the information about proprioceptive neuromuscular facilitation technique when the sport physical therapy will be needed in field. Technique of proprioceptive neuromuscular facilitation are methods of placing specific demands in order to secure a desired response. Greatest emphasis was placed on the application of optimal resistance throughout the range of motion, using many combinations of motions which were related to primitive patterns and employment of postural and righting reflexes. The treatment after sport injury patient is required that two component actions of muscles as well as permitting action to occur at two or more joint. The effect of P. N. F and of sprot P. N. F are reviewed. Implications for treatment of sport disability are suggested.

  • PDF

THE COMPOSITION SERIES OF IDEALS OF THE PARTIAL-ISOMETRIC CROSSED PRODUCT BY SEMIGROUP OF ENDOMORPHISMS

  • ADJI, SRIWULAN;ZAHMATKESH, SAEID
    • Journal of the Korean Mathematical Society
    • /
    • v.52 no.4
    • /
    • pp.869-889
    • /
    • 2015
  • Let ${\Gamma}^+$ be the positive cone in a totally ordered abelian group ${\Gamma}$, and ${\alpha}$ an action of ${\Gamma}^+$ by extendible endomorphisms of a $C^*$-algebra A. Suppose I is an extendible ${\alpha}$-invariant ideal of A. We prove that the partial-isometric crossed product $\mathcal{I}:=I{\times}^{piso}_{\alpha}{\Gamma}^+$ embeds naturally as an ideal of $A{\times}^{piso}_{\alpha}{\Gamma}^+$, such that the quotient is the partial-isometric crossed product of the quotient algebra. We claim that this ideal $\mathcal{I}$ together with the kernel of a natural homomorphism $\phi:A{\times}^{piso}_{\alpha}{\Gamma}^+{\rightarrow}A{\times}^{iso}_{\alpha}{\Gamma}^+$ gives a composition series of ideals of $A{\times}^{piso}_{\alpha}{\Gamma}^+$ studied by Lindiarni and Raeburn.

Action of Dopamine as Inhibitory Neuromodulator in Jellyfish Synapse

  • Chung, Jun-mo;Spencert, Andrew N.
    • BMB Reports
    • /
    • v.31 no.3
    • /
    • pp.264-268
    • /
    • 1998
  • Dopamine (DA) acts on swimming motor neurons (SMNs) of Polyorchis penicillatus as an inhibitory neurotransmitter by hyperpolarizing their membrane potentials, which results from the activation of voltagesensitive potassium channels mediated through a $D_2-type$ receptor. In addition, DA, and not the hyperpolarized membrane potential, directly decreased the input resistance of SMNs by ca. 50% from 1.42 to 0.68 $G{\Omega}$. It strongly indicates that DA can shunt other excitatory synaptic signals onto SMNs where DA usually elicited much greater responses in their neurites than soma. All these evidences suggest that DA may operate in this primitive nervous system in dual modes as an inhibitory neurotransmitter and neuromodulator as well.

  • PDF

AN ACTION OF A GALOIS GROUP ON A TENSOR PRODUCT

  • Hwang, Yoon-Sung
    • Communications of the Korean Mathematical Society
    • /
    • v.20 no.4
    • /
    • pp.645-648
    • /
    • 2005
  • Let K be a Galois extension of a field F with G = Gal(K/F). Let L be an extension of F such that $K\;{\otimes}_F\;L\;=\; N_1\;{\oplus}N_2\;{\oplus}{\cdots}{\oplus}N_k$ with corresponding primitive idempotents $e_1,\;e_2,{\cdots},e_k$, where Ni's are fields. Then G acts on $\{e_1,\;e_2,{\cdots},e_k\}$ transitively and $Gal(N_1/K)\;{\cong}\;\{\sigma\;{\in}\;G\;/\;{\sigma}(e_1)\;=\;e_1\}$. And, let R be a commutative F-algebra, and let P be a prime ideal of R. Let T = $K\;{\otimes}_F\;R$, and suppose there are only finitely many prime ideals $Q_1,\;Q_2,{\cdots},Q_k$ of T with $Q_i\;{\cap}\;R\;=\;P$. Then G acts transitively on $\{Q_1,\;Q_2,{\cdots},Q_k\},\;and\;Gal(qf(T/Q_1)/qf(R/P))\;{\cong}\;\{\sigma{\in}\;G/\;{\sigma}-(Q_1)\;=\;Q_1\}$ where qf($T/Q_1$) is the quotient field of $T/Q_1$.