• Title/Summary/Keyword: Auto Play

Search Result 52, Processing Time 0.027 seconds

Design and Implementation of Reinforcement Learning Agent Using PPO Algorithim for Match 3 Gameplay (매치 3 게임 플레이를 위한 PPO 알고리즘을 이용한 강화학습 에이전트의 설계 및 구현)

  • Park, Dae-Geun;Lee, Wan-Bok
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.3
    • /
    • pp.1-6
    • /
    • 2021
  • Most of the match-3 puzzle games supports automatic play using the MCTS algorithm. However, implementing reinforcement learning agents is not an easy job because it requires both the knowledge of machine learning and the way of complex interactions within the development environment. This study proposes a method in which we can easily design reinforcement learning agents and implement game play agents by applying PPO(Proximal Policy Optimization) algorithms. And we could identify the performance was increased about 44% than the conventional method. The tools we used are the Unity 3D game engine and Unity ML SDK. The experimental result shows that agents became to learn game rules and make better strategic decisions as experiments go on. On average, the puzzle gameplay agents implemented in this study played puzzle games better than normal people. It is expected that the designed agent could be used to speed up the game level design process.

The design of communication protocol for controlling efficiently modular medical instruments (모듈화된 의료장비들의 효율적 제어를 위한 통신 프로토콜 설계)

  • 신창민;김영길
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2000.10a
    • /
    • pp.284-287
    • /
    • 2000
  • Recently, developing medical devices have a tendency becoming the module for satisfying user's mutual complex needs. Because the most effective method for the observation of patients condition a diagnosis and a treatment is collecting data from various devices and controling operation following it. Module tendency is more popular due to manage easily totally many individual systems. This study implemented communication protocol to control by one control system connecting modular medical devices. Implemented system consist of one master module controlling all module and managing communication and many Slave modules. Communication between each modules introduced SPI(Serial Peripheral Interface) among many synchronous serial communication methods for the exact transmission and receipt of data. All communication executes by packet format. This can detect error. And, this protocol introduced PNP(Plug And Play) function that auto-detect connecting or removing module during running. This protocol exactly transmitted and received in faster speed more than 1Mbps. And in practical application to the ventilator this confirmed to give and take real-time data. And various functions by th central control system is implemented in this protocol.

  • PDF

A STUDY ON CAI AUDIO SYSTEM CONTROL BY PERSONAL COMPUTER (CAI 음성 관리매체의 퍼스날 컴퓨터 제어에 관한 연구)

  • Kho, Dae-Ghon;Park, Sang-Hee
    • Proceedings of the KIEE Conference
    • /
    • 1989.07a
    • /
    • pp.486-490
    • /
    • 1989
  • In this paper, a program controlling an auto-audio media - cassette deck - by a 16 bit personal computer is studied in order to execute audio and visual learning in CAI. The results of this study are as follows. 1. Audio and visual learning is executed efficiently in CAI. 2. Access rate of voice information to text/image information is about 98% and 60% in "play" and "fast forward" respectively. 3. In "fast forward", quality of a cassette tape affects voice information access rate in propotion to motor driving speed. 4. Synchronizing signal may be mistaken by defects of tape itself.

  • PDF

Transient Remission of Myasthenia Gravis Following Leukopenia (백혈구감소증 후에 일과성으로 관해된 중증근무력증)

  • Go, Seok Min;Bae, Jong Seok;Ahn, Jin Young;Kim, Min Ky;Kim, Byoung Joon
    • Annals of Clinical Neurophysiology
    • /
    • v.8 no.2
    • /
    • pp.182-185
    • /
    • 2006
  • Various immunotherapeutic modalities have been used based on the autoimmune pathogenic mechanisms of myasthenia gravis (MG). Cell-mediated immunity as well as auto-antibodies may play a role in the remission and relapse of MG. We recently experienced two patients with MG who showed spontaneous remission after inadvertent severe leukopenia. These findings suggest that the cell-mediated immune process is important in the treatment of MG, and selective suppression of leukocyte may induce remission in the patients with intractable MG.

  • PDF

An Experimental Study of Fire Suppression Using a Water Mist in a Compartment (물분무를 이용한 화재제어에 관한 실험적 연구)

  • Kim, Sung-Chan;Park, Hyun-Tae;Ryou, Hong-Sun
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.27 no.3
    • /
    • pp.367-373
    • /
    • 2003
  • The present study investigates the fire suppression characteristics using a water mist fire suppression system. The fire extinguishing times are measured for various fire sources, fuel types, and different total flooding rates of water mist. Pool fire with hydrocabon fuel is successfully extinguished within a minute under the operating conditions of the water mist system. Two different regimes of the smoke layer cooling are observed, such as rapid and slow cooling processes. The regimes are divided by threshold time which is calculated with auto-correlation function. The threshold time for the initial cooling decreases with increasing water flow-rates and fire sources. These initial cooling effects play an important role in preventing the occurance of flashover fire by the initial fire suppression.

Development Direction for Game Industry Development (게임산업 발전을 위한 개발방향 제안)

  • Han, Sang-Beom;Oh, Hyoun-Ju
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2017.07a
    • /
    • pp.89-92
    • /
    • 2017
  • This study critically analyzes the present situation of the domestic game industry that infringes game nature or diversity, which is the essence of game contents such as copycat, auto play, excessive billing inducement, indiscriminate advertisement developed by focusing on commercial aspect, It suggests the necessity of creative and various game development environment. It suggests development direction for the development of domestic game industry through game case analysis which shows the possibility of game media out of existing success formula and does not concentrate only on commerciality and makes effort to give new fun to users.

  • PDF

Effect of Pre-Aging Conditions on Bake-Hardening Response of Al-0.4 wt%Mg-1.2 wt%Si-0.1 wt%Mn Alloy Sheets

  • Lee, Kwang-jin;Woo, Kee-do
    • Korean Journal of Metals and Materials
    • /
    • v.49 no.6
    • /
    • pp.448-453
    • /
    • 2011
  • Pre-aging heat treatment after solution heat treatment (SHT) of Al-0.4 wt%Mg-1.2 wt%Si-0.1 wt%Mn alloy sheets for auto-bodies was carried out to investigate the effect of pre-aging and its conditions on the bake-hardening response. Mechanical properties were evaluated by a tensile and Vickers hardness test. Microstructural observation was also performed using a transmission electron microscope (TEM). It was revealed that pre-aging treatments play a great role in the bake-hardening response. In addition, it was found that the sphere-shaped nanosized clusters that can directly transit to the needle-shaped ${\beta}$" phase during the paint-bake process, not being dissolved into the matrix, are formed at 343 K. The result, reveals that the dominant factor of the bake-hardening response is the pre-aging temperature rather than the pre-aging time.

A study on the factors affecting to material inflow in the drawing process (드로잉 공정에서 소재 유입에 영향을 미치는 인자에 관한 연구)

  • Lee, Sung-Min;Shin, Jin-Hee;Kim, Kyung-A;Lee, Chun-Kyn
    • Design & Manufacturing
    • /
    • v.16 no.2
    • /
    • pp.39-45
    • /
    • 2022
  • Sheet Metal Forming by Press Forming Process takes a lot of time and cost from mold design to manufacturing. Therefore, all of die-makers are continuously conducting research to reduce the number of mold processes or the size of blanks to reduce costs. In the case of Forming complex shapes such as automobile component, wrinkles and cracks occur, so draw beads are used. Draw beads play an important role in suppressing the inflow of materials and minimizing the size of blanks. Factors that affect material flow include draw bead, blank holding pressure, lubricant, and surface roughness of punch and die. Most of the factors affect friction. In this study, after classifying circular beads and rectangular beads in cylindrical drawing molds using the AutoForm analysis program, the factors affecting the material inflow were considered.

Study on Undergraduate-Driven Autonomous Vehicle Competition (대학생 자율주행자동차 경진항목 연구)

  • Choi, Gyeung Ho;Lee, Jae-Cheon;Ahn, Sang Ho;Cho, Kwang Sang;Oh, Youkeun
    • Journal of Auto-vehicle Safety Association
    • /
    • v.9 no.4
    • /
    • pp.26-31
    • /
    • 2017
  • The current autonomous vehicle competitions are dominated by a few leading research institutions and universities. Since the leading research groups have been able to accumulate their knowledge and to develop their own algorithms for autonomous vehicle for many years, the technology gap seems too big for other followers to catch up with. On the other hand, recent researches predict that there would be a sharp rise in demand for engineers with background in autonomous vehicle technology. Therefore, it would be warranted to further expand the base of the academia and autonomous vehicle industry. In an effort to achieve this goal, it would be beneficial to hold a new format of autonomous vehicle competition event where undergraduate students can play a leading role. So, this study is to analyze the current autonomous vehicle competitions and thus to establish a strategic plan to develop a unique and improved competition event. This study investigates the pros and cons of the domestic and international autonomous vehicle competitions. Based on the analysis for the current autonomous vehicle competitions, the authors suggest a strategic plan to initiate an autonomous vehicle competition. To implement the aforementioned strategic plan, it is necessary to develop a systematic environment where the education and communication are actively available. Through the strategic plan the authors propose, the newly launching autonomous vehicle competition will able to encourage the undergraduate students and professors to dive in the cutting-edge technology thereby increasing technology competitiveness.

A Study on the Seoul Apartment Jeonse Price after the Global Financial Crisis in 2008 in the Frame of Vecter Auto Regressive Model(VAR) (VAR분석을 활용한 금융위기 이후 서울 아파트 전세가격 변화)

  • Kim, Hyun-woo;Lee, Du-Heon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.9
    • /
    • pp.6315-6324
    • /
    • 2015
  • This study analyses the effects of household finances on rental price of apartment in Seoul which play a major role in real estate policy. We estimate VAR models using time series data. Economy variables such as sales price of apartment in Seoul, consumer price index, hiring rate, real GNI and loan amount of housing mortgage, which relate to household finances and influence the rental price of apartment, are used for estimation. The main findings are as follows. In the short term, the rental price of apartment is impacted by economy variables. Specifically, Relative contributions of variation in rental price of apartment through structural shock of economy variables are most influenced by their own. However, in the long term, household variables are more influential to the rental price of apartment. These results are expected to contribute to establish housing price stabilization policies through understanding the relationship between economy variables and rental price of apartment.