• Title/Summary/Keyword: machine design

Search Result 4,528, Processing Time 0.028 seconds

Design and implementation of Robot Soccer Agent Based on Reinforcement Learning (강화 학습에 기초한 로봇 축구 에이전트의 설계 및 구현)

  • Kim, In-Cheol
    • The KIPS Transactions:PartB
    • /
    • v.9B no.2
    • /
    • pp.139-146
    • /
    • 2002
  • The robot soccer simulation game is a dynamic multi-agent environment. In this paper we suggest a new reinforcement learning approach to each agent's dynamic positioning in such dynamic environment. Reinforcement learning is the machine learning in which an agent learns from indirect, delayed reward an optimal policy to choose sequences of actions that produce the greatest cumulative reward. Therefore the reinforcement learning is different from supervised learning in the sense that there is no presentation of input-output pairs as training examples. Furthermore, model-free reinforcement learning algorithms like Q-learning do not require defining or learning any models of the surrounding environment. Nevertheless these algorithms can learn the optimal policy if the agent can visit every state-action pair infinitely. However, the biggest problem of monolithic reinforcement learning is that its straightforward applications do not successfully scale up to more complex environments due to the intractable large space of states. In order to address this problem, we suggest Adaptive Mediation-based Modular Q-Learning (AMMQL) as an improvement of the existing Modular Q-Learning (MQL). While simple modular Q-learning combines the results from each learning module in a fixed way, AMMQL combines them in a more flexible way by assigning different weight to each module according to its contribution to rewards. Therefore in addition to resolving the problem of large state space effectively, AMMQL can show higher adaptability to environmental changes than pure MQL. In this paper we use the AMMQL algorithn as a learning method for dynamic positioning of the robot soccer agent, and implement a robot soccer agent system called Cogitoniks.

COMPARISON OF RIGIDITY AND CASTABILITY IN DIFFERENT DESIGNS OF MAXILLARY MAJOR TITANIUM FRAMEWORK (타이타늄 상악 주연결장치에 디자인에 따른 주조성 및 견고성 비교)

  • Lee, Young-Jae;Vang, Mong-Sook;Yang, Hong-So;Park, Sang-Won;Park, Ha-Ok;Lim, Hyun-Pil
    • The Journal of Korean Academy of Prosthodontics
    • /
    • v.45 no.4
    • /
    • pp.431-443
    • /
    • 2007
  • Statement of problem: Injuries along with discomfort may result on the oral mucosa when non-rigid material is used as the major connector in construction of RPD, since nonrigid major connectors transmit unstable forces throughout the appliance. Titanium which recently draws attention as a substitute of Co-Cr had a difficulty in fabricating due to high melting temperature but the development of casting technique makes it possible to apply to the clinical case. Purpose: The purpose of this study was to investigate the rigidity and the castability of titanium upper major connector by design and make a comparison with Co-Cr major connectors which are widely used in clinical cases now. Material and methods: Casting was done using CP-Ti(Grage 2) (Kobe still Co., Japan) for the experimental groups, and 4 various designs namely palatal strap, U-shaped bar, A-P strap, and complete palatal plate were casted and 5 of each designs were included in each group. For the experimental group, Universal testing machine (Model 4502; Instron, Canton, Mass) was used to apply vertical torsional force vertically to the horizontal plane of major connector. In the second experiment, Vertical compressive force was applied to the horizontal plane of major connector. As a comparative group, Co-Cr major connector was equally manufactured and underwent the same experimental procedures Strain rate was measured after constant loading for one minute duration, and statistical analysis was done with SPSS ver.10.0 for WIN(SPSS. Inc. USA). From the one-way ANOVA and variance analysis (P=0.05), Scheffe's multiple comparison test implemented. Results: 1. Least amount of strain was observed with complete palatal plate followed by A-P bar, palatal bar, and the U-shaped bar having most amount of strain. 2. In all designs of titanium major connector, less strain rate was observed under compressive loading than under torsional loading showing more resistance to lateral force. 3. For titanium major connector, less strain rate was observed when the force is applied to the first premolar area rather than to the second molar area indicating more strength with shorter length of lever. 4. In Comparison of Co-Cr major connector with titanium major connector, palatal strap and U-shaped bar designs showed higher strength under torsional force that is statically significant, and under compressive force, no significant difference was observed expert for U-shaped bar. 5. In titanium major connector, complete palatal plate showed lowest success rate in casting when compared with the Co-Cr major connector. Conclusion: Above results prove that when using titanium for major connector, only with designs capable of generating rigidity can the major connector have almost equal amount of rigidity as Co-Cr major connector and show lower success rate in casting when compared with the Co-Cr major connector.

Particle Characteristics of Flame-Synthesized γ-Al2O3 Nanoparticles (화염법으로 제조된 감마-Al2O3 나노입자의 화염조건에 따른 입자특성 연구)

  • Lee, Gyo-Woo
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.36 no.5
    • /
    • pp.509-515
    • /
    • 2012
  • In this study, ${\gamma}-Al_2O_3$ nanoparticles were synthesized by using coflow hydrogen diffusion flames. The synthesis conditions were varied with using several oxygen concentrations in the oxidizing air. The particle characteristics of the flame-synthesized $Al_2O_3$ nanoparticles were determined by examining the crystalline structure, shape, and specific surface area of the nanoparticles. The measured maximum centerline temperature of the flames ranged from 1507.8 K to 1998.7 K. The morphology and crystal structure of the $Al_2O_3$ nanoparticles were determined from SEM images and XRD analyses, respectively. The particle sizes were calculated from measured BET specific surface areas and ranged from 25 nm to 52 nm. From XRD analyses, it was inferred that a large number of the synthesized nanoparticles were ${\gamma}-Al_2O_3$ nanoparticles including ${\theta}-Al_2O_3$ nanoparticles.

A preliminary study on the optimum excavation sequence of a room-and-pillar underground structure (주방식 지하구조물의 최적 굴착공정에 대한 예비 분석 연구)

  • Lee, Chulho;Choi, Soon-Wook;Hyun, Younghwan;Hwang, Jedon;Chang, Soo-Ho
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.17 no.4
    • /
    • pp.499-511
    • /
    • 2015
  • A room-and-pillar underground structure is characterized by its grid-type array of galleries. As a result, its construction and economical efficiency can be governed by excavation sequence of galleries. Therefore, this study aims to study the optimum excavation scheme of a room-and-pillar underground structure by considering its various design factors such as ground conditions and excavation sequences. Drill-and-blast method is assumed as a excavation method for a room-and-pillar underground structure. In addition, two kinds of excavation patterns corresponding to a concurrent and a sequential excavation patterns are considered in this study. For the assumed conditions, the structural stability and the construction efficiency based on the number of faces and the travel distance of a jumbo drilling machine are analyzed for the two excavation patterns. Even though the two kinds of excavation patterns show almost the same structural stability as each other, the concurrent excavation pattern is relatively preferable to the sequential excavation pattern in terms of the number of faces in operation and travel distance of a drilling jumbo.

A numerical study on the optimum spacing of disc cutters considering rock strength and penetration depth using discrete element method (암반강도 및 압입깊이에 따른 디스크커터의 최적간격 산정을 위한 개별요소법 기반 수치해석 연구)

  • Lee, Sang Yun;Song, Ki-il;Jung, Ju Hwan
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.22 no.4
    • /
    • pp.383-399
    • /
    • 2020
  • Optimizing the spacing of the disc cutter is a key element in the design of the TBM cutter head, which determines the drilling performance of the TBM. The full-scale linear cutting test is known as the most reliable and accurate test for calculating the spacing of the disc cutter, but it has the disadvantage of costly and time-consuming for the full-scale experiment. In this study, through the numerical analysis study based on the discrete element method, the tendency between Specific Energy-S/P ratio according to uniaxial compression strength and penetration depth of rock was analyzed, and the optimum spacing of 17-inch disc cutter was derived. To examine the appropriateness of the numerical analysis model, the rolling force acting on the disc cutter was compared and reviewed with the CSM model. As a result of numerical analysis for the linear cutting test, the rolling force acting on the disc cutter was analyzed to be similar to the rolling force derived from the theoretical formula of the CSM model. From the numerical analysis on 5 UCS cases (50 MPa, 70 MPa, 100 MPa, 150 MPa, 200 MPa), it is found that the range of the optimum spacing of the disc cutter decreases as the rock strength increases. And it can be concluded that 80~100 mm of disc cutter spacing is the optimum range having minimum specific energy regardless of rock strength. This tends to coincide with the optimal spacing of previously reported disk cutters, which underpins the disk cutter spacing calculated through this study.

Low-Gate-Count 32-Bit 2/3-Stage Pipelined Processor Design (소면적 32-bit 2/3단 파이프라인 프로세서 설계)

  • Lee, Kwang-Min;Park, Sungkyung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.53 no.4
    • /
    • pp.59-67
    • /
    • 2016
  • With the enhancement of built-in communication capabilities in various meters and wearable devices, which implies Internet of things (IoT), the demand of small-area embedded processors has increased. In this paper, we introduce a small-area 32-bit pipelined processor, Juno, which is available in the field of IoT. Juno is an EISC (Extendable Instruction Set Computer) machine and has a 2/3-stage pipeline structure to reduce the data dependency of the pipeline. It has a simple pipeline controller which only controls the program counter (PC) and two pipeline registers. It offers $32{\times}32=64$ multiplication, 64/32=32 division, $32{\times}32+64=64$ MAC (multiply and accumulate) operations together with 32*32=64 Galois field multiplication operation for encryption processing in wireless communications. It provides selective inclusion of these algebraic logic blocks if necessary in order to reduce the area of the overall processor. In this case, the gate count of our integer core amounts to 12k~22k and has a performance of 0.57 DMIPS/MHz and 1.024 Coremark/MHz.

A Simulation Study for Evaluation of Alternative Plans and Making the Upper-limit for Improvement in Productivity of Flow-shop with Considering a Work-wait Time (흐름생산 공정에서의 작업 대기시간을 고려한 공정 개선 상한선 도출 : H사의 공정 개선 계획안 시뮬레이션 사례를 중심으로)

  • Song, Young-Joo;Woo, Jong-Hun;Lee, Don-Kun;Shin, Jong-Gye
    • Journal of the Korea Society for Simulation
    • /
    • v.17 no.2
    • /
    • pp.63-74
    • /
    • 2008
  • The design of best efficient production process is common requirements of the production strategy department and the process planning department to maximize the revenue and accomplish target production volumes in the production periods. And they use several general methods for that-line-balancing, removing of the bottle-neck process, facility ramp-up, increasing of the worker's utilization, etc. But, those methods have depended on analytic, static and arithmetic calculations, yet. So, irregular work-waiting time causing the delay time isn't include in extracting production capacity, especially in the line production process. The work-waiting time is changed irregularly along the variation of each machine and very important for calculate real product lead-time and forecasting target production volumes. At this thesis, i'm going to mention the importance of the delay time of conveyor system which can be extracted by discrete-event simulation. And suggest it as a new main variable that must be considered at designing new production system. Then experimented and tested that's effects in the H-company case, conveyor based line production process.

  • PDF

A Study on the Wear Characteristics of Aluminizing Steel ( 1 ) - Wear in Run-in Period on Rolling-Sliding Contact - (알루미나이징 강의 마모특성에 관한 연구 ( 1 ) - Rolling-Sliding 마찰의 초기마모영역을 중심으로 -)

  • 이규용
    • Journal of the Korean Society of Fisheries and Ocean Technology
    • /
    • v.14 no.2
    • /
    • pp.69-78
    • /
    • 1978
  • It is well known that the aluminizing steel is excellent in corrosion resistance and heat resistance. Therefore it has been used as boiler parts, heat exchanger parts and guide rails which are used under comparatively simple conditions. Recently, it has been noticed that aluminizing steel has high resistance to various atmosphere, high temperature oxidation and seawater resistance. So its usage has been extended widely to the production of parts such as intake and exhaust valve of internal combustion engine, turbine blade and pipelines On ships which required such properties. It is considered that aluminium coated steel is excellent in wear resistance because of high hardness on main ingredient FezAIs of Fe-AI alloy layer existed in diffusion coating layer. And it will beused as a new material taking wear resitance with seawater resistance in marine field. However it is difficult to findout any report concering the wear behaviors or properties of alum in izing steel. In this study the experiment was carried out under the condition of rolling-sliding contact using an Amsler-type wear testing machine at 0.80, 0.91, 1. 10, 1. 25% of slip ratio and 55.43, 78.38, 110.85 kg/mm^2 of Hertz's contact stress in run-in period for the purpose of service-ability test of aluminizing steel as a wear resisting material and obtaining the available design data. The followings are the obtained results from the experimen tal study; 1) The 2nd diffusion material has most excellent wear resistance. This material has brought out about 18% decrease of wear weight in a lower friction load level and 40~G decrease in a higher level comparing to the raw material. 2) Satisfactory effect of wear resistivity cannot be much expected in 2nd diffusion specimens. This is considered due to the formation of fine void in the alloy layer near the boundary to the aluminium layer. 3) Fracture on friction surface of aluminizing steel by the rolling-sliding contact is spalling, and spalling crack occurres initially beneath the specimen surface near the boundary in diffusion coating layer.

  • PDF

Forensic Decision of Median Filtering Image Using a Coefficient of Variation of Fourier Transform (Fourier 변환 변이계수를 이용한 미디언 필터링 영상의 포렌식 판정)

  • RHEE, Kang Hyeon
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.8
    • /
    • pp.67-73
    • /
    • 2015
  • In a distribution of digital image, there is a serious problem that is the image alteration by a forger. For the problem solution, this paper proposes the forensic decision algorithm of a median filtering (MF) image using the feature vector based on a coefficient of variation (c.v.) of Fourier transform. In the proposed algorithm, we compute Fourier transform (FT) coefficients of row and column line respectively of an image first, then c.v. between neighboring lines is computed. Subsquently, 10 Dim. feature vector is defined for the MF detection. On the experiment of MF detection, the proposed scheme is compared to MFR (Median Filter Residual) and Rhee's MF detection schemes that have the same 10 Dim. feature vector both. As a result, the performance is excellent at Unaltered, JPEG (QF=90), Down scaling (0.9) and Up scaling (1.1) images, and it showed good performance at Gaussian filtering ($3{\times}3$) image. However, in the performance evaluation of all measured items of the proposed scheme, AUC (Area Under ROC (Receiver Operating Characteristic) Curve) by the sensitivity and 1-specificity approached to 1 thus, it is confirmed that the grade of the performance evaluation is rated as 'Excellent (A)'.

In Vitro Study on the Initial Stability of Two Tapered Dental Implant Systems in Poor Bone Quality (연질 골에서 두 종류의 테이퍼 형태 임플란트의 초기 안정성에 관한 실험실적 연구)

  • Kim, Duck-Rae;Kim, Myung-Joo;Kwon, Ho-Beom;Lee, Seok-Hyung;Lim, Young-Jun
    • Journal of Dental Rehabilitation and Applied Science
    • /
    • v.25 no.4
    • /
    • pp.391-401
    • /
    • 2009
  • The successful outcome of dental implants is mainly the result of intial implant stability following placement. The aim of this study was to investigate the effect of a self-tapping blades and implant design on initial stability of two tapered implant systems in poor bone quality. The two different implant systems included one with self-tapping blades and one without self-tapping blades. D4 bone model using Solid Rigid Polyurethane Form was used to simulate poor bone densities. The insertion torque during implant placement was recorded. Resonance frequency Analysis (RFA), measured as the implant stability quotient (ISQ), was assessed immediately after insertion. Finally, the implant-bone specimen was transferred to an Universal Testing Machine to measure the axial pull-out force. Insertion torque values and maximum pull-out torque value of the non self-tapping implants were significantly higher than those in the self-tapping group (P = 0.008). No statistically differences were noted between the two implant designs in RFA. Within the each implant system, no correlation among insertion torque, maximum pull-out torque and RFA value could be determined. Higher insertion torque of the non-self-tapping implants appeared to confirm higher clinical initial stability. In conclusion, implants without self-tapping blades have higher initial stability than implants with self-tapping blades in poor bone quality.