• Title/Summary/Keyword: 롤운동

Search Result 64, Processing Time 0.031 seconds

Reinforcement Learning based on Deep Deterministic Policy Gradient for Roll Control of Underwater Vehicle (수중운동체의 롤 제어를 위한 Deep Deterministic Policy Gradient 기반 강화학습)

  • Kim, Su Yong;Hwang, Yeon Geol;Moon, Sung Woong
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.24 no.5
    • /
    • pp.558-568
    • /
    • 2021
  • The existing underwater vehicle controller design is applied by linearizing the nonlinear dynamics model to a specific motion section. Since the linear controller has unstable control performance in a transient state, various studies have been conducted to overcome this problem. Recently, there have been studies to improve the control performance in the transient state by using reinforcement learning. Reinforcement learning can be largely divided into value-based reinforcement learning and policy-based reinforcement learning. In this paper, we propose the roll controller of underwater vehicle based on Deep Deterministic Policy Gradient(DDPG) that learns the control policy and can show stable control performance in various situations and environments. The performance of the proposed DDPG based roll controller was verified through simulation and compared with the existing PID and DQN with Normalized Advantage Functions based roll controllers.

Roll control of Underwater Vehicle based Reinforcement Learning using Advantage Actor-Critic (Advantage Actor-Critic 강화학습 기반 수중운동체의 롤 제어)

  • Lee, Byungjun
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.24 no.1
    • /
    • pp.123-132
    • /
    • 2021
  • In order for the underwater vehicle to perform various tasks, it is important to control the depth, course, and roll of the underwater vehicle. To design such a controller, it is necessary to construct a dynamic model of the underwater vehicle and select the appropriate hydrodynamic coefficients. For the controller design, since the dynamic model is linearized assuming a limited operating range, the control performance in the steady state is well satisfied, but the control performance in the transient state may be unstable. In this paper, in order to overcome the problems of the existing controller design, we propose a A2C(Advantage Actor-Critic) based roll controller for underwater vehicle with stable learning performance in a continuous space among reinforcement learning methods that can be learned through rewards for actions. The performance of the proposed A2C based roll controller is verified through simulation and compared with PID and Dueling DDQN based roll controllers.

Roll Motion Analysis of a 3 D.O.F. Planar Car Model using Instantaneous Centers (순간중심을 이용한 평면 3 자유도 자동차 모델의 롤 운동 해석)

  • Lee, Jae-Kil;Shim, Jae-Kyung
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.14 no.4
    • /
    • pp.92-98
    • /
    • 2006
  • In this paper, a planar car model with 3 degrees of freedom was analyzed using the concept of the roll center. To avoid ambiguity, force components which require experimental data were excluded. Only kinematic approach was used to find the position and orientation of the vehicle body and the position of the roll center. The roll center was found by the pole with infinitesimal movement and Kennedy-Aronhold theorem. Centrodes, which are the loci of instantaneous centers of planar motion, were constructed with analyzed results to show characteristics of vehicle body motion. To verify the presented analysis method in this paper, the locus of the roll center and the motion of a 3 D.O.F. planar car model were compared with those of the 1 D.O.F. model.

Enhancement of Roll Stability by Speed-Adaptive Robust Control (속도감은 강건제어에 의한 롤 운동 특성개선)

  • Kim, Hyo-Jun;Park, Yeong-Pil
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.18 no.4
    • /
    • pp.167-175
    • /
    • 2001
  • This paper presents design of active roll controller of a vehicle and experimental study using the electric actuating roll control system. Firstly, parameter sensitivity analysis is performed based on 3DOF linear vehicle model. The controller is designed in the frame work of gain-scheduled H$\infty$ control scheme considering the varying parameters induced by laden and running vehicle condition. In order to investigate a feasibility of an active control system, experimental work is performed using hardware-in-the -loop setup which has been constructed by the devised electric actuating system and the full vehicle model with tire characteristics. The performance is evaluated by experiment using hardware-in-the -loop simulation under the conditions of some steer maneuvers and parameter variations.

  • PDF

Development of a profile measuring system for conductor roll (전기도금 롤의 형상 측정시스템 개발)

  • Choi, Yong-Jun;Jun, Sung-Bai;Lee, Eung-Suk;Kim, Hyo-Sung;Jang, Ji-Soo
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.21 no.10
    • /
    • pp.1730-1741
    • /
    • 1997
  • In this paper, we developed a surface profile measuring system and a profile measuring software for EGL conductor roll. For the profilemeter, we designed a linear guided control system with Laser displacement sensors and developed a 3-dimensional software. Additionally, the AC motor and AC motor driver were used to control the precise position of linear guide system. The measuring principle of the Laser sensor is optical triangulation method. Also, two Laser sensors were used to remove the disturbance and vibration effects of the linear guide system.

Driving Torque Analysis of Role Driving & Wrapping Arm Rotation Type Round Bale Wrapper (롤 구동 래핑암 회전식 원형베일래퍼의 구동 토크 분석)

  • Yu B. K;Kim H. J.;Oh K. Y.;Choe K. J.;Lee S. H.;Park H. J.;Kim B. K.
    • Journal of Animal Environmental Science
    • /
    • v.11 no.1
    • /
    • pp.11-16
    • /
    • 2005
  • The round bale wrappers are generally used for rice straw after the harvesting of low land rice by combine harvester. In this situation, the bale wrappers should be well adapted under the travelling over raised borders and temporary ditches in soft soil of narrow rice fields. The study was conducted to improve the performance of bale wrapper through the new design for compact size, lowered gravity center and lowered power consumption. The prototype of round bale wrapper had been designed and assembled to tractor with three point hitch mounted. The machine type is one roll driving system with one roll for rotating and one roll for wrapping. The driving torque and work performance of the machines were measured and analysed. The torque requirement of the prototype and conventional type was 6kgf-m and 12kgf-m, respectively. The prototype shaved less friction resistance between bale driving roll and round bale. and the power requirement can also be reduced from 12kgf-m in the conventional to 6kgf-m in the prototype. The work efficiency of the new bale wrapper was $45\%$ higher than the conventional wrapper, and the working cost of the prototype can be reduced $17\%$ than that of the conventional.

  • PDF

Roll/Yaw Momentum Management Method of Pitch Momentum Biased Spacecraft (피치 모멘텀 바이어스 위성시스템의 롤/요축 모멘텀 제어방식)

  • Rhee, Seung-Wu;Ko, Hyun-Chul;Jang, Woo-Young;Son, Jun-Won
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.37 no.7
    • /
    • pp.669-677
    • /
    • 2009
  • In general, the pitch momentum biased system that induces inherently nutational motion in roll/yaw plane, has been adapted for geosynchronous communications satellites. This paper discusses the method of roll attitude control using yaw axis momentum management method for a low earth orbit(LEO) satellite which is a pitch momentum biased system equipped with only two reaction wheels. The robustness of wheel momentum management method with PI-controller is investigated comparing with wheel torque control method. The transfer function of roll/yaw axis momentum management system that is useful for attitude controller design is derived. The disturbance effect of roll/yaw axis momentum management system for attitude control is investigated to identify design parameters such as magnitude of momentum bias and to get the insight for controller design. As an example, the PID controller design result of momentum management system for roll/yaw axis control is provided and the simulation results are presented to provide further physical insight into the momentum management system.

Implementation of 3D Motion Simulator with Two Degrees of Freedom (2자유도를 갖는 3차원 운동 시뮬레이터 연구)

  • Choi, Myoung-Hwan;Kim, Young-Jin
    • Journal of Industrial Technology
    • /
    • v.21 no.A
    • /
    • pp.81-88
    • /
    • 2001
  • In this work, we have developed a 2 degrees of freedom(DOF) motion simulator that can generate the sensation of motion in a 6 DOF space. The motion base has the DOF of roll and pitch, and the purpose of the motion base is to create the sensation of riding a vehicle in a 3D space by controlling the motion base. The dynamics of the mechanism was analysed and the optimal design of the motion base mechanism has been reached. The prototype motion base mechanism was developed and tested. The multi-axis motion controller(MMC) was used to control the two AC servo meters that drive the roll and pitch motion.

  • PDF

Vehicle Dynamic Characteristics according to the Coherence of Road Roughness between Left and Right Wheels (좌우 바퀴 노면 거칠기 상관도가 차량 운동 특성에 미치는 영향)

  • Choi, Gyoo-Jae;Jang, Bong-Choon
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.14 no.6
    • /
    • pp.120-126
    • /
    • 2006
  • Vehicle dynamic simulation has been carried out using the coherence of road roughness between left and right wheels. The generated twin tracks with the coherence of road roughness between left and right wheels are in good agreements with the measured coherence relation of left and right wheels. And these tracks reflect well on the roughness characteristics of real roads. Using the generated roads and multibody dynamic simulation program, vehicle dynamic simulation is performed. The vertical and roll motion analysis of a vehicle are carried out using the realistic road profiles with the coherence between left and right wheels and the results are in good agreements with the dynamic characteristics of a vehicle.

Prediction of Pitch and Roll Dynamic Derivatives for Flight Vehicle using CFD (전산유체역학을 이용한 비행체의 피치와 롤 동안정 미계수 예측)

  • Lee, Hyung-Ro;Gong, Hyo-Joon;Kim, Beom-Soo;Lee, Seung-Soo
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.40 no.5
    • /
    • pp.395-404
    • /
    • 2012
  • This paper presents computations of the dynamic derivatives of three dimensional flight vehicle configurations using CFD. The pitch dynamic derivatives are computed from the pitch sinusoidal motion, while the roll damping is computed based on steady state calculation using a non-inertial frame method. The Basic Finner and the SDM(Standard Dynamic Model) are chosen for the benchmark tests against other numerical and experimental results. For the flow calculations, a 3-D Euler solver that can be run both on the non-inertial frame and on the inertial frame is developed. A dual-time stepping method is applied for the unsteady time accurate simulations. A good agreement of pitch-roll dynamic derivatives with previously published numerical results and the experimental results is observed.