• Title/Summary/Keyword: learning trajectory

Search Result 252, Processing Time 0.028 seconds

Exponential Convergence of A Learning Scheme for Unknown Linear Systems

  • Kuc, Tae-yong;Lee, Jin-Soo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1992.10b
    • /
    • pp.550-554
    • /
    • 1992
  • In this paper the issue of convergence rate is introduced for a learning control scheme we have developed and applied for tracking of unknown linear systems. A sufficient condition under which the output trajectory converges exponentially fast is obtained using the controllability grammian of controllable linear systems. Under the same condition it is also shown that the learning control input converges exponentially with the same rate as the rate of output convergence. A numerical example with computer simulation results is presented to show the feasibility of the scheme.

  • PDF

Variational Autoencoder-based Assembly Feature Extraction Network for Rapid Learning of Reinforcement Learning (강화학습의 신속한 학습을 위한 변이형 오토인코더 기반의 조립 특징 추출 네트워크)

  • Jun-Wan Yun;Minwoo Na;Jae-Bok Song
    • The Journal of Korea Robotics Society
    • /
    • v.18 no.3
    • /
    • pp.352-357
    • /
    • 2023
  • Since robotic assembly in an unstructured environment is very difficult with existing control methods, studies using artificial intelligence such as reinforcement learning have been conducted. However, since long-time operation of a robot for learning in the real environment adversely affects the robot, so a method to shorten the learning time is needed. To this end, a method based on a pre-trained neural network was proposed in this study. This method showed a learning speed about 3 times than the existing methods, and the stability of reward during learning was also increased. Furthermore, it can generate a more optimal policy than not using a pre-trained neural network. Using the proposed reinforcement learning-based assembly trajectory generator, 100 attempts were made to assemble the power connector within a random error of 4.53 mm in width and 3.13 mm in length, resulting in 100 successes.

Improving Orbit Determination Precision of Satellite Optical Observation Data Using Deep Learning (심층 학습을 이용한 인공위성 광학 관측 데이터의 궤도결정 정밀도 향상)

  • Hyeon-man Yun;Chan-Ho Kim;In-Soo Choi;Soung-Sub Lee
    • Journal of Advanced Navigation Technology
    • /
    • v.28 no.3
    • /
    • pp.262-271
    • /
    • 2024
  • In this paper, by applying deep learning, one of the A.I. techniques, through angle information, which is optical observation data generated when observing satellites at observatories, distance information from observatories is learned to predict range data, thereby increasing the precision of satellite's orbit determination. To this end, we generated observational data from GMAT, reduced the learning data error of deep learning through preprocessing of the generated observational data, and conducted deep learning through MATLAB. Based on the predicted distance information from learning, trajectory determination was performed using an extended Kalman filter, one of the filtering techniques for trajectory determination, through GMAT. The reliability of the model was verified by comparing and analyzing the orbital determination with angular information without distance information and the orbital determination result with predicted distance information from the model.

Determining Whether to Enter a Hazardous Area Using Pedestrian Trajectory Prediction Techniques and Improving the Training of Small Models with Knowledge Distillation (보행자 경로 예측 기법을 이용한 위험구역 진입 여부 결정과 Knowledge Distillation을 이용한 작은 모델 학습 개선)

  • Choi, In-Kyu;Lee, Young Han;Song, Hyok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.9
    • /
    • pp.1244-1253
    • /
    • 2021
  • In this paper, we propose a method for predicting in advance whether pedestrians will enter the hazardous area after the current time using the pedestrian trajectory prediction method and an efficient simplification method of the trajectory prediction network. In addition, we propose a method to apply KD(Knowledge Distillation) to a small network for real-time operation in an embedded environment. Using the correlation between predicted future paths and hazard zones, we determined whether to enter or not, and applied efficient KD when learning small networks to minimize performance degradation. Experimentally, it was confirmed that the model applied with the simplification method proposed improved the speed by 37.49% compared to the existing model, but led to a slight decrease in accuracy. As a result of learning a small network with an initial accuracy of 91.43% using KD, It was confirmed that it has improved accuracy of 94.76%.

Sociomathematical Norms of Elementary School Classrooms: Crossnational Perspectives between Korea and U .S. on Challenges of Reform in Mathematics Teaching (초등학교 수학교실의 사회수학적 규범: 수학 지도에서의 개혁상의 문제에 대한 한국과 미국의 관점 비교)

  • ;David Kirshner
    • Education of Primary School Mathematics
    • /
    • v.3 no.1
    • /
    • pp.1-36
    • /
    • 1999
  • The case of four classrooms analyzed in this study point to many commonalities in the challenges of reforming mathematics teaching in Korea and the U. S. In both national contexts we have seen the need fur a clear distinction between implementing new student-centered social practices in the classroom, and providing significant new loaming opportunities for students. In particular, there is an important need to distinguish between attending to the social practices of the classroom and attending to students conceptual development within those social practices. In both countries, teachers in the less successful student-centered classes tended to abdicate responsibility fur sense making to the students. They were more inclined to attend to the literal statements of their students without analyzing their conceptual understanding (Episodes KA5 and UP 2). This is easy to do when the rhetoric of reform emphasizes student-centered social practices without sufficient attention to psychological correlates of those social practices. The more successful teachers tended to monitor the understanding of the students and to take proactive measures to ensure the development of that understanding (Episodes KO5 and UN3). This suggests the usefulness of constructivism as a model (or successful student-centered instruction. As Simon(1995) observed, constructivist teachers envision a hypothetical learning trajectory that constitutes their plan and expectation for students learning from the particular if the trajectory is being followed. If not, the teacher adjusts or supplements the task to obtain a more satisfactory result, or reconsider her or his assumptions concerning the hypothetical learning trajectory. In this way, the teacher acts proactively to try to ensure that students are progressing in their understanding in particular ways. Thus the more successful student-centered teacher of this study can be seen as constructivist in their orientation to student conceptual development, in comparison to the less successful student-centered teachers. It is encumbant on the authors of reform in Korea and the U. S. to make sure that reform is not trivialized, or evaluated only on the surface of classroom practices. The commonalities of the two reform endeavores suggest that Korea and the U. S. have much to share with each other in the challenges of reforming mathematics teaching for the new millennium.

  • PDF

3D Ultrasound Panoramic Image Reconstruction using Deep Learning (딥러닝을 활용한 3차원 초음파 파노라마 영상 복원)

  • SiYeoul Lee;Seonho Kim;Dongeon Lee;ChunSu Park;MinWoo Kim
    • Journal of Biomedical Engineering Research
    • /
    • v.44 no.4
    • /
    • pp.255-263
    • /
    • 2023
  • Clinical ultrasound (US) is a widely used imaging modality with various clinical applications. However, capturing a large field of view often requires specialized transducers which have limitations for specific clinical scenarios. Panoramic imaging offers an alternative approach by sequentially aligning image sections acquired from freehand sweeps using a standard transducer. To reconstruct a 3D volume from these 2D sections, an external device can be employed to track the transducer's motion accurately. However, the presence of optical or electrical interferences in a clinical setting often leads to incorrect measurements from such sensors. In this paper, we propose a deep learning (DL) framework that enables the prediction of scan trajectories using only US data, eliminating the need for an external tracking device. Our approach incorporates diverse data types, including correlation volume, optical flow, B-mode images, and rawer data (IQ data). We develop a DL network capable of effectively handling these data types and introduce an attention technique to emphasize crucial local areas for precise trajectory prediction. Through extensive experimentation, we demonstrate the superiority of our proposed method over other DL-based approaches in terms of long trajectory prediction performance. Our findings highlight the potential of employing DL techniques for trajectory estimation in clinical ultrasound, offering a promising alternative for panoramic imaging.

Design of DNP Controller for Robust Control of Auto-Equipment Systems (자동화 설비시스템의 강인제어를 위한 DNP 제어기 설계)

  • 조현섭
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.13 no.2
    • /
    • pp.55-62
    • /
    • 1999
  • In order to perform a elaborate task like as assembly, manufacturing and so forth of components, tracking control on the trajectory of power coming in contact with a target as well as tracking control on the movement course trajectory of end-effector is indispensable. In this paper, to bring under robust ard accurate control of auto-equipnent systems which disturbance, parameter alteration of system, uncertainty ard so forth exist, neural network controller called dynamic neural processor(DNP) is designed. Also, the learning architecture to compute inverse kinematic coordinates transfonnations in the manirclator of auto-equipnent systems is developed ard the example that DNP can be used is explained The architocture and learning algorithm of the proposed dynamic neural network, the DNP, are described and computer simllations are provided to demonstrate the effectiveness of the proposed learning method using the DNP.he DNP.

  • PDF

Learning a Single Joint Perception-Action Coupling: A Pilot Study

  • Ryu, Young-Uk
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.6
    • /
    • pp.43-51
    • /
    • 2010
  • Purpose: This study examined the influence of visuomotor congruency on learning a relative phase relationship between a single joint movement and an external signal. Methods: Participants (N=5) were required to rhythmically coordinate elbow flexion-extension movements with a continuous sinusoidal wave (0.375 Hz) at a $90^{\circ}$ relative phase relationship. The congruent group was provided online feedback in which the elbow angle decreased (corresponding to elbow flexion) as the angle trajectory was movingup, and vice versa. The incongruent group was provided online feedback in which the elbow angle decreased as the angle trajectory was moving down, and vice versa. There were two practice sessions (day 1 and 2) and each session consisted of 6 trials per block (5 blocks per session). Retention tests were performed 24 hours after session 2, and only the external sinusoidal wave was provided. Repeated ANOVAs were used for statistical analysis. Results: During practice, the congruent group was significantly less variable than the incongruent group. Phase variability in the incongruent group did not significantly change across blocks, while variability decreased significantly in the congruent group. In retention, the congruent group produced the required $90^{\circ}$ relative phase pattern with significantly less phase variability than the incongruent group. Conclusions: Congruent visual feedback facilitates learning. Moreover, the deprivation of online feedback does not affect the congruent group but does affect the incongruent group in retention.

A Method of Robust Stabilization of the Plants Using DNP (DNP을 이용한 플랜트의 강인 안정화 기법)

  • Cho, Hyun-Seob
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.9 no.6
    • /
    • pp.1574-1580
    • /
    • 2008
  • In this paper, to bring under robust and accurate control of auto-equipment systems which disturbance, parameter alteration of system, uncertainty and so forth exist, neural network controller called dynamic neural processor(DNP) is designed In order to perform a elaborate task like as assembly, manufacturing and so forth of components, tracking control on the trajectory of power coming in contact with a target as well as tracking control on the movement course trajectory of end-effector is indispensable. Also, the learning architecture to compute inverse kinematic coordinates transformations in the Plants of auto-equipment systems is developed and the example that DNP can be used is explained. The architecture and learning algorithm of the proposed dynamic neural network, the DNP, are described and computer simulations are provided to demonstrate the effectiveness of the proposed learning method using the DNP.