• Title/Summary/Keyword: Robot-based Learning

Search Result 479, Processing Time 0.034 seconds

Tidy-up Task Planner based on Q-learning (정리정돈을 위한 Q-learning 기반의 작업계획기)

  • Yang, Min-Gyu;Ahn, Kuk-Hyun;Song, Jae-Bok
    • The Journal of Korea Robotics Society
    • /
    • v.16 no.1
    • /
    • pp.56-63
    • /
    • 2021
  • As the use of robots in service area increases, research has been conducted to replace human tasks in daily life with robots. Among them, this study focuses on the tidy-up task on a desk using a robot arm. The order in which tidy-up motions are carried out has a great impact on the success rate of the task. Therefore, in this study, a neural network-based method for determining the priority of the tidy-up motions from the input image is proposed. Reinforcement learning, which shows good performance in the sequential decision-making process, is used to train such a task planner. The training process is conducted in a virtual tidy-up environment that is configured the same as the actual tidy-up environment. To transfer the learning results in the virtual environment to the actual environment, the input image is preprocessed into a segmented image. In addition, the use of a neural network that excludes unnecessary tidy-up motions from the priority during the tidy-up operation increases the success rate of the task planner. Experiments were conducted in the real world to verify the proposed task planning method.

Estimation of tomato maturity as a continuous index using deep neural networks

  • Taehyeong Kim;Dae-Hyun Lee;Seung-Woo Kang;Soo-Hyun Cho;Kyoung-Chul Kim
    • Korean Journal of Agricultural Science
    • /
    • v.49 no.4
    • /
    • pp.785-793
    • /
    • 2022
  • In this study, tomato maturity was estimated based on deep learning for a harvesting robot. Tomato images were obtained using a RGB camera installed on a monitoring robot, which was developed previously, and the samples were cropped to 128 × 128 size images to generate a dataset for training the classification model. The classification model was constructed based on convolutional neural networks, and the mean-variance loss was used to learn implicitly the distribution of the data features by class. In the test stage, the tomato maturity was estimated as a continuous index, which has a range of 0 to 1, by calculating the expected class value. The results show that the F1-score of the classification was approximately 0.94, and the performance was similar to that of a deep learning-based classification task in the agriculture field. In addition, it was possible to estimate the distribution in each maturity stage. From the results, it was found that our approach can not only classify the discrete maturation stages of the tomatoes but also can estimate the continuous maturity.

Dodecagon-based Q-learning Algorithm using SVM for Object Search of Robot (로봇의 목표물 추적을 위한 SVM과 12각형 기반의 Q-learning 알고리즘)

  • Seo, Sang-Wook;Jang, In-Hun;Sim, Kwee-Bo
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2007.11a
    • /
    • pp.227-230
    • /
    • 2007
  • 본 논문에서는 로봇의 목표물 추적을 위하여 SVM을 이용한 12각형 기반의 Q-learning 알고리즘을 제안한다. 제안한 알고리즘의 유효성을 보이기 위해 본 논문에서는 두 대의 로봇과 장애물 그리고 하나의 목표물로 정하고, 각각의 로봇이 숨겨진 목표물을 찾아내는 실험을 가정하여 무작위, DBAM과 AMAB의 융합 모델, 마지막으로는 본 논문에서 제안한 SVM과 12각형 기반의 Q-learning 알고리즘을 이용하여 실험을 수행하고, 이 3가지 방법을 비교하여 본 논문의 유효성을 검증하였다.

  • PDF

Design of automatic cruise control system of mobile robot using fuzzy-neural control technique (퍼지-뉴럴 제어기법에 의한 이동형 로봇의 자율주행 제어시스템 설계)

  • 한성현;김종수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.1804-1807
    • /
    • 1997
  • This paper presents a new approach to the design of cruise control system of a mobile robot with two drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy-neural network, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learnign architecture. It is proposed a learning controller consisting of two neural networks-fuzzy based on independent reasoning and a connecton net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by two independent wheels.

  • PDF

The Azimuth and Velocity Control of a Mobile Robot with Two Drive Wheels by Neural-Fuzzy Control Method (뉴럴-퍼지제어기법에 의한 두 구동휠을 갖는 이동형 로보트의 자세 및 속도 제어)

  • Cho, Y.G.;Bae, J.I.
    • Journal of Power System Engineering
    • /
    • v.2 no.3
    • /
    • pp.74-82
    • /
    • 1998
  • This paper presents a new approach to the design of speed and azimuth control of a mobile robot with two drive wheels. The proposed control scheme uses a Gaussian function as a unit function in the neural-fuzzy network and back propagation algorithm to train the neural-fuzzy network controller in the framework of the specialized learning architecture. It is proposed to a learned controller with two neural-fuzzy networks based on an independent reasoning and a connection net with fixed weights to simplify the neural-fuzzy network. The performance of the proposed controller can be seen by the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by two independent wheels.

  • PDF

Development of Deep Learning based waste Detection vision system (Deep Learning 기반의 폐기물 선별 Vision 시스템 개발)

  • Bong-Seok Han;Hyeok-Won Kwon;Bong-Cheol Shin
    • Design & Manufacturing
    • /
    • v.16 no.4
    • /
    • pp.60-66
    • /
    • 2022
  • Recently, with the development of industry and the improvement of living standards, various wastes are generated along with the production of various products. Most of these wastes are used as containers for products, and plastic or aluminum is used. Various attempts are being made to automate the classification of these wastes due to the high labor cost, but most of them are solved by manpower due to the geometrical shape change due to the nature of the waste. In this study, in order to automate the waste sorting task, Deep Learning technology is applied to a robot system for waste sorting and a vision system for waste sorting to effectively perform sorting tasks according to the shape of waste. As a result of the experiment, a Deep Learning parameter suitable for waste sorting was selected. In addition, through various experiments, it was confirmed that 99% of wastes could be selected in individual & group image learning. It is expected that this will enable automation of the waste sorting operation.

A Case Study on the Implementation of Tele-Operation Robot Hand by Learning Factory based Technology Convergence Education (러닝팩토리기반 기술융합교육을 통한 텔리 오퍼레이션 로봇핸드 구현 사례 연구)

  • Hong, Chang-Ho;Lee, Jung-Hoon;Kim, Hyung-O
    • Journal of Practical Engineering Education
    • /
    • v.10 no.2
    • /
    • pp.113-118
    • /
    • 2018
  • The most important thing in vocational education and training is to enhance students' interest and understanding of the whole process of the production site. In this paper, we present a case on the implementation of tele-operation robot hand by learning factory based technology convergence education. It also suggests some points to be taken when applying the learning factory in the future curriculum. In order to implement the tele-operation robot hand, it is necessary to support the compulsory subjects of university level courses in domestic curriculum such as mechanic design, motor control, local communication implementation, sensing and feedback control. The educational research presented in this paper guides the students with the skills they need and understands the skills through self-study and practice, and implements the final products. This study will be useful as a base data when introducing the training process of training factory in the future.

Case Study on Competency-based Maker and Design Education using Marine Robot (해양로봇 활용의 역량중심 메이커 및 설계 교육 사례 연구)

  • Kim, Hyun-Sik
    • Journal of Engineering Education Research
    • /
    • v.24 no.2
    • /
    • pp.12-19
    • /
    • 2021
  • Recently, the need of the future education in youth and univesity is rapidly increasing according to 4th industrial revolution. However, the maker and design education as a kind of youth and university future education has the following problems: it is implemented as an interesting convergence education including software education, it is managed by integrating youth and university competencies, it is composed in the form of blended class of consilient subject and nonsubject, it requires considering satisfaction in competency measurement and management, it is connected with entering school and getting job. To solve these problems, a case study on competency-based maker and design education using marine robot, which is based on the process-based learing method, integrated competency of youth and university, blended-type curriculum in terms of online and offline, is executed. To verify the competency-based maker and design education, the satisfaction survey in subject and nonsubject is performed. Study results show the example of the marine robot-based maker and design education and the need for additional study.

DIRECT INVERSE ROBOT CALIBRATION USING CMLAN (CEREBELLAR MODEL LINEAR ASSOCIATOR NET)

  • Choi, D.Y.;Hwang, H.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10b
    • /
    • pp.1173-1177
    • /
    • 1990
  • Cerebellar Model Linear Associator Net(CMLAN), a kind of neuro-net based adaptive control function generator, was applied to the problem of direct inverse calibration of three and six d.o.f. POMA 560 robot. Since CMLAN autonomously maps and generalizes a desired system function via learning on the sampled input/output pair nodes, CMLAN allows no knowledge in system modeling and other error sources. The CMLAN based direct inverse calibration avoids the complex procedure of identifying various system parameters such as geometric(kinematic) or nongeometric(dynamic) ones and generates the corresponding desired compensated joint commands directly to each joint for given target commands in the world coordinate. The generated net outputs automatically handles the effect of unknown system parameters and dynamic error sources. On-line sequential learning on the prespecified sampled nodes requires only the measurement of the corresponding tool tip locations for three d.o.f. manipulator but location and orientation for six d.o.f. manipulator. The proposed calibration procedure can be applied to any robot.

  • PDF

Design of Autonomous Mobile Robot System Based on Artificial Immune Network and Internet (인공 면역망과 인터넷에 의한 자율이동로봇 시스템 설계)

  • Lee, Dong-Je;Lee, Min-Jung;Choi, Young-Kiu
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.50 no.11
    • /
    • pp.522-531
    • /
    • 2001
  • Recently conventional artificial intelligence(AI) approaches have been employed to build action selectors for the autonomous mobile robot(AMR). However, in these approaches, the decision making process to choose an action from multiple competence modules is still an open question. Many researches have been focused on the reactive planning systems such as the biological immune system. In this paper, we attempt to construct an action selector for an AMR based on the artificial immune network and internet. The information from vision sensors is used for antibody. We propose a learning method for artificial immune network using evolutionary algorithm to produce antibody automatically. The internet environment for an AMR action selector shows the usefulness of the proposed learning artificial immune network application.

  • PDF