• Title/Summary/Keyword: Harvesting robot

Search Result 53, Processing Time 0.035 seconds

Localization of ripe tomato bunch using deep neural networks and class activation mapping

  • Seung-Woo Kang;Soo-Hyun Cho;Dae-Hyun Lee;Kyung-Chul Kim
    • Korean Journal of Agricultural Science
    • /
    • v.50 no.3
    • /
    • pp.357-364
    • /
    • 2023
  • In this study, we propose a ripe tomato bunch localization method based on convolutional neural networks, to be applied in robotic harvesting systems. Tomato images were obtained from a smart greenhouse at the Rural Development Administration (RDA). The sample images for training were extracted based on tomato maturity and resized to 128 × 128 pixels for use in the classification model. The model was constructed based on four-layer convolutional neural networks, and the classes were determined based on stage of maturity, using a Softmax classifier. The localization of the ripe tomato bunch region was indicated on a class activation map. The class activation map could show the approximate location of the tomato bunch but tends to present a local part or a large part of the ripe tomato bunch region, which could lead to poor performance. Therefore, we suggest a recursive method to improve the performance of the model. The classification results indicated that the accuracy, precision, recall, and F1-score were 0.98, 0.87, 0.98, and 0.92, respectively. The localization performance was 0.52, estimated by the Intersection over Union (IoU), and through input recursion, the IoU was improved by 13%. Based on the results, the proposed localization of the ripe tomato bunch area can be incorporated in robotic harvesting systems to establish the optimal harvesting paths.

Development of the Servo Control System for the Apple harvesting Robot (사과 수확 로봇 관절의 서보 제어장치 개발)

  • 장익주;정종인
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2002.07a
    • /
    • pp.141-147
    • /
    • 2002
  • 생물 생산의 여러 과정 중에서도 자동화 기계의 개발과 제어 기술이 요구되는 부분은 이식이나 접목, 작물의 관리, 수확 등의 정밀한 반복 작업으로 볼 수 있다. 특히, 로봇에 의한 수확 작업중의 하나인 과실 수확 로봇은 각각의 대상물을 직접 다루어야 하면서도, 과실의 특성상 수확 작업에 의한 손상의 위험이 크기 때문에 정교한 제어가 요구된다. (중략)

  • PDF

DEVELOPMENT OF AGRICULTURAL HYDRAULIC ROBOT(Part I) - Dynamic Characteristics and System Identification -

  • Iida, Michihisa;Umeda, Mikio;Namikawa, Kiyoshi
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1993.10a
    • /
    • pp.820-829
    • /
    • 1993
  • We have developed an agricultural hydraulic robot to operate in the agricultural field. Using the robot, automatic harvesting experiments of watermelon were done. The results are as follows. First, the gripper should be modified its finger. Second, the manipulator and the gripper should be known precisely about dynamic characteristics of them in order to control adequately. Therefore, a new gripper was manufactured on trial by modifying its finger, and in order to known dynamic characteristics of the manipulator and the new gripper, the system identification was carried out with experiments.

  • PDF

Partially Asynchronous Task Planning for Dual Arm Manipulators (양팔 로봇을 위한 부분적 비동기 작업 계획)

  • Chung, Seong Youb;Hwang, Myun Joong
    • The Journal of Korea Robotics Society
    • /
    • v.15 no.2
    • /
    • pp.100-106
    • /
    • 2020
  • In the agricultural field, interests in research using robots for fruit harvesting are continuously increasing. Dual arm manipulators are promising because of its abilities like task-distribution and role-sharing. To operate it efficiently, the task sequence must be planned adequately. In our previous study, a collision-free path planning method based on a genetic algorithm is proposed for dual arm manipulators doing tasks cooperatively. However, in order to simplify the complicated collision-check problem, the movement between tasks of two robots should be synchronized, and thus there is a problem that the robots must wait and resume their movement. In this paper, we propose a heuristic algorithm that can reduce the total time of the optimal solution obtained by using the previously proposed genetic algorithm. It iteratively desynchronizes the task sequence of two robots and reduces the waiting time. For evaluation, the proposed algorithm is applied to the same work as the previous study. As a result, we can obtain a faster solution having 22.57 s than that of the previous study having 24.081 s. It will be further studied to apply the proposed algorithm to the fruit harvesting.

Development of a Fruit Harvesting Robot(II) -Determination of Fruit Location by a Closed-Circuit TV Camera- (과실수확(果實收穫) 로봇에 관한 연구(硏究)(II) -폐쇄회로(閉鎖回路) TV 카메라에 의한 과실(果實)의 위치검출(位置檢出)-)

  • Ryu, K.H.;Noh, S.H.;Kim, Y.H.
    • Journal of Biosystems Engineering
    • /
    • v.14 no.2
    • /
    • pp.104-114
    • /
    • 1989
  • The most important subject in developing agricultural robots for fruit harvesting is to detect accurately the location of a fruit about the given coordinate system. This study was carried out to develop an image processing algorithm which enables finding out the three dimensional locations of a fruit. The digital image processing device consisted of an optosensor (Closed-circuit TV camera), image processing interface board (Digitizer) and microcomputer (IBM PC/AT). A stereo-image processing method using the two cameras attached to the manipulator was evaluated through experiment with apples. The accuracy and quickness of detecting the location of apples by this method was not satisfactory. The maximum errors of the detected locations by the stereo-image processing method in x-, Y-, and z- directions were 3, 4 and 4 cm, respectively. The maximum time required to get the rectangular coordinate data of a fruit was about 2 minutes.

  • PDF

OBSTACLE-AVOIDANCE ALGORITHM WITH DYNAMIC STABILITY FOR REDUNDANT ROBOT MANIPULATOR WITH FRUIT-ILARVESTING APPLICATIONS

  • Ryu, Y.S.h;Ryu, K.H.
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1996.06c
    • /
    • pp.1063-1072
    • /
    • 1996
  • Fruit harvesting robots should have more diversity and flexibility in the working conditions and environments than industrial robots. This paper presents an efficient optimization algorithm for redundant manipulators to avoid obstacles using dynamic performance criteria, while the optimization schemes of the previous studies used the performance criteria using kinematic approach. Feasibility and effectiveness of this algorithm were tested through simulations on a 3-degrees-of-freedom manipulator made for this study. Only the position of the end-effector was controlled , which requires only three degrees of freedom. Remaining joints, except for the wrist roll joint, which does not contribute to the end-effector linear velocity, provide two degrees of redundancy. The algorithm was effective to avoid obstacles in the workspace even through the collision occurred in extended workspace, and it was found be to a useful design tool which gives more flexibility to design conditions nd to find the mechanical constraints for fruit harvesting robots.

  • PDF

Distributed beamforming with one-bit feedback and clustering for multi-node wireless energy transfer

  • Lee, Jonghyeok;Hwang, SeongJun;Hong, Yong-gi;Park, Jaehyun;Byun, Woo-Jin
    • ETRI Journal
    • /
    • v.43 no.2
    • /
    • pp.221-231
    • /
    • 2021
  • To resolve energy depletion issues in massive Internet of Things sensor networks, we developed a set of distributed energy beamforming methods with one-bit feedback and clustering for multi-node wireless energy transfer, where multiple singleantenna distributed energy transmitters (Txs) transfer their energy to multiple nodes wirelessly. Unlike previous works focusing on distributed information beamforming using a single energy receiver (Rx) node, we developed a distributed energy beamforming method for multiple Rx nodes. Additionally, we propose two clustering methods in which each Tx node chooses a suitable Rx node. Furthermore, we propose a fast distributed beamforming method based on Tx sub-clustering. Through computer simulations, we demonstrate that the proposed distributed beamforming method makes it possible to transfer wireless energy to massive numbers of sensors effectively and rapidly with small implementation complexity. We also analyze the energy harvesting outage probability of the proposed beamforming method, which provides insights into the design of wireless energy transfer networks with distributed beamforming.

Tele-operating System of Field Robot for Cultivation Management - Vision based Tele-operating System of Robotic Smart Farming for Fruit Harvesting and Cultivation Management

  • Ryuh, Youngsun;Noh, Kwang Mo;Park, Joon Gul
    • Journal of Biosystems Engineering
    • /
    • v.39 no.2
    • /
    • pp.134-141
    • /
    • 2014
  • Purposes: This study was to validate the Robotic Smart Work System that can provides better working conditions and high productivity in unstructured environments like bio-industry, based on a tele-operation system for fruit harvesting with low cost 3-D positioning system on the laboratory level. Methods: For the Robotic Smart Work System for fruit harvesting and cultivation management in agriculture, a vision based tele-operating system and 3-D position information are key elements. This study proposed Robotic Smart Farming, an agricultural version of Robotic Smart Work System, and validated a 3-D position information system with a low cost omni camera and a laser marker system in the lab environment in order to get a vision based tele-operating system and 3-D position information. Results: The tasks like harvesting of the fixed target and cultivation management were accomplished even if there was a short time delay (30 ms ~ 100 ms). Although automatic conveyor works requiring accurate timing and positioning yield high productivity, the tele-operation with user's intuition will be more efficient in unstructured environments which require target selection and judgment. Conclusions: This system increased work efficiency and stability by considering ancillary intelligence as well as user's experience and knowhow. In addition, senior and female workers will operate the system easily because it can reduce labor and minimized user fatigue.