• Journal of the Semiconductor & Display Technology
• /
• v.22 no.1
• /
• pp.72-77
• /
• 2023

In many manufacturing settings, including the semiconductor industry, products are completed by producing and assembling various components. Sorting out from randomly mixed parts and classification operations takes a lot of time and labor. Recently, many efforts have been made to select and assemble correct parts from mixed parts using robots. Automating the sorting and classification of randomly mixed components is difficult since various objects and the positions and attitudes of robots and cameras in 3D space need to be known. Previously, only objects in specific positions were grasped by robots or people sorting items directly. To enable robots to pick up random objects in 3D space, bin picking technology is required. To realize bin picking technology, it is essential to understand the coordinate system information between the robot, the grasping target object, and the camera. Calibration work to understand the coordinate system information between them is necessary to grasp the object recognized by the camera. It is difficult to restore the depth value of 2D images when 3D restoration is performed, which is necessary for bin picking technology. In this paper, we propose to use depth information of RGB-D camera for Z value in rotation and movement conversion used in calibration. Proceed with camera calibration for accurate coordinate system conversion of objects in 2D images, and proceed with calibration of robot and camera. We proved the effectiveness of the proposed method through accuracy evaluations for camera calibration and calibration between robots and cameras.

• Journal of the Korean Society for Precision Engineering
• /
• v.12 no.9
• /
• pp.156-166
• /
• 1995

This paper presents a bin picking method using a slit beam laser in which a robot recognizes all of the unoccluded objects from the top of jumbled objects, and picks them up one by one. Once those unoccluded objects are removed, newly developed unoccluded objects underneath are recognized and the same process is continued until the bin gets empty. To recognize unoccluded objects, a new algotithm to link edges on slices which are generated by the orthogonally mounted laser on the xy table is proposed. The edges on slices are partitioned and classified using convex and concave function with a distance parameter. The edge types on the neighborhood slices are compared, then the hamming distances among identical kinds of edges are extracted as the features of fuzzy membership function. The sugeno fuzzy integration about features is used to determine linked edges. Finally, the pick-up sequence based on MaxMin theory is determined to cause minimal disturbance to the pile. This proposed method may provide a solution to the automation of part handling in manufacturing environments such as in punch press operation or part assembly.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 1994.04a
• /
• pp.527-534
• /
• 1994

This paper presents a Bin-Picking method in which robot recognizes the positions and orientations of unoccluded objects at the top of jumbled objects placed in a bin, and picks up the unoccluded objects one by one from the jumble. A method using feasible region, painting, and hierarchical test is introduced for recognizing the unoccluded objects from the jumbled objects. The 3D information is obtained using the bipartite-matching method which finds the least difference of 3D by comparing vertexes of one camera with vertexes of the other camera, then hypothesis and test are done. The working order of unoccluded objects is made based on 3D, position, and orientation information. The robot picks up the unoccluded objects from the jumbled objects according to the working order. This all process continues to the empty bin.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.25 no.6
• /
• pp.522-531
• /
• 2016

In this study, we propose an object identification method for bin-picking developed for industrial robots. We identify the grasp posture and the associated geometric parameters of grasp objects using the joint data of a robotic gripper. Prior to grasp identification, we analyze the grasping motion in a low-dimensional space using principle component analysis (PCA) to reduce the dimensions. We collected the joint data from a human hand to demonstrate the grasp-identification algorithm. For data acquisition of the human grasp data, we conducted additional research on the motion characteristics of a human hand. We explain the method for using the algorithm of grasp identification for bin-picking. Finally, we present a subject for future research using our proposed algorithm of grasp model and identification.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.1
• /
• pp.8-16
• /
• 2016

In the field of computer vision and robotics, bin picking is an important application area in which object pose estimation is necessary. Different approaches, such as 2D feature tracking and 3D surface reconstruction, have been introduced to estimate the object pose accurately. We propose a new approach where we can use both 2D image features and 3D surface information to identify the target object and estimate its pose accurately. First, we introduce a label detection technique using Maximally Stable Extremal Regions (MSERs) where the label detection results are used to identify the target objects separately. Then, the 2D image features on the detected label areas are utilized to generate 3D surface information. Finally, we calculate the 3D position and the orientation of the target objects using the information of the 3D surface.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 1995.04a
• /
• pp.306-315
• /
• 1995

This paper presents a bin picking method using a slit beam laser in which a robot recognizes all of the unoccluded objects from the top of jumbled objects, and picks them up one by one. Once those unoccluded objects are removed, newly developed unoccluded objects underneath are recognized and the same process is continued until the bin gets empty. To recognize unoccluded objects, a new algorithm to link edges on slices which are generated by the orthogonally mounted laser on the xy table is proposed. The edges on slices are partitioned and classified using convex and concave function with a distance parameter. The edge types on the neighborhood slices are compared, then the hamming distances among identical kinds of edges are extracted as the features of fuzzy membership function. The sugeno fuzzy integration about features is used to determine linked edges. Finally, the pick-up sequence based on MaxMin theory is determined to cause minimal disturbance to the pile. This proposed method may provide a solution to the automation of part handling in manufacturing environments such as in punch press operation or part assembly.

• Bulletin of the Korean Chemical Society
• /
• v.30 no.11
• /
• pp.2665-2668
• /
• 2009

A new algorithm for determining noise level is proposed for more reliability in interpreting spectral data for complex Fourier transform ion cyclotron resonance (FTICR) mass spectra of petroleum. In the new algorithm, a moving window with a fixed number of data points was adopted, instead of a fixed m/z width. In the analysis of petroleum, it was found that a moving window of 50,000 or more data points was optimal. This optimized automated peak picking performed well even with frequency-dependant noise in the mass spectrum. Additionally, this fast, automated peak picking algorithm was suitable for the analysis of a large set of samples.

• Journal of Institute of Control, Robotics and Systems
• /
• v.14 no.1
• /
• pp.54-61
• /
• 2008

This paper proposes a new algorithm for detecting and recognizing overlapped objects among a stack of arbitrarily located objects using a signature representation scheme. The proposed algorithm consists of two processes of detecting overlap of objects and of determining the boundary between overlapping objects. To determine overlap of objects, in the first step, the edge image of object region is extracted and those areas in the object region are considered as the object areas if an area is surrounded by a closed edge. For each object, its signature image is constructed by measuring the distances of those edge points from the center of the object, along the angle axis, which are located at every angle with reference to the center of the object. When an object is not overlapped, its features which consist of the positions and angles of outstanding points in the signature are searched in the database to find its corresponding model. When an object is overlapped, its features are partially matched with those object models among which the best matching model is selected as the corresponding model. The boundary among the overlapping objects is determined by projecting the signature to the original image. The performance of the proposed algorithm has been tested with the task of picking the top or non-overlapped object from a stack of arbitrarily located objects. In the experiment, a recognition rate of 98% has been achieved.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.34 no.3
• /
• pp.125-136
• /
• 2009

The container packing problem Is one of the traditional optimization problems, which is very related to the knapsack problem and the bin packing problem. In this paper, we deal with the quadratic multiple container picking problem (QMCPP) and it Is known as a NP-hard problem. Thus, It seems to be natural to use a heuristic approach such as evolutionary algorithms for solving the QMCPP. Until now, only a few researchers have studied on this problem and some evolutionary algorithms have been proposed. This paper introduces a new efficient evolutionary algorithm for the QMCPP. The proposed algorithm is devised by improving the original network random key method, which is employed as an encoding method in evolutionary algorithms. And we also propose local search algorithms and incorporate them with the proposed evolutionary algorithm. Finally we compare the proposed algorithm with the previous algorithms and show the proposed algorithm finds the new best results in most of the benchmark instances.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.1-7
• /
• 2019

Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.