• Title/Summary/Keyword: 3D Object

Search Result 2,107, Processing Time 0.03 seconds

Development of an Efficient 3D Object Recognition Algorithm for Robotic Grasping in Cluttered Environments (혼재된 환경에서의 효율적 로봇 파지를 위한 3차원 물체 인식 알고리즘 개발)

  • Song, Dongwoon;Yi, Jae-Bong;Yi, Seung-Joon
    • The Journal of Korea Robotics Society
    • /
    • v.17 no.3
    • /
    • pp.255-263
    • /
    • 2022
  • 3D object detection pipelines often incorporate RGB-based object detection methods such as YOLO, which detects the object classes and bounding boxes from the RGB image. However, in complex environments where objects are heavily cluttered, bounding box approaches may show degraded performance due to the overlapping bounding boxes. Mask based methods such as Mask R-CNN can handle such situation better thanks to their detailed object masks, but they require much longer time for data preparation compared to bounding box-based approaches. In this paper, we present a 3D object recognition pipeline which uses either the YOLO or Mask R-CNN real-time object detection algorithm, K-nearest clustering algorithm, mask reduction algorithm and finally Principal Component Analysis (PCA) alg orithm to efficiently detect 3D poses of objects in a complex environment. Furthermore, we also present an improved YOLO based 3D object detection algorithm that uses a prioritized heightmap clustering algorithm to handle overlapping bounding boxes. The suggested algorithms have successfully been used at the Artificial-Intelligence Robot Challenge (ARC) 2021 competition with excellent results.

Object Recognition Using 3D RFID System (3D REID 시스템을 이용한 사물 인식)

  • Roh Se-gon;Lee Young Hoon;Choi Hyouk Ryeol
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.12
    • /
    • pp.1027-1038
    • /
    • 2005
  • Object recognition in the field of robotics generally has depended on a computer vision system. Recently, RFID(Radio Frequency IDentification) has been suggested as technology that supports object recognition. This paper, introduces the advanced RFID-based recognition using a novel tag which is named a 3D tag. The 3D tag was designed to facilitate object recognition. The proposed RFID system not only detects the existence of an object, but also estimates the orientation and position of the object. These characteristics allow the robot to reduce considerably its dependence on other sensors for object recognition. In this paper, we analyze the characteristics of the 3D tag-based RFID system. In addition, the estimation methods of position and orientation using the system are discussed.

Object detection and tracking using a high-performance artificial intelligence-based 3D depth camera: towards early detection of African swine fever

  • Ryu, Harry Wooseuk;Tai, Joo Ho
    • Journal of Veterinary Science
    • /
    • v.23 no.1
    • /
    • pp.17.1-17.10
    • /
    • 2022
  • Background: Inspection of livestock farms using surveillance cameras is emerging as a means of early detection of transboundary animal disease such as African swine fever (ASF). Object tracking, a developing technology derived from object detection aims to the consistent identification of individual objects in farms. Objectives: This study was conducted as a preliminary investigation for practical application to livestock farms. With the use of a high-performance artificial intelligence (AI)-based 3D depth camera, the aim is to establish a pathway for utilizing AI models to perform advanced object tracking. Methods: Multiple crossovers by two humans will be simulated to investigate the potential of object tracking. Inspection of consistent identification will be the evidence of object tracking after crossing over. Two AI models, a fast model and an accurate model, were tested and compared with regard to their object tracking performance in 3D. Finally, the recording of pig pen was also processed with aforementioned AI model to test the possibility of 3D object detection. Results: Both AI successfully processed and provided a 3D bounding box, identification number, and distance away from camera for each individual human. The accurate detection model had better evidence than the fast detection model on 3D object tracking and showed the potential application onto pigs as a livestock. Conclusions: Preparing a custom dataset to train AI models in an appropriate farm is required for proper 3D object detection to operate object tracking for pigs at an ideal level. This will allow the farm to smoothly transit traditional methods to ASF-preventing precision livestock farming.

AN AUTOMATED FORMWORK MODELING SYSTEM DEVELOPMENT FOR QUANTITY TAKE-OFF BASED ON BIM

  • Seong-Ah Kim;Sangyoon Chin;Su-Won Yoon;Tae-Hong Shin;Yea-Sang Kim;Cheolho Choi
    • International conference on construction engineering and project management
    • /
    • 2009.05a
    • /
    • pp.1113-1116
    • /
    • 2009
  • The attempt to use a 3D model each field such as design, structure, construction, facilities, and estimation in the construction project has recently increased more and more while BIM (Building Information Modeling) that manages the process of generating and managing building data has risen during life cycle of a construction project. While the 2D Drawing based work of each field is achieved in the already existing construction project, the BIM based construction project aims at accomplishing 3D model based work of each field efficiently. Accordingly, the solution that fits 3D model based work of each field and supports plans in order to efficiently accomplish the relevant work is demanded. The estimation, one of the fields of the construction project, has applied BIM to calculate quantity and cost of the building materials used to construction works after taking off building quantity information from the 3D model by a item for a Quantity Take-off grouping the materials relevant to a 3D object. A 3D based estimation program has been commonly used in abroad advanced countries using BIM. The program can only calculate quantity related to one 3D object. In other words, it doesn't support the take-off process considering quantity of a contiguous object. In case of temporary materials used in the frame construction, there are instances where quantity is different by the contiguous object. For example, the formwork of the temporary materials quantity is changed by dimensions of the contiguous object because formwork of temporary materials goes through the quantity take-off process that deduces quantity of the connected object when different objects are connected. A worker can compulsorily adjust quantity so as to recognize the different object connected to the contiguous object and deduces quantity, but it mainly causes the confusion of work because it must complexly consider quantity of other materials related to the object besides. Therefore, this study is to propose the solution that automates the formwork 3D modeling to efficiently accomplish the quantity take-off of formwork by preventing the confusion of the work which is caused by the quantity deduction process between the contiguous object and the connected object.

  • PDF

Improved Parameter Inference for Low-Cost 3D LiDAR-Based Object Detection on Clustering Algorithms (클러스터링 알고리즘에서 저비용 3D LiDAR 기반 객체 감지를 위한 향상된 파라미터 추론)

  • Kim, Da-hyeon;Ahn, Jun-ho
    • Journal of Internet Computing and Services
    • /
    • v.23 no.6
    • /
    • pp.71-78
    • /
    • 2022
  • This paper proposes an algorithm for 3D object detection by processing point cloud data of 3D LiDAR. Unlike 2D LiDAR, 3D LiDAR-based data was too vast and difficult to process in three dimensions. This paper introduces various studies based on 3D LiDAR and describes 3D LiDAR data processing. In this study, we propose a method of processing data of 3D LiDAR using clustering techniques for object detection and design an algorithm that fuses with cameras for clear and accurate 3D object detection. In addition, we study models for clustering 3D LiDAR-based data and study hyperparameter values according to models. When clustering 3D LiDAR-based data, the DBSCAN algorithm showed the most accurate results, and the hyperparameter values of DBSCAN were compared and analyzed. This study will be helpful for object detection research using 3D LiDAR in the future.

3-D Object Tracking using 3-D Information and Optical Correlator in the Stereo Vision System (스테레오 비젼 시스템에서 3차원정보와 광 상관기를 이용한 3차원 물체추적 방법)

  • 서춘원;이승현;김은수
    • Journal of Broadcast Engineering
    • /
    • v.7 no.3
    • /
    • pp.248-261
    • /
    • 2002
  • In this paper, we proposed a new 3-dimensional(3-D) object-tracking algorithm that can control a stereo camera using a variable window mask supported by which uses ,B-D information and an optical BPEJTC. Hence, three-dimensional information characteristics of a stereo vision system, distance information from the stereo camera to the tracking object. can be easily acquired through the elements of a stereo vision system. and with this information, we can extract an area of the tracking object by varying window masks. This extractive area of the tracking object is used as the next updated reference image. furthermore, by carrying out an optical BPEJTC between a reference image and a stereo input image the coordinates of the tracking objects location can be acquired, and with this value a 3-D object tracking can be accomplished through manipulation of the convergence angie and a pan/tilt of a stereo camera. From the experimental results, the proposed algorithm was found to be able to the execute 3-D object tracking by extracting the area of the target object from an input image that is independent of the background noise in the stereo input image. Moreover a possible implementation of a 3-D tele-working or an adaptive 3-D object tracker, using the proposed algorithm is suggested.

3 Dimensional Object Reconstruction Using Zoom Camera (줌 카메라를 이용한 3차원 물체 재구성)

  • 주도완;김주영기수용고광식
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.927-930
    • /
    • 1998
  • This paper presents a new method for reconstructing 3 dimensional object model using a zoom camera. The proposed method uses zoom images to find the distance(D) between camera and object. Also the method uses images obtained around the object to find an $angle(\theta)$ between two connected planes of the object. With the D and $\theta,$ we can reconstruct the real sized 3-D model of object with less errors without stereo camera or rangefinder.

  • PDF

A Study on the Stereo Vision System Design for the Displacement Estimation of Three-Dimensional Moving Object (3차원 이동물체의 변위평가를 위한 스테레오 비젼시스템 설계에 관한 연구)

  • 이주신
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.15 no.12
    • /
    • pp.1002-1016
    • /
    • 1990
  • This paper described design and implementation of stereo vision system, and also, proposed method for displacement estimation of 3-D moving object using this system. The extraction of moving object is obtained by difference image algorithm. Geometrical position of 3-D moving object is calculated form the mapping of center area of two's 2-D object. 3-D coordinate position produced space depth, moving velociity, distance, moving track and proved displacement estimation of 3-D moving object.

  • PDF

3D image processing using laser slit beam and CCD camera (레이저 슬릿빔과 CCD 카메라를 이용한 3차원 영상인식)

  • 김동기;윤광의;강이석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.40-43
    • /
    • 1997
  • This paper presents a 3D object recognition method for generation of 3D environmental map or obstacle recognition of mobile robots. An active light source projects a stripe pattern of light onto the object surface, while the camera observes the projected pattern from its offset point. The system consists of a laser unit and a camera on a pan/tilt device. The line segment in 2D camera image implies an object surface plane. The scaling, filtering, edge extraction, object extraction and line thinning are used for the enhancement of the light stripe image. We can get faithful depth informations of the object surface from the line segment interpretation. The performance of the proposed method has demonstrated in detail through the experiments for varies type objects. Experimental results show that the method has a good position accuracy, effectively eliminates optical noises in the image, greatly reduces memory requirement, and also greatly cut down the image processing time for the 3D object recognition compared to the conventional object recognition.

  • PDF

High-resolution 3D Object Reconstruction using Multiple Cameras (다수의 카메라를 활용한 고해상도 3차원 객체 복원 시스템)

  • Hwang, Sung Soo;Yoo, Jisung;Kim, Hee-Dong;Kim, Sujung;Paeng, Kyunghyun;Kim, Seong Dae
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.10
    • /
    • pp.150-161
    • /
    • 2013
  • This paper presents a new system which produces high resolution 3D contents by capturing multiview images of an object using multiple cameras, and estimating geometric and texture information of the object from the captured images. Even though a variety of multiview image-based 3D reconstruction systems have been proposed, it was difficult to generate high resolution 3D contents because multiview image-based 3D reconstruction requires a large amount of memory and computation. In order to reduce computational complexity and memory size for 3D reconstruction, the proposed system predetermines the regions in input images where an object can exist to extract object boundaries fast. And for fast computation of a visual hull, the system represents silhouettes and 3D-2D projection/back-projection relations by chain codes and 1D homographies, respectively. The geometric data of the reconstructed object is compactly represented by a 3D segment-based data format which is called DoCube, and the 3D object is finally reconstructed after 3D mesh generation and texture mapping are performed. Experimental results show that the proposed system produces 3D object contents of $800{\times}800{\times}800$ resolution with a rate of 2.2 seconds per frame.