• Title/Summary/Keyword: vision based inspection

Search Result 227, Processing Time 0.023 seconds

Autonomous vision-based damage chronology for spatiotemporal condition assessment of civil infrastructure using unmanned aerial vehicle

  • Mondal, Tarutal Ghosh;Jahanshahi, Mohammad R.
    • Smart Structures and Systems
    • /
    • v.25 no.6
    • /
    • pp.733-749
    • /
    • 2020
  • This study presents a computer vision-based approach for representing time evolution of structural damages leveraging a database of inspection images. Spatially incoherent but temporally sorted archival images captured by robotic cameras are exploited to represent the damage evolution over a long period of time. An access to a sequence of time-stamped inspection data recording the damage growth dynamics is premised to this end. Identification of a structural defect in the most recent inspection data set triggers an exhaustive search into the images collected during the previous inspections looking for correspondences based on spatial proximity. This is followed by a view synthesis from multiple candidate images resulting in a single reconstruction for each inspection round. Cracks on concrete surface are used as a case study to demonstrate the feasibility of this approach. Once the chronology is established, the damage severity is quantified at various levels of time scale documenting its progression through time. The proposed scheme enables the prediction of damage severity at a future point in time providing a scope for preemptive measures against imminent structural failure. On the whole, it is believed that the present study will immensely benefit the structural inspectors by introducing the time dimension into the autonomous condition assessment pipeline.

Design and Analysis of Illumination Optics for Image Uniformity in Omnidirectional Vision Inspection System for Screw Threads (나사산 전면검사 비전시스템의 영상 균일도 향상을 위한 조명 광학계 설계 및 해석)

  • Lee, Chang Hun;Lim, Yeong Eun;Park, Keun;Ra, Seung Woo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.31 no.3
    • /
    • pp.261-268
    • /
    • 2014
  • Precision screws have a wide range of industrial applications such as electrical and automotive products. To produce screw threads with high precision, not only high precision manufacturing technology but also reliable measurement technology is required. Machine vision systems have been used in the automatic inspection of screw threads based on backlight illumination, which cannot detect defects on the thread surface. Recently, an omnidirectional inspection system for screw threads was developed to obtain $360^{\circ}$ images of screws, based on front light illumination. In this study, the illumination design for the omnidirectional inspection system was modified by adding a light shield to improve the image uniformity. Optical simulation for various shield designs was performed to analyze image uniformity of the obtained images. The simulation results were analyzed statistically using response surface method, from which optical performance of the omnidirectional inspection system could be optimized in terms of image quality and uniformity.

Improvement of the Optical Characteristics of Vision System for Precision Screws Using Ray Tracing Simulation (광선추적을 이용한 정밀나사 비전검사용 광학계의 결상특성 향상)

  • Baek, Soon-Bo;Lee, Ki-Yean;Joo, Won-Jong;Park, Keun;Ra, Seung-Woo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.28 no.9
    • /
    • pp.1094-1102
    • /
    • 2011
  • Recent trends for the miniaturization and weight reduction of portable electronic parts is the use of subminiature components. Assembly of the miniaturized components requires subminiature screws of which pitch sizes are in a micrometer scale. To produce such a subminiature screw with high precision threads, not only a precision forming technology but also high-precision measurement technique is required. In the present work, a vision inspection system is developed to measure the thread profile of a subminiature screw. Optical simulation based on a ray tracing method is used to design and analyze the optical system of the vision inspection apparatus. Through this simulation, optical performance of the developed vision inspection system is optimized. The image processing algorithm for the precision screw inspection is also discussed.

3D Vision Inspection Algorithm using Geometrical Pattern Matching Method (기하학적 패턴 매칭을 이용한 3차원 비전 검사 알고리즘)

  • 정철진;허경무;김장기
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.10 no.1
    • /
    • pp.54-59
    • /
    • 2004
  • We suggest a 3D vision inspection algorithm which is based on the external shape feature. Because many electronic parts have the regular shape, if we have the database of pattern and can recognize the object using the database of the object s pattern, we can inspect many types of electronic parts. Our proposed algorithm uses the geometrical pattern matching method and 3D database on the electronic parts. We applied our suggested algorithm fer inspecting several objects including typical IC and capacitor. Through the experiments, we could find that our suggested algorithm is more effective and more robust to the inspection environment(rotation angle, light source, etc.) than conventional 2D inspection methods. We also compared our suggested algorithm with the feature space trajectory method.

Comparison of Region-based CNN Methods for Defects Detection on Metal Surface (금속 표면의 결함 검출을 위한 영역 기반 CNN 기법 비교)

  • Lee, Minki;Seo, Kisung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.7
    • /
    • pp.865-870
    • /
    • 2018
  • A machine vision based industrial inspection includes defects detection and classification. Fast inspection is a fundamental problem for many applications of real-time vision systems. It requires little computation time and localizing defects robustly with high accuracy. Deep learning technique have been known not to be suitable for real-time applications. Recently a couple of fast region-based CNN algorithms for object detection are introduced, such as Faster R-CNN, and YOLOv2. We apply these methods for an industrial inspection problem. Three CNN based detection algorithms, VOV based CNN, Faster R-CNN, and YOLOv2, are experimented for defect detection on metal surface. The results for inspection time and various performance indices are compared and analysed.

LED Die Bonder Inspection System Using Integrated Machine Visions (Integrated Machine Vision을 이용한 LED Die Bonder 검사시스템)

  • Cho, Yong-Kyu;Ha, Seok-Jae;Kim, Jong-Su;Cho, Myeong-Woo;Choi, Won-Ho
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.6
    • /
    • pp.2624-2630
    • /
    • 2013
  • In LED chip packaging, die bonding is a very important process which fixes the LED chip on the lead flame to provide enough strength for the next process. During the process, inspection processes are very important to detect exact locations of dispensed epoxy dots and to determine bonding status of dies whether they are lies at exact positions with sufficient bonding strength. In this study, a useful machine vision based inspection system is proposed for the LED die bonder. In the proposed system, 2 cameras are used for epoxy dot position detection and 2 cameras are sued for die attaching status determination. New vision processing algorithm is proposed, and its efficiency is verified through required field experiments. Measured position error is less than $X:-29{\mu}m$, $Y:-32{\mu}m$ and rotation error:$3^{\circ}$ using proposed vision algorithm. It is concluded that the proposed machine vision based inspection system can be successfully implemented on the developed die bonding system.

Development of an FPGA-based Sealer Coating Inspection Vision System for Automotive Glass Assembly Automation Equipment (자동차 글라스 조립 자동화설비를 위한 FPGA기반 실러 도포검사 비전시스템 개발)

  • Ju-Young Kim;Jae-Ryul Park
    • Journal of Sensor Science and Technology
    • /
    • v.32 no.5
    • /
    • pp.320-327
    • /
    • 2023
  • In this study, an FPGA-based sealer inspection system was developed to inspect the sealer applied to install vehicle glass on a car body. The sealer is a liquid or paste-like material that promotes adhesion such as sealing and waterproofing for mounting and assembling vehicle parts to a car body. The system installed in the existing vehicle design parts line does not detect the sealer in the glass rotation section and takes a long time to process. This study developed a line laser camera sensor and an FPGA vision signal processing module to solve this problem. The line laser camera sensor was developed such that the resolution and speed of the camera for data acquisition could be modified according to the irradiation angle of the laser. Furthermore, it was developed considering the mountability of the entire system to prevent interference with the sealer ejection machine. In addition, a vision signal processing module was developed using the Zynq-7020 FPGA chip to improve the processing speed of the algorithm that converted the profile to the sealer shape image acquired from a 2D camera and calculated the width and height of the sealer using the converted profile. The performance of the developed sealer application inspection system was verified by establishing an experimental environment identical to that of an actual automobile production line. The experimental results confirmed the performance of the sealer application inspection at a level that satisfied the requirements of automotive field standards.

Development of Machine Vision System based on PLC (PLC 기반 머신 비전 시스템 개발)

  • Lee, Sang-Back;Park, Tae-Hyoung;Han, Kyung-Sik
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.20 no.7
    • /
    • pp.741-749
    • /
    • 2014
  • This paper proposes a machine vision module for PLCs (Programmable Logic Controllers). PLC is the industrial controller most widely used in factory automation system. However most of the machine vision systems are based on PC (Personal Computer). The machine vision system embedded in PLC is required to reduce the cost and improve the convenience of implementation. In this paper, we newly propose a machine vision module based on PLC. The image processing libraries are implemented and integrated with the PLC programming tool. In order to interface the libraries with ladder programming, the ladder instruction set was also designed for each vision library. By use of the developed system, PLC users can implement vision systems easily by ladder programming. The developed system was applied to sample inspection system to verify the performance. The experimental results show that the proposed system can reduce the cost of installing as well as increase the ease-of-implementation.

Image Enhanced Machine Vision System for Smart Factory

  • Kim, ByungJoo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.13 no.2
    • /
    • pp.7-13
    • /
    • 2021
  • Machine vision is a technology that helps the computer as if a person recognizes and determines things. In recent years, as advanced technologies such as optical systems, artificial intelligence and big data advanced in conventional machine vision system became more accurate quality inspection and it increases the manufacturing efficiency. In machine vision systems using deep learning, the image quality of the input image is very important. However, most images obtained in the industrial field for quality inspection typically contain noise. This noise is a major factor in the performance of the machine vision system. Therefore, in order to improve the performance of the machine vision system, it is necessary to eliminate the noise of the image. There are lots of research being done to remove noise from the image. In this paper, we propose an autoencoder based machine vision system to eliminate noise in the image. Through experiment proposed model showed better performance compared to the basic autoencoder model in denoising and image reconstruction capability for MNIST and fashion MNIST data sets.

Robust Defect Size Measuring Method for an Automated Vision Inspection System (영상기반 자동결함 검사시스템에서 재현성 향상을 위한 결함 모델링 및 측정 기법)

  • Joo, Young-Bok;Huh, Kyung-Moo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.11
    • /
    • pp.974-978
    • /
    • 2013
  • AVI (Automatic Vision Inspection) systems automatically detect defect features and measure their sizes via camera vision. AVI systems usually report different measurements on the same defect with some variations on position or rotation mainly because different images are provided. This is caused by possible variations from the image acquisition process including optical factors, nonuniform illumination, random noises, and so on. For this reason, conventional area based defect measuring methods have problems of robustness and consistency. In this paper, we propose a new defect size measuring method to overcome this problem, utilizing volume information that is completely ignored in the area based defect measuring method. The results show that our proposed method dramatically improves the robustness and consistency of defect size measurement.