• Title/Summary/Keyword: vision based inspection

Search Result 229, Processing Time 0.023 seconds

Deep Learning Models for Autonomous Crack Detection System (자동화 균열 탐지 시스템을 위한 딥러닝 모델에 관한 연구)

  • Ji, HongGeun;Kim, Jina;Hwang, Syjung;Kim, Dogun;Park, Eunil;Kim, Young Seok;Ryu, Seung Ki
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.10 no.5
    • /
    • pp.161-168
    • /
    • 2021
  • Cracks affect the robustness of infrastructures such as buildings, bridge, pavement, and pipelines. This paper presents an automated crack detection system which detect cracks in diverse surfaces. We first constructed the combined crack dataset, consists of multiple crack datasets in diverse domains presented in prior studies. Then, state-of-the-art deep learning models in computer vision tasks including VGG, ResNet, WideResNet, ResNeXt, DenseNet, and EfficientNet, were used to validate the performance of crack detection. We divided the combined dataset into train (80%) and test set (20%) to evaluate the employed models. DenseNet121 showed the highest accuracy at 96.20% with relatively low number of parameters compared to other models. Based on the validation procedures of the advanced deep learning models in crack detection task, we shed light on the cost-effective automated crack detection system which can be applied to different surfaces and structures with low computing resources.

Three Dimensional Volume Reconstruction of an Object from X-ray Iamges using Uniform and Simultaneous ART (USART 방법에 의한 X선 영상으로부터의 삼차원 물체의 형상 복원)

  • Roh, Young-Jun;Cho, Hyung-Suck;Kim, Hyeong-Cheol;Kim, Jong-Hyung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.8 no.1
    • /
    • pp.21-27
    • /
    • 2002
  • Inspection and shape measurement of three-dimensional objects are widely needed in industries for quality monitoring and control. A number of visual or optical technologies have been successfully applied to measure three-dimensional surfaces. However, those conventional visual or optical methods have inherent shortcomings such as occlusion and variant surface reflection. X-ray vision system can be a good solution to these conventional problems, since we can extract the volume information including both the surface geometry and the inner structure of any objects. In the x-ray system, the surface condition of an object, whether it is lambertian or specular, does not affect the inherent characteristics of its x-ray images. In this paper, we propose a three-dimensional x-ray imaging method to reconstruct a three dimensional structure of an object out of two dimensional x-ray image sets. To achieve this by the proposed method, two or more x-ray images projected from different views are needed. Once these images are acquired, the simultaneous algebraic reconstruction technique(SART) is usually utilized. Since the existing SART algorithms have several shortcomings such as low performance in convergence and different convergence within the reconstruction volume of interest, an advanced SART algorithm named as USART(uniform SART) is proposed to avoid such shortcomings and improve the reconstruction performance. Because, each voxel within the volume is equally weighted to update instantaneous value of its internal density, it can achieve uniform convergence property of the reconstructed volume. The algorithm is simulated on various shapes of objects such as a pyramid, a hemisphere and a BGA model. Based on simulation results the performance of the proposed method is compared with that of the conventional SART method.

Properties of Defective Regions Observed by Photoluminescence Imaging for GaN-Based Light-Emitting Diode Epi-Wafers

  • Kim, Jongseok;Kim, HyungTae;Kim, Seungtaek;Jeong, Hoon;Cho, In-Sung;Noh, Min Soo;Jung, Hyundon;Jin, Kyung Chan
    • Journal of the Optical Society of Korea
    • /
    • v.19 no.6
    • /
    • pp.687-694
    • /
    • 2015
  • A photoluminescence (PL) imaging method using a vision camera was employed to inspect InGaN/GaN quantum-well light-emitting diode (LED) epi-wafers. The PL image revealed dark spot defective regions (DSDRs) as well as a spatial map of integrated PL intensity of the epi-wafer. The Shockley-Read-Hall (SRH) nonradiative recombination coefficient increased with the size of the DSDRs. The high nonradiative recombination rates of the DSDRs resulted in degradation of the optical properties of the LED chips fabricated at the defective regions. Abnormal current-voltage characteristics with large forward leakages were also observed for LED chips with DSDRs, which could be due to parallel resistances bypassing the junction and/or tunneling through defects in the active region. It was found that the SRH nonradiative recombination process was dominant in the voltage range where the forward leakage by tunneling was observed. The results indicated that the DSDRs observed by PL imaging of LED epi-wafers were high density SRH nonradiative recombination centers which could affect the optical and electrical properties of the LED chips, and PL imaging can be an inspection method for evaluation of the epi-wafers and estimation of properties of the LED chips before fabrication.

Three-dimensional Machine Vision System based on moire Interferometry for the Ball Shape Inspection of Micro BGA Packages (마이크로 BGA 패키지의 볼 형상 시각검사를 위한 모아레 간섭계 기반 3차원 머신 비젼 시스템)

  • Kim, Min-Young
    • Journal of the Microelectronics and Packaging Society
    • /
    • v.19 no.1
    • /
    • pp.81-87
    • /
    • 2012
  • This paper focuses on three-dimensional measurement system of micro balls on micro Ball-Grid-Array(BGA) packages in-line. Most of visual inspection system still suffers from sophisticate reflection characteristics of micro balls. For accurate shape measurement of them, a specially designed visual sensor system is proposed under the sensing principle of phase shifting moire interferometry. The system consists of a pattern projection system with four projection subsystems and an imaging system. In the projection system, four subsystems have spatially different projection directions to make target objects experience the pattern illuminations with different incident directions. For the phase shifting, each grating pattern of subsystem is regularly moved by PZT actuator. To remove specular noise and shadow area of BGA balls efficiently, a compact multiple-pattern projection and imaging system is implemented and tested. Especially, a sensor fusion algorithm to integrate four information sets, acquired from multiple projections, into one is proposed with the basis of Bayesian sensor fusion theory. To see how the proposed system works, a series of experiments is performed and the results are analyzed in detail.

Semantic Segmentation for Multiple Concrete Damage Based on Hierarchical Learning (계층적 학습 기반 다중 콘크리트 손상에 대한 의미론적 분할)

  • Shim, Seungbo;Min, Jiyoung
    • Journal of the Korea institute for structural maintenance and inspection
    • /
    • v.26 no.6
    • /
    • pp.175-181
    • /
    • 2022
  • The condition of infrastructure deteriorates as the service life increases. Since most infrastructure in South Korea were intensively built during the period of economic growth, the proportion of outdated infrastructure is rapidly increasing now. Aging of such infrastructure can lead to safety accidents and even human casualties. To prevent these issues in advance, periodic and accurate inspection is essential. For this reason, the need for research to detect various types of damage using computer vision and deep learning is increasingly required in the field of remotely controlled or autonomous inspection. To this end, this study proposed a neural network structure that can detect concrete damage by classifying it into three types. In particular, the proposed neural network can detect them more accurately through a hierarchical learning technique. This neural network was trained with 2,026 damage images and tested with 508 damage images. As a result, we completed an algorithm with average mean intersection over union of 67.04% and F1 score of 52.65%. It is expected that the proposed damage detection algorithm could apply to accurate facility condition diagnosis in the near future.

Development of Chicken Carcass Segmentation Algorithm using Image Processing System (영상처리 시스템을 이용한 닭 도체 부위 분할 알고리즘 개발)

  • Cho, Sung-Ho;Lee, Hyo-Jai;Hwang, Jung-Ho;Choi, Sun;Lee, Hoyoung
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.3
    • /
    • pp.446-452
    • /
    • 2021
  • As a higher standard for food consumption is required, the consumption of chicken meat that can satisfy the subdivided food preferences is increasing. In March 2003, the quality criteria for chicken carcasses notified by the Livestock Quality Assessment Service suggested quality grades according to fecal contamination and the size and weight of blood and bruises. On the other hand, it is too difficult for human inspection to qualify mass products, which is key to maintaining consistency for grading thousands of chicken carcasses. This paper proposed the computer vision algorithm as a non-destructive inspection, which can identify chicken carcass parts according to the detailed standards. To inspect the chicken carcasses conveyed at high speed, the image calibration was involved in providing robustness to the side effect of external lighting interference. The separation between chicken and background was achieved by a series of image processing, such as binarization based on Expectation Maximization, Erosion, and Labeling. In terms of shape analysis of chicken carcasses, the features are presented to reveal geometric information. After applying the algorithm to 78 chicken carcass samples, the algorithm was effective in segmenting chicken carcass against a background and analyzing its geometric features.

A review on deep learning-based structural health monitoring of civil infrastructures

  • Ye, X.W.;Jin, T.;Yun, C.B.
    • Smart Structures and Systems
    • /
    • v.24 no.5
    • /
    • pp.567-585
    • /
    • 2019
  • In the past two decades, structural health monitoring (SHM) systems have been widely installed on various civil infrastructures for the tracking of the state of their structural health and the detection of structural damage or abnormality, through long-term monitoring of environmental conditions as well as structural loadings and responses. In an SHM system, there are plenty of sensors to acquire a huge number of monitoring data, which can factually reflect the in-service condition of the target structure. In order to bridge the gap between SHM and structural maintenance and management (SMM), it is necessary to employ advanced data processing methods to convert the original multi-source heterogeneous field monitoring data into different types of specific physical indicators in order to make effective decisions regarding inspection, maintenance and management. Conventional approaches to data analysis are confronted with challenges from environmental noise, the volume of measurement data, the complexity of computation, etc., and they severely constrain the pervasive application of SHM technology. In recent years, with the rapid progress of computing hardware and image acquisition equipment, the deep learning-based data processing approach offers a new channel for excavating the massive data from an SHM system, towards autonomous, accurate and robust processing of the monitoring data. Many researchers from the SHM community have made efforts to explore the applications of deep learning-based approaches for structural damage detection and structural condition assessment. This paper gives a review on the deep learning-based SHM of civil infrastructures with the main content, including a brief summary of the history of the development of deep learning, the applications of deep learning-based data processing approaches in the SHM of many kinds of civil infrastructures, and the key challenges and future trends of the strategy of deep learning-based SHM.

Feature Detection using Measured 3D Data and Image Data (3차원 측정 데이터와 영상 데이터를 이용한 특징 형상 검출)

  • Kim, Hansol;Jung, Keonhwa;Chang, Minho;Kim, Junho
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.30 no.6
    • /
    • pp.601-606
    • /
    • 2013
  • 3D scanning is a technique to measure the 3D shape information of the object. Shape information obtained by 3D scanning is expressed either as point cloud or as polygon mesh type data that can be widely used in various areas such as reverse engineering and quality inspection. 3D scanning should be performed as accurate as possible since the scanned data is highly required to detect the features on an object in order to scan the shape of the object more precisely. In this study, we propose the method on finding the location of feature more accurately, based on the extended Biplane SNAKE with global optimization. In each iteration, we project the feature lines obtained by the extended Biplane SNAKE into each image plane and move the feature lines to the features on each image. We have applied this approach to real models to verify the proposed optimization algorithm.

Current Status of Taeniasis and Cysticercosis in Vietnam

  • De, Nguyen Van;Le, Thanh Hoa;Lien, Phan Thi Huong;Eom, Keeseon S.
    • Parasites, Hosts and Diseases
    • /
    • v.52 no.2
    • /
    • pp.125-129
    • /
    • 2014
  • Several reports on taeniasis and cysticercosis in Vietnam show that they are distributed in over 50 of 63 provinces. In some endemic areas, the prevalence of taeniasis was 0.2-12.0% and that of cysticercosis was 1.0-7.2%. The major symptoms of taeniasis included fidgeted anus, proglottids moving out of the anus, and proglottids in the feces. Clinical manifestations of cysticercosis in humans included subcutaneous nodules, epileptic seizures, severe headach, impaired vision, and memory loss. The species identification of Taenia in Vietnam included Taenia asiatica, Taenia saginata, and Taenia solium based on combined morphology and molecular methods. Only T. solium caused cysticercosis in humans. Praziquantel was chosen for treatment of taeniasis and albendazole for treatment of cysticercosis. The infection rate of cysticercus cellulosae in pigs was 0.04% at Hanoi slaughterhouses, 0.03-0.31% at provincial slaughterhouses in the north, and 0.9% in provincial slaughterhouses in the southern region of Vietnam. The infection rate of cysticercus bovis in cattle was 0.03-2.17% at Hanoi slaughterhouses. Risk factors investigated with regard to transmission of Taenia suggested that consumption of raw meat (eating raw meat 4.5-74.3%), inadequate or absent meat inspection and control, poor sanitation in some endemic areas, and use of untreated human waste as a fertilizer for crops may play important roles in Vietnam, although this remains to be validated.

Template Check and Block Matching Method for Automatic Defects Detection of the Back Light Unit (도광판의 자동결함검출을 위한 템플릿 검사와 블록 매칭 방법)

  • Han Chang-Ho;Cho Sang-Hee;Oh Choon-Suk;Ryu Young-Kee
    • The KIPS Transactions:PartB
    • /
    • v.13B no.4 s.107
    • /
    • pp.377-382
    • /
    • 2006
  • In this paper, two methods based on the use of morphology and pattern matching prior to detect classified defects automatically on the back light unit which is a part of display equipments are proposed. One is the template check method which detects small size defects by using closing and opening method, and the other is the block matching method which detects big size defects by comparing with four regions of uniform blocks. The TC algorithm also can detect defects on the non-uniform pattern of BLU by using revised Otsu method. The proposed method has been implemented on the automatic defect detection system we developed and has been tested image data of BLU captured by the system.