• Title/Summary/Keyword: vision based inspection

Search Result 231, Processing Time 0.029 seconds

Metal pad Discolored Image Classification Algorithm using Geometric Texture Information (기하학적 텍스쳐 정보를 이용한 금속 패드 변색영상 분류 알고리즘)

  • Cui, Xue Nan;Kim, Hak-Il
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.5
    • /
    • pp.469-475
    • /
    • 2010
  • This paper presents a method of classifying discolored defects of metal pads using geometric texture for AFVI (Automated Final Vision Inspection) systems. In PCB manufacturing process, the metal pads on PCB can be oxidized and discolored partly due to various environmental factors. Nowadays the discolored defects are manually detected and rejected from the process. This paper proposes an efficient geometric texture feature, SUTF (Symmetry and Uniformity Texture Feature) based on the symmetric and uniform textural characteristics of the surface of circular metal pads for automating AFVI systems. In practical experiments with real samples acquired from a production line, 30 discolored images and 1232 roughness images are tested. The experimental results demonstrate that the proposed method using SUTFs provides better performance compared to Gabor feature with 0% FNR (False Negative Rate) and 1.46% FPR (False Positive Rate). The performance of the proposed method shows its applicability in the real manufacturing systems.

2D/3D Visual Optical Inspection System for Quad Chip (Quad Chip 외관 불량 검사를 위한 2D/3D 광학 시스템)

  • Han, Chang Ho;Lee, Sangjoon;Park, Chul-Geon;Lee, Ji Yeon;Ryu, Young-Kee;Ko, Kuk Won
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.1
    • /
    • pp.684-692
    • /
    • 2016
  • In the manufacturing process of the LQFP/TQFP (Low-profile Quad Flat Package/Thin Quad Flat Package), the requirement of a 3 dimensional inspection is increasing rapidly and a 3D inspection of the shape of a chip has become an important report of quality control. This study developed a 3 dimensional measurement system based on PMP (Phase Measuring Profilometry) for an inspection of the LQFP/TQFP chip and image processing algorithms. The defects of the LQFP/TQFP chip were classified according to the dimensions. The 2 dimensional optical system was designed by the dorm illumination to achieve constant light distribution, In the 3 dimensional optical system, PZT was used for moving 90 degree in phase. The problem of 2 ambiguity was solved from the measured moir? pattern using the ambiguity elimination algorithm that finds the point of ambiguity and refines the phase value. The proposed 3D measurement system was evaluated experimentally.

UAV-based bridge crack discovery via deep learning and tensor voting

  • Xiong Peng;Bingxu Duan;Kun Zhou;Xingu Zhong;Qianxi Li;Chao Zhao
    • Smart Structures and Systems
    • /
    • v.33 no.2
    • /
    • pp.105-118
    • /
    • 2024
  • In order to realize tiny bridge crack discovery by UAV-based machine vision, a novel method combining deep learning and tensor voting is proposed. Firstly, the grid images of crack are detected and descripted based on SE-ResNet50 to generate feature points. Then, the probability significance map of crack image is calculated by tensor voting with feature points, which can define the direction and region of crack. Further, the crack detection anchor box is formed by non-maximum suppression from the probability significance map, which can improve the robustness of tiny crack detection. Finally, a case study is carried out to demonstrate the effectiveness of the proposed method in the Xiangjiang-River bridge inspection. Compared with the original tensor voting algorithm, the proposed method has higher accuracy in the situation of only 1-2 pixels width crack and the existence of edge blur, crack discontinuity, which is suitable for UAV-based bridge crack discovery.

A Review on Meat Quality Evaluation Methods Based on Non-Destructive Computer Vision and Artificial Intelligence Technologies

  • Shi, Yinyan;Wang, Xiaochan;Borhan, Md Saidul;Young, Jennifer;Newman, David;Berg, Eric;Sun, Xin
    • Food Science of Animal Resources
    • /
    • v.41 no.4
    • /
    • pp.563-588
    • /
    • 2021
  • Increasing meat demand in terms of both quality and quantity in conjunction with feeding a growing population has resulted in regulatory agencies imposing stringent guidelines on meat quality and safety. Objective and accurate rapid non-destructive detection methods and evaluation techniques based on artificial intelligence have become the research hotspot in recent years and have been widely applied in the meat industry. Therefore, this review surveyed the key technologies of non-destructive detection for meat quality, mainly including ultrasonic technology, machine (computer) vision technology, near-infrared spectroscopy technology, hyperspectral technology, Raman spectra technology, and electronic nose/tongue. The technical characteristics and evaluation methods were compared and analyzed; the practical applications of non-destructive detection technologies in meat quality assessment were explored; and the current challenges and future research directions were discussed. The literature presented in this review clearly demonstrate that previous research on non-destructive technologies are of great significance to ensure consumers' urgent demand for high-quality meat by promoting automatic, real-time inspection and quality control in meat production. In the near future, with ever-growing application requirements and research developments, it is a trend to integrate such systems to provide effective solutions for various grain quality evaluation applications.

BIM and Thermographic Sensing: Reflecting the As-is Building Condition in Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • Journal of Construction Engineering and Project Management
    • /
    • v.5 no.4
    • /
    • pp.16-22
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. Several case studies were conducted to experimentally evaluate their impact on BIM-based energy analysis to calculate energy load. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

Updating BIM: Reflecting Thermographic Sensing in BIM-based Building Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.532-536
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

  • PDF

Leveraging Deep Learning and Farmland Fertility Algorithm for Automated Rice Pest Detection and Classification Model

  • Hussain. A;Balaji Srikaanth. P
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.18 no.4
    • /
    • pp.959-979
    • /
    • 2024
  • Rice pest identification is essential in modern agriculture for the health of rice crops. As global rice consumption rises, yields and quality must be maintained. Various methodologies were employed to identify pests, encompassing sensor-based technologies, deep learning, and remote sensing models. Visual inspection by professionals and farmers remains essential, but integrating technology such as satellites, IoT-based sensors, and drones enhances efficiency and accuracy. A computer vision system processes images to detect pests automatically. It gives real-time data for proactive and targeted pest management. With this motive in mind, this research provides a novel farmland fertility algorithm with a deep learning-based automated rice pest detection and classification (FFADL-ARPDC) technique. The FFADL-ARPDC approach classifies rice pests from rice plant images. Before processing, FFADL-ARPDC removes noise and enhances contrast using bilateral filtering (BF). Additionally, rice crop images are processed using the NASNetLarge deep learning architecture to extract image features. The FFA is used for hyperparameter tweaking to optimise the model performance of the NASNetLarge, which aids in enhancing classification performance. Using an Elman recurrent neural network (ERNN), the model accurately categorises 14 types of pests. The FFADL-ARPDC approach is thoroughly evaluated using a benchmark dataset available in the public repository. With an accuracy of 97.58, the FFADL-ARPDC model exceeds existing pest detection methods.

Anomaly Detection of Generative Adversarial Networks considering Quality and Distortion of Images (이미지의 질과 왜곡을 고려한 적대적 생성 신경망과 이를 이용한 비정상 검출)

  • Seo, Tae-Moon;Kang, Min-Guk;Kang, Dong-Joong
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.3
    • /
    • pp.171-179
    • /
    • 2020
  • Recently, studies have shown that convolution neural networks are achieving the best performance in image classification, object detection, and image generation. Vision based defect inspection which is more economical than other defect inspection, is a very important for a factory automation. Although supervised anomaly detection algorithm has far exceeded the performance of traditional machine learning based method, it is inefficient for real industrial field due to its tedious annotation work, In this paper, we propose ADGAN, a unsupervised anomaly detection architecture using the variational autoencoder and the generative adversarial network which give great results in image generation task, and demonstrate whether the proposed network architecture identifies anomalous images well on MNIST benchmark dataset as well as our own welding defect dataset.

Adaptive Thresholding Method Using Zone Searching Based on Representative Points for Improving the Performance of LCD Defect Detection (LCD 결함 검출 성능 개선을 위한 대표점 기반의 영역 탐색을 이용한 적응적 이진화 기법)

  • Kim, Jin-Uk;Ko, Yun-Ho;Lee, Si-Woong
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.7
    • /
    • pp.689-699
    • /
    • 2016
  • As the demand for LCD increases, the importance of inspection equipment for improving the efficiency of LCD production is continuously emphasized. The pattern inspection apparatus is one that detects minute defects of pattern quickly using optical equipment such as line scan camera. This pattern inspection apparatus makes a decision on whether a pixel is a defect or not using a single threshold value in order to meet constraint of real time inspection. However, a method that uses an adaptive thresholding scheme with different threshold values according to characteristics of each region in a pattern can greatly improve the performance of defect detection. To apply this adaptive thresholding scheme it has to be known that a certain pixel to be inspected belongs to which region. Therefore, this paper proposes a region matching algorithm that recognizes the region of each pixel to be inspected. The proposed algorithm is based on the pattern matching scheme with the consideration of real time constraint of machine vision and implemented through GPGPU in order to be applied to a practical system. Simulation results show that the proposed method not only satisfies the requirement for processing time of practical system but also improves the performance of defect detection.

An Efficient Algorithm for 3-D Range Measurement using Disparity of Stereoscopic Camera (스테레오 카메라의 양안 시차를 이용한 거리 계측의 고속 연산 알고리즘)

  • 김재한
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.5 no.6
    • /
    • pp.1163-1168
    • /
    • 2001
  • The ranging systems measure range data in three-dimensional coordinate from target surface. These non-contact remote ranging systems is widely used in various automation applications, including military equipment, construction field, navigation, inspection, assembly, and robot vision. The active ranging systems using time of flight technique or light pattern illumination technique are complex and expensive, the passive systems based on stereo or focusing principle are time-consuming. The proposed algorithm, that is based on cross correlation of projection profile of vertical edge, provides advantages of fast and simple operation in the range acquisition. The results of experiment show the effectiveness of the proposed algorithm.

  • PDF