• Title/Summary/Keyword: Multi-Vision

Search Result 491, Processing Time 0.031 seconds

TFT-LCD Defect Detection Using Multi-level Threshold and Probability Density Function (다단계 임계화와 확률 밀도 함수를 이용한 TFT-LCD 결함 검출)

  • Kim, Se-Yun;Jung, Chang-Do;Yun, Byoung-Ju;Joo, Young-Bok;Choi, Byung-Jae;Park, Kil-Houm
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.5
    • /
    • pp.615-621
    • /
    • 2009
  • TFT-LCD image consists of ununiform background, random noises and target defect signal components. Defects in TFT-LCD have some intensity variations compared to background region. It is sometimes difficult for human inspectors to figure out. In this paper, we propose multi-level threshold scheme for detection of the real defect using probability density function with Parzen Window. The experimental results show that the proposed algorithms produce promising results and can be applied to automated inspection systems for finding defects in the TFT-LCD image.

Deep Local Multi-level Feature Aggregation Based High-speed Train Image Matching

  • Li, Jun;Li, Xiang;Wei, Yifei;Wang, Xiaojun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.5
    • /
    • pp.1597-1610
    • /
    • 2022
  • At present, the main method of high-speed train chassis detection is using computer vision technology to extract keypoints from two related chassis images firstly, then matching these keypoints to find the pixel-level correspondence between these two images, finally, detection and other steps are performed. The quality and accuracy of image matching are very important for subsequent defect detection. Current traditional matching methods are difficult to meet the actual requirements for the generalization of complex scenes such as weather, illumination, and seasonal changes. Therefore, it is of great significance to study the high-speed train image matching method based on deep learning. This paper establishes a high-speed train chassis image matching dataset, including random perspective changes and optical distortion, to simulate the changes in the actual working environment of the high-speed rail system as much as possible. This work designs a convolutional neural network to intensively extract keypoints, so as to alleviate the problems of current methods. With multi-level features, on the one hand, the network restores low-level details, thereby improving the localization accuracy of keypoints, on the other hand, the network can generate robust keypoint descriptors. Detailed experiments show the huge improvement of the proposed network over traditional methods.

Updating BIM: Reflecting Thermographic Sensing in BIM-based Building Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.532-536
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

  • PDF

Scaling Attack Method for Misalignment Error of Camera-LiDAR Calibration Model (카메라-라이다 융합 모델의 오류 유발을 위한 스케일링 공격 방법)

  • Yi-ji Im;Dae-seon Choi
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.33 no.6
    • /
    • pp.1099-1110
    • /
    • 2023
  • The recognition system of autonomous driving and robot navigation performs vision work such as object recognition, tracking, and lane detection after multi-sensor fusion to improve performance. Currently, research on a deep learning model based on the fusion of a camera and a lidar sensor is being actively conducted. However, deep learning models are vulnerable to adversarial attacks through modulation of input data. Attacks on the existing multi-sensor-based autonomous driving recognition system are focused on inducing obstacle detection by lowering the confidence score of the object recognition model.However, there is a limitation that an attack is possible only in the target model. In the case of attacks on the sensor fusion stage, errors in vision work after fusion can be cascaded, and this risk needs to be considered. In addition, an attack on LIDAR's point cloud data, which is difficult to judge visually, makes it difficult to determine whether it is an attack. In this study, image scaling-based camera-lidar We propose an attack method that reduces the accuracy of LCCNet, a fusion model (camera-LiDAR calibration model). The proposed method is to perform a scaling attack on the point of the input lidar. As a result of conducting an attack performance experiment by size with a scaling algorithm, an average of more than 77% of fusion errors were caused.

A study on development of automatic welding system for corrugated membranes of the LNG tank (LNG 탱크의 주름진 내벽박판용 자동용접시스템의 개발에 관한 연구)

  • 유제용;유원상;나석주;강계형;한용섭
    • Journal of Welding and Joining
    • /
    • v.14 no.1
    • /
    • pp.99-106
    • /
    • 1996
  • Development of an automatic TIG welding system incorporating a vision sensor and torch control mechanism leads to an improved welding quality and greater production efficiency. The automatic welding system should be greatly restricted in its size and weight for the LNG(Liquefied Natural Gas) storage tank and also provide a unique torch rotating mechanism which keeps the torch tip in the constant position while the angle is changed continuously to maintain the welding torch substantially perpendicular to the weld line. The developed system is driven by two translation axes X, Z and one rotational axis. A moving line window method is adopted to the image recognition of the corrugated membranes with specular reflection. This method decides original laser stripe patterns in image which is affected by multi-reflection. A self-teaching algorithm, which guides the automatic welding machine with the information provided by the CCD camera without any previous learning of a reference trajectory, was developed for tracking the corrugated membrane of the LNG tank along the weld line.

  • PDF

Distance Detection between Vehicles Using Stereo Vision (스테레오 비젼을 이용한 차량간 거리정보 검출)

  • Yang, Seok-Joo;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.6 no.1
    • /
    • pp.27-36
    • /
    • 2002
  • As the number of autonomous vehicles is increased, drivers are trending toward constant interests in detecting distance between vehicles in close-range and maintaining the distance between forward and backward vehicles for drivers' safety. In this paper, we propose a method of detecting the distance between two vehicles by computing the disparity of the close-rang vehicle using stereo vision. The boundary of the vehicle is obtained by using the modified wavelet transform which has multi-resolution characteristics. Then the disparity between left and right images is computed using coarse-to-fine method and histogram matching. Here we transform the left-right stereo images through 3-steps using the modified wavelet for maintaining the original resolution. An experimental result showed that the proposed method had 4.65% in total error rate.

  • PDF

Multi-Channel Vision System for On-Line Quantification of Appearance Quality Factors of Apple

  • Lee, Soo Hee;Noh, Sang Ha
    • Agricultural and Biosystems Engineering
    • /
    • v.1 no.2
    • /
    • pp.106-110
    • /
    • 2000
  • An integrated on-line inspection system was constructed with seven cameras, half mirrors to split images. 720 nm and 970 nm band pass filters, illumination chamber having several tungsten-halogen lamps, one main computer, one color frame grabber, two 4-channel multiplexors, and flat plate conveyer, etc. A total of seven images, that is, one color image form the top of an apple and two B/W images from each side (top, right and left) could be captured and displayed on a computer monitor through the multiplexor. One of the two B/W images captured from each side is 720nm filtered image and the other is 970 nm. With this system an on-line grading software was developed to evaluate appearance quality. On-line test results with Fuji apples that were manually fed on the conveyer showed that grading accuracies of the color, defect and shape were 95.3%, 86% and 88.6%, respectively. Grading time was 0.35 second per apple on an average. Therefore, this on-line grading system could be used for inspection of the final products produced from an apple sorting system.

  • PDF

Crowd Activity Recognition using Optical Flow Orientation Distribution

  • Kim, Jinpyung;Jang, Gyujin;Kim, Gyujin;Kim, Moon-Hyun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.8
    • /
    • pp.2948-2963
    • /
    • 2015
  • In the field of computer vision, visual surveillance systems have recently become an important research topic. Growth in this area is being driven by both the increase in the availability of inexpensive computing devices and image sensors as well as the general inefficiency of manual surveillance and monitoring. In particular, the ultimate goal for many visual surveillance systems is to provide automatic activity recognition for events at a given site. A higher level of understanding of these activities requires certain lower-level computer vision tasks to be performed. So in this paper, we propose an intelligent activity recognition model that uses a structure learning method and a classification method. The structure learning method is provided as a K2-learning algorithm that generates Bayesian networks of causal relationships between sensors for a given activity. The statistical characteristics of the sensor values and the topological characteristics of the generated graphs are learned for each activity, and then a neural network is designed to classify the current activity according to the features extracted from the multiple sensor values that have been collected. Finally, the proposed method is implemented and tested by using PETS2013 benchmark data.

RLDB: Robust Local Difference Binary Descriptor with Integrated Learning-based Optimization

  • Sun, Huitao;Li, Muguo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.9
    • /
    • pp.4429-4447
    • /
    • 2018
  • Local binary descriptors are well-suited for many real-time and/or large-scale computer vision applications, while their low computational complexity is usually accompanied by the limitation of performance. In this paper, we propose a new optimization framework, RLDB (Robust-LDB), to improve a typical region-based binary descriptor LDB (local difference binary) and maintain its computational simplicity. RLDB extends the multi-feature strategy of LDB and applies a more complete region-comparing configuration. A cascade bit selection method is utilized to select the more representative patterns from massive comparison pairs and an online learning strategy further optimizes descriptor for each specific patch separately. They both incorporate LDP (linear discriminant projections) principle to jointly guarantee the robustness and distinctiveness of the features from various scales. Experimental results demonstrate that this integrated learning framework significantly enhances LDB. The improved descriptor achieves a performance comparable to floating-point descriptors on many benchmarks and retains a high computing speed similar to most binary descriptors, which better satisfies the demands of applications.

A Study on Implementation for Real-time Lane Departure Warning System & Smart Night Vision Based on HDR Camera Platform (실시간 차선 이탈 경고 및 Smart Night Vision을 위한 HDR Camera Platform 구현에 관한 연구)

  • Park, Hwa-Beom;Park, Ge-O;Kim, Young-kil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.05a
    • /
    • pp.123-126
    • /
    • 2017
  • The information and communication technology that is being developed recently has been greatly influencing the automobile market. In recent years, devices equipped with IT technology have been installed for the safety and convenience of the driver. However, it has the advantage of increased convenience as well as the disadvantage of increasing traffic accidents due to driver 's distraction. In order to prevent such accidents, it is necessary to develop safety systems of various types and ways. In this paper, we propose a method to implement a multi-function camera driving safety system that notifies a pedestrian and lane departure warning without using a radar sensor or a stereo video image, and a study on the analysis of a lane departure alarm software result.

  • PDF