• Journal of Construction Engineering and Project Management
• /
• v.5 no.4
• /
• pp.16-22
• /
• 2015

This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. Several case studies were conducted to experimentally evaluate their impact on BIM-based energy analysis to calculate energy load. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.532-536
• /
• 2015

This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.1
• /
• pp.453-458
• /
• 2016

One of the most common applications of machine vision is quality inspections in automated production. In this study, a welding inspection system that is controlled by a PC and a PLC equipped with a multi-camera setup was developed. The system was designed to measure the primary dimensions, such as the length and width of the welding areas. The TCP/IP protocols and multi-threading techniques were used for parallel control of the optical components and physical distribution. A coaxial light was used to maintain uniform lighting conditions and enhance the image quality of the weld areas. The core image processing system was established through a combination of various algorithms from the OpenCV library. The proposed vision inspection system was fully validated for an actual weld production line and was shown to satisfy the functional and performance requirements.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.399-408
• /
• 2020

The construction industry is suffering from aging workers, frequent accidents, as well as low productivity. With the rapid development of information technologies in recent years, automatic construction, especially automatic cranes, is regarded as a promising solution for the above problems and attracting more and more attention. However, in practice, limited by the complexity and dynamics of construction environment, manual inspection which is time-consuming and error-prone is still the only way to recognize the search object for the operation of crane. To solve this problem, an image-processing-based automated object recognition approach is proposed in this paper, which is a fusion of Convolutional-Neutral-Network (CNN)-based and traditional object detections. The search object is firstly extracted from the background by the trained Faster R-CNN. And then through a series of image processing including Canny, Hough and Endpoints clustering analysis, the vertices of the search object can be determined to locate it in 3D space uniquely. Finally, the features (e.g., centroid coordinate, size, and color) of the search object are extracted for further recognition. The approach presented in this paper was implemented in OpenCV, and the prototype was written in Microsoft Visual C++. This proposed approach shows great potential for the automatic operation of crane. Further researches and more extensive field experiments will follow in the future.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.18 no.4
• /
• pp.959-979
• /
• 2024

Rice pest identification is essential in modern agriculture for the health of rice crops. As global rice consumption rises, yields and quality must be maintained. Various methodologies were employed to identify pests, encompassing sensor-based technologies, deep learning, and remote sensing models. Visual inspection by professionals and farmers remains essential, but integrating technology such as satellites, IoT-based sensors, and drones enhances efficiency and accuracy. A computer vision system processes images to detect pests automatically. It gives real-time data for proactive and targeted pest management. With this motive in mind, this research provides a novel farmland fertility algorithm with a deep learning-based automated rice pest detection and classification (FFADL-ARPDC) technique. The FFADL-ARPDC approach classifies rice pests from rice plant images. Before processing, FFADL-ARPDC removes noise and enhances contrast using bilateral filtering (BF). Additionally, rice crop images are processed using the NASNetLarge deep learning architecture to extract image features. The FFA is used for hyperparameter tweaking to optimise the model performance of the NASNetLarge, which aids in enhancing classification performance. Using an Elman recurrent neural network (ERNN), the model accurately categorises 14 types of pests. The FFADL-ARPDC approach is thoroughly evaluated using a benchmark dataset available in the public repository. With an accuracy of 97.58, the FFADL-ARPDC model exceeds existing pest detection methods.

• Structural Engineering and Mechanics
• /
• v.87 no.3
• /
• pp.211-219
• /
• 2023

The structural health of a pipeline is usually assessed by visual inspection. In addition to the fact that this method is expensive and time consuming, inspection of the whole structure is not possible due to limited access to some points. Therefore, adopting a damage detection method without the mentioned limitations is important in order to increase the safety of the structure. In recent years, vibration-based methods have been used to detect damage. These methods detect structural defects based on the fact that the dynamic responses of the structure will change due to damage existence. Therefore, the location and extent of damage, before and after the damage, are determined. In this study, fuzzy genetic algorithm has been used to monitor the structural health of the pipeline to create a fuzzy automated system and all kinds of possible failure scenarios that can occur for the structure. For this purpose, the results of an experimental model have been used. Its numerical model is generated in ABAQUS software and the results of the analysis are used in the fuzzy genetic algorithm. Results show that the system is more accurate in detecting high-intensity damages, and the use of higher frequency modes helps to increase accuracy. Moreover, the system considers the damage in symmetric regions with the same degree of membership. To deal with the uncertainties, some error values are added, which are observed to be negligible up to 10% of the error.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.31 no.3
• /
• pp.147-153
• /
• 2018

Cracking in concrete structure must be examined according to appropriate methods, to ensure structural serviceability and to prevent structural deterioration, since cracks opened wide for a long time expedite corrosion of rebar. A site investigation is conducted in a regular basis to monitor structural deterioration by tracking growing cracks. However, the visual inspection are labor intensive. and judgment are subject. To overcome the limit of the on-site visual investigation image processing for identifying the cracks of concrete structures by analyzing 2D images has been developed. This study develops a unique 3D technique utilizing a line laser and its projection image onto concrete surfaces. Automated process of crack detection is developed by the algorithms of automatizing crack map generation and image data acquisition. Performance of the developed method is experimentally evaluated.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2019.05a
• /
• pp.220-222
• /
• 2019

Korean automobile industry has been slow down since 2016. The most fundamental solution for solving this problem is to develop competitive parts. There are two important factors for developing competitive parts. The most important is product design technology, and the second most important is production technology. Production technology is important because it requires lowering the production cost except for the material cost and continuously maintaining the quality. In this paper, an intelligent smart inspection system is proposed and designed to inspect automobile parts of company C. At present, the basic and detailed design of this system has been completed and it is in the development progress stage. If the system is successfully developed, it is expected that the quality inspection stage of company C will be automated and the defect rate will be reduced.

• Proceedings of the IEEK Conference
• /
• 2003.07c
• /
• pp.2537-2540
• /
• 2003

In this paper, an integrated monitoring system is implemented for industrial equipments which use different types of network protocols to communicate with other equipments. Dedicated gateway systems mate it difficult to modify or to add contents of network systems for communication with other systems. We suggest an integration method of effectively utilizing the general purpose gateway system (ETOS-l00A) which converts various types of protocols into TCP/IP protocol. To demonstrate the validity of the proposed integrated monitoring system, PLC-based automated inspection system is considered and the monitoring system is implemented using Visual Basic and HMI software.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.1
• /
• pp.91-97
• /
• 2000

In this paper, the illuminator is designed to recognize the shape and the existence of holes of radiation fin in the point that the light reflection characteristics are different according to the roughness of the material. The threshold value, the positions of holes and the black pixel nembers in the positon are obtained under the illuminator, in accordance with the reference image, by applying binary conversion and hole segmentation algorithm, as they are suggested in this paper, The existence and shape of hole are recognized by calculating the distance and feature value in the test image, which is obtained from the parameters of reference image. It is programmed to apply to GUI(Graphic User the Interface) in windows. More than 98% of recognition rate is shown, as it is applied to three different sizes of the radiation fin.