• Title/Summary/Keyword: Multi-modal system

Search Result 274, Processing Time 0.031 seconds

BIM and Thermographic Sensing: Reflecting the As-is Building Condition in Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • Journal of Construction Engineering and Project Management
    • /
    • v.5 no.4
    • /
    • pp.16-22
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. Several case studies were conducted to experimentally evaluate their impact on BIM-based energy analysis to calculate energy load. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

Updating BIM: Reflecting Thermographic Sensing in BIM-based Building Energy Analysis

  • Ham, Youngjib;Golparvar-Fard, Mani
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.532-536
    • /
    • 2015
  • This paper presents an automated computer vision-based system to update BIM data by leveraging multi-modal visual data collected from existing buildings under inspection. Currently, visual inspections are conducted for building envelopes or mechanical systems, and auditors analyze energy-related contextual information to examine if their performance is maintained as expected by the design. By translating 3D surface thermal profiles into energy performance metrics such as actual R-values at point-level and by mapping such properties to the associated BIM elements using XML Document Object Model (DOM), the proposed method shortens the energy performance modeling gap between the architectural information in the as-designed BIM and the as-is building condition, which improve the reliability of building energy analysis. The experimental results on existing buildings show that (1) the point-level thermography-based thermal resistance measurement can be automatically matched with the associated BIM elements; and (2) their corresponding thermal properties are automatically updated in gbXML schema. This paper provides practitioners with insight to uncover the fundamentals of how multi-modal visual data can be used to improve the accuracy of building energy modeling for retrofit analysis. Open research challenges and lessons learned from real-world case studies are discussed in detail.

  • PDF

Modal parameter identification of tall buildings based on variational mode decomposition and energy separation

  • Kang Cai;Mingfeng Huang;Xiao Li;Haiwei Xu;Binbin Li;Chen Yang
    • Wind and Structures
    • /
    • v.37 no.6
    • /
    • pp.445-460
    • /
    • 2023
  • Accurate estimation of modal parameters (i.e., natural frequency, damping ratio) of tall buildings is of great importance to their structural design, structural health monitoring, vibration control, and state assessment. Based on the combination of variational mode decomposition, smoothed discrete energy separation algorithm-1, and Half-cycle energy operator (VMD-SH), this paper presents a method for structural modal parameter estimation. The variational mode decomposition is proved to be effective and reliable for decomposing the mixed-signal with low frequencies and damping ratios, and the validity of both smoothed discrete energy separation algorithm-1 and Half-cycle energy operator in the modal identification of a single modal system is verified. By incorporating these techniques, the VMD-SH method is able to accurately identify and extract the various modes present in a signal, providing improved insights into its underlying structure and behavior. Subsequently, a numerical study of a four-story frame structure is conducted using the Newmark-β method, and it is found that the relative errors of natural frequency and damping ratio estimated by the presented method are much smaller than those by traditional methods, validating the effectiveness and accuracy of the combined method for the modal identification of the multi-modal system. Furthermore, the presented method is employed to estimate modal parameters of a full-scale tall building utilizing acceleration responses. The identified results verify the applicability and accuracy of the presented VMD-SH method in field measurements. The study demonstrates the effectiveness and robustness of the proposed VMD-SH method in accurately estimating modal parameters of tall buildings from acceleration response data.

Analytical Method to Analyze the Effect of Tolerance on the Modal Characteristic of Multi-body Systems in Dynamic Equilibrium (동적 평형위치에 있는 다물체계의 모드특성에 미치는 공차의 영향 분석을 위한 해석적 방법)

  • Kim, Bum-Suk;Yoo, Hong-Hee
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.17 no.7 s.124
    • /
    • pp.579-586
    • /
    • 2007
  • Analytical method to analyze the effect of tolerance on the modal characteristic of multi-body systems in dynamic equilibrium position is suggested in this paper. Monte-Carlo method is conventionally employed to perform the tolerance analysis. However, Monte-Carlo method spends too much time for analysis and has a greater or less accuracy depending on sample condition. To resolve these problems, an analytical method is suggested in this paper. Sensitivity equations for damped natural frequencies and the transfer function are derived at the dynamic equilibrium position. By employing the sensitivity information of mass, damping and stiffness matrices, the sensitivities of damped natural frequencies and the transfer function can be calculated.

A Study on the Implementation of the Integrated Information System for Emergency Handling in Multi-modal Transfer Stations (복합형 환승센터에서의 상황대응을 위한 통합정보시스템 구축에 관한 연구)

  • Kim, Hyun-Tae;Han, Jeong-Hun;Jang, Bong-Seob;Kim, Hwang-Bae
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.16 no.3
    • /
    • pp.87-94
    • /
    • 2008
  • In this study, deals with selection of monitoring objects to handle emergency cases of multi-modal transfer stations and information required for emergency surveillance, recognition, verification, propagation, processing and situation closing. Furthermore, this article suggests integrated management scheme for the above information and methods which offer appropriate information required for situation handling decisions at each stage of situation changes. The transfer station which consists of facilities, passengers, and transportations has limitations in required monitoring information. So, for the situation recognition and handling strategy, case-based reasoning of the expert system was used to apply experience, knowledge, and past cases of situation handling experts. The article also suggests methods to control facilities which are operated at transfer stations and these methods can minimize spatial confusions and damages at the emergency situation. The real time situation information will be shared by proper facility controls to support services from external institutions.

  • PDF

Emotion-based Real-time Facial Expression Matching Dialogue System for Virtual Human (감정에 기반한 가상인간의 대화 및 표정 실시간 생성 시스템 구현)

  • Kim, Kirak;Yeon, Heeyeon;Eun, Taeyoung;Jung, Moonryul
    • Journal of the Korea Computer Graphics Society
    • /
    • v.28 no.3
    • /
    • pp.23-29
    • /
    • 2022
  • Virtual humans are implemented with dedicated modeling tools like Unity 3D Engine in virtual space (virtual reality, mixed reality, metaverse, etc.). Various human modeling tools have been introduced to implement virtual human-like appearance, voice, expression, and behavior similar to real people, and virtual humans implemented via these tools can communicate with users to some extent. However, most of the virtual humans so far have stayed unimodal using only text or speech. As AI technologies advance, the outdated machine-centered dialogue system is now changing to a human-centered, natural multi-modal system. By using several pre-trained networks, we implemented an emotion-based multi-modal dialogue system, which generates human-like utterances and displays appropriate facial expressions in real-time.

Telepresence Robotic Technology for Individuals with Visual Impairments Through Real-time Haptic Rendering (실시간 햅틱 렌더링 기술을 통한 시각 장애인을 위한 원격현장감(Telepresence) 로봇 기술)

  • Park, Chung Hyuk;Howard, Ayanna M.
    • The Journal of Korea Robotics Society
    • /
    • v.8 no.3
    • /
    • pp.197-205
    • /
    • 2013
  • This paper presents a robotic system that provides telepresence to the visually impaired by combining real-time haptic rendering with multi-modal interaction. A virtual-proxy based haptic rendering process using a RGB-D sensor is developed and integrated into a unified framework for control and feedback for the telepresence robot. We discuss the challenging problem of presenting environmental perception to a user with visual impairments and our solution for multi-modal interaction. We also explain the experimental design and protocols, and results with human subjects with and without visual impairments. Discussion on the performance of our system and our future goals are presented toward the end.

Dynamic Analysis of Carbon-fiber-reinforced Plastic for Different Multi-layered Fabric Structure (적층 직물 구조에 따른 탄소강화플라스틱 소재 동적 특성 분석)

  • Kim, Chan-Jung
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.26 no.4
    • /
    • pp.375-382
    • /
    • 2016
  • The mechanical property of a carbon-fiber-reinforced plastic (CFRP) is subjected to two elements, carbon fiber and polymer resin, in a first step and the selection of multi-layered structure is second one. Many combination of fabric layers, i.e. plainweave, twillweave, can be derived for candidates of test specimen used for a basic mechanical components so that a reliable identification of dynamic nature of possible multi-layered structures are essential during the development of CFRP based component system. In this paper, three kinds of multi-layered structure specimens were prepared and the dynamic characteristics of service specimens were conducted through classical modal test process with impact hammer. In addition, the design sensitivity analysis based on transmissibility function was applied for the measured response data so that the response sensitivity for each resonance frequency were compared for three CFRP test specimens. Finally, the evaluation of CFRP specimen over different multi-layered fabric structures are commented from the experimental consequences.