• Title/Summary/Keyword: 3D Environment Reconstruction

Search Result 82, Processing Time 0.026 seconds

Environment Map Based Disparity (환경맵 기반 디스페러티)

  • Ryoo Seung-Taek
    • Journal of Korea Multimedia Society
    • /
    • v.9 no.1
    • /
    • pp.109-118
    • /
    • 2006
  • In this paper, we suggest the environment based disparity method that calculate the depth value of the objects from environment maps. This method using the disparity of the environment map can calculate the depth value from two environment map that acquire at different viewpoint. This method can decide the visibility of the object whether it is occluded others or not. Also, we can analogize the depth value of the object that does not relate the reference plane(in case of being in the air) and make three dimensional environment model using the proposed method

  • PDF

EPAR V2.0: AUTOMATED MONITORING AND VISUALIZATION OF POTENTIAL AREAS FOR BUILDING RETROFIT USING THERMAL CAMERAS AND COMPUTATIONAL FLUID DYNAMICS (CFD) MODELS

  • Youngjib Ham;Mani Golparvar-Fard
    • International conference on construction engineering and project management
    • /
    • 2013.01a
    • /
    • pp.279-286
    • /
    • 2013
  • This paper introduces a new method for identification of building energy performance problems. The presented method is based on automated analysis and visualization of deviations between actual and expected energy performance of the building using EPAR (Energy Performance Augmented Reality) models. For generating EPAR models, during building inspections, energy auditors collect a large number of digital and thermal imagery using a consumer-level single thermal camera that has a built-in digital lens. Based on a pipeline of image-based 3D reconstruction algorithms built on GPU and multi-core CPU architecture, 3D geometrical and thermal point cloud models of the building under inspection are automatically generated and integrated. Then, the resulting actual 3D spatio-thermal model and the expected energy performance model simulated using computational fluid dynamics (CFD) analysis are superimposed within an augmented reality environment. Based on the resulting EPAR models which jointly visualize the actual and expected energy performance of the building under inspection, two new algorithms are introduced for quick and reliable identification of potential performance problems: 1) 3D thermal mesh modeling using k-d trees and nearest neighbor searching to automate calculation of temperature deviations; and 2) automated visualization of performance deviations using a metaphor based on traffic light colors. The proposed EPAR v2.0 modeling method is validated on several interior locations of a residential building and an instructional facility. Our empirical observations show that the automated energy performance analysis using EPAR models enables performance deviations to be rapidly and accurately identified. The visualization of performance deviations in 3D enables auditors to easily identify potential building performance problems. Rather than manually analyzing thermal imagery, auditors can focus on other important tasks such as evaluating possible remedial alternatives.

  • PDF

Framework for Reconstructing 2D Data Imported from Mobile Devices into 3D Models

  • Shin, WooSung;Min, JaeEun;Han, WooRi;Kim, YoungSeop
    • Journal of the Semiconductor & Display Technology
    • /
    • v.20 no.4
    • /
    • pp.6-9
    • /
    • 2021
  • The 3D industry is drawing attention for its applications in various markets, including architecture, media, VR/AR, metaverse, imperial broadcast, and etc.. The current feature of the architecture we are introducing is to make 3D models more easily created and modified than conventional ones. Existing methods for generating 3D models mainly obtain values using specialized equipment such as RGB-D cameras and Lidar cameras, through which 3D models are constructed and used. This requires the purchase of equipment and allows the generated 3D model to be verified by the computer. However, our framework allows users to collect data in an easier and cheaper manner using cell phone cameras instead of specialized equipment, and uses 2D data to proceed with 3D modeling on the server and output it to cell phone application screens. This gives users a more accessible environment. In addition, in the 3D modeling process, object classification is attempted through deep learning without user intervention, and mesh and texture suitable for the object can be applied to obtain a lively 3D model. It also allows users to modify mesh and texture through requests, allowing them to obtain sophisticated 3D models.

3D Information based Visualization System for Real-Time Teleoperation of Unmanned Ground Vehicles (무인 지상 로봇의 실시간 원격 제어를 위한 3차원 시각화 시스템)

  • Jang, Ga-Ram;Bae, Ji-Hun;Lee, Dong-Hyuk;Park, Jae-Han
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.4
    • /
    • pp.220-229
    • /
    • 2018
  • In the midst of disaster, such as an earthquake or a nuclear radiation exposure area, there are huge risks to send human crews. Many robotic researchers have studied to send UGVs in order to replace human crews at dangerous environments. So far, two-dimensional camera information has been widely used for teleoperation of UGVs. Recently, three-dimensional information based teleoperations are attempted to compensate the limitations of camera information based teleoperation. In this paper, the 3D map information of indoor and outdoor environments reconstructed in real-time is utilized in the UGV teleoperation. Further, we apply the LTE communication technology to endure the stability of the teleoperation even under the deteriorate environment. The proposed teleoperation system is performed at explosive disposal missions and their feasibilities could be verified through completion of that missions using the UGV with the Explosive Ordnance Disposal (EOD) team of Busan Port Security Corporation.

A Study on the Dynamic Expression of Fabrics based on RGB-D Sensor and 3D Virtual Clothing CAD System (RGB-D 센서 및 3D Virtual Clothing CAD활용에 의한 패션소재의 동적표현 시스템에 대한 연구)

  • Lee, Jieun;Kim, Soulkey;Kim, Jongjun
    • Journal of Fashion Business
    • /
    • v.17 no.1
    • /
    • pp.30-41
    • /
    • 2013
  • Augmented reality techniques have been increasingly employed in the textile and fashion industry as well as computer graphics sectors. Three-dimensional virtual clothing CAD systems have also been widely used in the textile industries and academic institutes. Motion tracking techniques are grafted together in the 3D and augmented reality techniques in order to develop the virtual three-dimensional clothing and fitting systems in the fashion and textile industry sectors. In this study, three-dimensional virtual clothing sample has been prepared using a 3D virtual clothing CAD along with a 3D scanning and reconstruction system. Motion of the user has been captured through an RGB-D sensor system, and the virtual clothing fitted on the user's body is allowed to move along with the captured motion flow of the user. Acutal fabric specimens are selected for the material characterization. This study is a primary step toward building a comprehensive system for the user to experience interactively virtual clothing under real environment.

A Study on the Optimization for Three Dimensional Reconstruction of Bio Surface Using by Stereo Vision (스테레오 비젼에 의한 생체표면 3차원 복원의 최적화 연구)

  • Lee, Kyungchai;Lee, Onseok
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.66 no.1
    • /
    • pp.107-113
    • /
    • 2017
  • Unlike regular images, there is no ground truth for bio surface images. Result of biosurface imaging is not only significantly affected by the environment and the condition of the bio surface, it requires more detailed expression than regular images. Therefore, unlike algorithms tested on regular images, studies on bio surface images requires a highly precise optimization process. We aim to optimize the graph cut algorithm, known to be the most outstanding among the stereo visions, by considering baseline, lambda, and disparity range. Optimal results were in the range of 1~10 for lambda. The disparity ranged from -30 to -50, indicating an optimal value in a slightly higher range. Furthermore, we verified the tested optimization data using SIFT.

A Study on the Method for Reconstructing the Shell Plates Surface from Shell Template Offset Drawing (Shell Template Offset 도면을 활용한 선체 곡판 형상 복원 방법에 관한 연구)

  • Hwang, Inhyuck;Son, Seunghyeok
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.56 no.1
    • /
    • pp.66-74
    • /
    • 2019
  • In the field of shipbuilding design, the use of 3D CAD is becoming commonplace, and most of the large shipyards are conducting 3D design. However at the production site, workers are still working on 2D drawings rather than 3D models. This tendency is even worse in small-scale shipyards and block manufacturing shops. Particularly, in a manufacturing shop that is engaged in the outsourcing of blocks, it may not be possible to provide 3D model. However, the demand for 3D models in the production field is steadily increasing. Therefore, it would be helpful if 3D model could be generated from a 2D drawing. In this paper, we propose a method to extract template and unfolded surface shape information from shell template offset drawing using computer vision technology. Also a 3D surface model was reconstructed and visualized from the extracted information. The result of this study is thought to be helpful in the work environment where 3D model information can not be obtained.

Homology Modeling and Molecular Docking Analysis of Streptomyces peucetius CYP125A4 as C26 Monooxygenase

  • Lee, Seung-Won;Lee, Na-Rae;Lee, Ji-Hun;Oh, Tae-Jin
    • Bulletin of the Korean Chemical Society
    • /
    • v.33 no.6
    • /
    • pp.1885-1889
    • /
    • 2012
  • Among 23 cytochrome P450s, CYP125A4 was proposed as a putative monooxygenase based on the high level of amino acid sequence homology (54% identity and 75% similarity) with the well characterized C27-steroid $Mycobacterium$ $tuberculosis$ CYP125A1. Utilizing MTBCYP125A1 as a template, homology modeling of SPCYP125A4 was conducted by Accelrys Discovery Studio 3.1 software. The modeled SPCYP125A4 structure with lowest energy value was subsequently assessed for its stereochemical quality and side-chain environment. The final model was generated by showing its active site through the molecular dynamics. The docking of steroids showed broad specificity of SPCYP125A4 with different orientation of ligand within active site facing the heme. One poses of C27-steroid with C26 facing the heme with distance of 3.734 ${\AA}$ from the Fe were predominant.

A Study on Robot OLP Compensation Based on Image Based Visual Servoing in the Virtual Environment (가상 환경에서의 영상 기반 시각 서보잉을 통한 로봇 OLP 보상)

  • Shin Chan-Bai;Lee Jeh-Woon;Kim Jin-Dae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.3
    • /
    • pp.248-254
    • /
    • 2006
  • It is necessary to improve the exactness and adaptation of the working environment for the intelligent robot system. The vision sensor have been studied for a long time at this points. However, it has many processes and difficulties for the real usages. This paper proposes a visual servoing in the virtual environment to support OLP(Off-Line-Programming) path compensation and supplement the problem of complexity of the old kinematical calibration. Initial robot path could be compensated by pixel differences between real and virtual image. This method removes the varies calibrations and 3D reconstruction process in real working space. To show the validity of the proposed approach, virtual space servoing with stereo camera is carried out with WTK and openGL library for a KUKA-6R manipulator and updated real robot path.

Low-Power Discrete-Event SoC for 3DTV Active Shutter Glasses (3DTV 엑티브 셔터 안경을 위한 저전력 이산-사건 SoC)

  • Park, Dae-Jin;Kwak, Sung-Ho;Kim, Chang-Min;Kim, Tag-Gon
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.18-26
    • /
    • 2011
  • Debates concerning the competitive edge of leading 3DTV technology of the shutter glasses (SG) 3D and the film-type patterned retarder (FPR) are flaring up. Although SG technology enables Full-HD 3D vision, it requires complex systems including the sync transmitter (emitter), the sync processor chip, and the LCD lens in the active shutter glasses. In addition, the transferred sync-signal is easily affected by the external noise and a 3DTV viewer may feel flicker-effect caused by cross-talk of the left and right image. The operating current of the sync processor in the 3DTV active shutter glasses is gradually increasing to compensate the sync reconstruction error. The proposed chip is a low-power hardware sync processor based discrete-event SoC(system on a chip) designed specifically for the 3DTV active shutter glasses. This processor implements the newly designed power-saving techniques targeted for low-power operation in a noisy environment between 3DTV and the active shutter glasses. This design includes a hardware pre-processor based on a universal edge tracer and provides a perfect sync reconstruction based on a floating-point timer to advance the prior commercial 3DTV shutter glasses in terms of their power consumption. These two techniques enable an accurate sync reconstruction in the slow clock frequency of the synchronization timer and reduce the power consumption to less than about a maximum of 20% compared with other major commercial processors. This article describes the system's architecture and the details of the proposed techniques, also identifying the key concepts and functions.