• Title/Summary/Keyword: Real-time stereo

Search Result 246, Processing Time 0.026 seconds

Generation of global coronal field extrapolation from frontside and AI-generated farside magnetograms

  • Jeong, Hyunjin;Moon, Yong-Jae;Park, Eunsu;Lee, Harim;Kim, Taeyoung
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.44 no.1
    • /
    • pp.52.2-52.2
    • /
    • 2019
  • Global map of solar surface magnetic field, such as the synoptic map or daily synchronic frame, does not tell us real-time information about the far side of the Sun. A deep-learning technique based on Conditional Generative Adversarial Network (cGAN) is used to generate farside magnetograms from EUVI $304{\AA}$ of STEREO spacecrafts by training SDO spacecraft's data pairs of HMI and AIA $304{\AA}$. Farside(or backside) data of daily synchronic frames are replaced by the Ai-generated magnetograms. The new type of data is used to calculate the Potential Field Source Surface (PFSS) model. We compare the results of the global field with observations as well as those of the conventional method. We will discuss advantage and disadvantage of the new method and future works.

  • PDF

FPGA implementation of NCC-based real-time stereo matching processor (FPGA를 이용한 NCC기반의 실시간 스테레오 매칭 프로세서 구현)

  • Kim, Byeong-Jin;Bae, Sang-Min;Koh, Kwang-Sik
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2011.11a
    • /
    • pp.322-325
    • /
    • 2011
  • 스테레오 비전 시스템에서 전통적인 매칭 알고리즘으로 SAD(Sum of Absolute Differences), SSD(Sum of Squared Differences), NCC(Normalized Cross Correlation) 등 다양한 알고리즘이 존재한다. 그러나 하드웨어로 실시간 처리를 위한 시스템을 구현하기 위해서는 리소스가 한정 되어있다는 제약 때문에 많은 연구에서 SAD 혹은 RT(Rank Transform), CT(Census Transform)를 많이 사용하게 된다. FPGA 내부에는 BRAM(Block RAM)과 MAC(multiply-accumulator)인 DSP슬라이스가 이미 존재한다. 본 논문에서는 BRAM과 DSP로직을 활용해서 전통적인 매칭 알고리즘 중에서 연산기 사용이 가장 많은 NCC를 FPGA로 실시간 처리 가능한 하드웨어 구조를 제안한다.

The Development of Device and the Algorithm for the Haptic Rendering (가상현실 역감구현을 위한 알고리즘과 장치개발)

  • 김영호;이경백;김영배
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2000.11a
    • /
    • pp.106-109
    • /
    • 2000
  • The virtual reality - haptic device is developed for the purpose used in the work that human cannot approach and that need elaborate exercises. To render haptic, the total system is constituted master, haptic device, and slave, remote manipulator. Human operates the remote manipulator. Human operates the remote manipulator relying on the hapti devices and stereo graphic. And then the force and scene of the remote manipulator is fed-back from each haptic devices and virtual devices. The feedback information gets system gain exactly. The system gain provides the most exact haptic and virtual devices. The feedback information gets system gain exactly. The system gain provides the most exact haptic and scene to human by the location, the graphic rendering and the haptic rendering algorithm on real-time. In this research, 3D haptic device is developed for common usage and make human feel the haptic when human contacts virtual object rendered by computer graphic. The haptic device is good for tracing location and producing devices because of the row structure. Also, openGL and Visual Basic is utilized to the algorithms for haptic rendering. The haptic device of this research makes the interface possible not only with virtual reality but also with the real remote manipulator.

  • PDF

A New Mapping Algorithm for Depth Perception in 3D Screen and Its Implementation (3차원 영상의 깊이 인식에 대한 매핑 알고리즘 구현)

  • Ham, Woon-Chul;Kim, Seung-Hwan
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.45 no.6
    • /
    • pp.95-101
    • /
    • 2008
  • In this paper, we present a new smoothing algorithm for variable depth mapping for real time stereoscopic image for 3D display. Proposed algorithm is based on the physical concept, called Laplacian equation and we also discuss the mapping of the depth from scene to displayed image. The approach to solve the problem in stereoscopic image which we adopt in this paper is similar to multi-region algorithm which was proposed by N.Holliman. The main difference thing in our algorithm compared with the N.Holliman's multi-region algorithm is that we use the Laplacian equation by considering the distance between viewer and object. We implement the real time stereoscopic image generation method for OpenGL on the circular polarized LCD screen to demonstrate its real functioning in the visual sensory system in human brain. Even though we make and use artificial objects by using OpenGL to simulate the proposed algorithm we assure that this technology may be applied to stereoscopic camera system not only for personal computer system but also for public broad cast system.

The Implementation of Multi-Channel Audio Codec for Real-Time operation (실시간 처리를 위한 멀티채널 오디오 코덱의 구현)

  • Hong, Jin-Woo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.2E
    • /
    • pp.91-97
    • /
    • 1995
  • This paper describes the implementation of a multi-channel audio codec for HETV. This codec has the features of the 3/2-stereo plus low frequency enhancement, downward compatibility with the smaller number of channels, backward compatibility with the existing 2/0-stereo system(MPEG-1 audio), and multilingual capability. The encoder of this codec consists of 6-channel analog audio input part with the sampling rate of 48 kHz, 4-channel digital audio input part and three TMS320C40 /DSPs. The encoder implements multi-channel audio compression using a human perceptual psychoacoustic model, and has the bit rate reduction to 384 kbit/s without impairment of subjective quality. The decoder consists of 6-channel analog audio output part, 4-channel digital audio output part, and two TMS320C40 DSPs for a decoding procedure. The decoder analyzes the bit stream received with bit rate of 384 kbit/s from the encoder and reproduces the multi-channel audio signals for analog and digital outputs. The multi-processing of this audio codec using multiple DSPs is ensured by high speed transfer of date between DSPs through coordinating communication port activities with DMA coprocessors. Finally, some technical considerations are suggested to realize the problem of real-time operation, which are found out through the implementation of this codec using the MPEG-2 layer II sudio coding algorithm and the use of the hardware architecture with commercial multiple DSPs.

  • PDF

Implementation of the SLAM System Using a Single Vision and Distance Sensors (단일 영상과 거리센서를 이용한 SLAM시스템 구현)

  • Yoo, Sung-Goo;Chong, Kil-To
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.45 no.6
    • /
    • pp.149-156
    • /
    • 2008
  • SLAM(Simultaneous Localization and Mapping) system is to find a global position and build a map with sensing data when an unmanned-robot navigates an unknown environment. Two kinds of system were developed. One is used distance measurement sensors such as an ultra sonic and a laser sensor. The other is used stereo vision system. The distance measurement SLAM with sensors has low computing time and low cost, but precision of system can be somewhat worse by measurement error or non-linearity of the sensor In contrast, stereo vision system can accurately measure the 3D space area, but it needs high-end system for complex calculation and it is an expensive tool. In this paper, we implement the SLAM system using a single camera image and a PSD sensors. It detects obstacles from the front PSD sensor and then perceive size and feature of the obstacles by image processing. The probability SLAM was implemented using the data of sensor and image and we verify the performance of the system by real experiment.

IIR Filter Design of HRTF for Real-Time Implementation of 3D Sound by Synthetic Stereo Method (합성 스테레오 방식 3차원 입체음향의 실시간 구현을 위한 머리전달 함수의 IIR 필터 설계)

  • Park Jang-Sik;Kim Hyun-Tae
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.6
    • /
    • pp.74-86
    • /
    • 2005
  • In this paper, we proposed an algorithm for the approximation of high order FIR filters by low order IIR filters to efficient implementing two channel 3-D surround sound systems using Head-related transfer functions(HRTFs). The algorithm is based on a concept of the balanced model reduction. The binaural sounds using the approximated HRTFs are reproduced by headphone, and serves as a cue of sound image localization. HRTFs of dummy-head are approximated from 512-order FIR filters by 32-order IIR filters and compare with each other. .Experiment of sound image are carried out for 10 participants. We perform the experiment based on computer simulation and hardware experiment with TMS320C32. The results of the experiments show that the localization using the approximated HRTFs is the same accuracy as the case of FIR filters that simulate the HRTFs.

  • PDF

A Study on the Application Technique and 3D Geospatial Information Generation for Optimum Route Decision (최적노선결정을 위한 3차원 지형공간정보생성 및 적용기법연구)

  • Yeon Sangho
    • Proceedings of the KSR Conference
    • /
    • 2003.05a
    • /
    • pp.321-325
    • /
    • 2003
  • The technology for the multi-dimensional terrain perspective view can be used as an important factors in planning and designing for the various construction projects. In this study, the stereo image perspective view has been generated for the multi-dimension analysis by combining useful digital map and remotely sensed satellite images. In the course of experimenting with the multi-dimensional topography generated by the combination of the front-projected image by the precise GCP and DEM from the contour line, the technology has been developed to offer the multi-dimensional access to the potential construction sites from the nearby main roads. This stereo image bird's eye view has made it possible to make multi-dimensional analysis on the terrain, which provides real time virtual access to the designated construction sites and will be a versatile application for development planning and construction projects.

  • PDF

Heuristic Designs of SAD Correlation Algorithm for Vision System (비전 시스템 구현을 위한 SAD 정합 알고리즘의 변형)

  • Yi, Jong-Su;Kim, Jun-Seong
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.47 no.5
    • /
    • pp.61-66
    • /
    • 2010
  • A stereo vision, which is based on two or more images taken from different view points, is able to build three dimensional maps of its environment having various applications including robots and home networks. SAD algorithm, which is based on area-based correlation, is widely used since its regular structure provide abundant parallelism. In this paper, we present heuristic designs of SAD algorithm to meet the demands on accuracy and resource usages in various applications. The disparity abridgement and the window abridgement algorithms can be used for vision systems in low cost and small size. The window shape algorithm can be applicable when object are in specific shapes. The adaptive window algorithm work well when accuracy is the primary concern.

Estimation of Traffic Volume Using Deep Learning in Stereo CCTV Image (스테레오 CCTV 영상에서 딥러닝을 이용한 교통량 추정)

  • Seo, Hong Deok;Kim, Eui Myoung
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.38 no.3
    • /
    • pp.269-279
    • /
    • 2020
  • Traffic estimation mainly involves surveying equipment such as automatic vehicle classification, vehicle detection system, toll collection system, and personnel surveys through CCTV (Closed Circuit TeleVision), but this requires a lot of manpower and cost. In this study, we proposed a method of estimating traffic volume using deep learning and stereo CCTV to overcome the limitation of not detecting the entire vehicle in case of single CCTV. COCO (Common Objects in Context) dataset was used to train deep learning models to detect vehicles, and each vehicle was detected in left and right CCTV images in real time. Then, the vehicle that could not be detected from each image was additionally detected by using affine transformation to improve the accuracy of traffic volume. Experiments were conducted separately for the normal road environment and the case of weather conditions with fog. In the normal road environment, vehicle detection improved by 6.75% and 5.92% in left and right images, respectively, than in a single CCTV image. In addition, in the foggy road environment, vehicle detection was improved by 10.79% and 12.88% in the left and right images, respectively.