• Title/Summary/Keyword: residual 영상

Search Result 266, Processing Time 0.026 seconds

Multi-view Synthesis Algorithm for the Better Efficiency of Codec (부복호화기 효율을 고려한 다시점 영상 합성 기법)

  • Choi, In-kyu;Cheong, Won-sik;Lee, Gwangsoon;Yoo, Jisang
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.2
    • /
    • pp.375-384
    • /
    • 2016
  • In this paper, when stereo image, satellite view and corresponding depth maps were used as the input data, we propose a new method that convert these data to data format suitable for compressing, and then by using these format, intermediate view is synthesized. In the transmitter depth maps are merged to a global depth map and satellite view are converted to residual image corresponding hole region as out of frame area and occlusion region. And these images subsampled to reduce a mount of data and stereo image of main view are encoded by HEVC codec and transmitted. In the receiver intermediate views between stereo image and between stereo image and bit-rate are synthesized using decoded global depth map, residual images and stereo image. Through experiments, we confirm good quality of intermediate views synthesized by proposed format subjectively and objectively in comparison to intermediate views synthesized by MVD format versus total bit-rate.

Artifact Reduction in Sparse-view Computed Tomography Image using Residual Learning Combined with Wavelet Transformation (Wavelet 변환과 결합한 잔차 학습을 이용한 희박뷰 전산화단층영상의 인공물 감소)

  • Lee, Seungwan
    • Journal of the Korean Society of Radiology
    • /
    • v.16 no.3
    • /
    • pp.295-302
    • /
    • 2022
  • Sparse-view computed tomography (CT) imaging technique is able to reduce radiation dose, ensure the uniformity of image characteristics among projections and suppress noise. However, the reconstructed images obtained by the sparse-view CT imaging technique suffer from severe artifacts, resulting in the distortion of image quality and internal structures. In this study, we proposed a convolutional neural network (CNN) with wavelet transformation and residual learning for reducing artifacts in sparse-view CT image, and the performance of the trained model was quantitatively analyzed. The CNN consisted of wavelet transformation, convolutional and inverse wavelet transformation layers, and input and output images were configured as sparse-view CT images and residual images, respectively. For training the CNN, the loss function was calculated by using mean squared error (MSE), and the Adam function was used as an optimizer. Result images were obtained by subtracting the residual images, which were predicted by the trained model, from sparse-view CT images. The quantitative accuracy of the result images were measured in terms of peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). The results showed that the trained model is able to improve the spatial resolution of the result images as well as reduce artifacts in sparse-view CT images effectively. Also, the trained model increased the PSNR and SSIM by 8.18% and 19.71% in comparison to the imaging model trained without wavelet transformation and residual learning, respectively. Therefore, the imaging model proposed in this study can restore the image quality of sparse-view CT image by reducing artifacts, improving spatial resolution and quantitative accuracy.

A Pansharpening Algorithm of KOMPSAT-3A Satellite Imagery by Using Dilated Residual Convolutional Neural Network (팽창된 잔차 합성곱신경망을 이용한 KOMPSAT-3A 위성영상의 융합 기법)

  • Choi, Hoseong;Seo, Doochun;Choi, Jaewan
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_2
    • /
    • pp.961-973
    • /
    • 2020
  • In this manuscript, a new pansharpening model based on Convolutional Neural Network (CNN) was developed. Dilated convolution, which is one of the representative convolution technologies in CNN, was applied to the model by making it deep and complex to improve the performance of the deep learning architecture. Based on the dilated convolution, the residual network is used to enhance the efficiency of training process. In addition, we consider the spatial correlation coefficient in the loss function with traditional L1 norm. We experimented with Dilated Residual Networks (DRNet), which is applied to the structure using only a panchromatic (PAN) image and using both a PAN and multispectral (MS) image. In the experiments using KOMPSAT-3A, DRNet using both a PAN and MS image tended to overfit the spectral characteristics, and DRNet using only a PAN image showed a spatial resolution improvement over existing CNN-based models.

A STUDY OF RESIDUAL IMAGE IN CHARGED-COUPLED DEVICE (CCD 잔존영상 분석)

  • Jin, Ho;Lee, C.U.;Kim, S.L.;Kang, Y.B.;Goo, J.L.;Han, W.
    • Journal of Astronomy and Space Sciences
    • /
    • v.22 no.4
    • /
    • pp.483-490
    • /
    • 2005
  • For an image sensor CCD, electrons can be trapped at the front-side $Si-SiO_2$ surface interface in a case of exceeding the full well by bright source. Residual images can be made by the electrons remaining in the interface. These residual images are seen in the font-side-illuminated CCDs especially. It is not easy to find a quantitative analysis for this phenomenon in the domestic reports, although it is able to contaminate observation data. In this study, we find residual images iB dark frames which were obtained from the front-side-illuminated CCD at Mt. Lemmon Optical Astronomy Observatory (LOAO), and analyze the effect to contaminated observation data by residual charges.

Stereo Image Coding Using Zerotree (제로트리 기법을 이용한 스테레오 영상 부호화)

  • Bae, Jin-Woo;Shin, Choel;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.26 no.12A
    • /
    • pp.2092-2099
    • /
    • 2001
  • In the three-dimensional image system using stereoscopic images, efficient coding schemes which can get rid of redundancy between the left and right images are usually used. In this paper, we propose an efficient coding method by using relationship between a reference image and residual image. In the proposed algorithm, zero-tree method which guaranty a good quality in low bit rate is used for encoding the residual image. Zero-tree algorithm gives good coding performance, but it has computational complexity so that we used ADLS method to reduce time for the disparity estimation. Using the wavelet based zero-tree method, it is shown that high quality of image in the limited band-width can be preserved through computer simulation.

  • PDF

Residual Filter to Improve Performance of H.264 Video Coding Standard (H.264 동영상 표준 부호화 방식의 성능 향상을 위한 잔여신호 필터)

  • Song, Won-Seon;Hong, Min-Cheol
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.11C
    • /
    • pp.1066-1070
    • /
    • 2006
  • In this paper, we present a residual filter to improve performance of H.264 compressed video. In general, noisy video sequences captured by imaging system result in decline of coding efficiency and unpleasant coding artifacts due to higher frequency components. By incorporating local statistics and quantization parameter into filtering process, the spurious noise is significantly attenuated and coding efficiency is improved, leading to improvement of visual quality and to bit-rate saving for given quantization step size. In addition, in order to reduce the complexity of the residual filter, noise induced by analyzing H.264 transformation and quantization processes are introduced. The simulation results show the capability of the proposed algorithm.

Atrous Residual U-Net for Semantic Segmentation in Street Scenes based on Deep Learning (딥러닝 기반 거리 영상의 Semantic Segmentation을 위한 Atrous Residual U-Net)

  • Shin, SeokYong;Lee, SangHun;Han, HyunHo
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.10
    • /
    • pp.45-52
    • /
    • 2021
  • In this paper, we proposed an Atrous Residual U-Net (AR-UNet) to improve the segmentation accuracy of semantic segmentation method based on U-Net. The U-Net is mainly used in fields such as medical image analysis, autonomous vehicles, and remote sensing images. The conventional U-Net lacks extracted features due to the small number of convolution layers in the encoder part. The extracted features are essential for classifying object categories, and if they are insufficient, it causes a problem of lowering the segmentation accuracy. Therefore, to improve this problem, we proposed the AR-UNet using residual learning and ASPP in the encoder. Residual learning improves feature extraction ability and is effective in preventing feature loss and vanishing gradient problems caused by continuous convolutions. In addition, ASPP enables additional feature extraction without reducing the resolution of the feature map. Experiments verified the effectiveness of the AR-UNet with Cityscapes dataset. The experimental results showed that the AR-UNet showed improved segmentation results compared to the conventional U-Net. In this way, AR-UNet can contribute to the advancement of many applications where accuracy is important.

A Study on Real-time Face Detection in Video (동영상에서 실시간 얼굴검출에 관한 연구)

  • Kim, Hyeong-Gyun;Bae, Yong-Guen
    • Journal of the Korea Society of Computer and Information
    • /
    • v.15 no.2
    • /
    • pp.47-53
    • /
    • 2010
  • This paper proposed Residual Image detection and Color Info using the face detection technique. The proposed technique was fast processing speed and high rate of face detection on the video. In addition, this technique is to detection error rate reduced through the calibration tasks for tilted face image. The first process is to extract target image from the transmitted video images. Next, extracted image processed by window rotated algorithm for detection of tilted face image. Feature extraction for face detection was used for AdaBoost algorithm.

A Theoretical Model for the Analysis of Residual Motion Artifacts in 4D CT Scans (이론적 모델을 이용한 4DCT에서의 Motion Artifact 분석)

  • Kim, Tae-Ho;Yoon, Jai-Woong;Kang, Seong-Hee;Suh, Tae-Suk
    • Progress in Medical Physics
    • /
    • v.23 no.3
    • /
    • pp.145-153
    • /
    • 2012
  • In this study, we quantify the residual motion artifact in 4D-CT scan using the dynamic lung phantom which could simulate respiratory target motion and suggest a simple one-dimension theoretical model to explain and characterize the source of motion artifacts in 4DCT scanning. We set-up regular 1D sine motion and adjusted three level of amplitude (10, 20, 30 mm) with fixed period (4s). The 4DCT scans are acquired in helical mode and phase information provided by the belt type respiratory monitoring system. The images were sorted into ten phase bins ranging from 0% to 90%. The reconstructed images were subsequently imported into the Treatment Planning System (CorePLAN, SC&J) for target delineation using a fixed contour window and dimensions of the three targets are measured along the direction of motion. Target dimension of each phase image have same changing trend. The error is minimum at 50% phase in all case (10, 20, 30 mm) and we found that ${\Delta}S$ (target dimension change) of 10, 20 and 30 mm amplitude were 0 (0%), 0.1 (5%), 0.1 (5%) cm respectively compare to the static image of target diameter (2 cm). while the error is maximum at 30% and 80% phase ${\Delta}S$ of 10, 20 and 30 mm amplitude were 0.2 (10%), 0.7 (35%), 0.9 (45%) cm respectively. Based on these result, we try to analysis the residual motion artifact in 4D-CT scan using a simple one-dimension theoretical model and also we developed a simulation program. Our results explain the effect of residual motion on each phase target displacement and also shown that residual motion artifact was affected that the target velocity at each phase. In this study, we focus on provides a more intuitive understanding about the residual motion artifact and try to explain the relationship motion parameters of the scanner, treatment couch and tumor. In conclusion, our results could help to decide the appropriate reconstruction phase and CT parameters which reduce the residual motion artifact in 4DCT.

Residual Image Compression based on Wavelet Transform (웨이브릿 변환을 이용한 스테레오 영상 압축)

  • 정한조;유지상;김은수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.25 no.4B
    • /
    • pp.763-770
    • /
    • 2000
  • In this paper, a new stereo image compression algorithm is suggested in which the residual image extracted from the stereo image by the disparity-compensated prediction method is compressed using the wavelet transform considering the inter & intra correlation between subbands. The compression performance of the proposed method is significantly improved by comparing with the conventional algorithm such as EPIC, EPWIC & JPEG through the computer simulation and the PSNR is also increased about 3.5dB compared with the EPIC. Finally, the stereo image having a good 3D effect can be reconstructed from the compressed image data by the proposed method.

  • PDF