• 제목/요약/키워드: Super Resolution Technique

검색결과 67건 처리시간 0.031초

3D 공간상에서의 주변 기울기 정보를 기반에 둔 필터 학습을 통한 MRI 영상 초해상화 (MRI Image Super Resolution through Filter Learning Based on Surrounding Gradient Information in 3D Space)

  • 박성수;김윤수;감진규
    • 한국멀티미디어학회논문지
    • /
    • 제24권2호
    • /
    • pp.178-185
    • /
    • 2021
  • Three-dimensional high-resolution magnetic resonance imaging (MRI) provides fine-level anatomical information for disease diagnosis. However, there is a limitation in obtaining high resolution due to the long scan time for wide spatial coverage. Therefore, in order to obtain a clear high-resolution(HR) image in a wide spatial coverage, a super-resolution technology that converts a low-resolution(LR) MRI image into a high-resolution is required. In this paper, we propose a super-resolution technique through filter learning based on information on the surrounding gradient information in 3D space from 3D MRI images. In the learning step, the gradient features of each voxel are computed through eigen-decomposition from 3D patch. Based on these features, we get the learned filters that minimize the difference of intensity between pairs of LR and HR images for similar features. In test step, the gradient feature of the patch is obtained for each voxel, and the filter is applied by selecting a filter corresponding to the feature closest to it. As a result of learning 100 T1 brain MRI images of HCP which is publicly opened, we showed that the performance improved by up to about 11% compared to the traditional interpolation method.

Super-Resolution Optical Fluctuation Imaging Using Speckle Illumination

  • Kim, Min-Kwan;Park, Chung-Hyun;Park, YongKeun;Cho, Yong-Hoon
    • 한국진공학회:학술대회논문집
    • /
    • 한국진공학회 2014년도 제46회 동계 정기학술대회 초록집
    • /
    • pp.403.1-403.1
    • /
    • 2014
  • In conventional far-field microscopy, two objects separated closer than approximately half of an emission wavelength cannot be resolved, because of the fundamental limitation known as Abbe's diffraction limit. During the last decade, several super-resolution methods have been developed to overcome the diffraction limit in optical imaging. Among them, super-resolution optical fluctuation imaging (SOFI) developed by Dertinger et al [1], employs the statistical analysis of temporal fluorescence fluctuations induced by blinking phenomena in fluorophores. SOFI is a simple and versatile method for super-resolution imaging. However, due to the uncontrollable blinking of fluorophores, there are some limitations to using SOFI for several applications, including the limitations of available blinking fluorophores for SOFI, a requirement of using a high-speed camera, and a low signal-to-noise ratio. To solve these limitations, we present a new approach combining SOFI with speckle pattern illumination to create illumination-induced optical fluctuation instead of blinking fluctuation of fluorophore.. This technique effectively overcome the limitations of the conventional SOFI since illumination-induced optical fluctuation is possible to control unlike blinking phenomena of fluorophore. And we present the sub-diffraction resolution image using SOFI with speckle illumination.

  • PDF

Recent Developments in Correlative Super-Resolution Fluorescence Microscopy and Electron Microscopy

  • Jeong, Dokyung;Kim, Doory
    • Molecules and Cells
    • /
    • 제45권1호
    • /
    • pp.41-50
    • /
    • 2022
  • The recently developed correlative super-resolution fluorescence microscopy (SRM) and electron microscopy (EM) is a hybrid technique that simultaneously obtains the spatial locations of specific molecules with SRM and the context of the cellular ultrastructure by EM. Although the combination of SRM and EM remains challenging owing to the incompatibility of samples prepared for these techniques, the increasing research attention on these methods has led to drastic improvements in their performances and resulted in wide applications. Here, we review the development of correlative SRM and EM (sCLEM) with a focus on the correlation of EM with different SRM techniques. We discuss the limitations of the integration of these two microscopy techniques and how these challenges can be addressed to improve the quality of correlative images. Finally, we address possible future improvements and advances in the continued development and wide application of sCLEM approaches.

모바일 환경을 위해 에지맵 보간과 개선된 고속 Back Projection 기법을 이용한 Super Resolution 알고리즘 (Super Resolution Algorithm Based on Edge Map Interpolation and Improved Fast Back Projection Method in Mobile Devices)

  • 이두희;박대현;김윤
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제1권2호
    • /
    • pp.103-108
    • /
    • 2012
  • 최근 고성능 모바일기기의 보급과 멀티미디어 콘텐츠의 활용이 커짐에 따라 저해상도 영상을 고해상도로 재구성하는 초해상도(super resolution) 기법이 중요하게 대두되고 있다. 모바일기기에서는 초해상도를 사용하기 위해서는 연산량과 메모리 등의 제한적인 자원의 사용을 고려한 초해상도 알고리즘이 요구된다. 본 논문에서는 모바일기기에 적용하기 위해 단일영상을 통한 빠른 초해상도 기법을 제안한다. 제안한 알고리즘은 색채 왜곡을 방지하기 위해 RGB 컬러 도메인에서 HSV 컬러 도메인으로 변경하여 인간의 시각인지 특성이 가장 뚜렷한 밝기정보인 V만 처리한다. 먼저 잡음제거 및 속도향상을 고려하여 개선된 고속 back projection에 의해 영상을 확대 재구성한다. 이와 함께 2차 미분을 사용하는 LoG (laplacian of gaussian) 필터링을 이용하여 신뢰할 수 있는 에지 맵을 추출한다. 최종적으로 에지 정보와 개선된 back projection 결과를 이용하여 고해상도 영상을 재구성한다. 제안한 알고리즘을 사용하여 복원한 영상은 부자연스러운 인공물을 효과적으로 제거하고, blur현상을 최소화하여 에지 정보를 보정하고 강조해준다. 실험결과를 통해 제안하는 알고리즘이 기존의 보간법이나 전통적인 back projection 결과보다 주관적인 화질이 우수하고, 객관적으로 우수한 성능을 나타냄을 입증한다.

SDCN: Synchronized Depthwise Separable Convolutional Neural Network for Single Image Super-Resolution

  • Muhammad, Wazir;Hussain, Ayaz;Shah, Syed Ali Raza;Shah, Jalal;Bhutto, Zuhaibuddin;Thaheem, Imdadullah;Ali, Shamshad;Masrour, Salman
    • International Journal of Computer Science & Network Security
    • /
    • 제21권11호
    • /
    • pp.17-22
    • /
    • 2021
  • Recently, image super-resolution techniques used in convolutional neural networks (CNN) have led to remarkable performance in the research area of digital image processing applications and computer vision tasks. Convolutional layers stacked on top of each other can design a more complex network architecture, but they also use more memory in terms of the number of parameters and introduce the vanishing gradient problem during training. Furthermore, earlier approaches of single image super-resolution used interpolation technique as a pre-processing stage to upscale the low-resolution image into HR image. The design of these approaches is simple, but not effective and insert the newer unwanted pixels (noises) in the reconstructed HR image. In this paper, authors are propose a novel single image super-resolution architecture based on synchronized depthwise separable convolution with Dense Skip Connection Block (DSCB). In addition, unlike existing SR methods that only rely on single path, but our proposed method used the synchronizes path for generating the SISR image. Extensive quantitative and qualitative experiments show that our method (SDCN) achieves promising improvements than other state-of-the-art methods.

POCS 이론을 이용한 개선된 S&A 방법에 의한 영상의 화질 향상 (Image Resolution Enhancement by Improved S&A Method using POCS)

  • 윤수아;이태균;이상헌;손명규;김덕규;원철호
    • 한국멀티미디어학회논문지
    • /
    • 제14권11호
    • /
    • pp.1392-1400
    • /
    • 2011
  • 최근 대부분의 디지털 이미지 응용분야에서는 영상 처리 및 분석을 위해 고해상도 이미지나 비디오가 요구되고 있다. 한편, 일반적인 영상획득시스템으로부터 획득한 영상신호는 획득하는 과정에서 물리적 영향, 제조 기술의 한계 및 환경적인 영향 등으로 인하여 영상의 화질 저하를 가져온다. 이러한 문제를 해결하기위해 연구되고 있는 방법 중 하나인 초해상도 복원 기술은 동일한 물체를 촬영한 다수의 저해상도 영상으로 고해상도 영상을 만들어내는 영상복원기술이다. 본 논문에서는 S&A (Shift & Add) 방법에 POCS (Projection onto Convex Sets) 이론을 적용하여 기존의 방법보다 개선된 알고리즘을 제안한다. 기존의 알고리즘은 잡음에 약하다는 문제점이 있다. 이를 해결하기 위해 제안한 방법에서는 복원단계에 사용되는 참조영상을 POCS이론에 적용하여 기존의 S&A방법과 결합하였다. 또한 광학적 왜곡에 해당하는 카메라 블러(blur) 연산자로 주파수 영역에서 BLPF (Butterworth Low-pass Filter)를 사용하여 기존방법의 문제점인 링잉현상을 해결하였다. 실험결과를 통해 잡음에 강하고 영상의 고주파영역을 향상시킨 제안한 초해상도 방법의 우수성을 확인하였고, 객관적 평가를 위해 기존의 방법과 PSNR (peak signal to noise ratio)을 비교하였다.

잔차 신경망과 팽창 합성곱 신경망을 이용한 라이트 필드 각 초해상도 기법 (Light Field Angular Super-Resolution Algorithm Using Dilated Convolutional Neural Network with Residual Network)

  • 김동명;서재원
    • 한국정보통신학회논문지
    • /
    • 제24권12호
    • /
    • pp.1604-1611
    • /
    • 2020
  • 마이크로렌즈 어레이 기반의 카메라로 촬영된 라이트필드 영상은 낮은 공간해상도 및 각해상도로 인하여 실제 사용하기에는 많은 제약이 따른다. 고해상도의 공간해상도 영상은 최근 많이 연구되고 있는 단일 영상 초해상도 기법으로 쉽게 얻을 수 있으나 고해상도의 각해상도 영상은 영상사이에 내재된 시점차 정보를 이용하는 과정에서 왜곡이 발생하여 좋은 품질의 각해상도 영상을 얻기 힘든 문제가 있다. 본 논문에서는 영상 사이에 내재된 시점차 정보를 효과적으로 추출하기 위해서 팽창 합성곱 신경망을 이용하여 초기 특징맵을 추출하고 잔차 신경망으로 새로운 시점 영상을 생성하는 라이트 필드 각 초해상도 영상 기법을 제안한다. 제안하는 네트워크는 기존의 각 초해상도 네트워크와 비교하여 PSNR 및 주관적 화질 비교에서 우수한 성능을 보였다.

영상 항법에서의 2D FRI (Finite Rate of Innovation) Super-resolution 기법 적용 및 분석 (Application and Analysis of 2D FRI (Finite Rate of Innovation) Super-resolution Technique in Vision Navigation)

  • 유경우;공승현
    • 한국자동차공학회논문집
    • /
    • 제23권1호
    • /
    • pp.1-10
    • /
    • 2015
  • In urban area, since multipath and signal attenuations frequently occur due to street trees, street lights and buildings, it is difficult to obtain accurate navigation solution using GPS. As these problems also impact negatively on the INS/GPS coupled system, implementing advanced transportation systems such as autonomous navigation system and Intelligent Transportation System (ITS) become quite hard. For this reason, to alleviate deterioration of navigation system performance in urban area, direction information extraction algorithm using vision system is proposed in this paper. 2D Finite Rate of Innovation (FRI) technique is applied to extract lane edges. The proposed technique is simulated using road images and feasibility of proposed technique is analyzed through the simulation results.

LDCSIR: Lightweight Deep CNN-based Approach for Single Image Super-Resolution

  • Muhammad, Wazir;Shaikh, Murtaza Hussain;Shah, Jalal;Shah, Syed Ali Raza;Bhutto, Zuhaibuddin;Lehri, Liaquat Ali;Hussain, Ayaz;Masrour, Salman;Ali, Shamshad;Thaheem, Imdadullah
    • International Journal of Computer Science & Network Security
    • /
    • 제21권12spc호
    • /
    • pp.463-468
    • /
    • 2021
  • Single image super-resolution (SISR) is an image processing technique, and its main target is to reconstruct the high-quality or high-resolution (HR) image from the low-quality or low-resolution (LR) image. Currently, deep learning-based convolutional neural network (CNN) image super-resolution approaches achieved remarkable improvement over the previous approaches. Furthermore, earlier approaches used hand designed filter to upscale the LR image into HR image. The design architecture of such approaches is easy, but it introduces the extra unwanted pixels in the reconstructed image. To resolve these issues, we propose novel deep learning-based approach known as Lightweight deep CNN-based approach for Single Image Super-Resolution (LDCSIR). In this paper, we propose a new architecture which is inspired by ResNet with Inception blocks, which significantly drop the computational cost of the model and increase the processing time for reconstructing the HR image. Compared with the other state of the art methods, LDCSIR achieves better performance in terms of quantitively (PSNR/SSIM) and qualitatively.