• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.11a
• /
• pp.133-135
• /
• 2017

본 논문에서는 스테레오 영상을 이용하여 외삽 시점 영상 생성 시 발생하는 홀을 채우는 방법을 제안한다. 스테레오 영상에 3D 워핑을 이용하여 다수의 시점을 생성할 수 있다. 하지만 이 방법은 보이지 않는 시점에서의 영역을 완벽히 복원할 수 없기 때문에 필연적으로 홀이 발생한다. 홀을 채우기 위해 먼저 홀 영역의 경계를 Random Walks 알고리즘을 이용하여 전경과 배경으로 구분한다. 그리고 홀을 배경 성분에 해당하는 영역만을 이용하여 채우게 된다. 홀 채움 과정에서는 패치 내의 홀의 비율과 컬러와 깊이 영상의 텍스처에 대한 복잡도를 정의하고 패치 별로 우선순위를 계산하여 높은 순위의 패치로 홀을 채우게 된다. 실험 결과 제안하는 기법이 홀을 효과적으로 채우는 것을 확인하였다.

• The Journal of the Acoustical Society of Korea
• /
• v.43 no.2
• /
• pp.234-242
• /
• 2024

We propose a passive sonar signal classification algorithm using Graph Neural Network (GNN). The proposed algorithm segments spectrograms into image patches and represents graphs through connections between adjacent image patches. Subsequently, Graph Convolutional Network (GCN) is trained using the represented graphs to classify signals. In experiments with publicly available underwater acoustic data, the proposed algorithm represents the line frequency features of spectrograms in graph form, achieving an impressive classification accuracy of 92.50 %. This result demonstrates a 8.15 % higher classification accuracy compared to conventional Convolutional Neural Network (CNN).

• Journal of Broadcast Engineering
• /
• v.24 no.5
• /
• pp.827-835
• /
• 2019

In the pooling stage of a full reference image quality assessment (FR-IQA) technique, the global perceived quality for any distorted image is usually measured from the quality of its local image patches. But all the image patches do not have equal contribution when estimating the overall visual quality since the degree of degradation on those patches depends on various considerations i.e., types of the patches, types of the distortions, distortion sensitivities of the patches, saliency score of the patches, etc. As a result, weighted pooling strategy comes into account and different weighting mechanisms are used by the existing FR-IQA methods. This paper performs a thorough analysis and proposes a novel weighting function by considering the luminance adaptation as well as the visual saliency effect to offer more appropriate local weights, which can be adopted in the existing FR-IQA frameworks to improve their prediction accuracy. The extended experimental results show the effectiveness of the proposed weighting function.

• Journal of KIISE
• /
• v.43 no.9
• /
• pp.1034-1042
• /
• 2016

Together with machine-learning frameworks, area-based imagery registration techniques can be easily applied to diverse types of image pairs without predefined features and feature descriptors. However, feature detectors are often used to quickly identify candidate image patch pairs, limiting the applicability of these registration techniques. In this paper, we propose a ConvNet (Convolutional Network) "Dart" that provides not only the matching metric between patches, but also information about their distance, which are helpful in reducing the search space of the corresponding patch pairs. In addition, we propose a ConvNet "Fad" to identify the patches that are difficult for Dart to improve the accuracy of registration. These two networks were successfully implemented using Deep Learning with the help of a number of training instances generated from a few registered image pairs, and were successfully applied to solve a simple image registration problem, suggesting that this line of research is promising.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.12
• /
• pp.130-139
• /
• 2014

Undesired camera shaking can make a blur effect, which causes a degradation of video quality. We propose an efficient method of removing the blur effects on video captured from a single camera. The proposed method has a sequential process that is applied to each frame. The first stage is to estimate the camera motion for each frame. In order to estimate the camera motion, we compute the optical flow using 3 consecutive frames. Then a patch-wise image deconvolution is applied. During the deconvolution, edge prediction is used to improve the quality of image deconvolution. After patch-wise image deconvolution, deblurred patches are integrated into an image to produce a deblurred frame. The above process is performed for each frame. The experimental result shows that the proposed method removes the blur effect efficiently.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.12
• /
• pp.2946-2952
• /
• 2014

Among the Example based Super Resolution(SR) techniques, Neighbor embedding(NE) has been inspired by manifold learning method, particularly locally linear embedding. However, the poor generalization of NE decreases the performance of such algorithm. The sizes of local training sets are always too small to improve the performance of NE. We propose the Learning Sparse-Neighbor Image Representation baesd on SVR having an excellent generalization ability to solve this problem. Given a low resolution image, we first use bicubic interpolation to synthesize its high resolution version. We extract the patches from this synthesized image and determine whether each patch corresponds to regions with high or low spatial frequencies. After the weight of each patch is obtained by our method, we used to learn separate SVR models. Finally, we update the pixel values using the previously learned SVRs. Through experimental results, we quantitatively and qualitatively confirm the improved results of the proposed algorithm when comparing with conventional interpolation methods and NE.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.06a
• /
• pp.18-19
• /
• 2018

본 논문에서는 실외 영상에서의 새로운 접근 방식의 복합 조명 알고리즘을 제안한다. 기존의 복합 조명 알고리즘들이 동시에 두 조명을 추정하는 것에 비해 제안 알고리즘은 먼저 단일 조명 기법을 적용하여 첫번째 광원의 색을 추정한 후에 각 영역에서 유사 패치 쌍을 찾아 두번째 광원의 색을 추정하는 방식이다. 일반적인 복합 조명 환경에서는 적용하기 힘들지만 환경을 실외로 제한하여 실외의 광원인 햇빛과 그늘 사이의 관계를 이용하여 효과적으로 유사 패치를 찾아 두 광원의 색을 추정한다. 따라서 실외 환경을 촬영하여 얻은 raw 파일 영상에 제안 알고리즘을 적용하여 효과적으로 광원들의 영향을 제거할 수 있다.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.22 no.4
• /
• pp.359-365
• /
• 2004

Data integration techniques are becoming increasing1y important for conquering a limitation with a single data. Image fusion which improves the spatial and spectral resolution from a set of images with difffrent spatial and spectral resolutions, and image registration which matches two images so that corresponding coordinate points in the two images correspond to the same physical region of the scene being imaged have been researched. In this paper, we compared with six image fusion methods(Brovey, IHS, PCA, HPF, CN, and MWD) with panchromatic and multispectral images of IKONOS and developed the registration method for applying to SPOT-5 satellite image and RADARSAT SAR satellite image. As the result of tests on image fusion and image registration, we could find that MWD and HPF methods showed the good result in term of visual comparison analysis and statistical analysis. And we could extract patches which depict detailed topographic information from SPOT-5 and RADARSAT and obtain encouraging results in image registration.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.1
• /
• pp.1-9
• /
• 2022

Non-small cell lung cancer (NSCLC) accounts for a high proportion of 85% among all lung cancer and has a significantly higher mortality rate (22.7%) compared to other cancers. Therefore, it is very important to predict the prognosis after surgery in patients with non-small cell lung cancer. In this study, the types of preoperative chest CT image patches for non-small cell lung cancer patients with tumor as a region of interest are diversified into five types according to tumor-related information, and performance of single classifier model, ensemble classifier model with soft-voting method, and ensemble classifier model using 3 input channels for combination of three different patches using pre-trained ResNet and EfficientNet CNN networks are analyzed through misclassification cases and Grad-CAM visualization. As a result of the experiment, the ResNet152 single model and the EfficientNet-b7 single model trained on the peritumoral patch showed accuracy of 87.93% and 81.03%, respectively. In addition, ResNet152 ensemble model using the image, peritumoral, and shape-focused intratumoral patches which were placed in each input channels showed stable performance with an accuracy of 87.93%. Also, EfficientNet-b7 ensemble classifier model with soft-voting method using the image and peritumoral patches showed accuracy of 84.48%.

• Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
• /
• 2008.06a
• /
• pp.260-264
• /
• 2008

변화탐지는 도시모델의 갱신을 위해 중요한 단계이다. 이에 본 연구는 도시지역의 변화탐지를 위한 라이다데이터로부터 추출한 표면패치의 분류 방법을 제안한다. 제안된 방법의 주요 과정은 (1) 라이다 데이터로부터 생성된 DSM의 차분을 통해 변화영역을 탐지하고, (2) 탐지된 영역의 라이다 점으로부터 표면패치를 구성하고, (3) 구성된 각각의 패치의 종류를 지면 수목, 빌딩으로 분류한다. 제안된 방법을 실측데이터에 적용한 결과를 동일한 지역의 정사영상으로부터 육안검사를 통해 수동 생성된 기준데이터를 이용하여 검증하였다. 패치분류의 성공률은 99%로 평가되었다. 결론적으로 제안된 방법은 변화탐지를 위한 강인하고, 신뢰성이 높고, 효율적인 패치 분류방법으로 판단된다.