• Journal of Broadcast Engineering
• /
• v.17 no.5
• /
• pp.838-850
• /
• 2012

In this paper, we propose a novel algorithm that generates multi-view images by using various image features obtained from the given stereoscopic images. In the proposed algorithm, we first create an intensity gradient saliency map from the given stereo images. And then we calculate a block-based optical flow that represents the relative movement(disparity) of each block with certain size between left and right images. And we also obtain the disparities of feature points that are extracted by SIFT(scale-invariant We then create a disparity saliency map by combining these extracted disparity features. Disparity saliency map is refined through the occlusion detection and removal of false disparities. Thirdly, we extract straight line segments in order to minimize the distortion of straight lines during the image warping. Finally, we generate multi-view images by grid mesh-based image warping algorithm. Extracted image features are used as constraints during grid mesh-based image warping. The experimental results show that the proposed algorithm performs better than the conventional DIBR algorithm in terms of visual quality.

• Korean Journal of Remote Sensing
• /
• v.31 no.5
• /
• pp.395-408
• /
• 2015

High-resolution satellite image mosaics are becoming increasingly important in the field of remote sensing image analysis as an essential image processing to create a large image constructed from several smaller images. In this paper, we present an automatic seamline extraction technique and the procedure to generate a mosaic image by this technique. For more effective seamline extraction in the overlap region of adjacent images, an NDVI-based seamline extraction technique is developed, which takes advantage of the computational time and memory. The Normalized Difference Vegetation Index(NDVI) is an index of plant "greeness" or photosynthetic activity that is employed to extract the initial seamline. The NDVI can divide into manmade region and natural region. The cost image is obtained by the canny edge detector and the buffering technique is used to extract the ranging cost image. The seamline is extracted by applying the Dijkstra algorithm to a cost image generated through the labeling process of the extracted edge information. Histogram matching is also conducted to alleviate radiometric distortion between adjacent images acquired at different time. In the experimental results using the KOMPSAT-2/3 satellite imagery, it is confirmed that the proposed method greatly reduces the visual discontinuity caused by geometric difference of adjacent images and the computation time.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.28-41
• /
• 2017

In this paper, the fast encoding algorithm in High Efficiency Video Coding (HEVC) encoder was studied. For the encoding efficiency, the current HEVC reference software is divided the input image into Coding Tree Unit (CTU). then, it should be re-divided into CU up to maximum depth in form of quad-tree for RDO (Rate-Distortion Optimization) in encoding precess. But, it is one of the reason why complexity is high in the encoding precess. In this paper, to reduce the high complexity in the encoding process, it proposed the method by determining the maximum depth of the CU using a hierarchical clustering at the pre-processing. The hierarchical clustering results represented an average combination of motion vectors (MV) on neighboring blocks. Experimental results showed that the proposed method could achieve an average of 16% time saving with minimal BD-rate loss at 1080p video resolution. When combined the previous fast algorithm, the proposed method could achieve an average 45.13% time saving with 1.84% BD-rate loss.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.31 no.3D
• /
• pp.403-412
• /
• 2011

On a curve radius, there is speed deviation because a driver who is on the curve radius can have visual distortion. The curve radius can be more dangerous than a straight radius by many reasons. Especially, visibility paralysis of delineator that is because of night and bad weather. Can pervert the information about curve sections, it threatens safety. More over accident risk is increased by influence to travel speed. Therefore, it needs to build and control delineators for driver's visibility. Therefore, this study focus on finding the two types of delineator(the retro-reflection and inside-lighting delineator) by insight-surveying and the operating speed are compared by survey and operating speed. Finally, inside-lighting delineator will be selected in terms of safety at the curve sections. The inside-lighting delineator was more effective than the retro-reflection delineator on visibility, the necessity of reduction of speed and will reduce the hazard at curve sections. Also, the study analyzes safety is guaranteed by the slight reduction of speed when the driver enters a curve radius with inside-lighting delineator. As a result, the inside-lighting delineator can give the information about horizontal and vertical profile effectively, so it can reduce the accident risk. And it can use to improve traffic safety on curve radius.

• Journal of the Korean Society of Propulsion Engineers
• /
• v.6 no.2
• /
• pp.45-52
• /
• 2002

An experimental investigation on the structure and dynamic behavior of two dimensional over-expanded air jets exiting into water was carried out. The hish speed digital video imaging and static pressure distribution measurement were made to characterize the structure and time-dependant behavior of the jets. Mach number at the jet exit was 2.0 and was slightly less than the value predicted by the ideal nozzle calculation. Variance of jet spreading angle at different stagnation condition was measured as a function of mass flow rate. Periodic nature of the air jet distortion in water was observed and the frequency of the repetition was approximately 5-6 Hz for all cases tested. Three characteristic length scales were defined to characterize jet structure. $L_1$, maximum width of the plume when the periodic instability occurs, $L_2$, width of the jet where secondary reverse flow entrained jet flow and $L_3$, distance from the jet exit to the location where entrainment of the secondary reverse flow occurs. The ratio of $L_1$ and $L_2$ decreased with increasing stagnation pressure, i.e. mass flow rate. $L_3$ increased with increasing stagnation pressure. The temporal behavior of static pressure measurements also showed peak around frequency of 5, which corresponds the frequency obtained by visual measurements

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.5C
• /
• pp.393-402
• /
• 2012

In this study, we propose a signal processing algorithm to measure the arousal level of a human subject using a PPG(Photoplethysmography) sensor. From the measured PPG signals, the arousal level is determined by PPI(Pulse to Pulse Interval) and discrete-time signal processing. We ran psychophysical experiments displaying visual stimuli on TV display while measuring PPG signal from a finger, where the nature landscape scenes were used for restorative effect, and the urban environments were used to stimulate the stress. However, the measured PPG signals may include noise due to subject movement and measurement error, which results in incorrect detections. In this paper, to mitigate the noise impact on stimulus detection, we propose a detecting algorithm using digital signal processing methods and statistics of measured signals. A filter is adopted to remove a high frequency noise and adaptively designed taking into account the statistics of the measured PPG signals. Moreover we employ a hysteresis method to reduce the distortion of PPI in decision of emotional. Via experiment, we show that the proposed scheme reduces signal noise and improves stimulus detection.

• KIPS Transactions on Software and Data Engineering
• /
• v.1 no.2
• /
• pp.103-108
• /
• 2012

Recently, as the prevalence of high-performance mobile devices and the application of the multimedia content are expanded, Super Resolution (SR) technique which reconstructs low resolution images to high resolution images is becoming important. And in the mobile devices, the development of the SR algorithm considering the operation quantity or memory is required because of using the restricted resources. In this paper, we propose a new single frame fast SR technique suitable for mobile devices. In order to prevent color distortion, we change RGB color domain to HSV color domain and process the brightness information V (Value) considering the characteristics of human visual perception. First, the low resolution image is enlarged by the improved fast back projection considering the noise elimination. And at the same time, the reliable edge map is extracted by using the LoG (Laplacian of Gaussian) filtering. Finally, the high definition picture is reconstructed by using the edge information and the improved back projection result. The proposed technique removes effectually the unnatural artefact which is generated during the super resolution restoration, and the edge information which can be lost is amended and emphasized. The experimental results indicate that the proposed algorithm provides better performance than conventional back projection and interpolation methods.

• Journal of the Korea institute for structural maintenance and inspection
• /
• v.26 no.2
• /
• pp.28-36
• /
• 2022

As port structures are exposed to various extreme external loads such as wind (typhoons), sea waves, or collision with ships; it is important to evaluate the structural safety periodically. To monitor the port structure, especially the rubber fender, a fender segmentation system using a vision sensor and deep learning method has been proposed in this study. For fender segmentation, a new deep learning network that improves the encoder-decoder framework with the receptive field block convolution module inspired by the eccentric function of the human visual system into the DenseNet format has been proposed. In order to train the network, various fender images such as BP, V, cell, cylindrical, and tire-types have been collected, and the images are augmented by applying four augmentation methods such as elastic distortion, horizontal flip, color jitter, and affine transforms. The proposed algorithm has been trained and verified with the collected various types of fender images, and the performance results showed that the system precisely segmented in real time with high IoU rate (84%) and F1 score (90%) in comparison with the conventional segmentation model, VGG16 with U-net. The trained network has been applied to the real images taken at one port in Republic of Korea, and found that the fenders are segmented with high accuracy even with a small dataset.

• Journal of Korean Ophthalmic Optics Society
• /
• v.16 no.4
• /
• pp.409-415
• /
• 2011

Purpose: To design applied anamorphic lens that focal length ratio is 3:1 optical system to improve detecting distance. Methods: We defined a boundary condition as $50^{\circ}{\sim}60^{\circ}$ for viewing angle, horizontal direction 36mm, vertical direction 12 mm for focal length, f-number 4, $15{\mu}m{\times}15{\mu}m$ for pixel size and limit resolution 25% in 33l p/mm. Si, ZnS and ZnSe as a materials were used and 4.8 ${\mu}m$, 4.2 ${\mu}m$, 3.7 ${\mu}m$ as a wavelength were set. optical performance with detection distance, narcissus and athermalization in designed camera were analyzed. Results: F-number 4, y direction 12 mm and x direction 36 mm for focal length of the thermal optical system were satisfied. Total length of the system was 76 mm so that an overall volume of the system was reduced. Astigmatism and spherical aberration was within ${\pm}$0.10 which was less than 2 pixel size. Distortion was within 10% so there was no matter to use as a thermal optical camera. MTF performance for the system was over 25% from 33l p/mm to full field so it was satisfied with the boundary condition. Designed optical system was able to detect up to 2.9 km and reduce a diffused image by decreasing a narcissus value from all surfaces except the 4th surface. From sensitivity analysis, MTF resolution was increased on changing temperature with the 5th lens which was assumed as compensation. Conclusions: Designed optical system which used anamorphic lens was satisfied with boundary condition. an increasing resolution with temperature, longer detecting distance and decreasing of narcissus were verified.

• Journal of Intelligence and Information Systems
• /
• v.21 no.2
• /
• pp.1-18
• /
• 2015

Collaborative filtering(CF) algorithm has been popularly used for recommender systems in both academic and practical applications. A general CF system compares users based on how similar they are, and creates recommendation results with the items favored by other people with similar tastes. Thus, it is very important for CF to measure the similarities between users because the recommendation quality depends on it. In most cases, users' explicit numeric ratings of items(i.e. quantitative information) have only been used to calculate the similarities between users in CF. However, several studies indicated that qualitative information such as user's reviews on the items may contribute to measure these similarities more accurately. Considering that a lot of people are likely to share their honest opinion on the items they purchased recently due to the advent of the Web 2.0, user's reviews can be regarded as the informative source for identifying user's preference with accuracy. Under this background, this study proposes a new hybrid recommender system that combines with users' review mining. Our proposed system is based on conventional memory-based CF, but it is designed to use both user's numeric ratings and his/her text reviews on the items when calculating similarities between users. In specific, our system creates not only user-item rating matrix, but also user-item review term matrix. Then, it calculates rating similarity and review similarity from each matrix, and calculates the final user-to-user similarity based on these two similarities(i.e. rating and review similarities). As the methods for calculating review similarity between users, we proposed two alternatives - one is to use the frequency of the commonly used terms, and the other one is to use the sum of the importance weights of the commonly used terms in users' review. In the case of the importance weights of terms, we proposed the use of average TF-IDF(Term Frequency - Inverse Document Frequency) weights. To validate the applicability of the proposed system, we applied it to the implementation of a recommender system for smartphone applications (hereafter, app). At present, over a million apps are offered in each app stores operated by Google and Apple. Due to this information overload, users have difficulty in selecting proper apps that they really want. Furthermore, app store operators like Google and Apple have cumulated huge amount of users' reviews on apps until now. Thus, we chose smartphone app stores as the application domain of our system. In order to collect the experimental data set, we built and operated a Web-based data collection system for about two weeks. As a result, we could obtain 1,246 valid responses(ratings and reviews) from 78 users. The experimental system was implemented using Microsoft Visual Basic for Applications(VBA) and SAS Text Miner. And, to avoid distortion due to human intervention, we did not adopt any refining works by human during the user's review mining process. To examine the effectiveness of the proposed system, we compared its performance to the performance of conventional CF system. The performances of recommender systems were evaluated by using average MAE(mean absolute error). The experimental results showed that our proposed system(MAE = 0.7867 ~ 0.7881) slightly outperformed a conventional CF system(MAE = 0.7939). Also, they showed that the calculation of review similarity between users based on the TF-IDF weights(MAE = 0.7867) leaded to better recommendation accuracy than the calculation based on the frequency of the commonly used terms in reviews(MAE = 0.7881). The results from paired samples t-test presented that our proposed system with review similarity calculation using the frequency of the commonly used terms outperformed conventional CF system with 10% statistical significance level. Our study sheds a light on the application of users' review information for facilitating electronic commerce by recommending proper items to users.