• The Bulletin of The Korean Astronomical Society
• /
• v.44 no.1
• /
• pp.82.3-82.3
• /
• 2019

In this study, we generate future full disk magnetograms in 12, 24, 36 and 48 hours advance from SDO/HMI images using deep learning. To perform this generation, we apply the convolutional generative adversarial network (cGAN) algorithm to a series of SDO/HMI magnetograms. We use SDO/HMI data from 2011 to 2016 for training four models. The models make AI-generated images for 2017 HMI data and compare them with the actual HMI magnetograms for evaluation. The AI-generated images by each model are very similar to the actual images. The average correlation coefficient between the two images for about 600 data sets are about 0.85 for four models. We are examining hundreds of active regions for more detail comparison. In the future we will use pix2pix HD and video2video translation networks for image prediction.

• The KIPS Transactions:PartB
• /
• v.8B no.5
• /
• pp.549-556
• /
• 2001

The general problems of recovering 3D for 2D imagery require the depth information for each picture element form focus. The manual creation of those 3D models is consuming time and cost expensive. The goal in this paper is to simplify the depth estimation algorithm that extracts the depth information of every region from monocular image sequence with camera translation to implement 3D video in realtime. The paper is based on the property that the motion of every point within image which taken from camera translation depends on the depth information. Full-search motion estimation based on block matching algorithm is exploited at first step and ten, motion vectors are compensated for the effect by camera rotation and zooming. We have introduced the algorithm that estimates motion of object by analysis of monocular motion picture and also calculates the averages of frame depth and relative depth of region to the average depth. Simulation results show that the depth of region belongs to a near object or a distant object is in accord with relative depth that human visual system recognizes.

• Journal of Broadcast Engineering
• /
• v.19 no.6
• /
• pp.798-809
• /
• 2014

Video stabilization is performed to remove unexpected shaky and irregular motion from a video. It is often used as preprocessing for robust feature tracking and matching in video. Typical video stabilization algorithms are developed to compensate motion from surveillance video or outdoor recordings that are captured by a hand-help camera. However, since the vehicle video contains rapid change of motion and local features, typical video stabilization algorithms are hard to be applied as it is. In this paper, we propose a novel approach to compensate shaky and irregular motion in vehicle video using linear regression model and vertical projection histogram matching. Towards this goal, we perform vertical projection histogram matching at each sub region of an input frame, and then we generate linear regression model to extract vertical translation and rotation parameters with estimated regional vertical movement vector. Multiple binarization with sub-region analysis for generating the linear regression model is effective to typical recording environments where occur rapid change of motion and local features. We demonstrated the effectiveness of our approach on blackbox videos and showed that employing the linear regression model achieved robust estimation of motion parameters and generated stabilized video in full automatic manner.

• Journal of Korea Multimedia Society
• /
• v.16 no.1
• /
• pp.42-49
• /
• 2013

The camera motion is accompanied with the translation and/or the rotation of objects in frames of a video sequence. An unnecessary rotation of objects declines the quality of the moving pictures and in addition is a primary cause of the viewers' fatigue. In this paper, a novel method for correcting rotated frames in video sequences is presented, where the modified Mojette transform is applied to the motion-compensated area in each frame. The Mojette transform is one of discrete Radon transforms, and is modified for correcting the rotated frames as follows. First, the bin values in the Mojette transform are determined by using pixels on the projection line and the interpolation of pixels adjacent to the line. Second, the bin values are calculated only at some area determined by the motion estimation between current and reference frames. Finally, only one bin at each projection is computed for reducing the amount of the calculation in the Mojette transform. Through the simulation carried out on various test video sequences, it is shown that the proposed scheme has good performance for correcting the rotation of frames in moving pictures.

• Journal of the Institute of Convergence Signal Processing
• /
• v.5 no.2
• /
• pp.96-105
• /
• 2004

The recovering 3D image from 2D requires the depth information for each picture element. The manual creation of those 3D models is time consuming and expensive. The goal in this paper is to estimate the relative depth information of every region from single view image with camera translation. The paper is based on the fact that the motion of every point within image which taken from camera translation depends on the depth. Motion vector using full-search motion estimation is compensated for camera rotation and zooming. We have developed a framework that estimates the average frame depth by analyzing motion vector and then calculates relative depth of region to average frame depth. Simulation results show that the depth of region belongs to a near or far object is consistent accord with relative depth that man recognizes.

• Journal of Korean Society for Geospatial Information Science
• /
• v.16 no.2
• /
• pp.49-56
• /
• 2008

Image registration is one of the critical techniques of image mosaic which has many applications such as generating panoramas, video monitoring, image rendering and reconstruction, etc. The fundamental tasks of image registration are point features extraction and tracking which take much computation time. KLT(Kanade-Lucas-Tomasi) feature tracker has proposed for extracting and tracking features through image sequences. The aim of this study is to demonstrate the usage of effective and robust KLT feature detector and tracker for an image registration using the sequence image frames captured by UAV video camera. In result, by using iterative implementation of the KLT tracker, the features extracted from the first frame of image sequences could be successfully tracked through all frames. The process of feature tracking in the various frames with rotation, translation and small scaling could be improved by a careful choice of the process condition and KLT pyramid implementation.

• Journal of the Korea Computer Graphics Society
• /
• v.25 no.5
• /
• pp.1-9
• /
• 2019

In this paper, we propose a video enhancement method using generative adversarial networks to remove raindrops and restore the background information on the removed region in the coastal wave video imagery distorted by raindrops during rainfall. Two experimental models are implemented: Pix2Pix network widely used for image-to-image translation and Attentive GAN, which is currently performing well for raindrop removal on a single images. The models are trained with a public dataset of paired natural images with and without raindrops and the trained models are evaluated their performance of raindrop removal and background information recovery of rainwater distortion of coastal wave video imagery. In order to improve the performance, we have acquired paired video dataset with and without raindrops at the real coast and conducted transfer learning to the pre-trained models with those new dataset. The performance of fine-tuned models is improved by comparing the results from pre-trained models. The performance is evaluated using the peak signal-to-noise ratio and structural similarity index and the fine-tuned Pix2Pix network by transfer learning shows the best performance to reconstruct distorted coastal wave video imagery by raindrops.

• The KIPS Transactions:PartD
• /
• v.9D no.3
• /
• pp.501-510
• /
• 2002

A various multimedia application services should be developed with techniques of high speed networks and computer. Among these, video-conference system over Internet is useful and important, and the standardization for it should be showed in ITU-T H.323. H.323 standardization consists of four components such as Terminal, MCU(Multipoint Control Unit), Gatekeeper, and Gateway. Among these, the functions of Gatekeeper are as follows, firstly the address translation service to translate the alias address into the IP address, secondary conference admission control service to control of conference start and termination, thirdly bandwidth management service for H.323 terminals. In this paper, we implemented the Gatekeeper for an efficient management of video-conference components in Internet environment, and will introduce our system. As the experimental results with CUSeeMe and Netmeeting which are well-known H.323 terminal, it is known that our gatekeeper should be satisfied with H.323 standardization.

• English Language & Literature Teaching
• /
• v.8 no.1
• /
• pp.1-13
• /
• 2002

One of the benefits of the internet-assisted instruction is that it can improve L2 Learners' motivation to express themselves in English. The purpose of this paper is to investigate an effective approach to British-American fiction learning in Korean universities, which can emphasize communicative strategies drawing on video-conferencing system, a chat system(CUSeeMe), and an e-mail system. Students are passive participants who cannot assert their creativity in the traditional teaching method of British-American fiction, which mainly relies upon reading and translation far from literature lessons. In CCDL(Cross-cultural distance learning) class, students can play active roles in asserting their own ideas and assuming considerable responsibility for making a presentation in English. A professor can play a role as a coordinator in supporting the students' activities and in winding up the class. The main significance of this article lies in providing a paradigm for CCDL class beyond the limitation of the traditional teaching method of British-American fiction in Korea and futhermore in exploring the eclectic integration of the traditional one and CCDL.

• Proceedings of the Korean Information Science Society Conference
• /
• 1999.10a
• /
• pp.12-14
• /
• 1999

오늘날 멀티미디어 및 인터넷 서비스가 눈에 띄게 증가하면서 다양한 응용분야에서의 동영상 데이터 활용을 급증하였고 이에 사용자가 원하는 동영상 데이터를 빠르고 정확하게 검색하기 위한 내용기반 검색기법이 필수적이다. 본 논문은 high-level features와 더불어 동영상의 고유 내용 속성에 속하는 low-level features를 자동 일반화(generalization)하여 다단계 관리하고 features에 대한 가중치 적용질의를 제공함으로써 기존 내용기반 검색 연구와는 뚜렷한 차별성을 갖는다. 또한 low-level features와 high-level features간의 자동변환(translation)을 가능하게 함으로써 동영상 데이터베이스의 사용자 접근 효율을 한단계 높이고 보다 의미구조화된 동영상 관리 및 내용기반 검색을 지원한다.