• Title/Summary/Keyword: multi-temporal

Search Result 667, Processing Time 0.027 seconds

Temporal Prediction Structure for Multi-view Video Coding (다시점 비디오 부호화를 위한 시간적 예측 구조)

  • Yoon, Hyo-Sun;Kim, Mi-Young
    • Journal of Korea Multimedia Society
    • /
    • v.15 no.9
    • /
    • pp.1093-1101
    • /
    • 2012
  • Multi-view video is obtained by capturing one three-dimensional scene with many cameras at different positions. Multi-view video coding exploits inter-view correlations among pictures of neighboring views and temporal correlations among pictures of the same view. Multi-view video coding which uses many cameras requires a method to reduce the computational complexity. In this paper, we proposed an efficient prediction structure to improve performance of multi-view video coding. The proposed prediction structure exploits an average distance between the current picture and its reference pictures. The proposed prediction structure divides every GOP into several small groups to decide the maximum index of hierarchical B layer and the number of pictures of each B layer. Experimental results show that the proposed prediction structure shows good performance in image quality and bit-rates. When compared to the performance of hierarchical B pictures of Fraunhofer-HHI, the proposed prediction structure achieved 0.07~0.13 (dB) of PSNR gain and was down by 6.5(Kbps) in bitrate.

Motion Vector Predictor selection method for multi-view video coding (다시점 비디오 부호화를 위한 움직임벡터 예측값 선택 방법)

  • Choi, Won-Jun;Suh, Doug-Young;Kim, Kyu-Heon;Park, Gwang-Hoon
    • Journal of Broadcast Engineering
    • /
    • v.12 no.6
    • /
    • pp.565-573
    • /
    • 2007
  • In this paper, we propose a method to select motion vector predictor by considering prediction structure of a multi view content for coding efficiency of multi view coding which is being standardized in JVT. Motion vector of a different tendency is happened while carrying out temporal and view reference prediction of multi-view video coding. Also, due to the phenomena of motion vectors being searched in both temporal and view order, the motion vectors do not agree with each other resulting a decline in coding efficiency. This paper is about how the motion vector predictor are selected with information of prediction structure. By using the proposed method, a compression ratio of the proposed method in multi-view video coding is increased, and finally $0.03{\sim}0.1$ dB PSNR(Peak Signal-to-Noise Ratio) improvement was obtained compared with the case of JMVM 3.6 method.

Cloud Removal Using Gaussian Process Regression for Optical Image Reconstruction

  • Park, Soyeon;Park, No-Wook
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.4
    • /
    • pp.327-341
    • /
    • 2022
  • Cloud removal is often required to construct time-series sets of optical images for environmental monitoring. In regression-based cloud removal, the selection of an appropriate regression model and the impact analysis of the input images significantly affect the prediction performance. This study evaluates the potential of Gaussian process (GP) regression for cloud removal and also analyzes the effects of cloud-free optical images and spectral bands on prediction performance. Unlike other machine learning-based regression models, GP regression provides uncertainty information and automatically optimizes hyperparameters. An experiment using Sentinel-2 multi-spectral images was conducted for cloud removal in the two agricultural regions. The prediction performance of GP regression was compared with that of random forest (RF) regression. Various combinations of input images and multi-spectral bands were considered for quantitative evaluations. The experimental results showed that using multi-temporal images with multi-spectral bands as inputs achieved the best prediction accuracy. Highly correlated adjacent multi-spectral bands and temporally correlated multi-temporal images resulted in an improved prediction accuracy. The prediction performance of GP regression was significantly improved in predicting the near-infrared band compared to that of RF regression. Estimating the distribution function of input data in GP regression could reflect the variations in the considered spectral band with a broader range. In particular, GP regression was superior to RF regression for reproducing structural patterns at both sites in terms of structural similarity. In addition, uncertainty information provided by GP regression showed a reasonable similarity to prediction errors for some sub-areas, indicating that uncertainty estimates may be used to measure the prediction result quality. These findings suggest that GP regression could be beneficial for cloud removal and optical image reconstruction. In addition, the impact analysis results of the input images provide guidelines for selecting optimal images for regression-based cloud removal.

Classification of Crop Lands over Northern Mongolia Using Multi-Temporal Landsat TM Data

  • Ganbaatar, Gerelmaa;Lee, Kyu-Sung
    • Korean Journal of Remote Sensing
    • /
    • v.29 no.6
    • /
    • pp.611-619
    • /
    • 2013
  • Although the need of crop production has increased in Mongolia, crop cultivation is very limited because of the harsh climatic and topographic conditions. Crop lands are sparsely distributed with relatively small sizes and, therefore, it is difficult to survey the exact area of crop lands. The study aimed to find an easy and effective way of accurate classification to map crop lands in Mongolia using satellite images. To classify the crop lands over the study area in northern Mongolia, four classifications were carried out by using 1) Thematic Mapper (TM) image August 23, 2) TM image of July 6, 3) combined 12 bands of TM images of July and August, and 4) both TM images of July and August by layered classification. Wheat and potato are the major crop types and they show relatively high variation in crop conditions between July and August. On the other hands, other land cover types (forest, riparian vegetation, grassland, water and bare soil) do not show such difference between July and August. The results of four classifications clearly show that the use of multi-temporal images is essential to accurately classify the crop lands. The layered classification method, in which each class is separated by a subset of TM images, shows the highest classification accuracy (93.7%) of the crop lands. The classification accuracies are lower when we use only a single TM image of either July or August. Because of the different planting practice of potato and the growth condition of wheat, the spectral characteristics of potato and wheat cannot be fully separated from other cover types with TM image of either July or August. Further refinements on the spatial characteristics of existing crop lands may enhance the crop mapping method in Mongolia.

A Statistical Analysis of JERS L-band SAR Backscatter and Coherence Data for Forest Type Discrimination

  • Zhu Cheng;Myeong Soo-Jeong
    • Korean Journal of Remote Sensing
    • /
    • v.22 no.1
    • /
    • pp.25-40
    • /
    • 2006
  • Synthetic aperture radar (SAR) from satellites provides the opportunity to regularly incorporate microwave information into forest classification. Radar backscatter can improve classification accuracy, and SAR interferometry could provide improved thematic information through the use of coherence. This research examined the potential of using multi-temporal JERS-l SAR (L band) backscatter information and interferometry in distinguishing forest classes of mountainous areas in the Northeastern U.S. for future forest mapping and monitoring. Raw image data from a pair of images were processed to produce coherence and backscatter data. To improve the geometric characteristics of both the coherence and the backscatter images, this study used the interferometric techniques. It was necessary to radiometrically correct radar backscatter to account for the effect of topography. This study developed a simplified method of radiometric correction for SAR imagery over the hilly terrain, and compared the forest-type discriminatory powers of the radar backscatter, the multi-temporal backscatter, the coherence, and the backscatter combined with the coherence. Statistical analysis showed that the method of radiometric correction has a substantial potential in separating forest types, and the coherence produced from an interferometric pair of images also showed a potential for distinguishing forest classes even though heavily forested conditions and long time separation of the images had limitations in the ability to get a high quality coherence. The method of combining the backscatter images from two different dates and the coherence in a multivariate approach in identifying forest types showed some potential. However, multi-temporal analysis of the backscatter was inconclusive because leaves were not the primary scatterers of a forest canopy at the L-band wavelengths. Further research in forest classification is suggested using diverse band width SAR imagery and fusing with other imagery source.

Automatic Estimation of Threshold Values for Change Detection of Multi-temporal Remote Sensing Images (다중시기 원격탐사 화상의 변화탐지를 위한 임계치 자동 추정)

  • 박노욱;지광훈;이광재;권병두
    • Korean Journal of Remote Sensing
    • /
    • v.19 no.6
    • /
    • pp.465-478
    • /
    • 2003
  • This paper presents two methods for automatic estimation of threshold values in unsupervised change detection of multi-temporal remote sensing images. The proposed methods consist of two analytical steps. The first step is to compute the parameters of a 3-component Gaussian mixture model from difference or ratio images. The second step is to determine a threshold value using Bayesian rule for minimum error. The first method which is an extended version of Bruzzone and Prieto' method (2000) is to apply an Expectation-Maximization algorithm for estimation of the parameters of the Gaussian mixture model. The second method is based on an iterative thresholding algorithm that successively employs thresholding and estimation of the model parameters. The effectiveness and applicability of the methods proposed here were illustrated by two experiments and one case study including the synthetic data sets and KOMPSAT-1 EOC images. The experiments demonstrate that the proposed methods can effectively estimate the model parameters and the threshold value determined shows the minimum overall error.

An Adaptive Motion Vector Estimation Method for Multi-view Video Coding Based on Spatio-temporal Correlations among Motion Vectors (움직임 벡터들의 시·공간적 상관성을 이용한 다시점 비디오 부호화를 위한 적응적 움직임 벡터 추정 기법)

  • Yoon, Hyo-Sun;Kim, Mi-Young
    • The Journal of the Korea Contents Association
    • /
    • v.18 no.12
    • /
    • pp.35-45
    • /
    • 2018
  • Motion Estimation(ME) has been developed to reduce the redundant data in digital video signal. ME is an important part of video encoding system, However, it requires huge computational complexity of the encoder part, and fast motion search methods have been proposed to reduce huge complexity. Multi- view video is obtained by capturing on a three-dimensional scene with many cameras at different positions and its complexity increases in proportion to the number of cameras. In this paper, we proposed an efficient motion method which chooses a search pattern adaptively by using the temporal-spatial correlation of the block and the characteristics of the block. Experiment results show that the computational complexity reduction of the proposed method over TZ search method and FS method can be up to 70~75% and 99% respectively while keeping similar image quality and bit rates.

Analysis on the Sedimentary Environment Change Induced by Typhoon in the Sacheoncheon, Gangneung using Multi-temporal Remote Sensing Data (태풍 루사에 의한 강릉 사천천 주변 퇴적 환경 변화: 다중 시기 원격탐사 자료를 이용한 정보 분석)

  • Park, No-Wook;Jang, Dong-Ho;Chi, Kwang-Hoon
    • Journal of the Korean earth science society
    • /
    • v.27 no.1
    • /
    • pp.83-94
    • /
    • 2006
  • The objective of this paper is to extract and analyze the sediment environment change information in the Sachencheon, Gangneung, Korea that was seriously damaged as a result of typhoon Rusa aftermath early in September, 2002 using multi-temporal remote sensing data. For the extraction of change information, an unsupervised approach based on the automatic determination of thresholding values was applied. As the change detection results, turbidity changes right after typhoon Rusa, the decrease of wetlands, the increase of dry sand and channel width and changes of relative level in the stream due to seasonal variation were observed. Sedimentation in the cultivated areas and restoration works also affected the change near the Sacheoncheon. In addition to the change detection analysis, several environmental thematic maps including microtopographic map, distributions of estimated amount of flood deposits and flood hazard landform classification map were generated by using remote sensing and field survey data. In conclusion, multi-temporal remote sensing data can be effectively used for natural hazard analysis and damage information extraction and specific data processing techniques for high-resolution remote sensing data should also be developed.

Land Cover Change Detection in the Nakdong River Basin Using LiDAR Data and Multi-Temporal Landsat Imagery (LiDAR DEM과 다중시기에 촬영된 Landsat 영상을 이용한 낙동강 유역 내 토지피복 변화 탐지)

  • CHOUNG, Yun-Jae
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.18 no.2
    • /
    • pp.135-148
    • /
    • 2015
  • This research is carried out for the land cover change detection in the Nakdong River basin before and after the 4 major rivers restoration project using the LiDAR DEM(Digital Elevation Model) and the multi-temporal Landsat imagery. Firstly the river basin polygon is generated by using the levee boundaries extracted from the LiDAR DEM, and the four river basin imagery are generated from the multi-temporal Landsat-5 TM(Thematic Mapper) and Landsat-8 OLI(Operational Land Imager) imagery by using the generated river basin polygon. Then the main land covers such as river, grass and bare soil are separately generated from the generated river basin imagery by using the image classification method, and the ratio of each land cover in the entire area is calculated. The calculated land cover changes show that the areas of grass and bare soil in the entire area have been significantly changed because of the seasonal change, while the area of the river has been significantly increased because of the increase of the water storage. This paper contributes to proposing an efficient methodology for the land cover change detection in the Nakdong River basin using the LiDAR DEM and the multi-temporal satellite imagery taken before and after the 4 major rivers restoration project.

Use of Unmanned Aerial Vehicle for Multi-temporal Monitoring of Soybean Vegetation Fraction

  • Yun, Hee Sup;Park, Soo Hyun;Kim, Hak-Jin;Lee, Wonsuk Daniel;Lee, Kyung Do;Hong, Suk Young;Jung, Gun Ho
    • Journal of Biosystems Engineering
    • /
    • v.41 no.2
    • /
    • pp.126-137
    • /
    • 2016
  • Purpose: The overall objective of this study was to evaluate the vegetation fraction of soybeans, grown under different cropping conditions using an unmanned aerial vehicle (UAV) equipped with a red, green, and blue (RGB) camera. Methods: Test plots were prepared based on different cropping treatments, i.e., soybean single-cropping, with and without herbicide application and soybean and barley-cover cropping, with and without herbicide application. The UAV flights were manually controlled using a remote flight controller on the ground, with 2.4 GHz radio frequency communication. For image pre-processing, the acquired images were pre-treated and georeferenced using a fisheye distortion removal function, and ground control points were collected using Google Maps. Tarpaulin panels of different colors were used to calibrate the multi-temporal images by converting the RGB digital number values into the RGB reflectance spectrum, utilizing a linear regression method. Excess Green (ExG) vegetation indices for each of the test plots were compared with the M-statistic method in order to quantitatively evaluate the greenness of soybean fields under different cropping systems. Results: The reflectance calibration methods used in the study showed high coefficients of determination, ranging from 0.8 to 0.9, indicating the feasibility of a linear regression fitting method for monitoring multi-temporal RGB images of soybean fields. As expected, the ExG vegetation indices changed according to different soybean growth stages, showing clear differences among the test plots with different cropping treatments in the early season of < 60 days after sowing (DAS). With the M-statistic method, the test plots under different treatments could be discriminated in the early seasons of <41 DAS, showing a value of M > 1. Conclusion: Therefore, multi-temporal images obtained with an UAV and a RGB camera could be applied for quantifying overall vegetation fractions and crop growth status, and this information could contribute to determine proper treatments for the vegetation fraction.