• Title/Summary/Keyword: Multi frames of reference

Search Result 36, Processing Time 0.024 seconds

Illumination Mismatch Compensation Algorithm based on Layered Histogram Matching by Using Depth Information (깊이 정보에 따른 레이어별 히스토그램 매칭을 이용한 조명 불일치 보상 기법)

  • Lee, Dong-Seok;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.8C
    • /
    • pp.651-660
    • /
    • 2010
  • In this paper, we implement an efficient histogram-based prefiltering to compensate the illumination mismatches in regions between neighboring views. In multi-view video, such illumination disharmony can primarily occur on account of different camera location and orientation and an imperfect camera calibration. This discrepancy can cause the performance decrease of multi-view video coding(MVC) algorithm. A histogram matching algorithm can be exploited to make up for these differences in a prefiltering step. Once all camera frames of a multi-view sequence are adjusted to a predefined reference through the histogram matching, the coding efficiency of MVC is improved. However general frames of multi-view video sequence are composed of several regions with different color composition and their histogram distribution which are mutually independent of each other. In addition, the location and depth of these objects from sequeuces captured from different cameras can be different with different frames. Thus we propose a new algorithm which classify a image into several subpartitions by its depth information first and then histogram matching is performed for each region individually. Experimental results show that the compression ratio for the proposed algorithm is improved comparing with the conventional image-based algorithms.

Feature based Pre-processing Method to compensate color mismatching for Multi-view Video (다시점 비디오의 색상 성분 보정을 위한 특징점 기반의 전처리 방법)

  • Park, Sung-Hee;Yoo, Ji-Sang
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.15 no.12
    • /
    • pp.2527-2533
    • /
    • 2011
  • In this paper we propose a new pre-processing algorithm applied to multi-view video coding using color compensation algorithm based on image features. Multi-view images have a difference between neighboring frames according to illumination and different camera characteristics. To compensate this color difference, first we model the characteristics of cameras based on frame's feature from each camera and then correct the color difference. To extract corresponding features from each frame, we use Harris corner detection algorithm and characteristic coefficients used in the model is estimated by using Gauss-Newton algorithm. In this algorithm, we compensate RGB components of target images, separately from the reference image. The experimental results with many test images show that the proposed algorithm peformed better than the histogram based algorithm as much as 14 % of bit reduction and 0.5 dB ~ 0.8dB of PSNR enhancement.

Estimation of Drone Velocity with Sum of Absolute Difference between Multiple Frames (다중 프레임의 SAD를 이용한 드론 속도 측정)

  • Nam, Donho;Yeom, Seokwon
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.20 no.3
    • /
    • pp.171-176
    • /
    • 2019
  • Drones are highly utilized because they can efficiently acquire long-distance videos. In drone operation, the speed, which is the magnitude of the velocity, can be set, but the moving direction cannot be set, so accurate information about the drone's movement should be estimated. In this paper, we estimate the velocity of the drone moving at a constant speed and direction. In order to estimate the drone's velocity, the displacement of the target frame to minimize the sum of absolute difference (SAD) of the reference frame and the target frame is obtained. The ground truth of the drone's velocity is calculated using the position of a certain matching point over all frames. In the experiments, a video was obtained from the drone moving at a constant speed at a height of 150 meters. The root mean squared error (RMSE) of the estimated velocities in x and y directions and the RMSE of the speed were obtained showing the reliability of the proposed method.

Design of Intra Prediction Circuit for HEVC and H.264 Multi-decoder Supporting UHD Images (UHD 영상을 지원하는 HEVC 및 H.264 멀티 디코더 용 인트라 예측 회로 설계)

  • Yu, Sanghyun;Cho, Kyeongsoon
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.53 no.12
    • /
    • pp.50-56
    • /
    • 2016
  • This paper proposes the architecture and design of intra prediction circuit for a multi-decoder supporting UHD images. The proposed circuit supports not only the latest video compression standard HEVC but also H.264. In addition to the basic function of performing intra prediction, this circuit has the capability of performing the reference sample filter operation defined in the H.264 standard, and the smoothing and strong sample filter operations defined in the HEVC standard. We reduced the circuit size by sharing the circuit blocks for common operations and internal storage, and improved the circuit performance by parallel processing. The proposed circuit was described at RTL using Verilog HDL and its functionality was verified by using NC-Verilog of Cadence. The RTL circuit was synthesized by using Design Compiler of Synopsys and 130nm standard cell library. The synthesized gate-level circuit consists of 69,694 gates and processes 100 ~ 280 frames per second for 4K-UHD HEVC images at the maximum operation frequency of 157MHz.

Fast Intra Mode Decision for H.264/AVC based on Directional Information (방향 정보를 이용한 H.264/AVC의 고속 인트라 모드 결정)

  • Lee, Kyung-Hee;Kim, Jong-Gu;Suh, Jae-Won
    • The Journal of the Korea Contents Association
    • /
    • v.9 no.3
    • /
    • pp.20-27
    • /
    • 2009
  • H.264/AVC video coding standard adapting a rate-distortion optimization technique to select the best coding mode with multi reference frames for each macroblock gets a higher coding efficiency than those of previous video coding standards but the computational complexity increases drastically. Therefore, many fast mode decision algorithms are proposed to reduce the computational complexity. Among them, we propose a fast intra mode decision algorithm based on directional information of I4MB. The proposed algorithm achieves consistent time saving about 15% in IPPP sequences and 44% in all I frame sequences with negligible loss in PSNR and small increment of bit rate compared with that of JM11.0.

An Efficient Scheme for Motion Estimation Using Multi-reference Frames in H.264/AVC (H.264에서 다중참조 프레임을 이용한 효율적인 움직임 예측)

  • Kim Sung-Eun;Han Jong-Ki
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.9C
    • /
    • pp.859-868
    • /
    • 2006
  • H.264에서 다중참조 프레임을 사용한 움직임 예측 방법은 단일 참조프레임을 이용한 움직임 예측보다 더 많은 시간적 중복성을 제거하여 부호화 효율을 높이거나 채널에러에 강인하게 부호화하기 위해 사용된다. 하지만 다중 참조 프레임을 이용하여 움직임 예측을 하는 것은 단일의 참조 프레임을 이용하는 것보다 많은 계산량을 요구하기 때문에 비디오 인코더의 복잡도를 증가시키게 된다. 본 논문에서는 다중참조 프레임을 사용한 움직임 예측을 화질 열화 없이 적은 복잡도로서 가능하게 하는 알고리즘을 제안한다. 움직임 예측 절차의 복잡도를 줄이기 위해, 제안한 알고리즘에서는 연속되는 프레임 사이에 구성된 움직임 벡터맵을 이용하여 움직임벡터를 추정한다. 제안한 방식은 추정된 움직임벡터를 작은 탐색영역에서 보정하는 방식을 적용하기 때문에 기존의 방식들에 비해 적은 복잡도가 요구된다. 제안된 방법으로 추정된 움직임벡터는 각 참조프레임들에 대해 최적의 움직임 벡터를 효과적으로 추적하기 때문에 부호화 된 영상의 화질은 전 탐색영역 움직임 예측 알고리즘을 이용한 결과와 매우 비슷하다. 제안된 방식은 세가지 단계로 구성된다. (a) 연속되는 두 개의 프레임 사이에 벡터맵을 구성한다. (b) 벡터맵에 있는 요소벡터를 이용하여 시간적 움직임 벡터를 구성한다. (c) 마지막으로, 임시 움직임 벡터를 좁은 탐색영역에서 보정한다. 컴퓨터 실험을 통해 제안된 방식의 효율성을 입증하였다. 제안된 방식과 기존의 방식들과의 비교를 위해 H.264 부호화기에서 움직임 예측 모듈에 의해 소비된 CPU 시간을 측정하였다. 컴퓨터 실험을 통해 알 수 있듯이 제안된 방식에 의해 부호화된 영상의 화질은 기존 방식과 을 통해 얻은 영상화질과 거의 같으면서 알고리즘 복잡도는 크게 줄어드는 것을 볼 수 있다.

NUMERICAL STUDY OF A CENTRIFUGAL PUMP PERFORMANCE WITH VARIOUS VOLUTE SHAPE (볼루트의 형상 변화가 원심펌프 성능에 미치는 영향에 대한 수치해석)

  • Lee, J.H.;Hur, N.;Yoon, I.S.
    • Journal of computational fluids engineering
    • /
    • v.20 no.3
    • /
    • pp.35-40
    • /
    • 2015
  • Centrifugal pumps consume considerable amounts of energy in various industrial applications. Therefore, improving the efficiency of pumps machine is a crucial challenge in industrial world. This paper presents numerical investigation of flow characteristics in volutes of centrifugal pumps in order to compare the energy consumption. A wide range of volumetric flow rate has been investigated for each case. The standard k-${\varepsilon}$ is adopted as the turbulence model. The impeller rotation is simulated employing the Multi Reference Frames(MRF) method. First, two different conventional design methods, i.e., the constant angular momentum(CAM) and the constant mean velocity (CMV) are studied and compared to a baseline volute model. The CAM volute profile is a logarithmic spiral. The CMV volute profile shape is an Archimedes spiral curve. The modified volute models show lower head value than baseline volute model, but in case of efficiency graph, CAM curve has higher values than others. Finally for this part, CAM curve is selected to be used in the simulation of different cross-section shape. Two different types of cross-section are generated. One is a simple rectangular shape, and the other one is fan shape. In terms of different cross-section shape, simple rectangular geometry generated higher head and efficiency. Overall, simulation results showed that the volute designed using constant angular momentum(CAM) method has higher characteristic performances than one by CMV volute.

New Prefiltering Methods based on a Histogram Matching to Compensate Luminance and Chrominance Mismatch for Multi-view Video (다시점 비디오의 휘도 및 색차 성분 불일치 보상을 위한 히스토그램 매칭 기반의 전처리 기법)

  • Lee, Dong-Seok;Yoo, Ji-Sang
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.47 no.6
    • /
    • pp.127-136
    • /
    • 2010
  • In multi-view video, illumination disharmony between neighboring views can occur on account of different location of each camera and imperfect camera calibration, and so on. Such discrepancy can be the cause of the performance decrease of multi-view video coding by mismatch of inter-view prediction which refer to the pictures obtained from the neighboring views at the same time. In this paper, we propose an efficient histogram-based prefiltering algorithm to compensate mismatches between the luminance and chrominance components in multi-view video for improving its coding efficiency. To compensate illumination variation efficiently, all camera frames of a multi-view sequence are adjusted to a predefined reference through the histogram matching. A Cosited filter that is used for chroma subsampling in many video encoding schemes is applied to each color component prior to histogram matching to improve its performance. The histogram matching is carried out in the RGB color space after color space converting from YCbCr color space. The effective color conversion skill that has respect to direction of edge and range of pixel value in an image is employed in the process. Experimental results show that the compression ratio for the proposed algorithm is improved comparing with other methods.

A Case Study of Elementary Students' Developmental Pathway of Spatial Reasoning on Earth Revolution and Apparent Motion of Constellations (지구의 공전과 별자리의 겉보기 운동에 대한 초등학생들의 공간적 추론 발달 경로의 사례 연구)

  • Maeng, Seungho;Lee, Kiyoung
    • Journal of The Korean Association For Science Education
    • /
    • v.38 no.4
    • /
    • pp.481-494
    • /
    • 2018
  • This study investigated elementary students' understanding of Earth revolution and its accompanied apparent motion of constellation in terms of spatial reasoning. We designed a set of multi-tiered constructed response items in which students described their own idea about the reason of consecutive movement of constellations for three months and drew a diagram about relative locations of the Sun, the Earth, and the constellations. Sixty-five sixth grade students from four elementary schools participated in the tests both before and after science classes on the relative movement of Earth and Moon. Their answers to the items were categorized inductively in terms of transforming frames of reference which are observed on the Earth and designed from the Space-based perspective. We analyzed those categories by the levels of spatial reasoning and depicted the change of students' levels between pre/post-tests so that we could get an idea on the preliminary developmental pathway of students' understanding of this topic. The lower anchor description was that constellations move around the Earth with geocentric perspective. Intermediate level descriptions were planar understanding of Earth movement, intuitive idea on constellation movement along with the Earth. Students with intermediate levels did not reach understanding of the apparent motion of constellations. As the upper anchor description students understood the apparent motion of constellations according to the Earth revolution and could transform their frames of reference between Earth-based view and Space-based view. The features as the case of evolutionary learning progressions and critical points of students' development for this topic were discussed.

Parametric Analysis of the Solar Radiation Pressure Model for Precision GPS Orbit Determination

  • Bae, Tae-Suk
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.35 no.1
    • /
    • pp.55-62
    • /
    • 2017
  • The SRP (Solar Radiation Pressure) model has always been an issue in the dynamic GPS (Global Positioning System) orbit determination. The widely used CODE (Center for Orbit Determination in Europe) model and its variants have nine parameters to estimate the solar radiation pressure from the Sun and to absorb the remaining forces. However, these parameters show a very high correlation with each other and, therefore, only several of them are estimated at most of the IGS (International GNSS Service) analysis centers. In this study, we attempted to numerically verify the correlation between the parameters. For this purpose, a bi-directional, multi-step numerical integrator was developed. The correlation between the SRP parameters was analyzed in terms of post-fit residuals of the orbit. The integrated orbit was fitted to the IGS final orbit as external observations. On top of the parametric analysis of the SRP parameters, we also verified the capabilities of orbit prediction at later time epochs. As a secondary criterion for orbit quality, the positional discontinuity of the daily arcs was also analyzed. The resulting post-fit RMSE (Root-Mean-Squared Error) shows a level of 4.8 mm on average and there is no significant difference between block types. Since the once-per-revolution parameters in the Y-axis are highly correlated with those in the B-axis, the periodic terms in the D- and Y-axis are constrained to zero in order to resolve the correlations. The 6-hr predicted orbit based on the previous day yields about 3 cm or less compared to the IGS final orbit for a week, and reaches up to 6 cm for 24 hours (except for one day). The mean positional discontinuity at the boundary of two 1-day arcs is on the level of 1.4 cm for all non-eclipsing satellites. The developed orbit integrator shows a high performance in statistics of RMSE and positional discontinuity, as well as the separations of the dynamic parameters. In further research, additional verification of the reference frame for the estimated orbit using SLR is necessary to confirm the consistency of the orbit frames.