• Title/Summary/Keyword: Data skew

Search Result 125, Processing Time 0.024 seconds

Effective Parallel Hash Join Algorithm Based on Histoftam Equalization in the Presence of Data Skew (데이터 편재 하에서 히스토그램 변환기법에 기초한 효율적인 병렬 해쉬 결합 알고리즘)

  • Park, Ung-Gyu;Choe, Hwang-Gyu;Kim, Tak-Gon
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.2
    • /
    • pp.338-348
    • /
    • 1997
  • In this pater, we first propose a data distribution framework to resolve load imbalance and bucket oerflow in parallel hash join.Using the histogram equalization technique, the framework transforms a histogram of skewed data to the desired uniform distribution that corresponds to the relative computing power of node processors in the system.Next we propose an effcient parallel hash join algorithm for handing skwed data based on the proposed data distribution methodology.For performance comparison of our algorithm with other hash join algorithms.we perform similation experiments and actual exeution on COREDB database computer with 8-node hyperube architecture. In these experiments, skwed data distebution of the join atteibute is modeled using a Zipf-like distribution.The perfomance studies undicate that our algorithm outperforms other algorithms in the skewed cases.

  • PDF

Development of Simulation Method of Doppler Power Spectrum and Raw Time Series Signal Using Average Moments of Radar Wind Profiler (윈드프로파일러의 평균모멘트 값을 이용한 도플러 파워 스펙트럼 및 시계열 원시신호 시뮬레이션기법 개발)

  • Lee, Sang-Yun;Lee, Gyu-Won
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.15 no.6
    • /
    • pp.1037-1044
    • /
    • 2020
  • Since radar wind profiler (RWP) provides wind field data with high time and space resolution in all weather conditions, their verification of the accuracy and quality is essential. The simultaneous wind measurement from rawinsonde is commonly used to evaluate wind vectors from RWP. In this study, the simulation algorithm which produces the spectrum and raw time series (I/Q) data from the average values of moments is presented as a step-by-step verification method for the signal processing algorithm. The possibility of the simulation algorithm was also confirmed through comparison with the raw data of LAP-3000. The Doppler power spectrum was generated by assuming the density function of the skew-normal distribution and by using the moment values as the parameter. The simulated spectrum was generated through random numbers. In addition, the coherent averaged I/Q data was generated by random phase and inverse discrete Fourier transform, and raw I/Q data was generated through the Dirichlet distribution.

A Dynamic Synchronization Method for Multimedia Delivery and Presentation based on QoS (QoS를 이용한 동적 멀티미디어 전송 및 프리젠테이션 동기화 기법)

  • 나인호;양해권;고남영
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.1 no.2
    • /
    • pp.145-158
    • /
    • 1997
  • Method for synchronizing multimedia data is needed to support continuous transmission of multimedia data through a network in a bounded time and it also required for supporting continuous presentation of multimedia data with the required norminal playout rate in distributed network environments. This paper describes a new synchronization method for supporting delay-sensitive multimedia Presentation without degration of Quality of services of multimedia application. It mainly aims to support both intermedia and intermedia synchronization by absorbing network variations which may cause skew or jitter. In order to remove asynchonization problems, we make use of logical time system, dynamic buffer control method, and adjusting synchronization intervals based on the quality of services of a multimedia. It might be more suitable for working on distribute[1 multimedia systems where the network delay variation is changed from time to time and no global clock is supported. And it also can effectively reduce the amount of buffer requirements needed for transfering multimedia data between source and destination system by adjusting synchronization intervals with acceptable packet delay limits and packet loss rates.

  • PDF

Estimation of Local Scour at Piers Using Artificial Neural Network (인공신경망을 이용한 피어의 국부세굴 평가)

  • Park, Hyun-Il;Shin, Jong-Hyun
    • Journal of the Korean Geotechnical Society
    • /
    • v.24 no.11
    • /
    • pp.17-24
    • /
    • 2008
  • It is known that scour at bridge piers is one of the leading causes of bridge failure. However, the mechanism of flow around a pier structure is so complicated that it is difficult to establish a general empirical model to provide accurate estimation for scour. Especially, each of the proposed empirical formula yields good results for a particular data set but can't show reliable predictability for various scouring data set. In this study, an alternative approach, that is, artificial neural networks (ANN), is proposed to estimate the local scour depth with numerous field data base. The local scour depth was modeled as a function of seven variables; pier shape, pier width, pier length, skew angle, stream velocity, water depth, $D_{50}$. 426 field data were used for the training and testing of ANN model. The predicted results showed that the neural network could provide a better alternative to the empirical equations.

Design of Bit Selectable and Bi-directional Interface Device using Interrupt Generator (인터럽트 발생기를 사용한 접속 비트 전환식 양방향 접속장치의 설계)

  • Lim, Tae-Young;Yi, Cheon-Hee
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.36C no.7
    • /
    • pp.17-26
    • /
    • 1999
  • In this paper, Bit selectable and Bi-directional Interface Device is described, which can communicate data with the peripheral devices. Specially, an algorithm of truth-table comparison that synthesizes the pulse-type sequential circuit pulse has been proposed to design the Interrupt Generator, and implemented in designing the Interrupt Register. Also, a description of the asynchronous design method is given to remove the clock skew phenomenon, and the output asynchronous control method which finds the optimal clock and controls all the enable signal of the output pins at the same time is presented. Using this technique interface ports have delay time of less-than 0.7ns.

  • PDF

A Multidimensional Simulation of Swirl Flow and Turbulent Combustion in a Cylinder of SI Engine (전기점화 기관의 선회 유동 및 연소에 관한 수치해석)

  • 정진은;김응서
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.16 no.9
    • /
    • pp.1744-1759
    • /
    • 1992
  • A multidimensional simulation of turbulent flow and combustion with swirl in the cylinder of SI engine is implemented to clarify the effects of swirl. present simulation employs the ICED-ALE numerical technique, the skew-upwind difference scheme, a modified k_.epsilon. turbulence model, a combustion model of Arrhenius type and turbulence-mixing-control type. First, the calculations for swirling flow in an axisymmetric cylinder are carried out. The results are compared with the experimental data to validate the numerical analysis. Second, the calculations for intake, compression and combustion processes in an axisymmetric cylinder are performed. The effects of swirl on turbulent flow and combustion are examined through the parametric study of swirl number 0.0, 0.6, 1.2 and 2.4. As a result, it is numerically shown that the turbulent kinetic energy and the swirl velocity, which are produced during the intake process, affect the combustion process.

A study on the Flood Frequency Analyzed in Consideration of Low Outliers. (Low Outliers를 고려한 홍수빈도분석에 관한 연구)

  • 이순혁;홍성표;박명근
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.30 no.4
    • /
    • pp.62-70
    • /
    • 1988
  • This study was conducted to solve the problems for the unsuitable parameters and the uncertainty of design flood can be appeared by low outliers were inclined to the lower part from the trend of the balance of the data. Derivation of reasonable design flood was attempted finally by modification of low outliers with analysis of flood frequency by means of Log Pearson Type Ill distribution. Three subwatersheds were selected as studying basins with the annual maximum series including low outliers along Geum River basin. The results through this study were analyzed and summarized as follows. 1. Log Pearson Type In distribution was confirmed as a reasonable one by X$^2$ goodness of fit test at Gong Ju, Gyu Am, og Cheon watershed along Geum River basin. 2. Probable flood flows for each watershed were derivated by flood frequency curve with outliers. 3. Weighted skew coefficient for each watershed was calculated for the evaluation of freq- uency factor which is needed for the modification of low outlier. 4. It was confirrned that adjusted frequency curve has a lower tendency than that of deletion of low outlier in common at all watersheds. 5. Final probable flood flows were derivated by modification with evaluation of modified basic statistics for three watersheds. 6. In comparison with a frequency curve with modification and one with outlier, The former has a higher probable flood flow within three years of return periods than that of the latter, and vice versa over three years of return periods.

  • PDF

Contribution Assessment of Roadheader Performance Indexes by Analysis of Variance (분산분석을 이용한 로드헤더 절삭시험 입출력 인자 간의 기여도 조사)

  • Mun-Gyu, Kim;Chang-Heon, Song;Joo-Young, Oh;Jung-Woo, Cho
    • Tunnel and Underground Space
    • /
    • v.32 no.6
    • /
    • pp.386-396
    • /
    • 2022
  • To analyze the influence of variables of roadheaders, the linear cutting testing data of pick cutter were collected from the former literatures. The input factors were set up as uniaxial compressive strength, cutting depth, cutting spacing, attack angle, skew angle, and output factors were determined as specific energy, average cutting force, maximum cutting force, average vertical force, and maximum vertical force. After composing a table of the design of experiment (DOE). The contribution level of each factor was calculated by analysis of variance (ANOVA). As a result, the factors having greatest influence on cutting force and specific energy were uniaxial compressive strength and cutting spacing.

A DLL-Based Multi-Clock Generator Having Fast-Relocking and Duty-Cycle Correction Scheme for Low Power and High Speed VLSIs (저전력 고속 VLSI를 위한 Fast-Relocking과 Duty-Cycle Correction 구조를 가지는 DLL 기반의 다중 클락 발생기)

  • Hwang Tae-Jin;Yeon Gyu-Sung;Jun Chi-Hoon;Wee Jae-Kyung
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.42 no.2 s.332
    • /
    • pp.23-30
    • /
    • 2005
  • This paper describes a DLL(delay locked loop)-based multi-clock generator having the lower active stand-by power as well as a fast relocking after re-activating the DLL. for low power and high speed VLSI chip. It enables a frequency multiplication using frequency multiplier scheme and produces output clocks with 50:50 duty-ratio regardless of the duty-ratio of system clock. Also, digital control scheme using DAC enables a fast relocking operation after exiting a standby-mode of the clock system which was obtained by storing analog locking information as digital codes in a register block. Also, for a clock multiplication, it has a feed-forward duty correction scheme using multiphase and phase mixing corrects a duty-error of system clock without requiring additional time. In this paper, the proposed DLL-based multi-clock generator can provides a synchronous clock to an external clock for I/O data communications and multiple clocks of slow and high speed operations for various IPs. The proposed DLL-based multi-clock generator was designed by the area of $1796{\mu}m\times654{\mu}m$ using $0.35-{\mu}m$ CMOS process and has $75MHz\~550MHz$ lock-range and maximum multiplication frequency of 800 MHz below 20psec static skew at 2.3v supply voltage.

Experimental Studies on the Compressive Strength of the Frozen Soils (동결토의 압축강도에 관한 실험적 연구)

  • 유능환;최중돈;유영선;조영택
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.35 no.4
    • /
    • pp.55-66
    • /
    • 1993
  • Upon freezing a soil swells due to phase change and its compression stress increase a lot. As the soil undergo thawing, however, it becomes a soft soil layer because the 'soil changes from a solid state to a plastic state. These changes are largely dependent on freezing temperature and repeated freezing-thawing cycle as well as the density of the soil and applied loading condition. This study was initiated to describe the effect of the freezing temperature and repeated freezing-thawing cycle on the unconfined compressive strength. Soil samples were collected at about 20 sites where soil structures were installed in Kangwon provincial area and necessary laboratory tests were conducted. The results could be used to help manage effectively the field structures and can be used as a basic data for designing and constructing new projects in the future. The results were as follows ; 1. Unconfined compressive strength decreased as the number of freezing and thawing cycle went up. But the strength increased as compression speed, water content and temperature decreased. The largest effect on the strength was observed at the first freezing and thawing cycle. 2. Compression strain went up with the increase of deformation speed, and was largely influenced by the number of the freezing-thawing cycle. 3. Secant modulus was responded sensitivefy to the material of the loading plates, increased with decrease of temperature down to - -10$^{\circ}$C, but was nearly constant below the temperature. Thixotropic ratio characteristic became large as compression strain got smaller and was significantly larger in the controlled soil than in the soil treated with freezing and thawing processes 4. Vertical compression strength of ice crystal(development direction) was 3 to 4 times larger than that of perpendicular to the crystal. The vertical compression strength was agreed well with Clausius-Clapeyrons equation when temperature were between 0 to 5C$^{\circ}$, but the strength below - 5$^{\circ}$C were different from the equation and showed a strong dependency on temperature and deformation speed. When the skew was less then 20 degrees, the vertical compression strength was gradually decreased but when the skew was higher than that, the strength became nearly constant. Almost all samples showed ductile failure. As considered above, strength reduction of the soil due to cyclic freezing-thawing prosses must be considered when trenching and cutting the soil to construct soil structures if the soil is likely subject to the processes. Especially, if a soil no freezing-thawing history, cares for the strength reduction must be given before any design or construction works begin. It is suggested that special design and construction techniques for the strength reduction be developed.

  • PDF