• Title/Summary/Keyword: Data skew

Search Result 126, Processing Time 0.025 seconds

New Calibration Methods with Asymmetric Data

  • Kim, Sung-Su
    • The Korean Journal of Applied Statistics
    • /
    • v.23 no.4
    • /
    • pp.759-765
    • /
    • 2010
  • In this paper, two new inverse regression methods are introduced. One is a distance based method, and the other is a likelihood based method. While a model is fitted by minimizing the sum of squared prediction errors of y's and x's in the classical and inverse methods, respectively. In the new distance based method, we simultaneously minimize the sum of both squared prediction errors. In the likelihood based method, we propose an inverse regression with Arnold-Beaver Skew Normal(ABSN) error distribution. Using the cross validation method with an asymmetric real data set, two new and two existing methods are studied based on the relative prediction bias(RBP) criteria.

Depth-Based rank test for multivariate two-sample scale problem

  • Digambar Tukaram Shirke;Swapnil Dattatray Khorate
    • Communications for Statistical Applications and Methods
    • /
    • v.30 no.3
    • /
    • pp.227-244
    • /
    • 2023
  • In this paper, a depth-based nonparametric test for a multivariate two-sample scale problem is proposed. The proposed test statistic is based on the depth-induced ranks and is thus distribution-free. In this article, the depth values of data points of one sample are calculated with respect to the other sample or distribution and vice versa. A comprehensive simulation study is used to examine the performance of the proposed test for symmetric as well as skewed distributions. Comparison of the proposed test with the existing depth-based nonparametric tests is accomplished through empirical powers over different depth functions. The simulation study admits that the proposed test outperforms existing nonparametric depth-based tests for symmetric and skewed distributions. Finally, an actual life data set is used to demonstrate the applicability of the proposed test.

A fast approximate fitting for mixture of multivariate skew t-distribution via EM algorithm

  • Kim, Seung-Gu
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.2
    • /
    • pp.255-268
    • /
    • 2020
  • A mixture of multivariate canonical fundamental skew t-distribution (CFUST) has been of interest in various fields. In particular, interest in the unsupervised learning society is noteworthy. However, fitting the model via EM algorithm suffers from significant processing time. The main cause is due to the calculation of many multivariate t-cdfs (cumulative distribution functions) in E-step. In this article, we provide an approximate, but fast calculation method for the in univariate fashion, which is the product of successively conditional univariate t-cdfs with Taylor's first order approximation. By replacing all multivariate t-cdfs in E-step with the proposed approximate versions, we obtain the admissible results of fitting the model, where it gives 85% reduction time for the 5 dimensional skewness case of the Australian Institution Sport data set. For this approach, discussions about rough properties, advantages and limits are also presented.

An Alternating Approach of Maximum Likelihood Estimation for Mixture of Multivariate Skew t-Distribution (치우친 다변량 t-분포 혼합모형에 대한 최우추정)

  • Kim, Seung-Gu
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.5
    • /
    • pp.819-831
    • /
    • 2014
  • The Exact-EM algorithm can conventionally fit a mixture of multivariate skew distribution. However, it suffers from highly expensive computational costs to calculate the moments of multivariate truncated t-distribution in E-step. This paper proposes a new SPU-EM method that adopts the AECM algorithm principle proposed by Meng and van Dyk (1997)'s to circumvent the multi-dimensionality of the moments. This method offers a shorter execution time than a conventional Exact-EM algorithm. Some experments are provided to show its effectiveness.

Skew Compensation Algorithm for Time Synchronization in Wireless Sensor Networks (무선 센서 네트워크 시간 동기화에 대한 왜곡 보정 알고리즘)

  • Kumar, Shiu;Keshav, Tushar;Jo, Dong Hyeon;Kim, Hui;Lee, Jae Yeong;Jeon, Hye Ji;Jeong, Min A;Lee, Seong-Ro
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2013.05a
    • /
    • pp.495-497
    • /
    • 2013
  • Wireless sensor networks (WSNs) have emerged as an attractive and key research area over the last decade. Time synchronization is a vital part of infrastructure for any distributed system. In embedded sensor networks, time synchronization is an essential service for correlating data among nodes and communication scheduling. This is realized by exchanging messages that are time stamped using the local clocks on the nodes. Various time synchronization protocols have been proposed aiming to attain high synchronization accuracy, high efficiency and low communication overhead. However, it requires that the time between resynchronization intervals to be as large as possible to obtain a system which is energy efficient having low communication overhead. This paper presents a simple but effective skew compensation algorithm that measures the skew rate of the sensor nodes with respect to the reference node and calibrates itself to compensate for the difference in the frequencies of the nodes. The proposed method can be incorporated with any existing time synchronization protocol for WSNs.

The Substitution Reaction of Equatorial-Skew-[Co(TRDTRA)($OH_2$)] Complex with $CN^-, NO^{-}_{2}$ and $NCS^-$ ion (Equatorial-Skew형 [Co(TRDTRA)($OH_2$)] 착물과 $CN^-, NO^{-}_{2}$ 그리고 $NCS^-$ 이온간의 치환반응)

  • Dong-Yeub Kim;Young-Jae Cho;Dong-Jin Lee;Chang-Eon Oh;Doh Myung-ki
    • Journal of the Korean Chemical Society
    • /
    • v.36 no.3
    • /
    • pp.405-411
    • /
    • 1992
  • The substitution reaction and structrue of products obtained from the reaction of Equatorial-Skew-[Co(TRDTRA)($OH_2$)] (TRDTRA = trimethylenediaminetriacetate) with $CN^-, NO^{-}_{2}$ and $NCS^-$ ions have been investigated by means of electronic absorption spectroscopy and theoretical calculation based on the Yamatera's theory. According to kinetic data, the substitution reaction order for the complexes such as $CN^-, NO^{-}_{2}$ and $NCS^-$ was the first order, respectively, and overall reaction order was second order. It has been determined that the structure of products having $CN^{-} and NO^{-}_{2}$ ions was Polar-Chair type complexes which were accompanying with isomerization and having $NCS^-$ ion was Equatorial-Skew type complex which was not accompanying with isomerization.

  • PDF

A 155 Mb/s BiCMOS Multiplexer-Demultiplexer IC (155 Mb/s BiCMOS 멀티플렉서-디멀티플렉서 소자)

  • Lee, Sang-Hoon;Kim, Seong-Jeen
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.28 no.1A
    • /
    • pp.47-53
    • /
    • 2003
  • This paper describes the design of a 155 Mb/s multiplexer-demultiplexer chip. This device for a 2.5 Gb/s SDH based transmission system is to interleave the parallel data of 51 Mb/s into 155 Mb/s serial data output, and is to deinterleave a serial input bit stream of 155 Mb/s into the parallel output of 51 Mb/s The input and output of the device are TTL compatible at the low-speed end, but 100K ECL compatible at the high-speed end The device has been fabricated with a 0.7${\mu}m$ BiCMOS gate array The fabricated chip shows the typical phase margin of 180 degrees and output data skew less than 470 ps at the high-speed end. And power dissipation is evaluated under 2.0W.

Scan Matching based De-skewing Algorithm for 2D Indoor PCD captured from Mobile Laser Scanning (스캔 매칭 기반 실내 2차원 PCD de-skewing 알고리즘)

  • Kang, Nam-woo;Sa, Se-Won;Ryu, Min Woo;Oh, Sangmin;Lee, Chanwoo;Cho, Hunhee;Park, Insung
    • Korean Journal of Construction Engineering and Management
    • /
    • v.22 no.3
    • /
    • pp.40-51
    • /
    • 2021
  • MLS (Mobile Laser Scanning) which is a scanning method done by moving the LiDAR (Light Detection and Ranging) is widely employed to capture indoor PCD (Point Cloud Data) for floor plan generation in the AEC (Architecture, Engineering, and Construction) industry. The movement and rotation of LiDAR in the scanning phase cause deformation (i.e. skew) of PCD and impose a significant impact on quality of output. Thus, a de-skewing method is required to increase the accuracy of geometric representation. De-skewing methods which use position and pose information of LiDAR collected by IMU (Inertial Measurement Unit) have been mainly developed to refine the PCD. However, the existing methods have limitations on de-skewing PCD without IMU. In this study, a novel algorithm for de-skewing 2D PCD captured from MLS without IMU is presented. The algorithm de-skews PCD using scan matching between points captured from adjacent scan positions. Based on the comparison of the deskewed floor plan with the benchmark derived from TLS (Terrestrial Laser Scanning), the performance of proposed algorithm is verified by reducing the average mismatched area 49.82%. The result of this study shows that the accurate floor plan is generated by the de-skewing algorithm without IMU.

A Study on Interpretation of Seismic Reflection Traveltimes in Anisotropic Layers (이방성 지층에서의 탄성파 반사 주시자료의 해석에 관한 연구)

  • Hwang, Se Ho;Yang, Seung Jin;Jang, Seong Hyung;Kim, Jung Yul
    • Economic and Environmental Geology
    • /
    • v.27 no.2
    • /
    • pp.201-207
    • /
    • 1994
  • This paper presents a technique to determine anisotropic elastic coefficients from traveltimes of seismic reflections or vertical seismic profiling (VSP) in tranversely isotropic layers whose thicknesses are known. The elastic coefficients are calculated from three different velocities (vertical, horizontal and skew velocities) which are determined from skew hyperbolic traveltimes by least-square fitting or semblance analysis. This interpretation technique is tested for synthetic traveltime data obtained for transversely isotropic models. The test shows that the anisotropic elastic constants of the models are determined accurately by this interpretation method.

  • PDF

A digital frame phse aligner in SDH-based transmission system (SDH 동기식 전송시스템의 디지철 프레임 위상 정열기)

  • 이상훈;성영권
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.34S no.12
    • /
    • pp.10-18
    • /
    • 1997
  • The parallel trabutary signals in the SDH-based transmission system have the frame phase skew due to uneven transmission delays in the data and the clock path. This phase skew must be eliminated prior to synchronously multiplexing process. A new twenty-four channel, 51.84Mb/s DFPA(Digital Frame Phase Aligner) has been designed and fabricated in 0.8.mu.m CMOS gate array. This unique device phase-aligns the skewed input signals with refernce frame synchronous signal and reference clok for subsequent synchronous multiplexing process. the performance of fabricated device is evaluated by the STM-16 transmission system and DS-3 meansurement set. The frame phase margin of +2/-3 bit periods has been demonstrated.

  • PDF