• Title/Summary/Keyword: Biased Data

Search Result 350, Processing Time 0.023 seconds

Adaptive System Identification Using an Efficient Recursive Total Least Squares Algorithm

  • Choi, Nakjin;Lim, Jun-Seok;Song, Joon-Il;Sung, Koeng-Mo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.3E
    • /
    • pp.93-100
    • /
    • 2003
  • We present a recursive total least squares (RTLS) algorithm for adaptive system identification. So far, recursive least squares (RLS) has been successfully applied in solving adaptive system identification problem. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of O(N²).

A Study on The Utility Estimation about Employment of The Disabled (AHP를 이용한 장애인고용의 효용성평가 연구)

  • Park, Jae-Hyun
    • Proceedings of the Safety Management and Science Conference
    • /
    • 2008.11a
    • /
    • pp.405-419
    • /
    • 2008
  • It is expected that the change of industrial structure of Knowledge based economy, and service based economy would affect on economic life of physically-challenged person with no exceptions. There have been some former studies which have been misunderstood the employment of disabled due to the declining employment of the disabled and prejudice to the disabled based on biased perspective and public opinion. This study have analyzed the employment conditions of the ordinary workers and disabled workers out of those prejudices and biased opinions. Wage, economic activity ratio, age, educational background and industry those 5 parameters are brought for analyzing the two comparison group. Each parameter have compared based on the statistical data of ordinary workers and disabled workers for past 7 years. Weight between each parameter have been drawn by collecting the experts' opinion using AHP(Analytic Hierarchy Process), and utility of employment of two comparison groups have been estimated through progress inclination of each parameter. Through the estimated outcome, present condition and controversial issues and way of improvement of domestic employment of ordinary workers and the disabled is mentioned.

  • PDF

Impact of Outliers on the Statistical Measures of the Environmental Monitoring Data in Busan Coastal Sea (이상자료가 연안 환경자료의 통계 척도에 미치는 영향)

  • Cho, Hong-Yeon;Lee, Ki-Seop;Ahn, Soon-Mo
    • Ocean and Polar Research
    • /
    • v.38 no.2
    • /
    • pp.149-159
    • /
    • 2016
  • The statistical measures of the coastal environmental data are used in a variety of statistical inferences, hypothesis tests, and data-driven modeling. If the measures are biased, then the statistical estimations and models may also be biased and this potential for bias is great when data contain some outliers defined as extraordinary large or small data values. This study aims to suggest more robust statistical measures as alternatives to more commonly used measures and to assess the performance these robust measures through a quantitative evaluation of more typical measures, such as in terms of locations, spreads, and shapes, with regard to environmental monitoring data in the Busan coastal sea. The detection of outliers within the data was carried out on the basis of Rosner's test. About 5-10% of the nutrient data were found to contain outliers based on Rosner's test. After removal (zero-weighting) of the outliers in the data sets, the relative change ratios of the mean and standard deviation between before and after outlier-removal conditions revealed the figures 13 and 33%, respectively. The variation magnitudes of skewness and kurtosis are 1.36 and 8.11 in a decreasing trend, respectively. On the other hand, the change ratios for more robust measures regarding the mean and standard deviation are 3.7-10.5%, and the variation magnitudes of robust skewness and kurtosis are about only 2-4% of the magnitude of the non-robust measures. The robust measures can be regarded as outlier-resistant statistical measures based on the relatively small changes in the scenarios before and after outlier removal conditions.

Comparison of Five Single Imputation Methods in General Missing Pattern

  • Kang, Shin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.4
    • /
    • pp.945-955
    • /
    • 2004
  • 'Complete-case analysis' is easy to carry out and it may be fine with small amount of missing data. However, this method is not recommended in general because the estimates are usually biased and not efficient. There are numerous alternatives to complete-case analysis. One alternative is the single imputation. Some of the most common single imputation methods are reviewed and the performances are compared by simulation studies.

  • PDF

The Precision Validation of the Precise Baseline Determination for Satellite Formation

  • Choi, Jong-Yeoun;Lee, Sang-Jeong
    • Journal of Astronomy and Space Sciences
    • /
    • v.28 no.1
    • /
    • pp.63-70
    • /
    • 2011
  • The needs for satellite formation flying are gradually increasing to perform the advanced space missions in remote sensing and observation of the space or Earth. Formation flying in low Earth orbit can perform the scientific missions that cannot be realized with a single spacecraft. One of the various techniques of satellite formation flying is the determination of the precise baselines between the satellites within the formation, which has to be in company with the precision validation. In this paper, the baseline of Gravity Recovery and Climate Experiment (GRACE) A and B was determined with the real global positioning system (GPS) measurements of GRACE satellites. And baseline precision was validated with the batch and sequential processing methods using K/Ka-band ranging system (KBR) biased range measurements. Because the proposed sequential method validate the baseline precision, removing the KBR bias with the epoch difference instead of its estimation, the validating data (KBR biased range) are independent of the data validated (GPS-baseline) and this method can be applied to the real-time precision validation. The result of sequential precision validation was 1.5~3.0 mm which is similar to the batch precision validation.

The Evolution of the Mass-Metallicity Relation at 0.20 < z < 0.35

  • Chung, Jiwon;Rey, Soo-Chang;Sung, Eon-Chang
    • Journal of Astronomy and Space Sciences
    • /
    • v.30 no.1
    • /
    • pp.59-67
    • /
    • 2013
  • We present a spectroscopic study of 343 blue compact galaxies (BCGs) at 0.20 < z < 0.35 from the Sloan Digital Sky Survey (SDSS) DR7 data. We derive gas phase oxygen abundance using the empirical and direct method. Stellar masses of galaxies are derived from the STARLIGHT code. We also derive star formation rates of galaxies based on $H{\alpha}$ emission line from the SDSS as well as far-ultraviolet (FUV) flux from the Galaxy Evolution Explorer GR6 data. Evolution of the luminosity-metallicity and mass-metallicity (M-Z) relations with redshift is observed. At a given luminosity and mass, galaxies at higher redshifts appear to be biased to low metallicities relative to the lower redshift counterparts. Furthermore, low mass galaxies show higher specific star formation rates (SSFRs) than more massive ones and galaxies at higher redshifts are biased to higher SSFRs compared to the lower redshift sample. By visual inspection of the SDSS images, we classify galaxy morphology into disturbed or undisturbed. In the M-Z relation, we find a hint that morphologically disturbed BCGs appear to exhibit low metallicities and high SSFRs compared to undisturbed counterparts. We suggest that our results support downsizing galaxy formation scenario and star formation histories of BCGs are closely related with their morphologies.

Outlier Detection Techniques for Biased Opinion Discovery (편향된 의견 문서 검출을 위한 이상치 탐지 기법)

  • Yeon, Jongheum;Shim, Junho;Lee, Sanggoo
    • The Journal of Society for e-Business Studies
    • /
    • v.18 no.4
    • /
    • pp.315-326
    • /
    • 2013
  • Users in social media post various types of opinions such as product reviews and movie reviews. It is a common trend that customers get assistance from the opinions in making their decisions. However, as opinion usage grows, distorted feedbacks also have increased. For example, exaggerated positive opinions are posted for promoting target products. So are negative opinions which are far from common evaluations. Finding these biased opinions becomes important to keep social media reliable. Techniques of opinion mining (or sentiment analysis) have been developed to determine sentiment polarity of opinionated documents. These techniques can be utilized for finding the biased opinions. However, the previous techniques have some drawback. They categorize the text into only positive and negative, and they also need a large amount of training data to build the classifier. In this paper, we propose methods for discovering the biased opinions which are skewed from the overall common opinions. The methods are based on angle based outlier detection and personalized PageRank, which can be applied without training data. We analyze the performance of the proposed techniques by presenting experimental results on a movie review dataset.

FDI and the Evolution of Directed Technological Progress Bias: New Evidence from Korean Outward Investment

  • Boye Li;Xiang Li;Yaokun Wu
    • Journal of Korea Trade
    • /
    • v.27 no.5
    • /
    • pp.1-22
    • /
    • 2023
  • Purpose - Southeast Asia has been the focus of Korea's foreign investment. Korea has been helping developing countries in Southeast Asia achieve economic growth and win-win cooperation through capital exports. FDI is an important channel for technology diffusion. However, the impact of FDI on the bias of technological progress in the host country is dependent on the host country's own endowment structure and capital-labor factor substitution elasticity. Therefore, the central issue of this paper is to accurately evaluate the impact of Korea's FDI to the four Southeast Asian countries in various industries on their bias of technological progress. Design/methodology - The paper uses macroeconomic data for Korea and four East Asian countries to estimate capital-labor factor elasticities of substitution using nonlinear, seemingly uncorrelated regressions (NLSUR). Then, the biased technological change index (BTCI) is calculated for each country. Finally, panel data analysis is used to explore the impact of Korean FDI in various industries in the four Southeast Asian countries on their own directed technological progress, and a robustness test is conducted. Findings - There is a substitution relationship between capital and labor factors based on their elasticity in Korea, Singapore and the Philippines. There is a complementary relationship between capital and labor factors in Indonesia and Malaysia. According to the BTCI, there is a trend toward labor-biased technological progress in all countries. Korean investments in manufacturing, wholesale and retail trade in the host country trigger capital-biased technological change in the host country; investments in the finance, insurance and information and communication sectors trigger labor-biased technological change. In addition, this paper also confirms that directed technological progress can enable cross-country transmission. Originality/value - The innovation of this paper lies in three aspects. First, we estimate the BTCI for five countries and explore the trend and situation of directed technological progress in each country from each country's own perspective. Second, we explore the impact of Korean FDI in the host country on the bias to its technological progress at the industry level. Second, we explore the impact of Korean FDI in various industries in the four Southeast Asian countries on the four countries' own directed technological progress from a national perspective. Finally, we propose corresponding countermeasures for technological progress from the perspective of inverse factor endowment. These innovative points not only expand the understanding of technological progress and cross-country technology transfer in East Asia but also provide practical references for policy-makers and business operators.

Inappropriate Survey Design Analysis of the Korean National Health and Nutrition Examination Survey May Produce Biased Results

  • Kim, Yangho;Park, Sunmin;Kim, Nam-Soo;Lee, Byung-Kook
    • Journal of Preventive Medicine and Public Health
    • /
    • v.46 no.2
    • /
    • pp.96-104
    • /
    • 2013
  • Objectives: The inherent nature of the Korean National Health and Nutrition Examination Survey (KNHANES) design requires special analysis by incorporating sample weights, stratification, and clustering not used in ordinary statistical procedures. Methods: This study investigated the proportion of research papers that have used an appropriate statistical methodology out of the research papers analyzing the KNHANES cited in the PubMed online system from 2007 to 2012. We also compared differences in mean and regression estimates between the ordinary statistical data analyses without sampling weight and design-based data analyses using the KNHANES 2008 to 2010. Results: Of the 247 research articles cited in PubMed, only 19.8% of all articles used survey design analysis, compared with 80.2% of articles that used ordinary statistical analysis, treating KNHANES data as if it were collected using a simple random sampling method. Means and standard errors differed between the ordinary statistical data analyses and design-based analyses, and the standard errors in the design-based analyses tended to be larger than those in the ordinary statistical data analyses. Conclusions: Ignoring complex survey design can result in biased estimates and overstated significance levels. Sample weights, stratification, and clustering of the design must be incorporated into analyses to ensure the development of appropriate estimates and standard errors of these estimates.

A correction of SE from penalized partial likelihood in frailty models

  • Ha, Il-Do
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.5
    • /
    • pp.895-903
    • /
    • 2009
  • The penalized partial likelihood based on restricted maximum likelihood method has been widely used for the inference of frailty models. However, the standard-error estimate for frailty parameter estimator can be downwardly biased. In this paper we show that such underestimation can be corrected by using hierarchical likelihood. In particular, the hierarchical likelihood gives a statistically efficient procedure for various random-effect models including frailty models. The proposed method is illustrated via a numerical example and simulation study. The simulation results demonstrate that the corrected standard-error estimate largely improves such bias.

  • PDF