• Title/Summary/Keyword: censored regression

Search Result 93, Processing Time 0.03 seconds

Machine learning in survival analysis (생존분석에서의 기계학습)

  • Baik, Jaiwook
    • Industry Promotion Research
    • /
    • v.7 no.1
    • /
    • pp.1-8
    • /
    • 2022
  • We investigated various types of machine learning methods that can be applied to censored data. Exploratory data analysis reveals the distribution of each feature, relationships among features. Next, classification problem has been set up where the dependent variable is death_event while the rest of the features are independent variables. After applying various machine learning methods to the data, it has been found that just like many other reports from the artificial intelligence arena random forest performs better than logistic regression. But recently well performed artificial neural network and gradient boost do not perform as expected due to the lack of data. Finally Kaplan-Meier and Cox proportional hazard model have been employed to explore the relationship of the dependent variable (ti, δi) with the independent variables. Also random forest which is used in machine learning has been applied to the survival analysis with censored data.

A Comparative Study of Microarray Data with Survival Times Based on Several Missing Mechanism

  • Kim Jee-Yun;Hwang Jin-Soo;Kim Seong-Sun
    • Communications for Statistical Applications and Methods
    • /
    • v.13 no.1
    • /
    • pp.101-111
    • /
    • 2006
  • One of the most widely used method of handling missingness in microarray data is the kNN(k Nearest Neighborhood) method. Recently Li and Gui (2004) suggested, so called PCR(Partial Cox Regression) method which deals with censored survival times and microarray data efficiently via kNN imputation method. In this article, we try to show that the way to treat missingness eventually affects the further statistical analysis.

Estimation on Modified Proportional Hazards Model

  • Lee, Kwang-Ho;Lee, Mi-Sook
    • Journal of the Korean Data and Information Science Society
    • /
    • v.5 no.1
    • /
    • pp.59-66
    • /
    • 1994
  • Heller and Simonoff(1990) compared several methods of estimating the regression coefficient in a modified proportional hazards model, when the response variable is subject to censoring. We give another method of estimating the parameters in the model which also allows the dependent variable to be censored and the error distribution to be unspecified. The proposed method differs from that of Miller(1976) and that of Buckely and James(1979). We also obtain the variance estimator of the coefficient estimator and compare that with the Buckely-James Variance estimator studied by Hillis(1993).

  • PDF

Nonparametric estimation of conditional quantile with censored data (조건부 분위수의 중도절단을 고려한 비모수적 추정)

  • Kim, Eun-Young;Choi, Hyemi
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.2
    • /
    • pp.211-222
    • /
    • 2013
  • We consider the problem of nonparametrically estimating the conditional quantile function from censored data and propose new estimators here. They are based on local logistic regression technique of Lee et al. (2006) and "double-kernel" technique of Yu and Jones (1998) respectively, which are modified versions under random censoring. We compare those with two existing estimators based on a local linear fits using the check function approach. The comparison is done by a simulation study.

Estimation on a two-parameter Rayleigh distribution under the progressive Type-II censoring scheme: comparative study

  • Seo, Jung-In;Seo, Byeong-Gyu;Kang, Suk-Bok
    • Communications for Statistical Applications and Methods
    • /
    • v.26 no.2
    • /
    • pp.91-102
    • /
    • 2019
  • In this paper, we propose a new estimation method based on a weighted linear regression framework to obtain some estimators for unknown parameters in a two-parameter Rayleigh distribution under a progressive Type-II censoring scheme. We also provide unbiased estimators of the location parameter and scale parameter which have a nuisance parameter, and an estimator based on a pivotal quantity which does not depend on the other parameter. The proposed weighted least square estimator (WLSE) of the location parameter is not dependent on the scale parameter. In addition, the WLSE of the scale parameter is not dependent on the location parameter. The results are compared with the maximum likelihood method and pivot-based estimation method. The assessments and comparisons are done using Monte Carlo simulations and real data analysis. The simulation results show that the estimators ${\hat{\mu}}_u({\hat{\theta}}_p)$ and ${\hat{\theta}}_p({\hat{\mu}}_u)$ are superior to the other estimators in terms of the mean squared error (MSE) and bias.

Additive hazards models for interval-censored semi-competing risks data with missing intermediate events (결측되었거나 구간중도절단된 중간사건을 가진 준경쟁적위험 자료에 대한 가산위험모형)

  • Kim, Jayoun;Kim, Jinheum
    • The Korean Journal of Applied Statistics
    • /
    • v.30 no.4
    • /
    • pp.539-553
    • /
    • 2017
  • We propose a multi-state model to analyze semi-competing risks data with interval-censored or missing intermediate events. This model is an extension of the three states of the illness-death model: healthy, disease, and dead. The 'diseased' state can be considered as the intermediate event. Two more states are added into the illness-death model to incorporate the missing events, which are caused by a loss of follow-up before the end of a study. One of them is a state of the lost-to-follow-up (LTF), and the other is an unobservable state that represents an intermediate event experienced after the occurrence of LTF. Given covariates, we employ the Lin and Ying additive hazards model with log-normal frailty and construct a conditional likelihood to estimate transition intensities between states in the multi-state model. A marginalization of the full likelihood is completed using adaptive importance sampling, and the optimal solution of the regression parameters is achieved through an iterative quasi-Newton algorithm. Simulation studies are performed to investigate the finite-sample performance of the proposed estimation method in terms of empirical coverage probability of true regression parameters. Our proposed method is also illustrated with a dataset adapted from Helmer et al. (2001).

Estimation methods and interpretation of competing risk regression models (경쟁 위험 회귀 모형의 이해와 추정 방법)

  • Kim, Mijeong
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.7
    • /
    • pp.1231-1246
    • /
    • 2016
  • Cause-specific hazard model (Prentice et al., 1978) and subdistribution hazard model (Fine and Gray, 1999) are mostly used for the right censored survival data with competing risks. Some other models for survival data with competing risks have been subsequently introduced; however, those models have not been popularly used because the models cannot provide reliable statistical estimation methods or those are overly difficult to compute. We introduce simple and reliable competing risk regression models which have been recently proposed as well as compare their methodologies. We show how to use SAS and R for the data with competing risks. In addition, we analyze survival data with two competing risks using five different models.

Smoothing Kaplan-Meier estimate using monotone support vector regression (단조 서포트벡터기계를 이용한 카플란-마이어 생존함수의 평활)

  • Hwang, Changha;Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.6
    • /
    • pp.1045-1054
    • /
    • 2012
  • Support vector machine is known to be the very useful statistical method in classification and nonlinear function estimation. In this paper we propose a monotone support vector regression (SVR) for the estimation of monotonically decreasing function. The proposed monotone SVR is applied to smooth the Kaplan-Meier estimate of survival function. Experimental results are then presented which indicate the performance of the proposed monotone SVR using survival functions obtained by exponential distribution.

Semiparametric support vector machine for accelerated failure time model

  • Hwang, Chang-Ha;Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.4
    • /
    • pp.765-775
    • /
    • 2010
  • For the accelerated failure time (AFT) model a lot of effort has been devoted to develop effective estimation methods. AFT model assumes a linear relationship between the logarithm of event time and covariates. In this paper we propose a semiparametric support vector machine to consider situations where the functional form of the effect of one or more covariates is unknown. The proposed estimating equation can be computed by a quadratic programming and a linear equation. We study the effect of several covariates on a censored response variable with an unknown probability distribution. We also provide a generalized approximate cross-validation method for choosing the hyper-parameters which affect the performance of the proposed approach. The proposed method is evaluated through simulations using the artificial example.

An Exploratory Study on the New Product Demand Curve Estimation Using Online Auction Data

  • Shim Seon-Young;Lee Byung-Tae
    • Management Science and Financial Engineering
    • /
    • v.11 no.3
    • /
    • pp.125-136
    • /
    • 2005
  • As the importance of time-based competition is increasing, information systems for supporting the immediate decision making is strongly required. Especially high -tech product firms are under extreme pressure of rapid response to the demand side due to relatively short life cycle of the product. Therefore, the objective of our research is proposing a framework of estimating demand curve based on e-auction data, which is extremely easy to access and well reflect the limited demand curve in that channel. Firstly, we identify the advantages of using e-auction data for full demand curve estimation and then verify it using Agent-Eased-Modeling and Tobin's censored regression model.