• Korean Journal of Radiology
• /
• v.22 no.10
• /
• pp.1697-1707
• /
• 2021

The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time-dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.19 no.5
• /
• pp.1-11
• /
• 2024

Online reviews play a crucial role in assessing a company's market value and are a significant factor influencing profitability. As such, sentiment analysis of online reviews has emerged as a key indicator for predicting business success. This study focuses on restaurant reviews from Yelp, one of the leading online review platforms, utilizing the Yelp Open Dataset. Six machine learning algorithms were applied to predict the sentiment polarity of these reviews: Logistic Regression, Support Vector Machine (SVM), Random Forest, Gradient Boosting Machine (GBM), XGBoost, and LightGBM. Performance evaluations demonstrated that Logistic Regression, SVM, and LightGBM achieved the highest accuracy, with a score of 0.91. The primary contribution of this study is its ability to transform unstructured review text into quantifiable data, enabling businesses, especially startups, to effectively analyze customer feedback and predict ratings. These insights are expected to assist business owners in forecasting consumer behavior and developing strategic marketing approaches.

• KIPS Transactions on Computer and Communication Systems
• /
• v.9 no.1
• /
• pp.17-24
• /
• 2020

In this paper, we present a movie rating prediction architecture based on a convolutional neural network (CNN). Our prediction architecture extends TextCNN, a popular CNN-based architecture for sentence classification, in three aspects. First, character embeddings are utilized to cover many variants of words since reviews are short and not well-written linguistically. Second, the attention mechanism (i.e., squeeze-and-excitation) is adopted to focus on important features. Third, a scoring function is proposed to convert the output of an activation function to a review score in a certain range (1-10). We evaluated our prediction architecture on a movie review dataset and achieved a low MSE (e.g., 3.3841) compared with an existing method. It showed the superiority of our movie rating prediction architecture.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.15 no.1
• /
• pp.87-97
• /
• 2019

Reaction of people is importantly considered about specific case as a social network service grows. In the previous research on analysis of social network service, they predicted tendency of interesting topic by giving scores to sentences written by user. Based on previous study we proceeded research of sentiment analysis for social network service's sentences, which predict the result as positive or negative for movie reviews. In this study, we used movie review to get high accuracy. We classify the movie review into positive or negative based on the score for learning. Also, we performed embedding and morpheme analysis on movie review. We could predict learning result as positive or negative with a number 0 and 1 by applying the model based on learning result to social network service. Experimental result show accuracy of about 80% in predicting sentence as positive or negative.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.12
• /
• pp.259-266
• /
• 2023

In this paper, we propose an algorithm that can improve the accuracy performance of collaborative filtering using attribute-based opinion mining (ABOM). For the experiment, a total of 1,227 online consumer review data about smartphone apps from domestic smartphone users were used for analysis. After morpheme analysis using the KKMA (Kkokkoma) analyzer and emotional word analysis using KOSAC, attribute extraction is performed using LDA topic modeling, and the topic modeling results for each weighted review are used to add up the ratings of collaborative filtering and the sentiment score. MAE, MAPE, and RMSE, which are statistical model performance evaluations that calculate the average accuracy error, were used. Through experiments, we predicted the accuracy of online customers' app ratings (APP_Score) by combining traditional collaborative filtering among the recommendation algorithms and the attribute-based opinion mining (ABOM) technique, which combines LDA attribute extraction and sentiment analysis. As a result of the analysis, it was found that the prediction accuracy of ratings using attribute-based opinion mining CF was better than that of ratings implementing traditional collaborative filtering.

• Journal of the Korea Safety Management & Science
• /
• v.15 no.2
• /
• pp.243-253
• /
• 2013

This research paper introduces the application and implementation of medical decision metrics that classifies medical decision-making into four different metrics using statistical diagnostic tools, such as confusion matrix, normal distribution, Bayesian prediction and Receiver Operating Curve(ROC). In this study, the metrics are developed based on cross-section study, cohort study and case-control study done by systematic literature review and reformulated the structure of type I error, type II error, confidence level and power of detection. The study proposed implementation strategies for 10 quality improvement activities via 14 medical decision metrics which consider specificity and sensitivity in terms of ${\alpha}$ and ${\beta}$. Examples of ROC implication are depicted in this paper with a useful guidelines to implement a continuous quality improvement, not only in a variable acceptance sampling in Quality Control(QC) but also in a supplier grading score chart in Supplier Chain Management(SCM) quality. This research paper is the first to apply and implement medical decision-making tools as quality improvement activities. These proposed models will help quality practitioners to enhance the process and product quality level.

• Journal of Korean Neurosurgical Society
• /
• v.30 no.8
• /
• pp.970-975
• /
• 2001

Objective : By conducing a review of clinical outcomes for patients with aneurysm treated using current microneurosurgical techniques and intensive care unit management, we speculated that grading systems based only on clinical condition or CT finding after admission failed to provide a significant stratification of outcome between individual grades of patients, because these systems did not include the factor for postoperative vasospasm. We hypothesized that postoperative blood flow velocity could have a significant impact on outcome prediction for patients surgically treated for intracranial aneurysms. Methods : We conducted a analysis on patient- and lesion-specific factors that might have been associated with outcome in a series of 55 aneurysm operations performed with measurements of blood-flow velocity with transcranial Doppler ultrasonography(TCD). In the new scale(NS) score system, 1 point is assigned additionally for the case with Hunt and Hess(H-H)/World Federation of Neurological Surgeons(WFNS) Grade IV or V, Fisher Scale(FS) score 3 or 4, aneurysm size greater than 10mm, patient age older than 60 years, blood-flow velocity higher than 120cm/sec, and posterior circulation lesion. By adding the total points, a 6-point scale score(score 0-6) is obtained. Results : Age of patient, size of aneurysm, clinical condition(H-H grade and WFNS), FS score, and blood flow velocity(TCD 1day after operation) were independently and strongly associated with long-term outcome. When NS scores were applied to 55 patients with at least 6 months follow-up, the correlation of individual scores with outcome was strongly validated the retrospective findings. Conclusion : It was speculated that TCD could be used to assess postoperative vasospasm and to monitor noninvasively the patients with aneurysmal SAH. This NS score system is easy to apply, divide patients into groups with different outcome, and is comprehensive, allowing for more accurate prediction of surgical outcome.

• Journal of Information Technology Services
• /
• v.20 no.1
• /
• pp.131-143
• /
• 2021

Commercial transactions, one of the pillars of the capitalist economy, are occurring countless times every day, especially small and medium-sized businesses. However, small and medium-sized enterprises are bound to be the legal underdogs in contracts for commercial transactions and do not receive legal support for contracts for fair and legitimate commercial transactions. When subcontracting contracts are concluded among small and medium-sized enterprises, 58.2% of them do not apply standard contracts and sign contracts that have not undergone legal review. In order to support small and medium-sized enterprises' fair and legitimate contracts, small and medium-sized enterprises can be protected from legal threats if they can reduce the risk of signing contracts by analyzing various risks in the contract and analyzing and informing them of toxic clauses and omitted contracts in advance. We propose a risk prediction model for the machine reading-based legal contract to minimize legal damage to small and medium-sized business owners in the legal blind spots. We have established our own set of legal questions and answers based on the legal data disclosed for the purpose of building a model specialized in legal contracts. Quantitative verification was carried out through indicators such as EM and F1 Score by applying pine tuning and hostile learning to pre-learned machine reading models. The highest F1 score was 87.93, with an EM value of 72.41.

• Journal of the Korean Burn Society
• /
• v.23 no.1
• /
• pp.1-6
• /
• 2020

Purpose: PL, creatinine and urine output are biomarkers of the suitability and prognosis of fluid therapy in severe burn patients. The purpose of this study is to evaluate the usefulness of predicting mortality by biomarkers and its change during initial fluid therapy for severe burn patients. Methods: A retrograde review was performed on 733 patients from January 2014 to December 2018 who were admitted as severe burn patients to our burn intensive care unit (BICU). Plasma lactate, serum creatinine and urine output were measured at the time of admission to the BICU and after 48 hours. ABSI score, Hangang score, APACHEII, revised Baux index and TBSA were collected after admission. Results: 733 patients were enrolled. PL was the most useful indicators for predicting mortality in burn patients at the time of admission (AUC: 0.813) and after 48 hours (AUC: 0.698). On the other hand, mortality prediction from initial fluid therapy for 48 hours showed different results. Only creatinine showed statistical differences (P<0.05) in mortality prediction. But there were no statistical differences in mortality prediction with PL and UO (P>0.05). Conclusion: In this study, PL was most useful predictor among biomarkers for predicting mortality. Improvement in creatinine levels during the first 48 hours is associated with improved mortality. Therefore, efforts are needed to improve creatinine levels.

• Journal of Hospice and Palliative Care
• /
• v.26 no.1
• /
• pp.1-6
• /
• 2023

This paper aimed to summarize the current situation of prognostication for patients with an expected survival of weeks or months, and to clarify future research priorities. Prognostic information is essential for patients, their families, and medical professionals to make end-of-life decisions. The clinician's prediction of survival is often used, but this may be inaccurate and optimistic. Many prognostic tools, such as the Palliative Performance Scale, Palliative Prognostic Index, Palliative Prognostic Score, and Prognosis in Palliative Care Study, have been developed and validated to reduce the inaccuracy of the clinician's prediction of survival. To date, there is no consensus on the most appropriate method of comparing tools that use different formats to predict survival. Therefore, the feasibility of using prognostic scales in clinical practice and the information wanted by the end users can determine the appropriate prognostic tool to use. We propose four major themes for further prognostication research: (1) functional prognosis, (2) outcomes of prognostic communication, (3) artificial intelligence, and (4) education for clinicians.