• Title/Summary/Keyword: Validation Studies as Topic

Search Result 10, Processing Time 0.028 seconds

Development and Validation of a Prediction Model: Application to Digestive Cancer Research (예측모형의 구축과 검증: 소화기암연구 사례를 중심으로)

  • Yonghan Kwon;Kyunghwa Han
    • Journal of Digestive Cancer Research
    • /
    • v.11 no.3
    • /
    • pp.157-164
    • /
    • 2023
  • Prediction is a significant topic in clinical research. The development and validation of a prediction model has been increasingly published in clinical research. In this review, we investigated analytical methods and validation schemes for a clinical prediction model used in digestive cancer research. Deep learning and logistic regression, with split-sample validation as an internal or external validation, were the most commonly used methods. Furthermore, we briefly introduced and summarized the advantages and disadvantages of each method. Finally, we discussed several points to consider when conducting prediction model studies.

Is Text Mining on Trade Claim Studies Applicable? Focused on Chinese Cases of Arbitration and Litigation Applying the CISG

  • Yu, Cheon;Choi, DongOh;Hwang, Yun-Seop
    • Journal of Korea Trade
    • /
    • v.24 no.8
    • /
    • pp.171-188
    • /
    • 2020
  • Purpose - This is an exploratory study that aims to apply text mining techniques, which computationally extracts words from the large-scale text data, to legal documents to quantify trade claim contents and enables statistical analysis. Design/methodology - This is designed to verify the validity of the application of text mining techniques as a quantitative methodology for trade claim studies, that have relied mainly on a qualitative approach. The subjects are 81 cases of arbitration and court judgments from China published on the website of the UNCITRAL where the CISG was applied. Validation is performed by comparing the manually analyzed result with the automatically analyzed result. The manual analysis result is the cluster analysis wherein the researcher reads and codes the case. The automatic analysis result is an analysis applying text mining techniques to the result of the cluster analysis. Topic modeling and semantic network analysis are applied for the statistical approach. Findings - Results show that the results of cluster analysis and text mining results are consistent with each other and the internal validity is confirmed. And the degree centrality of words that play a key role in the topic is high as the between centrality of words that are useful for grasping the topic and the eigenvector centrality of the important words in the topic is high. This indicates that text mining techniques can be applied to research on content analysis of trade claims for statistical analysis. Originality/value - Firstly, the validity of the text mining technique in the study of trade claim cases is confirmed. Prior studies on trade claims have relied on traditional approach. Secondly, this study has an originality in that it is an attempt to quantitatively study the trade claim cases, whereas prior trade claim cases were mainly studied via qualitative methods. Lastly, this study shows that the use of the text mining can lower the barrier for acquiring information from a large amount of digitalized text.

A Validation Study of the Modified Korean Version of Ethical Leadership at Work Questionnaire (K-ELW) (간호사가 인지하는 간호관리자의 윤리적 리더십 측정 도구 K-ELW의 타당화 연구)

  • Kim, Jeong-Eon;Park, Eun-Jun
    • Journal of Korean Academy of Nursing
    • /
    • v.45 no.2
    • /
    • pp.240-250
    • /
    • 2015
  • Purpose: The purpose of this study was to validate the Korean version of the Ethical Leadership at Work questionnaire (K-ELW) that measures RNs' perceived ethical leadership of their nurse managers. Methods: The strong validation process suggested by Benson (1998), including translation and cultural adaptation stage, structural stage, and external stage, was used. Participants were 241 RNs who reported their perceived ethical leadership using both the pre-version of K-ELW and a previously known Ethical Leadership Scale, and interactional justice of their managers, as well as their own demographics, organizational commitment and organizational citizenship behavior. Data analyses included descriptive statistics, Pearson correlation coefficients, reliability coefficients, exploratory factor analysis, and confirmatory factor analysis. SPSS 19.0 and Amos 18.0 versions were used. Results: A modified K-ELW was developed from construct validity evidence and included 31 items in 7 domains: People orientation, task responsibility fairness, relationship fairness, power sharing, concern for sustainability, ethical guidance, and integrity. Convergent validity, discriminant validity, and concurrent validity were supported according to the correlation coefficients of the 7 domains with other measures. Conclusion: The results of this study provide preliminary evidence that the modified K-ELW can be adopted in Korean nursing organizations, and reliable and valid ethical leadership scores can be expected.

Qualitative Research in Healthcare: Necessity and Characteristics

  • Jeehee Pyo;Won Lee;Eun Young Choi;Seung Gyeong Jang;Minsu Ock
    • Journal of Preventive Medicine and Public Health
    • /
    • v.56 no.1
    • /
    • pp.12-20
    • /
    • 2023
  • Quantitative and qualitative research explore various social phenomena using different methods. However, there has been a tendency to treat quantitative studies using complicated statistical techniques as more scientific and superior, whereas relatively few qualitative studies have been conducted in the medical and healthcare fields. This review aimed to provide a proper understanding of qualitative research. This review examined the characteristics of quantitative and qualitative research to help researchers select the appropriate qualitative research methodology. Qualitative research is applicable in following cases: (1) when an exploratory approach is required on a topic that is not well known, (2) when something cannot be explained fully with quantitative research, (3) when it is necessary to newly present a specific view on a research topic that is difficult to explain with existing views, (4) when it is inappropriate to present the rationale or theoretical proposition for designing hypotheses, as in quantitative research, and (5) when conducting research that requires detailed descriptive writing with literary expressions. Qualitative research is conducted in the following order: (1) selection of a research topic and question, (2) selection of a theoretical framework and methods, (3) literature analysis, (4) selection of the research participants and data collection methods, (5) data analysis and description of findings, and (6) research validation. This review can contribute to the more active use of qualitative research in healthcare, and the findings are expected to instill a proper understanding of qualitative research in researchers who review qualitative research reports and papers.

Development and Validation of the Nurse Needs Satisfaction Scale Based on Maslow's Hierarchy of Needs Theory (Maslow의 욕구위계이론에 근거한 간호사 욕구만족도 측정도구 개발 및 타당화)

  • Kim, Hwa Jin;Shin, Sun Hwa
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.6
    • /
    • pp.848-862
    • /
    • 2020
  • Purpose: The purpose of this study was to develop an instrument to evaluate the needs satisfaction of nurses and examine its validity and reliability. Methods: The initial items for the instrument were developed through a literature review and interviews, using the conceptual framework of Maslow's hierarchy of needs theory. The initial items were evaluated for content validity by 14 experts. Four hundred and eighty-six clinical nurses participated in this study through offline and online surveys to test the reliability and validity of the instrument. The first evaluation (n = 256) was used for item analysis and exploratory factor analysis, and the second evaluation (n = 230) was used to conduct a confirmatory factor analysis and to assess the criterion-related validity and internal consistency of the instrument. Test-retest reliability was analyzed using data from 30 nurses. Results: The final instrument consisted of 30 items with two sub-factors for five needs that were identified through the confirmatory factor analysis. The criterion-related validity was established using the five need satisfaction measures (r = .56). Cronbach's α for total items was .90, and test-retest reliability was .89. Conclusion: The findings from this study indicate that this instrument has sufficient validity and reliability. This instrument can be used for the development of nursing interventions to improve the needs satisfaction of clinical nurses.

Development and Validation of a Korean Nursing Work Environment Scale for Critical Care Nurses (한국형 중환자실 간호근무환경 측정도구 개발 및 평가)

  • Lee, Hyo Jin;Moon, Ji Hyun;Kim, Se Ra;Shim, Mi Young;Kim, Jung Yeon;Lee, Mi Aie
    • Journal of Korean Clinical Nursing Research
    • /
    • v.27 no.3
    • /
    • pp.279-293
    • /
    • 2021
  • Purpose: The purpose of this study was to develop a Korean nursing work environment scale for critical care nurses (KNWES-CCN) and verify its validity and reliability. Methods: A total of 46 preliminary items were selected using content validity analysis of experts on 64 candidate items derived through literature reviews and in-depth interviews with critical care nurses. 535 critical care nurses from 21 hospitals responded to the preliminary questionnaire from February to March 2021. The collected data were analysed using construct, convergent and discriminant validities, and internal consistency and test-retest reliability. Results: The 23 items in 4 factors accounted for 55.6% of the total variance were identified through item analysis and exploratory factor analysis (EFA). EFA was performed with maximum likelihood method including direct oblimin method. In the confirmatory factor analysis, KNWES-CCN consisted of 21 items in 4 factors by deleting the items that were not meet the condition that the factor loading over .50 or the squared multiple correlation over .30. This model was considered to be suitable because it satisfied the fit index and acceptable criteria of the model [𝒳2=440.47 (p<.001), CMIN/DF=2.41, GFI=.86, SRMR=.06, RMSEA=.07, TLI=.90, CFI=.91]. The item total correlation values ranged form .32 to .73 and its internal consistency was Cronbach's α=.92. The reliability of the test-retest correlation coefficient was .72 and the intra-class correlation coefficient was .83. Conclusion: The KNWES-CCN showed good validity and reliability. Therefore, it is expected that the use of this scale would measure and improve nursing work environment for critical care nurses in Korea.

Specifying and Analyzing Formative Measurement of High-order Factor (고차 요인의 형성적 측정방법에 대한 식별 및 분석방법)

  • Yim, Myung-Seong
    • Journal of Digital Convergence
    • /
    • v.11 no.3
    • /
    • pp.101-113
    • /
    • 2013
  • Although the methodological literature is replete with advice regarding the development and validation of multi-item scales based on reflective measures, the issue of index construction using formative measures has received little attention. The aim of this paper is to enhance researchers' understanding of formative measures of high-order factor and assist them in their index construction efforts. This article is also to provide some insights into the nature of formative indicators for researchers to reach an informed choice as to the appropriate high order formative measurement model for their needs. We first provide a brief background on formative indicators, drawing from the limited and fragmented literature on the topic. Next we give an example of constructing an index based on actual survey data and highlight the procedures used to assess its quality. We conclude the article with some thoughts about the use of indexes in empirical studies.

A System Dynamics Study of Enterprise Value $Creation{\sim}$ the Example of Taiwan's SMEs

  • Chung, Yi-Chan;Tsai, Chih-Hung;Tien, Shiaw-Wen;Lin, Yu-Hsin;Lin, Ja-Lin
    • International Journal of Quality Innovation
    • /
    • v.7 no.1
    • /
    • pp.128-160
    • /
    • 2006
  • With the globalization of economy, industries are facing increasingly greater challenges. Business integration, both internally and externally, is undoubtedly an important topic. However, how does an enterprise create its own value will be the key to an enterprise's success in the future. Therefore, this study bases on the evaluation of company value to assess the key factors and competitive strategies of an enterprise. Yet, only with stable enterprise performance can the company value be correctly evaluated. This will be an important issue for enterprise performance and business strategy. Subject of this study are mainly small and medium-sized (enterprises (SMEs). Model construction for SME value assessment is established through the system dynamics approach. Scholars' opinions on literature validation and application of Delphi Method are explored through literature review on local and foreign studies, in order to compile the relevant perspectives and indices for enterprise value creation. Hence model construction of the value creation system is established, and the correlation between the perspectives and related factors is explored to understand the overall dynamics model of SMEs' value creation system. Consequently, a research method based on the system dynamics perspective is provided for the study of enterprise value creation is provided, as policy reference for improvement of decision-making and value creation.

Bankruptcy prediction using an improved bagging ensemble (개선된 배깅 앙상블을 활용한 기업부도예측)

  • Min, Sung-Hwan
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.4
    • /
    • pp.121-139
    • /
    • 2014
  • Predicting corporate failure has been an important topic in accounting and finance. The costs associated with bankruptcy are high, so the accuracy of bankruptcy prediction is greatly important for financial institutions. Lots of researchers have dealt with the topic associated with bankruptcy prediction in the past three decades. The current research attempts to use ensemble models for improving the performance of bankruptcy prediction. Ensemble classification is to combine individually trained classifiers in order to gain more accurate prediction than individual models. Ensemble techniques are shown to be very useful for improving the generalization ability of the classifier. Bagging is the most commonly used methods for constructing ensemble classifiers. In bagging, the different training data subsets are randomly drawn with replacement from the original training dataset. Base classifiers are trained on the different bootstrap samples. Instance selection is to select critical instances while deleting and removing irrelevant and harmful instances from the original set. Instance selection and bagging are quite well known in data mining. However, few studies have dealt with the integration of instance selection and bagging. This study proposes an improved bagging ensemble based on instance selection using genetic algorithms (GA) for improving the performance of SVM. GA is an efficient optimization procedure based on the theory of natural selection and evolution. GA uses the idea of survival of the fittest by progressively accepting better solutions to the problems. GA searches by maintaining a population of solutions from which better solutions are created rather than making incremental changes to a single solution to the problem. The initial solution population is generated randomly and evolves into the next generation by genetic operators such as selection, crossover and mutation. The solutions coded by strings are evaluated by the fitness function. The proposed model consists of two phases: GA based Instance Selection and Instance based Bagging. In the first phase, GA is used to select optimal instance subset that is used as input data of bagging model. In this study, the chromosome is encoded as a form of binary string for the instance subset. In this phase, the population size was set to 100 while maximum number of generations was set to 150. We set the crossover rate and mutation rate to 0.7 and 0.1 respectively. We used the prediction accuracy of model as the fitness function of GA. SVM model is trained on training data set using the selected instance subset. The prediction accuracy of SVM model over test data set is used as fitness value in order to avoid overfitting. In the second phase, we used the optimal instance subset selected in the first phase as input data of bagging model. We used SVM model as base classifier for bagging ensemble. The majority voting scheme was used as a combining method in this study. This study applies the proposed model to the bankruptcy prediction problem using a real data set from Korean companies. The research data used in this study contains 1832 externally non-audited firms which filed for bankruptcy (916 cases) and non-bankruptcy (916 cases). Financial ratios categorized as stability, profitability, growth, activity and cash flow were investigated through literature review and basic statistical methods and we selected 8 financial ratios as the final input variables. We separated the whole data into three subsets as training, test and validation data set. In this study, we compared the proposed model with several comparative models including the simple individual SVM model, the simple bagging model and the instance selection based SVM model. The McNemar tests were used to examine whether the proposed model significantly outperforms the other models. The experimental results show that the proposed model outperforms the other models.

A Multimodal Profile Ensemble Approach to Development of Recommender Systems Using Big Data (빅데이터 기반 추천시스템 구현을 위한 다중 프로파일 앙상블 기법)

  • Kim, Minjeong;Cho, Yoonho
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.4
    • /
    • pp.93-110
    • /
    • 2015
  • The recommender system is a system which recommends products to the customers who are likely to be interested in. Based on automated information filtering technology, various recommender systems have been developed. Collaborative filtering (CF), one of the most successful recommendation algorithms, has been applied in a number of different domains such as recommending Web pages, books, movies, music and products. But, it has been known that CF has a critical shortcoming. CF finds neighbors whose preferences are like those of the target customer and recommends products those customers have most liked. Thus, CF works properly only when there's a sufficient number of ratings on common product from customers. When there's a shortage of customer ratings, CF makes the formation of a neighborhood inaccurate, thereby resulting in poor recommendations. To improve the performance of CF based recommender systems, most of the related studies have been focused on the development of novel algorithms under the assumption of using a single profile, which is created from user's rating information for items, purchase transactions, or Web access logs. With the advent of big data, companies got to collect more data and to use a variety of information with big size. So, many companies recognize it very importantly to utilize big data because it makes companies to improve their competitiveness and to create new value. In particular, on the rise is the issue of utilizing personal big data in the recommender system. It is why personal big data facilitate more accurate identification of the preferences or behaviors of users. The proposed recommendation methodology is as follows: First, multimodal user profiles are created from personal big data in order to grasp the preferences and behavior of users from various viewpoints. We derive five user profiles based on the personal information such as rating, site preference, demographic, Internet usage, and topic in text. Next, the similarity between users is calculated based on the profiles and then neighbors of users are found from the results. One of three ensemble approaches is applied to calculate the similarity. Each ensemble approach uses the similarity of combined profile, the average similarity of each profile, and the weighted average similarity of each profile, respectively. Finally, the products that people among the neighborhood prefer most to are recommended to the target users. For the experiments, we used the demographic data and a very large volume of Web log transaction for 5,000 panel users of a company that is specialized to analyzing ranks of Web sites. R and SAS E-miner was used to implement the proposed recommender system and to conduct the topic analysis using the keyword search, respectively. To evaluate the recommendation performance, we used 60% of data for training and 40% of data for test. The 5-fold cross validation was also conducted to enhance the reliability of our experiments. A widely used combination metric called F1 metric that gives equal weight to both recall and precision was employed for our evaluation. As the results of evaluation, the proposed methodology achieved the significant improvement over the single profile based CF algorithm. In particular, the ensemble approach using weighted average similarity shows the highest performance. That is, the rate of improvement in F1 is 16.9 percent for the ensemble approach using weighted average similarity and 8.1 percent for the ensemble approach using average similarity of each profile. From these results, we conclude that the multimodal profile ensemble approach is a viable solution to the problems encountered when there's a shortage of customer ratings. This study has significance in suggesting what kind of information could we use to create profile in the environment of big data and how could we combine and utilize them effectively. However, our methodology should be further studied to consider for its real-world application. We need to compare the differences in recommendation accuracy by applying the proposed method to different recommendation algorithms and then to identify which combination of them would show the best performance.