• Journal of Korean Academy of Nursing
• /
• v.46 no.1
• /
• pp.109-117
• /
• 2016

Purpose: The aim of this study was to develop a Korean version of Night Eating Questionnaire (KNEQ) and test its psychometric properties and evaluate items according to item response theory. Methods: The 14-item NEQ as a measure of severity of the night eating syndrome was translated into Korean, and then this KNEQ was evaluated. A total of 1171 participants aged 20 to 50 completed the KNEQ on the Internet. To test reliability and validity, Cronbach's alpha, correlation, simple regression, and factor analysis were used. Each item was analyzed according to Rasch-Andrich rating scale model and item difficulty, discrimination, infit/outfit, and point measure correlation were evaluated. Results: Construct validity was evident. Cronbach's alpha was .78. The items of evening hyperphagia and nocturnal ingestion showed high ability in discriminating people with night eating syndrome, while items of morning anorexia and mood/sleep provided relatively little information. The results of item analysis showed that item2 and item7 needed to be revised to improve the reliability of KNEQ. Conclusion: KNEQ is an appropriate instrument to measure severity of night eating syndrome with good validity and reliability. However, further studies are needed to find cut-off scores to screen persons with night eating syndrome.

• Journal of Applied Reliability
• /
• v.12 no.3
• /
• pp.131-138
• /
• 2012

A design of reliability qualification test based on performance distribution is developed. In general, the performance of an item degrades as the time goes by and the failure of an item occurs when the performance degradation reaches the pre-determined critical level. This article considers the reliability qualification test based on a more tightened critical value at the earlier stage to reduce the evaluation testing time and cost. A numerical example is provided to illustrate how to use the developed reliability qualification test.

• Journal of Korean Academy of Nursing Administration
• /
• v.7 no.2
• /
• pp.285-300
• /
• 2001

To meet standards for high quality of care and satisfied customers, an evaluation tool about nursing care is necessary. And, We need to evaluate our practice continuously for the improvement in quality and outcomes. This study was intended to develop an evaluation tool about nursing care in NSICU, and was progressed of 3 steps; development, content validity verification and reliability verification. Data were obtained and analysed from Feb. To April, 2000. Development process of the study was as follows A preliminary list was made item by item on the basis of clinical Experience, literature review and patients' record review. Then the standards, criteria and indicators of preliminary evaluation tool were set by 5 clinical nursing panel, and their content validity was reviewed by 27 ICU nurses. Finally, an evaluation tool was developed and verified the reliability at c-university hospital located in Kwang-Ju. The results of this was as follows 1) The evaluation tool of this study developed 8 standards, 39 criterias and 106 indicators. The standards were divided into two dimensions. One was process dimension which contained 4 standards(26 criteria), The other was outcome dimension which contained 4 standards(13 criteria). 2) the Average content validity of the tool was 3.39 at standards, 3.55 at criteria and 3.51 at indicators. 3) Interrater reliability of the tool is r=.7993(p<.001) & internal consistency reliability ${\alpha}$ is .6031 4) Scores of NSICU Patients who participated in this study were 57 at total mean score, 58 at process mean score and 56 at outcome mean score The evaluation tool developed in this study seems to be useful in evaluation nursing practice appropriately for the improvement of nursing care in NSICU. I hope that this evaluation tool can be used effectively in NSICU as an intervention for the improvement of quality control.

• Journal of Korean Society for Quality Management
• /
• v.30 no.2
• /
• pp.1-10
• /
• 2002

A performance evaluation model of an R&D module in the quality management system for M Company Is constructed using QFD. The company produces telecommunication devices and employs the performance evaluation model based on ISO 9000 family. However, the model has some problems, one of them is that all check items are regarded as equally important Customer requirements are gathered from internal customers and QFD is utilized to obtain weights for each check item.

• Physical Therapy Korea
• /
• v.23 no.4
• /
• pp.71-80
• /
• 2016

Background: Functional capacity evaluations (FCEs) are designed to systematically assess the capacity to perform work-related tasks and to determine worker's ability to return to the previous job following work-related injuries. These evaluations may be rated either by clinician or worker. There has been a lack of consensus between the two scoring methods. Objects: This study aimed: 1) to confirm if the data are fit to the Rasch rating scale model and 2) to investigate the item-level concordance rate between the ratings of clinician and injured worker of the FCE. Methods: A cross-sectional study was conducted with a sample (n=124) of a rehabilitation program with the Occupational Rehabilitation Data Base for workers with low back pain. The functional capacity evaluation at admission and discharge was administered to clinicians and workers. The data were analyzed using both classical test theory-based Pearson's r and intra-class coefficient followed by item-level analysis with Rasch rating scale model. Results: All items of the FCE, except sitting items rated by clinician at admission and handling items rated by both clinician and worker throughout admission and discharge, were acceptable fit statistics with minor out of ranges for a misfit criterion. This may indicate that the items of the FCE overall fit to the Rasch rating scale model. Few problematic items responding differently to clinician and worker both at admission and discharge were detected with the differential item functioning analysis despite the excellent concordance rate using the two conventional statistics-sitting and handling items at admission and handling item at discharge. Conclusion: The item-level speculations using Rasch analysis of the FCE demonstrate that the ratings of clinician and self ratings of worker were psychometrically acceptable though there was an apparent discrepancy between the raters both at admission and discharge.

• Korean Journal of Child Studies
• /
• v.24 no.3
• /
• pp.135-149
• /
• 2003

This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

• Journal of Korea Multimedia Society
• /
• v.24 no.12
• /
• pp.1673-1681
• /
• 2021

Item cold start is a well studied problem in the research field of recommender systems. Still, many existing collaborative filters cannot recommend items accurately when only a few user-item interaction data are available for newly introduced items (Cold items). We propose a interaction feature prediction method to mitigate item cold start problem. The proposed method predicts the interaction features that collaborative filters can calculate for the cold items. For prediction, in addition to content features of the cold-items used by state-of-the-art methods, our method exploits the interaction features of k-nearest content neighbors of the cold-items. An attention network is adopted to extract appropriate information from the interaction features of the neighbors by examining the contents feature similarity between the cold-item and its neighbors. Our evaluation on a real dataset CiteULike shows that the proposed method outperforms state-of-the-art methods 0.027 in Recall@20 metric and 0.023 in NDCG@20 metric.

• The Pure and Applied Mathematics
• /
• v.3 no.2
• /
• pp.141-154
• /
• 1996

A data-driven index of dimensionality for an educational or psychological test - DETECT, short for Dimensionality Evaluation To Enumerate Contributing Traits, is proposed in this paper. It is based on estimated conditional covariances of item pairs, given score on remaining test items. Its purpose is to detect whatever multidimensionality structure exists, especially in the case of approximate simple structure. It does so by assigning items to relatively dimensionally homogeneous clusters via attempted maximization of the DETECT over all possible item cluster partitions. The performance of DETECT is studied through real and simulated data analyses.

• Journal of Yeungnam Medical Science
• /
• v.38 no.2
• /
• pp.118-126
• /
• 2021

Background: This study is an analysis of evaluator factors affecting physician-patient interaction (PPI) scores in clinical performance examination (CPX). The purpose of this study was to investigate possible ways to increase the reliability of the CPX evaluation. Methods: The six-item Yeungnam University Scale (YUS), four-item analytic global rating scale (AGRS), and one-item holistic rating scale (HRS) were used to evaluate student performance in PPI. A total of 72 fourth-year students from Yeungnam University College of Medicine in Korea participated in the evaluation with 32 faculty and 16 standardized patient (SP) raters. The study then examined the differences in scores between types of scale, raters (SP vs. faculty), faculty specialty, evaluation experience, and level of fatigue as time passes. Results: There were significant differences between faculty and SP scores in all three scales and a significant correlation among raters' scores. Scores given by raters on items related to their specialty were lower than those given by raters on items out of their specialty. On the YUS and AGRS, there were significant differences based on the faculty's evaluation experience; scores by raters who had three to ten previous evaluation experiences were lower than others' scores. There were also significant differences among SP raters on all scales. The correlation between the YUS and AGRS/HRS declined significantly according to the length of evaluation time. Conclusion: In CPX, PPI score reliability was found to be significantly affected by the evaluator factors as well as the type of scale.

• Proceedings of the Korean Geotechical Society Conference
• /
• 2006.03a
• /
• pp.732-737
• /
• 2006

The facility diagnosis technique of past subjective judged the technical expert and interpreted stably mainly. The facility the periodical civil official becomes indispensability consequently with the law and the system and objectivity inspection which relates with a this and development of diagnosis technique were necessary. Currently the evaluation elements which relate with an inspection and diagnosis technique depended to the subjectivity of each facility quality, data statistics, diagnosis know-how, various circumstance and the technical expert and the evaluation item came to decide. But the evaluation score distribution of marks of each item depended plentifully in data analysis result and experience. The past method is weak in logically because the objection theoretical background and basis are insufficiency. Consequently in order to apply a data analysis result and an experience logically, it used AHP(Analytic Hierarchy Process) method from this research. It is visible with the fact that the application result reconfirmation and complement process will be necessary the technique which is suitable in the multi facility management. Also it is expected with the fact that the application characteristic from the next relation technique will be excellent.