• Title/Summary/Keyword: Item Reliability

Search Result 982, Processing Time 0.024 seconds

Psychometric Properties of the Alzheimer's Disease Knowledge Scale-Korean Version (한국어판 알츠하이머병 지식 측정도구의 신뢰도와 타당도)

  • Kim, Eun Joo;Jung, Ji-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.45 no.1
    • /
    • pp.107-117
    • /
    • 2015
  • Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

Development of Nuclear Energy Attitude Scale (핵에너지 태도 측정도구의 개발)

  • 장우정;우형택
    • Journal of Environmental Science International
    • /
    • v.11 no.9
    • /
    • pp.829-842
    • /
    • 2002
  • The purpose of this study was to design a reliable and valid Likert-type scale to measure nuclear energy attitudes of various groups. 8 tests were applied to the construction of a 26-item long form, a 12-item middle form, and a 6-item short form of the scale. Three scales were field tested on 760 respondents representing a diverse range of subjects. The 26-item scale appeared to be reliable, content valid and construct valid. Scale reliability and homogeneity were evidenced by 0.95 coefficient alpha and positive interitem correlations ranging from 0.18 to 0.74. The results of factor analysis and known-groups comparison revealed that this scale had high validity. Reliability of the middle form and short form were evidenced by coefficient alpha of 0.92 and 0.90 respectively. The long and middle forms were strongly correlated, r-value of 0.98 and the long and short forms were also highly correlated, r-value of 0.93. Consequently, long form, middle form and short form scales were evidenced very reliable and valid in measuring nuclear energy attitudes of various groups in general. They can be used for a variety of purpose of measuring and testing nuclear energy attitude.

A Study to Standardize the Child Development Review in Korea (영.유아발달선별검사(Child Development Review)의 한국에서의 표준화 연구)

  • Shin, Hee-Sun;Kim, Jeong-Mee
    • Child Health Nursing Research
    • /
    • v.12 no.3
    • /
    • pp.333-340
    • /
    • 2006
  • Purpose: This study was to restandardize the Child Development Review (CDR) which was developed by Dr. Ireton and based on Child Development Inventory (CDI). Method: The participants were 1143 children who were aged 12months to 6.3years old and parents. They were the sample for standardization study of CDI. The age level assigned to each item of Korean version of CDI were assessed. The reliability and validity was analyzed by reliability coefficient and concurrent validity analysis. Result: The item set was revised by the age level of each item at which at least 75 percent of parents answered YES to the statement. The child development chart was composed of 100 item which include social, self-help, gross motor, fine motor, and language sector. The internal consistency coefficient of the instrument was .93. The concurrent validity with Korean Denver II was good. Conclusions: The Korean version of CDR showed good reliability and validity. It could be utilized for developmental screening at pediatric clinic and child care center.

  • PDF

Reassessment of Validity and Reliability of the Tools for Measuring Yangseng -Focused on the Elderly People in Jeonbuk Area- (양생측정도구의 타당도와 신뢰도 재검증 -전북지역 노인을 중심으로-)

  • Jung, Hae-Kyoung;Kwon, So-Hee;Kim, Ae-Jung;Wang, Myoung-Ja;Lee, Ki-Nam
    • Journal of Society of Preventive Korean Medicine
    • /
    • v.9 no.1
    • /
    • pp.17-36
    • /
    • 2005
  • The objective of this study is to present basic data for producing tools to measure Yangseng of the elderly aged older than 65 by reassessing the validity and reliability of such tools already developed. In the present study, total 855 subjects were divided into 4 groups and given 31 question for the ultimate factor analysis of each item. The results cloud be summarized as follows: 1. In case of 'don't have sex in drunken state or right after dinner'(the 31st item of sex live yangseng). factor loading came out proportionally in 3 factors such as factor 4=0.358, factor 5=0.389 and factor 6=0.386. As they all failed to reach the general standard of 0.5 or more and even the minimum standard of 0.4 or more, the 31st item was deleted from the questionnaires. 2. From the factor analysis after exclusion of the 31st item, factor loading of the 25th item of sleep yangseng 'go to bed and get up regularly' appeared to be proportional in 2 factor(factor 4=0.393 and factor 7=0.373). Since it was shown that the 25th item could not be classified into a category but interacted with others in common and didn't satisfy the minimum standard of 0.4, it was deleted form the questionnaires, too. 3. From the factor analysis conducted after excluding the item numbers 31 and 25, factor loading of the 12th item of diet yangseng 'do not eat much' turned out to be relatively high with such values as factor 5=0.518 and factor 3=0.453. As it was, however, tied up with the factor of exercise yangseng, it was also deleted. In conclusion, 28 items after excluding the item numbers 12, 25 and 31 form 4 group showed the same results as divided into 8 factor with high grade of reliability and validity, evidencing the assumption that they can be employed practically to measure yangseng of the elderly aged 65 and oder.

  • PDF

A Development of the Korean Version of the constitutions in Ayurveda Questionnaire (한국형 아유르베다(Āyurveda) 체질유형 검사지의 개발을 위한 기초연구)

  • Cheong, MeeSook;Rim, Aela
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.12
    • /
    • pp.62-70
    • /
    • 2016
  • This study investigated the development of a Korean version of the Ayurvedic constitution questionnaire and sought to verify its validity and reliability. Each study subject completed a self-administered questionnaire consisting of 63 questions. The Ayurvedic constitutions were placed into 7 categories. The results from 271 subjects revealed that the internal consistency reliability (Cronbach's ${\alpha}$) in the 41 item biometric signature part of the questionnaire was 0.757. The Cronbach's ${\alpha}$ for the 22 item psychological part was 0.616, whereas the Cronbach's ${\alpha}$ for the entire 63 items was 0.840. Taken together, the results indicate that the Korean version of the Ayurvedic questionnaire was valid. Within the questionnaire, the fourth item about body and the ninth item about psychological showed item-total correlations with negative total values, thereby indicating inconsistent (less reliable) responses. The remaining 61 items had a 0.864 degree of reliability. The results for the pure Vata Pitta and Kapha body types showed a high level of internal consistency reliability, presumably because those participants were of a pure constitution type. The Kappa factor for inter-item coincidence between the judgment of Ayurvedic constitution experts and the judgment derived from the written test scores was 0.619, thereby indicating questionnaire validity. The results of this study may be useful in further development of a Korean version of the Ayurveda constitution questionnaire.

Exploring the Reliability of an Assessment based on Automatic Item Generation Using the Multivariate Generalizability Theory (다변량일반화가능도 이론을 적용한 자동문항생성 기반 평가에서의 신뢰도 탐색)

  • Jinmin Chung;Sungyeun Kim
    • Journal of Science Education
    • /
    • v.47 no.2
    • /
    • pp.211-224
    • /
    • 2023
  • The purpose of this study is to suggest how to investigate the reliability of the assessment, which consists of items generated by automatic item generation using empirical example data. To achieve this, we analyzed the illustrative assessment data by applying the multivariate generalizability theory, which can reflect the design of responding to different items for each student and multiple error sources in the assessment score. The result of the G-study showed that, in most designs, the student effect corresponding to the true score of the classical test theory was relatively large after residual effects. In addition, in the design where the content domain was fixed, the ranking of students did not change depending on the item types or items. Similarly, in the design where the item format was fixed, the difficulty showed little variation depending on the content domains. The result of the D-study indicated that the original assessment data achieved a sufficient level of reliability. It was also found that higher reliability than the original assessment data could be obtained by reducing the number of items in the content domains of operation, geometry, and probability and statistics, or by assigning higher weights to the domains of letters and formulas, and function. The efficient measurement conditions presented in this study are limited to the illustrative assessment data. However, the method applied in this study can be utilized to determine the reliability and to find efficient measurement conditions for the various assessment situations using automatic item generation based on measurement traits.

Block 대체정책에 관한 연구

  • Bae, Mun-Sik
    • ETRI Journal
    • /
    • v.6 no.3
    • /
    • pp.17-20
    • /
    • 1984
  • A block replacement policy using items with different reliability is discussed. We devide system unit failure modes into two modes and use less reliable unit when operating unit fails near the planned preventive replacement time. In this policy, item A has two failure modes. Mode-1 failure is removed by minimal repair, mode-2 failure by replacement. If mode-2 failure of item A happens in (0,T- $\delta$). failure item A is replaced by new item A. If mode-2 failure of item A happens in(T-$\delta$,T), failure item A is replaced by new item B. Item B should be cheaper and less durable than item A. Under this policy, we determine the preventive replacement interval T and the interval $\delta$ of item B replacement which minimize the cost rate per unit time.

  • PDF

Scalable Collaborative Filtering Technique based on Adaptive Clustering (적응형 군집화 기반 확장 용이한 협업 필터링 기법)

  • Lee, O-Joun;Hong, Min-Sung;Lee, Won-Jin;Lee, Jae-Dong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.73-92
    • /
    • 2014
  • An Adaptive Clustering-based Collaborative Filtering Technique was proposed to solve the fundamental problems of collaborative filtering, such as cold-start problems, scalability problems and data sparsity problems. Previous collaborative filtering techniques were carried out according to the recommendations based on the predicted preference of the user to a particular item using a similar item subset and a similar user subset composed based on the preference of users to items. For this reason, if the density of the user preference matrix is low, the reliability of the recommendation system will decrease rapidly. Therefore, the difficulty of creating a similar item subset and similar user subset will be increased. In addition, as the scale of service increases, the time needed to create a similar item subset and similar user subset increases geometrically, and the response time of the recommendation system is then increased. To solve these problems, this paper suggests a collaborative filtering technique that adapts a condition actively to the model and adopts the concepts of a context-based filtering technique. This technique consists of four major methodologies. First, items are made, the users are clustered according their feature vectors, and an inter-cluster preference between each item cluster and user cluster is then assumed. According to this method, the run-time for creating a similar item subset or user subset can be economized, the reliability of a recommendation system can be made higher than that using only the user preference information for creating a similar item subset or similar user subset, and the cold start problem can be partially solved. Second, recommendations are made using the prior composed item and user clusters and inter-cluster preference between each item cluster and user cluster. In this phase, a list of items is made for users by examining the item clusters in the order of the size of the inter-cluster preference of the user cluster, in which the user belongs, and selecting and ranking the items according to the predicted or recorded user preference information. Using this method, the creation of a recommendation model phase bears the highest load of the recommendation system, and it minimizes the load of the recommendation system in run-time. Therefore, the scalability problem and large scale recommendation system can be performed with collaborative filtering, which is highly reliable. Third, the missing user preference information is predicted using the item and user clusters. Using this method, the problem caused by the low density of the user preference matrix can be mitigated. Existing studies on this used an item-based prediction or user-based prediction. In this paper, Hao Ji's idea, which uses both an item-based prediction and user-based prediction, was improved. The reliability of the recommendation service can be improved by combining the predictive values of both techniques by applying the condition of the recommendation model. By predicting the user preference based on the item or user clusters, the time required to predict the user preference can be reduced, and missing user preference in run-time can be predicted. Fourth, the item and user feature vector can be made to learn the following input of the user feedback. This phase applied normalized user feedback to the item and user feature vector. This method can mitigate the problems caused by the use of the concepts of context-based filtering, such as the item and user feature vector based on the user profile and item properties. The problems with using the item and user feature vector are due to the limitation of quantifying the qualitative features of the items and users. Therefore, the elements of the user and item feature vectors are made to match one to one, and if user feedback to a particular item is obtained, it will be applied to the feature vector using the opposite one. Verification of this method was accomplished by comparing the performance with existing hybrid filtering techniques. Two methods were used for verification: MAE(Mean Absolute Error) and response time. Using MAE, this technique was confirmed to improve the reliability of the recommendation system. Using the response time, this technique was found to be suitable for a large scaled recommendation system. This paper suggested an Adaptive Clustering-based Collaborative Filtering Technique with high reliability and low time complexity, but it had some limitations. This technique focused on reducing the time complexity. Hence, an improvement in reliability was not expected. The next topic will be to improve this technique by rule-based filtering.

Reliability and Validity of Stroke Impact Scale 3.0 (뇌졸중 영향 척도 3.0의 신뢰도와 타당도)

  • Park, Eun-Young;Choi, Yoo-Im;Kim, Eun-Joo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.8
    • /
    • pp.293-302
    • /
    • 2019
  • The purpose of this study was to examine the reliability and validity of Stroke Impact Scale 3.0 (SIS 3.0). Here, the SIS 3.0 was completed by 154 stroke patients (mean = 62.7; standard deviation [SD] = 9.43). Construct validity was verified by analyzing the correlation between SIS 3.0 sub-domains, and convergent validity was investigated by analyzing the correlation between the Modified Barthel Index (MBI) and the Mini-Mental State Examination-Korean (K-MMSE) version. The characteristics of each item were analyzed by internal consistency and item discrimination based on the classical item theory. Construct and convergent validity were verified through this study. Although the item i included in the emotion domain showed low item discrimination, all but this item showed high discrimination. Internal consistency was also high in all sub-domains.

A Development of the Test for Mathematical Creative Problem Solving Ability

  • Lee, Kang-Sup;Hwang, Dong jou;Seo, Jong-Jin
    • Research in Mathematical Education
    • /
    • v.7 no.3
    • /
    • pp.163-189
    • /
    • 2003
  • The purpose of this study is to develop a test, which can be used in creative problem solving ability in mathematics of the mathematically gifted and the regular students. This test tool is composed of three categories; fluency (number of responses), flexibility (number of different kinds of responses), and originality (degree of uniqueness of responses) which are the factors of the creativity. After applying to 462 middle school students, this test was analyzed into item analysis. As a results of item analysis, it turned out to be meaningful (reliability: 0.80, validity: item 1(1.05), item 2(1.10), item 3(0.85), item 4(0.90), item 5(1.08), item difficulty: item 1(-0.22), item 2(-0.41), item 3(0.23), item 4(0.40), item 5(-0.01), item discriminating power: item 1(0.73), item 2(0.73), item 3(0.67), item 4(0.51), item 5(0.56), over the level of a standard basis. This means that the test tool was useful in the test process of creative problem solving ability in mathematics

  • PDF