• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.28 no.1C
• /
• pp.19-29
• /
• 2008

As a part of study to develop LRFD (Load and Resistance Factor Design) codes for foundation structures in Korea, reliability analyses for driven steel pipe piles are performed and the target reliability indices are selected carefully. The 58 data sets of static load tests and soil property tests conducted in the whole domestic area were collected and analyzed to determine the representative bearing capacities of the piles. The static bearing capacity formula and the Meyerhof method using N values are applied to calculate the expected design bearing capacity of the piles. The resistance bias factors were evaluated for the two static design methods by comparing the representative bearing capacities with the design values. Reliability analysis was performed by two types of advanced methods: First Order Reliability Method (FORM), and Monte Carlo Simulation (MCS) method using resistance bias factor statistics. The static bearing capacity formula exhibited relatively small variation, whereas the Meyerhof method showed relatively high inherent conservatism in the resistance bias factors. Reliability indices for safety factors in the range of 3 to 5 were evaluated respectively as 1.50~2.89 and 1.61~2.72 for both of the static bearing capacity formula and the Meyerhof method. The target reliability indices are selected as 2.0 and 2.33 for group pile case and 2.5 for single pile case, based on the reliability level of the current design practice and considering redundancy of pile group, acceptable risk level, construction quality control, and significance of individual structure.

• Journal of Preventive Medicine and Public Health
• /
• v.30 no.4 s.59
• /
• pp.719-728
• /
• 1997

To guarantee the inter-reviewer reliability is very important in evaluating the quality of large number of clinical research papers by multiple reviewers. We cannot find reports on statistical methods for evaluating reliability for multiple raters in clinical research field. The purpose of this paper is to introduce the statistical methods focused on kappa statistic and five kinds of loglinear models for, which can be applied when evaluating the reliability of multiple raters. We have applied these methods to the result of a project, in which seven reviewers have evaluated the quality of 33 papers with regard to four aspects of paper contents including study hypothesis, study design, study population, study method, data analysis and interpretation. Among the five loglinear models including Symmetry model, Conditional symmetry model, Quasi-symmetry model, Independence model, and Quasi-independence model, Quasi-symmetry model shows the best model of fitting. And the level of reliability among seven reviewers revealed to be acceptable as meaningful.

• Safety and Health at Work
• /
• v.4 no.2
• /
• pp.111-116
• /
• 2013

Background: The aim of this study was to evaluate the quality of the Second Korean Working Conditions Survey (KWCS), focusing on its validity and reliability. Methods: The external validity was evaluated by the assessment of sampling procedures and the response rate, in order to investigate the representativeness of the sample. The content validity was evaluated by the assessment of the development of the questionnaire, and the consistency of questions for the selected construct. The test-retest method was used to evaluate the reliability by means of a phone call survey of 30% of the respondents, who were randomly selected. The respondents' satisfaction regarding the survey procedures and interview time were analyzed to evaluate the quality of survey data. Results: The external validity was assured by an acceptable sampling procedure, rigid multi-stage stratified cluster random sampling. The content validity was also guaranteed by a reasonable procedure for the development of the questionnaire with a pretest. The internal consistency of the questions for work autonomy was maintained, with 0.738 of Cronbach's alpha. The response rate of 36% was lower than that of the European Working Conditions Survey (EWCS), with a contact rate of 66%, compared to 76% for the EWCS. The matching rates of the five retested questions were more than 98% reliable. Conclusion: The quality of the second KWCS was assured by the high external and content validity and reliability. The rigid sampling procedure and development of the questionnaire contributed to quality assurance. The high level of reliability may be guaranteed by the sophisticated field survey procedures and the development of a technical manual for interviewers. The technical strategies for a high response rate should be developed for future surveys.

• PNF and Movement
• /
• v.16 no.3
• /
• pp.405-414
• /
• 2018

Purpose: The purpose of this study was to examine test-retest reliability and criterion-related validity of a trunk stability robot when measuring the weight-bearing symmetry static sitting and standing in stroke patients. Methods: For 27 stroke patients, weight-bearing symmetry was assessed twice, 7 days apart. The intraclass correlation coefficient (ICC2,1) and minimal detectable change (MDC) were used to examine the level of agreement between test and retest. The criterion-related validity of weight -bearing symmetry was demonstrated by Spearman correlation of modified Barthel index (MBI), the sit to stand test (STS), the timed up & go Test (TUG), and the function in sitting test (FIST). Results: the test-retest agreements were excellent for the weight-bearing symmetry of static sitting (ICC2,1: 0.90) and standing (ICC2,1: 0.89). It all showed that the acceptable MDC for the weight-bearing symmetry of static sitting and standing was 0.11 and 0.16, respectively (highest possible score<20 %), indicating that the measures had a small and acceptable degree of measurement error. The weight-bearing symmetry of static sitting was significantly correlated with the TUG(r=-0.45) and FIST(r=0.46)(p<0.05); the weight-bearing symmetry of static standing was also significantly correlated with MBI (r=0.65), TUG (r=-0.67), FIST (r=0.61)(p<0.01), and STS (r=-0.47)(p<0.05). Conclusion: The weight-bearing symmetry of static sitting and standing assessed by the trunk stability robot showed highly sufficient test-retest agreement and mild-to-moderate validity. It could also be useful for clinicians and researchers to evaluate balance performance and monitor functional change in stroke patients.

• Journal of The Korean Association For Science Education
• /
• v.25 no.2
• /
• pp.173-183
• /
• 2005

In this study, we questioned what assessment types and scoring methods of science performance assessment(SPA) were being used in middle and high school, and how much these SPA scores were reliable(generalizable). To answer these questions, SPA data obtained from the seven schools were classified according to assessment type and scoring method. Based upon this classification, we analyzed the reliability by applying generalizability theory. The result, from the classification of assessment type and scoring method, showed that SPA types of the seven schools were divided into two types: paper-pencil type and task type. Paper-pencil type included answer(content)-restricted essay-type test solely. Task type has two parts: process and outcome assessment. As the results of analyzing scoring methods of the seven schools, there were two cases in the way of scoring methods: one case is scoring all essay-type items and performance tasks by one teacher, the other is scoring assigned performance tasks by two teachers. But the case of scoring assigned essay-type items or the case of cross scoring by two or more teachers were not found. The findings of the reliability analysis are as follows: (1) Effect of essay-type item to SPA score was larger than that of performance task. (2) There was remarkable difference among the seven schools' interaction effect of person and rater in scoring performance tasks. (3) Most of generalizability(reliability) coefficients of SPA for the seven schools were smaller than the acceptable generalizability coefficient(0.80). Therefore, the population of statistical parameters such as number of item, task and rater, should be increased for approaching the acceptable generalizability level.

• Journal of Korean Academy of Nursing
• /
• v.53 no.3
• /
• pp.324-339
• /
• 2023

Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

• Journal of Preventive Medicine and Public Health
• /
• v.55 no.4
• /
• pp.334-341
• /
• 2022

Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.28 no.6C
• /
• pp.367-377
• /
• 2008

As part of study to develop LRFD (Load and Resistance Factor Design) codes for foundation structures in Korea, resistance factors for static bearing capacity of driven steel pipe piles were calibrated in the framework of reliability theory. The 57 data sets of static load tests and soil property tests conducted in the whole domestic area were collected and these load test piles were sorted into two cases: SPT N at pile tip less than 50, SPT N at pile tip equal to or more than 50. The static bearing capacity formula and the Meyerhof method using N values were applied to calculate the expected design bearing capacities of the piles. The resistance bias factors were evaluated for the two static design methods by comparing the representative measured bearing capacities with the expected design values. Reliability analysis was performed by two types of advanced methods: the First Order Reliability Method (FORM), and the Monte Carlo Simulation (MCS) method using resistance bias factor statistics. The target reliability indices are selected as 2.0 and 2.33 for group pile case and 2.5 for single pile case, in consideration of the reliability level of the current design practice, redundancy of pile group, acceptable risk level, construction quality control, and significance of individual structure. Resistance factors of driven steel pipe piles were recommended based on the results derived from the First Order Reliability Method and the Monte Carlo Simulation method.

• Journal of Applied Reliability
• /
• v.15 no.3
• /
• pp.207-215
• /
• 2015

Safety' can be used in a variety of ways and may also have different meanings when used in theoretical field and routinely used. In this paper, the 'safety' means that human injury, fire or physical accident condition does not occur while used by the end-user. The meaning of safety may be different by era and culture. Even in contemporary era, the meaning can be used differently by country, region and culture. As the rights of consumers are increasingly reinforced, we can expect the acceptable risk or safety level can rise higher. In this paper, the R-map of Japan and the European risk assessment guidelines (RAPEX) were reviewed considering domestic incidents database status and its applicability. Because it is difficult to make a model based on a R-map, a revised model was developed mainly based on European Assessment Model with a combination of the important characteristics of Japan model R-map. Also utilizing this revised model, the availability as a new risk assessment model was confirmed by comparing the test results for the same scenarios to the other risk assessment model (RAPEX/RAG).

• Journal of Korean Academy of Nursing
• /
• v.28 no.2
• /
• pp.244-255
• /
• 1998

The purpose of this study was to verify the reliability and validity of the Rosenbaum self-control schedule (SCS) for assessing resourcefulness in Korea and to explore the simplified scale. The study subjects consisted of 787 adults in a community. The data was collected during the period from Oct. to Dec., 1995 and analyzed as Cronbach α, item correlation with total, Pearson correlation and factor analysis with varimax rotation using SAS. Results were as follows : The mean SCS score for this sample was 17.2 and there were statistical differences for gender(men, 13.1 ; women, 20.0) on the SCS scores. The cronbachα of SCS with 36 items was .74 and when simplified with 30 items, it's coefficient alpha was .78. The translated content of the SCS was validated by two nursing faculty members and one professor of psychology. Factor analysis revealed the most parsimonious structure was obtained when six factors were extracted and subsequently rotated via the varimax criterion. There was 40.2% of total communality variance in the SCS with 36 items. The total communality variance was slightly increased to 43.4% with 30 items of the SCS. In order to reduce from 36 items to 30 items, the process excepted 6 items having low item correlation with total and low MSA(means of sampling adequacy) of factor analysis. According to factor analysis, there are six factors such as emotion control, impulse control, self-efficacy, coping with problems, pain control and satisfaction control, The SCS was found to have low, but statistically significant, correlations with social desirability and helplessness. From the above results, it can be concluded that the reliability of the SCS(inherent and simplified) was a acceptable level and its validity was reasonable when comparing it with other validity studies. To determine the usefulness the simplified scale, further study is necessary to simultaneously compare and analyze both scales for stability.