• Title/Summary/Keyword: internal consistency

Search Result 1,007, Processing Time 0.025 seconds

A Study on Institutional Reliability of Open Record Information in the Information Disclosure System (정보공개제도에서 공개 기록정보의 제도적 신뢰성에 관한 연구)

  • Lee, Bo-ram;Lee, Young-hak
    • The Korean Journal of Archival Studies
    • /
    • no.35
    • /
    • pp.41-91
    • /
    • 2013
  • There have been numerous steps of growth in policy system since the legal systemization through the enactment of Information Disclosure of public institution Act in 1996 and Records Management of public institution Act in 1999 as well as infrastructure advancement led by government bodies, but it still shows insufficiency in some aspects of information disclosure system and records management. In particular, the issue of reliability on record information disclosed through information disclosure system is raised, and institutional base through the legal and technical devices to ensure the reliability are not well prepared. Government has attempted to enact laws and regulations to guarantee the public right to know through information disclosure and records management at government level, and establish the national system in a way that advances the infrastructure for encouraging the participation in state affairs and utilization of national record information resources. There are limitations that it lacks internal stability and overlooks the impact and significance of record information itself by focusing upon system expansion and disclosing information quantatively. Numerous record information disclosed tends to be falsified, forged, extracted or manufactured by information disclosure staffs, or provided in a form other than official document or draft. In addition, the disclosure or non-disclosure decisions without consistency and criteria due to lack of information disclosure staff or titular supervising authority, which is likely to lead to societal confusion. There are also frequent cases where the reliability is damaged due to voluntary decision, false response or non response depending upon request agents for information disclosure. In other cases, vague request by information disclosure applicant or civil complaint form request are likely to hinder the reliability of record information. Thus it is essential to ensure the reliability of record information by establishing and amending relevant laws and regulations, systemic improvement through organizational and staff expertise advancement, supplementing the information disclosure system and process, and changing the social perception on information disclosure. That is, reliable record information is expected to contribute to genuine governance form administration as well as accountability of government bodies and public organizations. In conclusion, there are needed numerous attempts to ensure the reliability of record information to be disclosure in the future beyond previous trials of perceiving record information as records systematically and focusing upon disclosing more information and external development of system.

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.

A Development and Validation Study of the Web-based Korean Version of the Eating Disorder Diagnostic Scale DSM-5 (웹 기반 한국판 섭식장애진단척도 DSM-5의 개발 및 타당화 연구)

  • Lee, Hye Rin;Kwag, Kyung Hwa;Lee, You Kyung;Han, Soo Wan;Kim, Youl-Ri
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.28 no.2
    • /
    • pp.185-193
    • /
    • 2020
  • Objectives : The aim of this study was to develop and to verify the Korean version of the Eating Disorder Diagnosis Scale DSM-5 (K-EDDS) as a web-based diagnostic system, which enables rapid diagnosis of patients for early intervention. Methods : A total of 119 persons participated in the study, including patients with eating disorders (n=38) and college students (n=81). Along with the paper-and-pencil SCOFF, all participants completed the web-based K-EDDS, the Eating Disorder Examination-Questionaire (EDE-Q), and the Clinical Impairment Assessment Questionnaire (CIA). The semi-structured interview using the Eating Disorder Examination Interview (EDE) was conducted for participants with two or more SCOFF scores. Within two weeks, the web-based K-EDDS, the EDE-Q, and the CIA were re-tested. Results : In the exploratory factor analysis, four factors were extracted : body dissatisfaction, binge behaviors, binge frequency and compensatory behaviors. The four subscales of the web-based K-EDDS had significant correlation with each of the four subscales of the EDE-Q. The internal consistency of the web-based K-EDDS was highly satisfactory (Cronbach's alpha=0.93). The diagnostic agreement between the web-based K-EDDS and the EDE was excellent (96.83%), and the web-based K-EDDS's test-retest diagnostic agreement was fairly good (92.86%). The web-based K-EDDS and the CIA also showed significant differences between patients and general population, supporting discriminant validity. Conclusions : This study suggested that the web-based K-EDDS is a valid tool for assisting diagnosis of eating disorders based on DSM-5 in clinical and research fields.

Reliability and validity of Korean version of the OHIP for edentulous subjects: A pilot study (무치악 환자들을 위한 한국어 버전의 구강건강영향지수 신뢰도와 타당성 평가를 위한 모의연구)

  • Shin, Jae Seob;Bae, So Young;Park, Jin Hong;Shim, Ji Suk;Lee, Jeong Yol
    • The Journal of Korean Academy of Prosthodontics
    • /
    • v.59 no.3
    • /
    • pp.305-313
    • /
    • 2021
  • Purpose. The purpose of this pilot study is to evaluate the reliability and validity of the Korean version of the oral health impact profile (OHIP-EDENT K) for edentulous patients. Materials and methods. The study was conducted on 12 patients who fabricated overdenture in the Department of Prosthodontics, Korea University, Guro Hospital. All subjects completed the Korean version of Oral Health Impact Profile (OHIP K) questionnaire. Shorten version of the OHIP called OHIP-14 K and OHIP-EDENT K were derived from the datasets. Cronbach's alpha was used to measure internal consistency of the summary scores for OHIP-EDENT K. The Spearman's correlation coefficient between the summary scores for OHIP-EDENT K and OHIP K was calculated to evaluate concurrent validity. Results. The reliability of the summary scores for OHIP-EDENT K was acceptable (α=.736). The Spearman's correlation coefficient of the summary scores for OHIP-EDENT K and OHIP K was 0.966, which was statistically significant (P<.001). OHIP-EDENT K exhibited less susceptibility to floor effects than OHIP-14 K and appeared to measure change as effectively as OHIP K. In order to prove the reliability, responsiveness and validity of OHIP-EDENT K, further studies with more samples are needed. Conclusion. The OHIP-EDENT K, a questionnaire on oral health-related QOL comprising 19 items, has measurement properties comparable with the full 49-item version. This modified shortened version can be an alternative questionnaire to full version of OHIP K and OHIP-14 K in edentulous patients.

Development and Validation of the Korean Tier 3 School-Wide Positive Behavior Support Implementation Fidelity Checklist (KT3-FC) (한국형 긍정적 행동지원 3차 실행충실도 척도(KT3-FC)의 개발과 타당화)

  • Won, Sung-Doo;Chang, Eun Jin;Cho Blair, Kwang-Sun;Song, Wonyoung;Nam, Dong Mi
    • Korean Journal of School Psychology
    • /
    • v.17 no.2
    • /
    • pp.165-180
    • /
    • 2020
  • As a tiered system of supports, School-Wide Positive Behavior Support (SWPBS) is an evidence-based practice in the educational system of Korea. An important aspect of SWPBS is the ongoing progress monitoring and evaluation of implementation fidelity. This study aimed to develop and validate the Korean Tier 3 School-Wide Positive Behavior Support Implementation Fidelity Checklist (KT3-FC). The preliminary KT3-FC consisted of a 37-item, 6-factor checklist. In the first phase of the study, 10 experts reported that the range of content validity of the KT3-FC was adequate. In the second phase of the study, 185 teachers (52 men and 133 women) who implemented SWPBS completed the KT3-FC, Individualized Supports Questionnaire, School Climate Questionnaire, School Discipline Practice Scale, and PBS Effectiveness Scale. An exploratory factor analysis resulted in a 5-factor structure, with 20 items, instead of 37 items, consisting of: (a) progress monitoring and evaluation of the individualized supports, (b) provision of supports by aligning and integrating mental health and SWPBS, (c) crisis management planning, (d) problem behavior assessment, and (e) establishment of individualized support team. The internal consistency of the KT3-FC was good (full scale α = .950, sub-factor α = .888 ~ .954). In addition, the KT3-FC showed good convergent validity, having statistically significant correlations with the Individualized Support Questionnaire, School Climate Questionnaire, School Discipline Practice Scale, and the PBS Effectiveness Scale. Finally, the confirmatory factor analysis showed that the 5-factor model of the KT3-FC had some good model fits, indicating that the newly developed fidelity measure could be a reliable and valid tool to assess the implementation of Tier 3 supports in Korean schools. Accordingly, the KT3-FC could contribute to implement SWPBS as an evidence-based behavioral intervention for Korean students.

Development and Validation of the Korean Implementation Fidelity Checklist of Tier 1 School-Wide Positive Behavior Support (KIFC-T1) (한국형 학교차원 긍정적 행동지원 1차 실행충실도 척도(KIFC-T1)의 개발과 타당화)

  • Nam, Dong Mi;Chang, Eun Jin;Won, Sung-Doo;Cho Blair, Kwang-Sun;Song, Wonyoung
    • Korean Journal of School Psychology
    • /
    • v.17 no.3
    • /
    • pp.401-419
    • /
    • 2020
  • The purpose of this study was to validate the Korean Implementation Fidelity Checklist of Tier 1 School-Wide Positive Behavior Support (KIFC-T1) for use in the Korean educational system. Tier 1 support, which is universal supports, within a multi-tiered, school-wide positive behavior support (SWPBS) model, aims to provide support to and prevent problem behaviors among all students in a school. The initial KIFC-T1 consisted of 48 items and 11 factors and was developed based on a literature review. Its content was validated by experts. The validated KIFC-T1 was introduced to 185 special school teachers who had experience implementing SWPBS and who used the instrument to assess the degree to which their schools had implemented Tier 1 support. Based on their responses, the construct validity of the KIFC-T1 was examined using factor, item, and internal consistency reliability analyses. The concurrent validity of the tool was examined using the PBS Evaluation Tool, School Climate Questionnaire, School Discipline Practice Scale, and PBS Effectiveness Scale. The analyses revealed that KIFC-T1 had a stable five-factor structure with 35 items, had good reliability (Cronbach's α=.956, each factor's Cronbach's α=.834-.951), and its results were statistically significantly correlated with those of the PBS Evaluation Tool, School Discipline Practice Scale, and the PBS Effectiveness Scale. However the KIFC-T1's results were not statistically significantly correlated with the results of the School Climate Questionnaire. These results suggest that KIFC-T1 is a reliable and valid tool for assessing the fidelity of universal support implementations.

A Longitudinal Validation Study of the Korean Version of PCL-5(Post-traumatic Stress Disorder Checklist for DSM-5) (PCL-5(DSM-5 기준 외상 후 스트레스 장애 체크리스트) 한국판 종단 타당화 연구)

  • Lee, DongHun;Lee, DeokHee;Kim, SungHyun;Jung, DaSong
    • Korean Journal of Culture and Social Issue
    • /
    • v.28 no.2
    • /
    • pp.187-217
    • /
    • 2022
  • The aim of this study is to examine the psychometric properties of the Korean version of the Post-traumatic Stress Disorder Checklist for DSM-5(PCL-5). For this purpose, online surveys were conducted for two times with a one year interval using the data from 1,077 Korean adults at time 1, and 563 Korean adults at time 2. First, from the result of the confirmatory factor analysis, comparing the model fit of the 1, 4, 6, and 7-factor model, the 4, 6, and 7-factor model showed a acceptable fit, and the best fit was seen in the order of the 7, 6, 4-factor model. Second, the internal consistency, omega coefficient, construct validity, average variance extracted, and test-retest reliability results were all satisfactory.. Third, a correlation analysis with the K-PC-PTSD-5 and the sub-factors of BSI-18 was conducted to check the validity of the Korean Version of PCL-5. As a result, a positive correlation was seen with both K-PC-PTSD-5 and BSI-18. Fourth, a hierarchical multiple regression was performed to examine whether the Korean Version of PCL-5 predicts future PTSD, depression, anxiety, and somatization. As a result, the Korean Version of PCL-5 measured at time 1 significantly predicted PTSD, depression, anxiety, and somatization symptoms at time 2. Fifth, by analyzing the ROC curve, the discriminant power of PCL-5 for screening PTSD symptom groups was confirmed, and the best cut-off score was suggested. As a result of the longitudinal validation of Korean version of PCL-5, it was found that this scale is a reliable and valid measure for Korean adults. By looking into the predictive validity of the scale, it was found that the Korean version of PCL-5 can predict not only PTSD symptoms but also PTSD-related symptoms such as depression, anxiety, and somatization. Also, this study differs from previous validation studies measuring PTSD symptoms in that it suggested a cut-off score to help differentiate PTSD symptom groups.

Development and Validation of Classroom Problem Behavior Scale - Elementary School Version(CPBS-E) (초등학생 문제행동선별척도: 교사용(CPBS-E)의 개발과 타당화)

  • Song, Wonyoung;Chang, Eun Jin;Choi, Gayoung;Choi, Jae Gwang;ChoBlair, Kwang-Sun;Won, Sung-Doo;Han, Miryeung
    • Korean Journal of School Psychology
    • /
    • v.16 no.3
    • /
    • pp.433-451
    • /
    • 2019
  • This study aimed to develop and validate the Classroom Problem Behavior Scale - Elementary School Version (CPBS-E) measure which is unique to classroom problem behavior exhibited by Korean elementary school students. The focus was on developing a universal screening instrument designed to identify and provide intervention to students who are at-risk for severe social-emotional and behavioral problems. Items were initially drawn from the literature, interviews with elementary school teachers, common office discipline referral measures used in U.S. elementary schools, penalty point systems used in Korean schools, 'Green Mileage', and the Inventory of Emotional and Behavioral Traits. The content validity of the initially developed items was assessed by six classroom and subject teachers, which resulted in the development of a preliminary scale consisting of 63 two-dimensional items (i.e., Within Classroom Problem Behavior and Outside of Classroom Problem Behavior), each of which consisted of 3 to 4 factors. The Within Classroom Problem Behavior dimension consisted of 4 subscales (not being prepared for class, class disruption, aggression, and withdrawn) and the Outside of Classroom Problem Behavior dimension consisted of 3 subscales (rule-violation, aggression, and withdrawn). The CPBS-E was pilot tested on a sample of 154 elementary school students, which resulted in reducing the scale to 23 items. Following the scale revision, the CPBS-E was validated on a sample population of 209 elementary school students. The validation results indicated that the two-dimensional CPBS-E scale of classroom problem behavior was a reliable and valid measure. The test-retest reliability was stable at above .80 in most of the subscales. The CPBS-E measure demonstrated high internal consistency of .76-.94. In examining the criterion validity, the scale's correlation with the Teacher Observation of Classroom Adaptation-Checklist (TOCA-C) was high and the aggression and withdrawn subscales of the CPBS-E demonstrated high correlations with externalization and internalization, respectively, of the Child Behavior Checklist - Teacher Report Form CBCL-TRF). In addition, the factor structure of the CPBS-E scale was examined using the structural equation model and found to be acceptable. The results are discussed in relation to implications, contributions to the field, and limitations.

Developing a Tool to Assess Competency to Consent to Treatment in the Mentally Ill Patient: Reliability and Validity (정신장애인의 치료동의능력 평가 도구 개발 : 신뢰도와 타당화)

  • Seo, Mi-Kyoung;Rhee, MinKyu;Kim, Seung-Hyun;Cho, Sung-Nam;Ko, Young-hun;Lee, Hyuk;Lee, Moon-Soo
    • Korean Journal of Health Psychology
    • /
    • v.14 no.3
    • /
    • pp.579-596
    • /
    • 2009
  • This study aimed to develop the Korean tool of competency to consent to psychiatric treatment and to analyze the reliability and validity of this tool. Also the developed tool's efficiency in determining whether a patient possesses treatment consent competence was checked using the Receiver Operating Characteristic curve and the relevant indices. A total of 193 patients with mental illness, who were hospitalized in a mental hospital or were in community mental health center, participated in this study. We administered a questionnaire consisting of 14 questions concerning understanding, appreciation, reasoning ability, and expression of a choice to the subjects. To investigate the validity of the tool, we conducted the K-MMSE, insight test, estimated IQ, and BPRS. The tool's reliability and usefulness were examined via Cronbach's alpha, ICC, and ROC analysis, and criterion related validation was performed. This tool showed that internal consistency and agreement between raters was relatively high(ICC .80~.98, Cronbach's alpha .56~.83)and the confirmatory factor analysis for constructive validation showed that the tool was valid. Also, estimated IQ, and MMSE were significantly correlated to understanding, appreciation, expression of a choice, and reasoning ability. However, the BPRS did not show significant correlation with any subcompetences. In ROC analysis, full scale cutoff score 18.5 was suggested. Subscale cutoff scores were understanding 4.5, appreciation 8.5, reasoning ability 3.5, and expression of a choice 0.5. These results suggest that this assessment tool is reliable, valid and efficient diagnostically. Finally, limitations and implications of this study were discussed.

A Study on Startups' Dependence on Business Incubation Centers (창업보육서비스에 따른 입주기업의 창업보육센터 의존도에 관한 연구)

  • Park, JaeSung;Lee, Chul;Kim, JaeJon
    • Korean small business review
    • /
    • v.31 no.2
    • /
    • pp.103-120
    • /
    • 2009
  • As business incubation centers (BICs) have been operating for more than 10 years in Korea, many early stage startups tend to use the services provided by the incubating centers. BICs in Korea have accumulated the knowledge and experience in the past ten years and their services have been considerably improved. The business incubating service has three facets : (1) business infrastructure service, (2) direct service, and (3) indirect service. The mission of BICs is to provide the early stage entrepreneurs with the incubating service in a limited period time to help them grow strong enough to survive the fierce competition after graduating from the incubation. However, the incubating services sometimes fail to foster the independence of new startup companies, and raise the dependence of many companies on BICs. Thus, the dependence on BICs is a very important factor to understand the survival of the incubated startup companies after graduation from BICs. The purpose of this study is to identify the main factors that influence the firm's dependence on BICs and to characterize the relationships among the identified factors. The business incubating service is a core construct of this study. It includes various activities and resources, such as offering the physical facilities, legal service, and connecting them with outside organizations. These services are extensive and take various forms. They are provided by BICs directly or indirectly. Past studies have identified various incubating services and classify them in different ways. Based on the past studies, we classify the business incubating service into three categories as mentioned above : (1) business infrastructure support, (2) direct support, and (3) networking support. The business infrastructure support is to provide the essential resources to start the business, such as physical facilities. The direct support is to offer the business resources available in the BICs, such as human, technical, and administrational resources. Finally, the indirect service was to support the resource in the outside of business incubation center. Dependence is generally defined as the degree to which a client firm needs the resources provided by the service provider in order to achieve its goals. Dependence is generated when a firm recognizes the benefits of interacting with its counterpart. Hence, the more positive outcomes a firm derives from its relationship with the partner, the more dependent on the partner the firm must inevitably become. In business incubating, as a resident firm is incubated in longer period, we can predict that her dependence on BICs would be stronger. In order to foster the independence of the incubated firms, BICs have to be able to manipulate the provision of their services to control the firms' dependence on BICs. Based on the above discussion, the research model for relationships between dependence and its affecting factors was developed. We surveyed the companies residing in BICs to test our research model. The instrument of our study was modified, in part, on the basis of previous relevant studies. For the purposes of testing reliability and validity, preliminary testing was conducted with firms that were residing in BICs and incubated by the BICs in the region of Gwangju and Jeonnam. The questionnaire was modified in accordance with the pre-test feedback. We mailed to all of the firms that had been incubated by the BICs with the help of business incubating managers of each BIC. The survey was conducted over a three week period. Gifts (of approximately ₩10,000 value) were offered to all actively participating respondents. The incubating period was reported by the business incubating managers, and it was transformed using natural logarithms. A total of 180 firms participated in the survey. However, we excluded 4 cases due to a lack of consistency using reversed items in the answers of the companies, and 176 cases were used for the analysis. We acknowledge that 176 samples may not be sufficient to conduct regression analyses with 5 research variables in our study. Each variable was measured through multiple items. We conducted an exploratory factor analysis to assess their unidimensionality. In an effort to test the construct validity of the instruments, a principal component factor analysis was conducted with Varimax rotation. The items correspond well to each singular factor, demonstrating a high degree of convergent validity. As the factor loadings for a variable (or factor) are higher than the factor loadings for the other variables, the instrument's discriminant validity is shown to be clear. Each factor was extracted as expected, which explained 70.97, 66.321, and 52.97 percent, respectively, of the total variance each with eigen values greater than 1.000. The internal consistency reliability of the variables was evaluated by computing Cronbach's alphas. The Cronbach's alpha values of the variables, which ranged from 0.717 to 0.950, were all securely over 0.700, which is satisfactory. The reliability and validity of the research variables are all, therefore, considered acceptable. The effects of dependence were assessed using a regression analysis. The Pearson correlations were calculated for the variables, measured by interval or ratio scales. Potential multicollinearity among the antecedents was evaluated prior to the multiple regression analysis, as some of the variables were significantly correlated with others (e.g., direct service and indirect service). Although several variables show the evidence of significant correlations, their tolerance values range between 0.334 and 0.613, thereby demonstrating that multicollinearity is not a likely threat to the parameter estimates. Checking some basic assumptions for the regression analyses, we decided to conduct multiple regression analyses and moderated regression analyses to test the given hypotheses. The results of the regression analyses indicate that the regression model is significant at p < 0.001 (F = 44.260), and that the predictors of the research model explain 42.6 percent of the total variance. Hypotheses 1, 2, and 3 address the relationships between the dependence of the incubated firms and the business incubating services. Business infrastructure service, direct service, and indirect service are all significantly related with dependence (β = 0.300, p < 0.001; β = 0.230, p < 0.001; β = 0.226, p < 0.001), thus supporting Hypotheses 1, 2, and 3. When the incubating period is the moderator and dependence is the dependent variable, the addition of the interaction terms with the antecedents to the regression equation yielded a significant increase in R2 (F change = 2.789, p < 0.05). In particular, direct service and indirect service exert different effects on dependence. Hence, the results support Hypotheses 5 and 6. This study provides several strategies and specific calls to action for BICs, based on our empirical findings. Business infrastructure service has more effect on the firm's dependence than the other two services. The introduction of an additional high charge rate for a graduated but allowed to stay in the BIC is a basic and legitimate condition for the BIC to control the firm's dependence. We detected the differential effects of direct and indirect services on the firm's dependence. The firms with long incubating period are more sensitive to indirect service positively, and more sensitive to direct service negatively, when assessing their levels of dependence. This implies that BICs must develop a strategy on the basis of a firm's incubating period. Last but not least, it would be valuable to discover other important variables that influence the firm's dependence in the future studies. Moreover, future studies to explain the independence of startup companies in BICs would also be valuable.