• Title/Summary/Keyword: Test-Retest

Search Result 441, Processing Time 0.027 seconds

Investigation on Methods to Improve the Reliability of Education Satisfaction Surveys: Focused on the S University Case (교육수요자 만족도조사의 신뢰성 제고방안 탐색: S대학교 사례를 중심으로)

  • Ahn, Su-Hyun;Lee, Sang-Jun
    • Journal of Digital Convergence
    • /
    • v.15 no.12
    • /
    • pp.71-77
    • /
    • 2017
  • In order for the consumers of education and university to be mutually communicating well, satisfaction surveys with a correct system are essential. This study points out the causes for insincere responses found in the process of education satisfaction surveys while discussing possible methods to elicit sincere responses from the students. As a result of analyzing S University, it was observed that enforced online evaluation methods did have a high response rate but also monotonously insincere responses showed to have a high ration among them. A second study was carried out in order to improve the research method after confirming the reliability of the research. Study results sowed that through a representative sample survey, monotonous response patterns decreased and the data distribution satisfied normal distribution. Moreover, a focus group interview was carried out in order to understand the root causes and possible solutions to the problem. Lastly, this study revealed the need of diversified attempts and research in order to secure reliability in education satisfaction surveys while proposing methods of improvement.

Reliability and Validity of the Korean Version of the Combat Exposure Scale (한국판 전투 노출 척도의 신뢰도와 타당도)

  • Kim, Dong Su;Chung, Hae Gyung;Choi, Jin Hee;So, Hyung Seok;Kim, Hae Jung;Go, Chang Min;Kim, Tae Yong;Chung, Moon Yong
    • Anxiety and mood
    • /
    • v.8 no.2
    • /
    • pp.106-112
    • /
    • 2012
  • Objective : In posttraumatic stress disorder (PTSD), it is essential to evaluate the severity of trauma with a reliable instrument. The combat exposure scale (CES) is one of the most widely used measures for the combat-related trauma. The present study was conducted to test the reliability and validity of the Korean version of CES (CES-K). Methods : One hundred and forty-five male Korean veterans of the Vietnam War participated in this study. CES-K, the structured clinical interview for DSM-III-R (SCID), clinician administered PTSD scale (CAPS), and the Korean version life events checklist (LEC-K) were administered. Results : Cronbach's coefficient of CES-K was .85, and the test-retest reliability was .94. The mean [standard deviation (SD)] scores of CES-K were 20.4 (9.0) in the PTSD group and 12.0 (8.6) in the non-PTSD group (p<.001). CES-K showed a significant correlation with LEC-K (r=.31, p<.001) and CAPS (r=.52, p<.001). Only one factor was revealed by the factor analysis. Conclusion : CES-K showed good reliability and validity for assessing the severity of combat exposure. Further, it demonstrated comparable psychometric properties to the previous study. It is expected that CES-K will be a useful tool for evaluating the severity of combat exposure in Korea.

The Development and Validity of a Scale for Measuring Mother's Reaction to Children's Negative Emotions (아동의 부정적 정서표현에 대한 어머니 반응 척도 개발과 타당화)

  • Oh, Ji Hyun
    • Korean Journal of Child Studies
    • /
    • v.34 no.6
    • /
    • pp.97-122
    • /
    • 2013
  • The aim of this study was to develop and validate measures of a mother's reaction to children's negative emotions. After construct factors of a mother's reaction to children's negative emotions based on the theoretical basis and existing scales were explored, the first preliminary items were extracted. After the content validity was confirmed by expert opinions, the second preliminary items were composed, and the initial survey was carried out. Using exploratory factor analysis, three principal factors and 21 items were revealed to be most suitable. The factors of the scale consist of emotion-coaching-reactions, oversensitive reactions, and emotion-minimizing-reactions, respectively. In addition, the reliability analysis and validation analysis of the scale was conducted, by means of surveying 413 elementary students. The internal coherence reliability and test-retest reliability were verified as was the general internal coherence and timing stability of the scale. There were three additional verifications to validate the scale. (1)For the evidence based on internal structure, the confirmatory factor analysis and convergent-discriminant evidence; this resulted in confirming the factor structure of the scale as being reliable. (2)In order to understand the relationships to other variables, the correlation analysis came in effect to the overall scale and each of its sub-factors, showing that they are significantly correlated with the scale of the child's perception on rearing attitudes of the mother. (3)As for evidence based on the consequences of the test, the correlation analysis produced a result showed that sub-factors of the scale have as significant correlation with the child's emotional intelligence and resilience.

Development and Validation of Short Form of the Normal Depression Scale for Individual Screening (개인선별용 일상우울척도 단축형의 개발 및 타당화)

  • Lee, Soonmook;Kim, Jong-Nam;Chae, Jungmin;Choi, Seungwon;Seo, Dong Gi
    • Stress
    • /
    • v.26 no.4
    • /
    • pp.277-289
    • /
    • 2018
  • Background: The purpose of this study is to develop a short form of the normal depression scale for individual use in the school, health, industry, organization, and counseling settings, based on the original normal depression scale (17 items). Methods: To achieve this purpose, we selected five items from the original test and analyzed data using Mplus 7.4 and SPSS 21.0. Results: The normal depression scale-short form consists of 5 items. The reliability of the short form (test-retest reliability) was good. The content validity and internal structure validity (1 factor model) were verified. The cut score between normal and dysfunctional depression was determined to be 18. Conclusions: The normal depression scale-short form for individual screening is verified to have good reliability and validity, so it is expected to be useful to perform quick screening of normal depression in the practical settings.

Reliability of Quantifying Maximal Mouth Opening and Lateral Mandibular Shift in Individuals With and Without Temporomandibular Disorder Using Three-dimensional Ultrasound-based Motion Analysis

  • Oh, Jae-seop;Kim, Si-hyun;Kyung, Moon-su;Park, Kyue-nam
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.99-105
    • /
    • 2019
  • Background: Although magnetic resonance imaging is accurate, it is expensive to measure the movement of temporomandibular joint. The three-dimensional (3D) motion analysis system is an inexpensive measurement tool. Objects: This study examined the reliability of quantifying the mouth opening and lateral mandibular shift and differences between individuals with and without temporomandibular disorder (TMD) using the hygienic method of surface markers on the skin with 3D ultrasound-based motion analysis. Methods: This study included 24 subjects (12 with and 12 without TMD). Temporomandibular joint motion during mouth opening was recorded using two surface markers with 3D ultrasound-based motion analysis. An intraclass correlation coefficient [ICC (3,k)] was used to confirm the intrarater reliability of quantifying kinematic temporomandibular joint motion, and an independent t-test was used to evaluate differences in maximal mouth opening and lateral mandibular shift between the two groups. Results: Assessment of mouth opening and lateral mandibular shift showed excellent test-retest reliability with low standard error of measurement. The lateral mandibular shift and opening-lateral mandibular shift ratio were significantly increased in the TMD group during maximum mouth opening (p<.05). However, no significant difference in maximal mouth opening was observed between the groups with and without TMD (p>.05). Conclusion: This hygienic and simple surface marker method can be used to quantify the mouth opening and lateral mandibular shift at the end-range of mouth opening. The TMD group showed an increased lateral mandibular shift movement at the end-range of mouth opening. The lateral mandibular shift movement can be regarded as a symptom in the diagnosis and treatment of TMD.

Development of human rights indicators for dental hygiene students (치위생(학)과 학생들의 인권 실태 지표 개발: 치과의료기관 임상실습을 중심으로)

  • Won, Yoon-Ah;Noh, Hie-Jin;Mun, So-Jung;Chung, Won-Gyun;Park, Bo-Young;Sim, Eun-Bi;Choi, Eun-Mi
    • Journal of Korean society of Dental Hygiene
    • /
    • v.21 no.3
    • /
    • pp.291-300
    • /
    • 2021
  • Objectives: This study aimed to develop human rights indicators through reliability and validity tests in order to measure the human rights situation of dental hygiene students who experience clinical practice at dental clincs. Methods: The basic framework of questions was constructed through literature review. Nine experts were tested for validity of the contents of the experts twice. The main survey was conducted on 121 students in the 3rd and 4th grade who were enrolled in the department of dental hygiene located in Seoul, Gyeonggi and Gangwon-do. Validity was tested through exploratory factor analysis, and reliability was tested through internal reliability coefficient and test-retest method. Results: The cronbach's α value was 0.734, and the Kappa coefficient was 0.584. The result of the reliability and validity test was composed of 11 questions and 3 factors. Conclusions: During the practice of a dental institution, the validity and reliability of the indicators that can grasp the human rights status of dental hygiene students were tested. It is expected that the indicators of this study will be provided an opportunity to understand the human rights situation of dental hygiene students and to improve problems such as human rights violations.

Reliability in longitudinal study (종단적 연구의 신뢰도)

  • Jinuk Kim
    • The Korean Journal of Applied Statistics
    • /
    • v.37 no.1
    • /
    • pp.61-72
    • /
    • 2024
  • The purpose of this study is to investigate retest reliabilities in longitudinal study, the same test is administered repeatedly over time. Linear mixed models were used to establish various situations of tests occurred in longitudinal study. Combination of two types of true value and three types of systematic error was considered. In order to apply the models to real longitudinal data, height data from the Berkeley growth study and vocabulary score data from the University of Chicago experimental school were used. Using the mixed model, there is an advantage that the reliability can be determined by selecting the covariance structure of the true value and the error separately. However, in order to properly analyze the reliability, researchers need to consider variations that can occur in measurement, such as characteristics of subject, the test, and the the treatment applied in the study. And the proper model should be selected and the quality of the measurement should be evaluated for each trial.

A Study of the Reliability and the Validity of Clinical Data Interchange Standards Consortium(CDISC) based Nonphamacy Dementia Diagnosis Contents(Co-Wis) (국제임상데이터표준(CDISC TA)기반 비약물성 치매진단콘텐츠(Co-Wis)의 신뢰도 및 타당도에 대한 연구)

  • Jun, Ji-Yun;Song, Seung-Il;Park, Jung Pil
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.7
    • /
    • pp.638-649
    • /
    • 2019
  • The purpose of this study was to investigate the usefulness of the cognitive function test tool in the clinical or multi-life environment for the elderly and high-risk demented subjects after the development of the non-clinical dementia early diagnosis test content(Co-Wis) based on the contents of the International Clinical Data Standard(CDISC TAUG-Alzheimer's v 2.0, SDTMIG v3.3) And to verify the validity and reliability of the data. To do this, after searching for dementia diagnosis process, we developed a non-clinical dementia diagnosis content(Co-Wis) that can supplement the shortcomings of the existing paper test. We selected 30 subjects from elders who were over 60 years old and verified the validity of test and the reliability of retest among cognitive domains of the Korean MMSE-K, Seoul Neuropsychological Test(SNSB-II) and non-medication dementia diagnosis content(Co-Wis). As a result, we showed high correlation and reliability in all cognitive domains. However, the limitations of insufficient subjects and regional distribution were identified. Based on the results of the study, we discussed the necessity of supplementing and expanding further studies such as various methods of verifying validity and reliability.

Development of Measurement Scale for Korean Scaling Fear-1.0 and Related Factors (한국형 스켈링공포(KSF 1.0)의 측정도구 개발 및 관련요인)

  • Cho, Myung-Sook;Lee, Sung-Kook
    • Journal of dental hygiene science
    • /
    • v.9 no.3
    • /
    • pp.327-338
    • /
    • 2009
  • This study was to develop an instrument for multidimensional measurement of Korean scaling fear (KSF)-1.0 and analyze related factors. A sample of 720 subjects(scaling patients and community people) was studied in Daegu city from November in 2008 to March in 2009. Authors first conceptualized the KSF, item generation, item reduction, and questionnaire formatting were performed in the stage of the development. Item descriptive, missing%, item internal consistency, and item discriminant validity were analyzed in the item-level, also descriptive, floor and ceiling effect were analyzed in the scale-level. Cronbach's alpha, test-retest, inter-dimension correlations, and factor analysis were performed to evaluate the validity and reliability in the new instrument. Confirmative factor analysis was did to evaluate the fit of model. The results for item-level and scale-level were acceptable except item discriminant validity. The reliability for 0.92~0.96 of corelation coefficient range(Cronbach's alpha 0.96~0.98) was high in the test-retest, and there was no significant difference in paired t-test. Item internal consistency(range of pearson corelation coefficient 0.39~0.95) was also high. The result of explanatory factor analysis was the same as the intended dimension structure, also confirmatory factor analysis results revealed that the dimensional structure model were fined well in the evaluation of model fit($x^2$= 1245.66, df=146, p=0.0000; GFI=0.85; AGFI=0.80; RMSEA=0.10). Factors related to KSF by multiple regression were gender($\beta$=0.28, p=0.0004) and teeth brush method($\beta$=-0.15, p=0.0053) in scaling patients, also gender($\beta$=0.25, p=0.0002), educational level($\beta$=0.14, p=0.0155), teeth brush method($\beta$=-0.09, p=0.0229) and time of daily work out($\beta$=-0.10, p=0.0055) were significantly associated with KSF in no scaling group. In conclusion, The results of this study reveal that the new developed measurement scale was reliable and val id instrument for measuring the KSF in dental hygiene patients and community people. We recommend that further research should develop more the instrument for the Korean scaling fear.

  • PDF

Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores - (우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 -)

  • Jang, Mi Jin;Shin, Sangah;Kim, Seong-Ah;Chung, Sangwon;Paik, Hee Young;Choe, Jeong-Sook;Hong, Eun Joo;Joung, Hyojee
    • Journal of Nutrition and Health
    • /
    • v.47 no.5
    • /
    • pp.351-363
    • /
    • 2014
  • Purpose: The aim of this study was to develop a reliable measurement tool to assess the urban food environment, particularly focusing on food stores in Korea. Methods: The items for the measurement tool were selected through systematic literature reviews and adjusted to the Korean food environment. A total of 25 food stores in an urban area were recruited for the pilot test to evaluate the time required for completion of the survey, ease of response, willingness to participate, difficulties in conducting the survey, and appropriateness, and 34 food stores were recruited for assessment of the reliability of the tool using percent agreement and kappa value. Results: The measurement tool is composed of questions regarding food store characteristics, accessibility, and food availability. On average, 26 minutes was required to survey a single food store, and the subjects and interviewers answered that the process was not difficult for the survey. The percent agreement for the inter-rater and test-retest reliability ranged from 93.9~98.8% and 91.9~97.9, respectively. The kappa values ranged from 0.78 to 0.97, which was very high. Percent agreement and kappa value of food with healthy option were lower than those of the general food in the inter-rater reliability (p = 0.0027, p = 0.0095 respectively) as well as in the test-retest reliability (p = 0.0081, p = 0.0290, respectively), although they were still high enough (86.4~98.0% for percent agreement, 0.64~0.96 for kappa value). Conclusion: The newly developed measurement tool for assessment of food store environment appears to be feasible and reliable; therefore, it can be applied to research on the association between food environment and dietary behaviors as well as health outcomes.