• Title/Summary/Keyword: Test-retest Method

Search Result 88, Processing Time 0.023 seconds

Investigation on Methods to Improve the Reliability of Education Satisfaction Surveys: Focused on the S University Case (교육수요자 만족도조사의 신뢰성 제고방안 탐색: S대학교 사례를 중심으로)

  • Ahn, Su-Hyun;Lee, Sang-Jun
    • Journal of Digital Convergence
    • /
    • v.15 no.12
    • /
    • pp.71-77
    • /
    • 2017
  • In order for the consumers of education and university to be mutually communicating well, satisfaction surveys with a correct system are essential. This study points out the causes for insincere responses found in the process of education satisfaction surveys while discussing possible methods to elicit sincere responses from the students. As a result of analyzing S University, it was observed that enforced online evaluation methods did have a high response rate but also monotonously insincere responses showed to have a high ration among them. A second study was carried out in order to improve the research method after confirming the reliability of the research. Study results sowed that through a representative sample survey, monotonous response patterns decreased and the data distribution satisfied normal distribution. Moreover, a focus group interview was carried out in order to understand the root causes and possible solutions to the problem. Lastly, this study revealed the need of diversified attempts and research in order to secure reliability in education satisfaction surveys while proposing methods of improvement.

Development of human rights indicators for dental hygiene students (치위생(학)과 학생들의 인권 실태 지표 개발: 치과의료기관 임상실습을 중심으로)

  • Won, Yoon-Ah;Noh, Hie-Jin;Mun, So-Jung;Chung, Won-Gyun;Park, Bo-Young;Sim, Eun-Bi;Choi, Eun-Mi
    • Journal of Korean society of Dental Hygiene
    • /
    • v.21 no.3
    • /
    • pp.291-300
    • /
    • 2021
  • Objectives: This study aimed to develop human rights indicators through reliability and validity tests in order to measure the human rights situation of dental hygiene students who experience clinical practice at dental clincs. Methods: The basic framework of questions was constructed through literature review. Nine experts were tested for validity of the contents of the experts twice. The main survey was conducted on 121 students in the 3rd and 4th grade who were enrolled in the department of dental hygiene located in Seoul, Gyeonggi and Gangwon-do. Validity was tested through exploratory factor analysis, and reliability was tested through internal reliability coefficient and test-retest method. Results: The cronbach's α value was 0.734, and the Kappa coefficient was 0.584. The result of the reliability and validity test was composed of 11 questions and 3 factors. Conclusions: During the practice of a dental institution, the validity and reliability of the indicators that can grasp the human rights status of dental hygiene students were tested. It is expected that the indicators of this study will be provided an opportunity to understand the human rights situation of dental hygiene students and to improve problems such as human rights violations.

Evaluation of Variation Method to Improve the Sensitivity of Immunoradiometric Assay (면역방사계수측정법의 민감도 향상을 위한 변법의 평가)

  • Won-Hyun Kwon;Mi-Ji Kang;;Ji-Sol Park;Jung-In Kim;Kyung-Jae Lee
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.27 no.1
    • /
    • pp.29-35
    • /
    • 2023
  • Purpose The concentration of PSA (Prostate Specific Antigen) after radical prostatectomy in prostate cancer patients is a predictor of biochemical recurrence, and the AUA (American Urological Association) is defined as biochemical recurrence when the concentration of PSA is measured at 0.2 ng/mL or more, and when the concentration is measured at 0.2 ng/mL or more at the retest. This standard is also applied our hospital. In this laboratory, the PSA reagent using IRMA (Immunoradiometric Assay) is used, and the sensitivity at a very low value was not as good as the reagent used in the department of laboratory medicine. This study aims to increase the reliability of the results by improving the precision and sensitivity of very low values. Materials and Methods As a reagent for the study, PSA reagent using IRMA was used. As a method to improve the precision and sensitivity of very low values, a variation method on the serum volume(25 uL, 50 uL, 100 uL, 200 uL) was studied, and variation usefulness evaluation was conducted. The evaluation items were compared the results of precision, analytical sensitivity, recovery rate, dilution test, high-dose hook effect test, parallel test and very low concentration values(n = 20). Results The validation results were displayed in the order of 25 uL, 50 uL, 100 uL, 200 uL. As the serum volume increased, it was confirmed that CV (Coefficient of Variation)(%) improved. Analytical sensitivity(ng/mL) was 0.038, 0.041, 0.017, 0.015 and recovery rate(%) was 101±3, 101±3, 99±2, 97±4. very low concentration values(ng/mL) between each volume(n=20) were 0.135±0.068, 0.076±0.050, 0.048±0.034, 0.046±0.034. and high dose hook effect appeared as the serum volume increased. Conclusion Through the variation usefulness evaluation, it was confirmed that as the serum volume increased, the precision and sensitivity improved at very low concentration values. However, it is necessary to pay special attention to the occurrence of high-dose hook effect as the serum volume increases. In the case of tests that requires very low concentration values, it is thought that the reliability of the result will be increased if the variation method is properly used after the variation usefulness evaluation.

  • PDF

Development of Measurement Scale for Korean Scaling Fear-1.0 and Related Factors (한국형 스켈링공포(KSF 1.0)의 측정도구 개발 및 관련요인)

  • Cho, Myung-Sook;Lee, Sung-Kook
    • Journal of dental hygiene science
    • /
    • v.9 no.3
    • /
    • pp.327-338
    • /
    • 2009
  • This study was to develop an instrument for multidimensional measurement of Korean scaling fear (KSF)-1.0 and analyze related factors. A sample of 720 subjects(scaling patients and community people) was studied in Daegu city from November in 2008 to March in 2009. Authors first conceptualized the KSF, item generation, item reduction, and questionnaire formatting were performed in the stage of the development. Item descriptive, missing%, item internal consistency, and item discriminant validity were analyzed in the item-level, also descriptive, floor and ceiling effect were analyzed in the scale-level. Cronbach's alpha, test-retest, inter-dimension correlations, and factor analysis were performed to evaluate the validity and reliability in the new instrument. Confirmative factor analysis was did to evaluate the fit of model. The results for item-level and scale-level were acceptable except item discriminant validity. The reliability for 0.92~0.96 of corelation coefficient range(Cronbach's alpha 0.96~0.98) was high in the test-retest, and there was no significant difference in paired t-test. Item internal consistency(range of pearson corelation coefficient 0.39~0.95) was also high. The result of explanatory factor analysis was the same as the intended dimension structure, also confirmatory factor analysis results revealed that the dimensional structure model were fined well in the evaluation of model fit($x^2$= 1245.66, df=146, p=0.0000; GFI=0.85; AGFI=0.80; RMSEA=0.10). Factors related to KSF by multiple regression were gender($\beta$=0.28, p=0.0004) and teeth brush method($\beta$=-0.15, p=0.0053) in scaling patients, also gender($\beta$=0.25, p=0.0002), educational level($\beta$=0.14, p=0.0155), teeth brush method($\beta$=-0.09, p=0.0229) and time of daily work out($\beta$=-0.10, p=0.0055) were significantly associated with KSF in no scaling group. In conclusion, The results of this study reveal that the new developed measurement scale was reliable and val id instrument for measuring the KSF in dental hygiene patients and community people. We recommend that further research should develop more the instrument for the Korean scaling fear.

  • PDF

A Study on Reliability and Applicability of Oriental Medical Music Therapy Using (음악요법의 한의학적 활용을 위한 신뢰도 및 적용 가능성 연구)

  • Song, Min Sun;Choi, Chan Hun
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.28 no.6
    • /
    • pp.674-682
    • /
    • 2014
  • The purpose of this study was to identify the effect of applying oriental music therapy and reliability of electroencephalogram(EEG) equipment. The study was approved by the critical trial judge committee from ${\bigcirc}{\bigcirc}$(IRB No. 2013-07) university. In order to measure test-retest reliability for 15 subjects, EEG for same participants were measured using same method mentioned above after 2 hours from the first measurement. Same provider implemented to each person at same time. Firstly, EEG was measured for 5 minutes after the subject with attached electrodes sat on chair comfortably for 10 minutes. Then, the subject was given mental stress using the four fundamental arithmetic operations for 5 minutes, and measured EEG for another 5 minutes. After that the subject sat on the chair comfortably listening oriental medicine music therapy for 5 minutes, and EEG was measured for 5 minutes again. There was no side effect regarding music therapy reported. Raw data, which was measured in each step, were converted through FFT(fast fourier transform) and analyzed after divided into certain frequency including ${\alpha}$ wave, ${\beta}$ wave, ${\theta}$ wave, immersion wave, stabilization wave, sef100 wave, and sef95 wave. Data were analyzed using wilcoxon signed rank test, Intraclass correlation coefficient(ICC), repeated measures ANOVA with the SPSS program. In test-retes method, there were significantly differences in ${\alpha}$ wave, ${\beta}$ wave, immersion wave, stability wave, ${\theta}$ wave, sef100 wave, sef95 wave. ICC has shown a high degree of reliability that it was ${\alpha}$ wave .877, ${\beta}$ wave .855, ${\gamma}$ wave .895, immersion wave .897, stability wave .816, ${\theta}$ wave .904, sef100 wave .910, sef95 wave .776. Also, there was a statistically significant difference in ${\alpha}$ wave after applying oriental music therapy. Based on these results, it is considered that average of the channel EEG and application of oriental music therapy would be practiced by increase of sample size using this machine.

Development of Yin-Deficiency Questionnaire and Examine the Reliability and Validity (음허증 측정도구의 개발 및 신뢰도 타당도 검정)

  • Lee Sang Jae;Park Jong Bae;Lee Song Shil;Kim Kwang Ho
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.18 no.2
    • /
    • pp.376-380
    • /
    • 2004
  • The purpose of this study is the develop a questionnaire for measuring Yin-Deficiency and examine the reliability and validity for its' value as a barometer for evaluating Yin-Deficiency. Questionnaire was developed according to the symptoms of Yin-Deficiency suggested in the 'Standardization of diagnostic terms and requirements of Korean Medicine', With and as a reference, each symptom has been worked on to be put on the questionnaire. Visual analogue scales(VAS) was used as a barometer for measuring frequency of manifestation of symptoms. A study was performed to measure validity and reliability of the final questionnaire for analysis. reliability of YinDQ was measured by Cronbach's alpha coefficient and test-retest method. This study utilized factor analysis and clinical validity for evaluation of validity. For the purpose of decreasing the amount of data-the number of factors, and at the same time minimize the loss of information factor analysis was performed Component factors were extracted using Principal Component Analysis. This study evaluated the clinical validity for examination of difference between the normal group and the patient group. Evaluation on the's internal consistency showed strong internal consistency with value of 0.8615. reliability from test-rest with three-week interval, followed by comparisons of the correlation coefficient and mean values of each item between the two. The Spearman correlation coefficient was 0.54-0.79. By factor analyse two factors with Eigen value of greater than 2.2 were selected. Factor 1 consists of items of 'irritable fever on the five Hearts', 'flushing of the zygomatic region in the afternoon', 'tidal fever', 'night sweats', and 'dryness on the mouth or the throat'. Factor two consists of items of 'emaciation', 'dizziness', 'insomnia', 'decreased amount of urine with yellowish color', and 'constipation'. The comparison between the patient group and the normal group showed significant differences for every ten questions. The results implies that YinDQ is a barometer with sufficient reliability and validity. The questionnaire for Yin-Deficiency may not be enough to replace the specific differential diagnosis by a doctor of Oriental medicine. Nevertheless, it can be effectively utilized as an assisting method in consultation or a method of measuring the degree of Yin-Deficiency in a group.

Accuracy and Consistency of Three-Dimensional Motion Analysis System (3차원 동작분석 시스템의 정밀도와 측정 일관성)

  • Park, Young-Hoon;Youm, Chang-Hong;Seo, Kook-Woong
    • Korean Journal of Applied Biomechanics
    • /
    • v.15 no.2
    • /
    • pp.83-92
    • /
    • 2005
  • Computer-assisted motional analysis is a popular method in biomechanical studies. Validation of the specific system and its measurement are fundamental to its application in the areas. Because the accuracy and consistency of a particular system provide the researchers with critical information to assist in making judgements regarding the degree to which inferences can be drawn from measurement data. The purpose of this study was to assess the accuracy and consistency of the Kwon3D motion analysis system. Validation parameters were five lengths from eight landmarkers in combination with the DLT reconstruction error values, digitizing monitor resolutions, and numbers of control points. With the best setting, Kwon3D's estimations of 260cm, 200cm, 140cm, 100cm, and 20cm were $260.33{\pm}.688cm$, $199.98{\pm}.625cm$, $139.89{\pm}.537cm$, $99.75{\pm}.466cm$, $20.08{\pm}.114$, respectively. There was no significant DLT error value difference between two monitor resolutions, but 0.27cm significant difference in 260cm estimation. There were significant differences in 260cm and 200cm estimations between with 33-control-point DLT error and with 17-control-point DLT error, but no in 140cm, 100cm, and 20cm estimations. Test-retest results showed that Kwon3D measurements were highly consistent with reliability coefficients alpha of .9263 and above.

The Basic Study for Building the Depression Prescription Guideline of Gamiguibi-Tang - The Evaluation of Reliability and Validity of the Depression Pattern-Identification Questionnaire - (가미귀비탕(加味歸脾湯)의 우울증 투약지침 개발을 위한 기초연구 - 우울증 변증 설문지의 신뢰도 타당도 평가 -)

  • Koo, Byung-Soo;Lee, Sang-Jae;Han, Chang-Ho;Kim, Ho-Jun;Park, Se-Hwan
    • Journal of Oriental Neuropsychiatry
    • /
    • v.20 no.4
    • /
    • pp.1-13
    • /
    • 2009
  • Objectives : As depression falls into the category of Wuljeung, Gamiguibi-Tang(Jiaweiguipitang) is the standard prescription to cure Wuljeung. This study develops a questionnaire for building the guidelines to administer Gamiguibi-Tang to depression and evaluates reliability and validity of questionnaire. Methods : With extracting the text related to depression and Gamiguibi-Tang through total 9 Korean medicine books and consulting the experts, the study selected 80 items and converted them into a questionnaire. It surveyed the neuropsychiatry professors and the medical specialists three times by Delphi method, and lastly selected 21 final items of a questionnaire. On the basis of the questionnaire, it collected total 216 samples and tested their reliability and validity. Results : 21 items all didn't reduce total Cronbach alpha coefficient and satisfied test-retest reliability. As a result of factor analysis, totally 5 factors were extracted such as mental state, sleep, accompaniment, fatigue and weakness. Finally, in comparing a depression group with a normal control group, two groups all showed meaningful difference in each 21 items' point, the sum of factor 1 to 5 items' points, and the sum of 21 items' points. Conclusions : The questionnaire on the updated depression prescription guideline of Gamiguibi-Tang satisfied both of reliability and validity. Later it can help objectifying to apply Gamiguibi-Tang to depression cure.

  • PDF

Reliability and Validity of PWI(Psychosocial Wellbeing Index) (Psychosocial Wellbeing Index의 신뢰도 및 타당도)

  • Lee, Chae-Yong;Lee, Jong-Young
    • Journal of Preventive Medicine and Public Health
    • /
    • v.29 no.2 s.53
    • /
    • pp.255-264
    • /
    • 1996
  • To study reliability and validity of PWI, this newly developed self-administered questionnaire which measures stress, was given to medical students. All respondent(133) were followed 4 weeks later and 92 were retested. Cronbach's $\alpha$ coefficient of data was 0.93. Test-retest reliability measured by Pearson's correlation coefficient was 0.72(P<0.01). Exploratory factor analysis(EFA) performed by principal axis factor method without iteration and by varimax rotation explored 13 principal components(eigenvalues > 1). After exploring 4 factor structure according to previous study results, factor 1 showed good agreement but other factors did not. Confirmatory factor analysis(CFA) showed poor fit of 4 factor model to data. In the further study, it may be considered to model that has unidimensional factor structure.

  • PDF

Assessing Reliability of Medical Record Reviews for the Detection of Hospital Adverse Events

  • Ock, Minsu;Lee, Sang-il;Jo, Min-Woo;Lee, Jin Yong;Kim, Seon-Ha
    • Journal of Preventive Medicine and Public Health
    • /
    • v.48 no.5
    • /
    • pp.239-248
    • /
    • 2015
  • Objectives: The purpose of this study was to assess the inter-rater reliability and intra-rater reliability of medical record review for the detection of hospital adverse events. Methods: We conducted two stages retrospective medical records review of a random sample of 96 patients from one acute-care general hospital. The first stage was an explicit patient record review by two nurses to detect the presence of 41 screening criteria (SC). The second stage was an implicit structured review by two physicians to identify the occurrence of adverse events from the positive cases on the SC. The inter-rater reliability of two nurses and that of two physicians were assessed. The intra-rater reliability was also evaluated by using test-retest method at approximately two weeks later. Results: In 84.2% of the patient medical records, the nurses agreed as to the necessity for the second stage review (kappa, 0.68; 95% confidence interval [CI], 0.54 to 0.83). In 93.0% of the patient medical records screened by nurses, the physicians agreed about the absence or presence of adverse events (kappa, 0.71; 95% CI, 0.44 to 0.97). When assessing intra-rater reliability, the kappa indices of two nurses were 0.54 (95% CI, 0.31 to 0.77) and 0.67 (95% CI, 0.47 to 0.87), whereas those of two physicians were 0.87 (95% CI, 0.62 to 1.00) and 0.37 (95% CI, -0.16 to 0.89). Conclusions: In this study, the medical record review for detecting adverse events showed intermediate to good level of inter-rater and intra-rater reliability. Well organized training program for reviewers and clearly defining SC are required to get more reliable results in the hospital adverse event study.