• Title/Summary/Keyword: Diagnostics reliability and validity

Search Result 18, Processing Time 0.027 seconds

Reliability Study of the Pattern Identification Questionnaire Developed by Korean Institute of Oriental Medicine (한국한의학연구원 개발 변증설문지의 신뢰도 연구)

  • Kim, Bum-Su;Lim, Jung-Hwa;Lee, Min-Hee;Yun, Young-Ju
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.17 no.1
    • /
    • pp.29-44
    • /
    • 2013
  • Objectives This study is aimed at assessing the reliability of the Pattern identification questionnaire (PIQ) developed by Korea Institute of Oriental Medicine and examining the validity of the PIQ by comparing the pattern identification scores of different groups. Methods We conducted a survey of 258 participants (79 teachers and 179 graduate students at one School of Korean Medicine) using self-reported questionnaire and all the samples were retested. The test-retest reliability was assessed by Kappa coefficient(${\kappa}$) and Pearson correlation coefficient. Also we compared the differences in pattern identification scores according to sex, age and occupation. Results 1. One of 116 questions are impossible to calculate; 22 of them (18.97%) scored under 0.4 in ${\kappa}$; 90(77.59%) ranged from 0.4 to 0.8 in ${\kappa}$; and three questions (3.58%) scored 0.8 or over in ${\kappa}$. 2. Pearson correlation coefficients between test score and retest score of all pattern identification items are 0.4 or over. 3. The mean score for pattern identification in women was generally higher than that in men, particularly in patterns of blood-deficiency, blood-stasis, yang-deficiency and kidney disease. 4. The mean score for pattern identification in the graduate student group was generally higher than that in the teacher group. Conclusion In test-retest reliability, the PIQ showed relatively high reliability. The mean pattern identification score showed differences in regards to retaining knowledge about Korean medicine. Therefore, future research involving modification of questionnaire items and confirming the validity of this questionnaire is required.

Development of Questionnaires for Pathogenesis Analysis of Bojungikgitang Symptom( II ) (보중익기탕증(補中益氣湯證)의 병인론적(病因論的) 분석을 위한 설문문항(說問問項) 개발(開發)( II ))

  • Yoon, Tae-Deug;Park, Young-Jae;Lee, Sang-Chul;Park, Young-Bae;Oh, Hwan-Sup
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.11 no.2
    • /
    • pp.45-58
    • /
    • 2007
  • Background and purpose: We previously developed questionnaire of Bojungikgitang systom on the Delphi method through the pathogenesis analysis. But developed a questionnaire was not verified in the clinical. So, to ensure objectivity, quantification and validity, verification is needed for questionnaire items before applying a clinical. On this study, we looked at whether questionnaire items had been validity in the clinical. Methods: Surveys conducted about 191 patients at 12 oriental medicine hospitals. Among them, patients with Bojungikgitang systom(group I) were 95, and patients with no Bojungikgitang systom(group II) were 96. We calculated that the sum of each item in the survey and then the sum was reviewed statistically significant difference through Independent samples T test between group I and II. Results: Between group I and II, the total sum survey of the percent difference is meaningful (P<0.05). Conclusions: Reliability analysis of the Bojungikgitang systom survey research is needed in the future. Also I think that research should proceed about a lot of people.

  • PDF

Development on the Questionnaire of Cold-Heat Pattern Identification Based on Usual Symptoms: Reliability and validation Study (평소 증상 기반 한열변증 설문지의 신뢰도 및 타당도 연구)

  • Bae, Kwang Ho;Jang, Eun Su;Park, Kihyun;Lee, Youngseop
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.32 no.5
    • /
    • pp.341-346
    • /
    • 2018
  • The aims of this study were to evaluate the reliability and validity of the cold and heat pattern identification questionnaire (CHPIQ). From July 2015 to December 2015, 120 participants, university faculties, filled out CHPIQ by the way of self-reporting. Then two Korean medical doctors independently diagnosed them whether they belonged to cold pattern (CP) or not, and heat pattern (HP) or not. We evaluated the internal consistency using Cronbach's alpha coefficient, and the validity using the sensitivity and specificity through receiver operating characteristic-curve. The internal consistency (Cronbach's alpha coefficient) showed 0.754 (CP) and 0.753 (HP). The area under the curve was recorded with 0.884 (CP) and 0.786 (HP). The agreements between CHPIQ and experts were 82.8% (CP) and 72.9% (HP). The sensitivities showed 0.707 (CP) and 0.719 (HP), and the specificities were 0.935 (CP) and 0.736 (HP). This study suggests that CHPIQ is a reliable and valid instrument for estimating cold-heat pattern identification.

Firework plot for evaluating the impact of influential observations in multi-response surface methodology (다반응 반응표면분석에서 특이값의 영향을 평가하기 위한 불꽃그림)

  • Kim, Sang Ik;Jang, Dae-Heung
    • The Korean Journal of Applied Statistics
    • /
    • v.31 no.1
    • /
    • pp.97-108
    • /
    • 2018
  • It has been routine practice in regression analysis to check the validity of the assumed model by the use of regression diagnostics tools. Outliers and influential observations often distort the regression output in an undesired manner. Jang and Anderson-Cook (Quality and Reliability Engineering International, 30, 1409-1425, 2014) proposed a graphical method (called a firework plot) so that there could be an exploratory visualization of the trace of the impact of the possible outliers and influential observations on individual regression coefficients and the overall residual sum of the squares measure. This paper further extends a graphical approach to a multi-response surface methodology problem.

The Analysis on the Reliability of Measuring Pulse-Respiration Ratio (맥솔(脈率) 측정방법(測定方法)의 신뢰도(信賴度) 분석(分析))

  • Kim, Dong-Hoon;Yang, Dong-Hoon;Huh, Woong;Park, Young-Jae;Park, Young-Bae
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.9 no.2
    • /
    • pp.123-144
    • /
    • 2005
  • Objectives: Pulse-Respiration Ratio has been used for estimating subject's Han-Yeol [寒熱] status since it mentioned in suwen [素問]. In practicing Pulse-Respiration Ratio over 5 means the status of Yeol [熱], Pulse-Respiration Ratio below 3 means the status of Han [寒]. We performed this study to examine the Optimum Standard for Measuring Pulse-Respiration Ratio on the Basis of Repeatability and Reproducibility. Methods: After subject's 5 minutes rest we measured subject's ECG, respiration pattern, EEG, EMG simultaneously. In this research examiner's number is two, subject's number is four, and the number of repeat is two. We calculated Pulse-Respiration Ratio through dividing Respiration cycle average by Pulse cycle average according to each standard including time section, $EEG(relative-{\alpha}$ density, $relative-{\beta}$ density, ${\alpha}/{\beta}$ and EMG. We analyzed these data through Gage R&R study using MINITAB 13.20 program and considered the results of below 30 %R&R and over 4 Number of Distinct Categories to have a significance. Results: 1. In the applying of time standard, Pulse-Respiration Ratio from section 3, 4, 6, 8 had a significant meaning in the aspect of Repeatability and Reproducibility. 2. In the applying of $EEG({\alpha}$ I , ${\beta}$ I , ${\alpha}/{\beta})$, EMG(E I) standard, there was no significant results. 3. In the applying of time standard(section 5, 6, 7), $EEG({\alpha}$ I , ${\beta}$ I , ${\alpha}/{\beta})$ and EMG(E I) standard simultaneously, Pulse-Respiration Ratio from ${\alpha}/{\beta}$ in section 6, ${\beta}$ I in section 8 had a significant meaning in the aspect of Repeatability and Reproducibility. Conclusions: We can suggest the Optimum Standard for Measuring Pulse-Respiration Ratio on the basis of Repeatability and Reproducibility as followings; 1. Pulse-Respiration Ratio Measuring time should be at least 15 minutes. 2. Applying of time(section 6, 8) and $EEG({\beta}$ I, ${\alpha}/{\beta})$ standard simultaneously is recommended considering reliability and validity but more study is needed. 3. EMG(E I) may be helpful to detect the segment of physical rest and exclude artifacts but more study is needed.

  • PDF

Development on the Questionnaire of Cold-Heat Pattern Identification Based on Usual Symptoms for Health Promotion - Focused on Reliability Study (건강 증진을 위한 평소 증상 기반의 한열변증 설문지 개발 - 신뢰도를 중심으로)

  • Yeo, Minkyung;Park, Kihyun;Bae, Kwangho;Jang, Eunsu;Lee, Youngseop
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.30 no.2
    • /
    • pp.116-123
    • /
    • 2016
  • This study was performed to develop questionnaire of cold-heat pattern identification(PI) based on usual symptoms for general people, and we analyzed reliability of the questionnaire. We reviewed cold-heat PI questionnaire of advanced research and selected twenty-three items through three time experts meeting. Three hundred and fifty nine healthy subjects were joined in this study. As a results, Cronbach's α of cold-heat PI questionnaire was 0.79 and 0.83. According to the factor analysis about fifteen-chosen cold-heat PI questionnaires, each cold-heat consisted of two factors and each Convergence was 56.46% and 65.93%. Intra-class Correlation Coefficient was 0.67-0.83. Based on the median of samples of primary source, we classified subjects into four category as Cold, Heat, No Cold-Heat, and Cold-heat complex. We examined agreement of diagnosis and coefficient of kappa, and agreement rate of diagnosis was 64.2%, and coefficient of kappa was 0.51. Based on research result, we expect that validity study about questionnaire of cold-heat PI based on usual symptoms will be continued, and hope to be used as subsidiary diagnosis in clinical practice.

Development on the Questionnaire of Cold-Heat Pattern Identification Based on Usual Symptoms for Health Promotion - Focused on Agreement Study (건강 증진을 위한 평소 증상 기반의 한열변증 설문지 개발 - 일치도를 중심으로)

  • Bae, Kwang-Ho;Yoon, Youngheum;Yeo, Minkyung;Kim, Ho-Seok;Lee, Youngseop;Lee, Siwoo
    • Journal of Society of Preventive Korean Medicine
    • /
    • v.20 no.2
    • /
    • pp.17-26
    • /
    • 2016
  • Objectives : We presented the results of reliability study in advance, and analyzed agreement between Korean medicine doctors(KMDs)' diagnosis and cold-heat pattern identification questionnaire(CHPI)'s diagnosis. Methods : This survey was conducted from May 16 to 17, 2015. The subjects were 93 adults living in rural society. Diagnosis of CHPI was performed by 2 KMDs who have clinical experience more than 5 years. The KMDs' diagnosis was set as a reference index, and then we compare 23 items(cold pattern 11 items and heat pattern 12 items) of CHPI questionnaire and 15 items(cold pattern 8 items and heat pattern 7 items) that were brief form of it. We had cut-off value by standard of KMDs' diagnosis using receiver operating characteristic-curve(ROC-curve), with which we calculated agreement including kappa value. Correlation analysis between CHPI evaluation score by KMDs and by the questionnaire was fulfilled as well. Results : Agreement about 11 and 8 cold pattern items showed 87.1% together, and the value of kappa each recorded 0.742 and 0.741. Agreement about 12 and 7 heat pattern items suggested 81.7% and 78.5%, and the value of kappa showed 0.634 and 0.570. Correlation coefficients were 0.803 of 11 items and 0.761 of 8 items about cold pattern. In addition, correlation coefficients were 0.789 of 12 items and 0.767 of 7 items about heat pattern. The significant probability (p-value) was under 0.001. Conclusions : We have developed CHPI questionnaire involving reliability and agreement based on usual symptoms, and hope additional complements so that Korean medicine diagnostics and Korean preventive medicine would be improved.

Presentation on Research Trends and Suggestion for further research and education on Objective Structured Clinical Examination and Clinical Performance Examination in Korean Medicine Education: Scoping Review (한의학교육에서 객관구조화진료시험과 진료수행평가에 대한 연구 동향과 후속 연구 및 교육에 대한 제언: 주제범위 문헌고찰)

  • Shin, Jinyeong;Go, Yerim;Song, Changjin;Cho, Eunbyul;Leem, Jungtae
    • Journal of Society of Preventive Korean Medicine
    • /
    • v.26 no.2
    • /
    • pp.87-112
    • /
    • 2022
  • Objectives : This study reviewed existing studies on clinical examination of Korean medicine to investigate the trends and gaps of existing research on clinical performance examination (CPX) or objective structured clinical examination (OSCE) in Korean medicine education. Methods : We conducted a scoping review according to the five steps suggested by Arksey and O'Malley. Six databases(RISS, OASIS, KMBASE, KISS, ScienceON, and DBpia) were searched and studies published from 2012 to July 15, 2022 were considered. The subjects of the study were limited to domestic studies about OSCE or CPX conducted in Korean medicine education. Results : Among the 25 selected papers, 17 studies implemented OSCE or CPX in practice. Those studies were conducted in 8 clinical departments and 9 of them used standardized patients. All 14 survey studies reported positive answers in satisfaction, efficacy, and self-assessment. OSCE, CPX scoring items were developed by modifying existing tools or developing through expert surveys or through literature review and significant cases. Conclusions : This study is expected to be used as basic data for following studies and promote clinical examination. From now on, the colleges of Korean medicine should proceed research on large-scale students about extended subjects through various research methods to obtain objective results that can be generalized and acquire validity and reliability. In order to promote such research, it is necessary to induce cooperation from institutions related to Korean Medicine and local universities to develop modules, implement, and conduct post-evaluation.