• Korean Journal of Oriental Medicine
• /
• v.12 no.2 s.17
• /
• pp.103-113
• /
• 2006

Objectives we intended to know how much did it relate with the results between the instruments of diagnosis by using methods of three factors - QSCCII, PSSC(Phonetic System for Sasang Constitution)-2004, and body measurement which are usually used in diagnosing the Sasang Constitution in clinics Methods We diagnosed Sasang constitution through QSCCII, PSSC(Phonetic System for Sasang Constitution)-2004, Body measurement as a dignosis factors and we used Kappa coefficient to estimate simularity between diagnosis factors, and SPSS 12.0K to analyze data Results and conchusions 1. The orders of agreement statistics are different in the currency of Sasang Constitution diagnosis, Soeum-in was highest and Taeum-in lowest in the the fricency of Sasang Conctitution Diagnosis in the QSCCII, Soeum-in was highest Soyang-in lowest in the PSSC and Taeum-in highest, Soyang-in lowest in the body measurement so, we analogized incorrection in Sasang Constitution Diagnosis 2. Among 443 subjects, 156 (35.3%) had same dignosis in three Sasang Constitution factors. It means agreement statistics among factors of diagnosis are very low, so it is absolutely nessessary to research connection among those, especially Soyang-in part 3. Totally, it is not robust to apply these factors on Sasang Constitution diagnosis, especially agreement statistics between two kinds of Sasang Constitution diagnosis as $0.358{\sim}0.380$. However, we can have a possibility the more we use Sasang Constitution dignosis factors, the higher the agreement statistics is, through the ascending of agreement statistics as $0.526{\sim}0.592$, among three kinds of Sasang Constitution diagnosis To evaluate accuracy of Sasang Constitution diagnosis, it is nessessary to collect data from the subjects who are dignosed through the evidences such as herb medicine, disease and normal symption observation, etc. Using these data, we have to evaluate correction of seperated Sasang Constitution diagnosis methods and to connect those.

• Journal of Convergence Korean Medicine
• /
• v.6 no.1
• /
• pp.37-42
• /
• 2024

Objectives: This study aims to evaluate the clinical validity of the system by conducting a clinical study to assess the diagnostic agreement between the system and Korean medical doctors. Methods: This study was conducted from September 7, 2023, to December 7, 2023, across five Korean medicine institutions, involving 100 adult participants aged 20-64 who consented to participate. Participants first entered their symptoms into a web-based program, which utilized an AI-based algorithm to diagnose 36 types of pattern differentiation. Subsequently, Korean medical doctors conducted face-to-face diagnoses using the same 36 types. The diagnostic agreement between the system and the doctors' diagnoses was analyzed using descriptive statistical analysis, and the results were expressed as a percentage agreement. Results: Analysis of the diagnostic data from 100 participants revealed that the web-based diagnosis support system identified an average of 7.76±0.79 patterns per patient, while Korean medical doctors identified an average of 7.99±0.10 patterns per patient. The diagnostic agreement between the system and the doctors showed an average of 7.08±1.08 patterns per patient, with an overall diagnostic agreement rate of 88.57±13.31%. Conclusion: This study developed a web-based diagnosis support system for traditional Korean medicine and evaluated its clinical validity by assessing diagnostic agreement. Comparing the diagnoses of the system with those of Korean medical doctors for 100 patients, the system showed an approximately 89% agreement rate with the clinical diagnoses. The system holds potential for aiding Korean medical doctors in pattern differentiation diagnosis in clinical practice.

• The Journal of Internal Korean Medicine
• /
• v.33 no.1
• /
• pp.1-13
• /
• 2012

Background : In oriental medicine, the status of the tongue is an important indicator to diagnose the condition of one's health, such as physiological and the clinicopathological changes of internal organs. A tongue diagnosis is not only convenient but also non-invasive, and therefore widely used in Oriental medicine. However, the tongue diagnosis is greatly affected by examination circumstances, patient's posture, and doctor's diagnosis criteria. Objectives : This study was designed to assure the necessity for standardization of tongue diagnosis based on diagnostic criteria of tongue coating thickness (TCT). Methods : Thirty tongue photographs were acquired and analyzed by digital tongue diagnosis system (DTDS) which measured the percentage of TCT on the tongue surface. Fifteen oriental medical doctors evaluated TCT in 30 photographs. Afterward, the 15 assessors were trained for diagnostic criteria of TCT and evaluated the photographs again. The intraclass correlation coefficient (ICC) was used to obtain the agreement rate among the 15 assessors and the agreement rate between assessors' TCT scores and DTDS values. Results : The agreement rate among the 15 assessors after training was higher than before training. The agreement rate between assessors' TCT scores and DTDS values after training was also higher than before training. Furthermore, the difference of the agreement rate between before and after training was significant (p<0.05). Conclusions : The standardization of diagnostic criteria of TCT increased the agreement rate among the assessors and the agreement rate between assessors' TCT scores and DTDS values. Therefore, the standardization of diagnostic criteria is expected to contribute to the objectification and quantification of the tongue diagnosis system.

• The Journal of the Society of Korean Medicine Diagnostics
• /
• v.10 no.1
• /
• pp.78-97
• /
• 2006

Background: There was seldom study about method that estimate expertness of pulse diagnosis in 8 Constitution Medicine in spite of the diagnostician importance in 8 Constitution Medicine Objectives: This study is to evaluate diagnostician's consistency and accuracy about pulse diagnosis in 8 Constitution Medicine using Cage R&R study. Methods: The subjects were comprised of 28 volunteers. Among theme, 3 diagnosticians and 10 participants were chosen through questionnaire. Diagnosticians diagnosed participant's Constitution by pulse diagnosis in 8 Constitution Medicine with hiding their eyes by eyepatch. MINITAB statistical software(ver. 13.20) was used for statistical analysis: Attribute Cage R&R study was used to verify the results. Results: 1. In the measurements of consistency, diagnostician b(agreement=80%, Value of k=0.8276)was very good, diagnostician a(agreement=70%, Value of k=0.7465) was good, and diagnostician c(agreement=50%, Value of k=0.5365) was moderate. 2. In the measurements of accuracy, diagnostician b(agreement =70%, Value of t=0.6812) was good, diagnostician a(agreement=60%. Value of t=0.6414) was good, and diagno-stician c(agreement=0%, Value of k=-0.1000) was poor. 3. In cofidence of diagnosis, diagnostician c was 75%, diagnostician a was 70%, and diagnostician b was 64%. Conclusion: The results suggest that diagnostician's consistency and accuracy about pulse diagnosis in 8 Constitution Medicine can be evaluated by Cage R&R study. further study is needed for estimation method of pulse diagnosis in 8 Constitution Medicine.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.1
• /
• pp.423-426
• /
• 2014

Aim: To evaluate the agreement between colposcopic diagnosis and cervical pathology a retrospective chart review was performed. Materials and Methods: This study included 437 patients who underwent colposcopy and cervical biopsy or conization at Siriraj Hospital from October 2010 - December 2012. The patient clinical characteristics, cervical cytology results, colposcopic diagnoses, cervical pathology results were recorded and correlations between variables were analyzed. Results: Agreement of colposcopic diagnosis and cervical pathology was matched in 253 patients (57.9%). The strength of agreement with weighted Kappa statistic was 0.494 (p<0.001). Colposcopic diagnoses more often overestimated (31.1%) than underestimated (11%) the cervical pathology. Agreement of colposcopic diagnosis and cervical pathology within 1 grade was found in 411 patients (94.1%). Positive predictive value (PPV) of high grade colposcopy or more was 75.5%, whereas the negative predictive value (NPV) of insignificant and low grade colposcopy was 83.8%. False positives of high grade colposcopy or more were 21%. False negatives of insignificant or low grade colposcopy were 19.1%. Conclusions: Strength of agreement between colposcopic diagnosis and cervical pathology was found to be only moderate. A biopsy at colposcopy should be performed at a gold standard level to detect high grade lesions.

• Journal of Digital Convergence
• /
• v.17 no.1
• /
• pp.281-286
• /
• 2019

This study, which checked diagnostic agreement at the femoral region and lumbar region during diagnosis of osteoporosis and surveyed errors related with choosing measured parts, aimed at providing basic date for right diagnosis of osteoporosis. The study, using the first, second years of the fifth period from initial data from National Nutrition Survey, surveyed 1,637 men and 2,128 women at the age of 50 years or older. The study used kappa test to grasp the agreement between the occurrence of osteoporosis at the femoral region and lumbar region and whether or not received doctor's diagnosis. Women showed diagnostic agreement of osteoporosis at all of the femoral region and lumbar region, with diagnostic agreement of the lumbar region being higher than that of the femoral region. While, men showed diagnostic agreement of osteoporosis only at the lumbar region. Bone density changes with the age and varies depending on parts, and so, the study believes, measuring bone density should conduct all of the femoral region and lumbar region and diagnosis had better be made focused on the lumbar region.

• Advances in Traditional Medicine
• /
• v.9 no.1
• /
• pp.14-19
• /
• 2009

The aim of this study is to evaluate appraiser's consistency and accuracy about pulse diagnosis (PD) in discrimination of eight-constitutions using Gage R&R study. Cumulative numbers of PD for discrimination of eight constitutions of three appraisers' experience were 75,000 cases, 50,000 cases, 1,100 cases, respectively. Three Appraisers diagnosed subject's eight-constitutions by PD with blinded method. Gage R&R study was used to verify the results. In the measurements of consistency, appraiser B (agreement = 80%, Value of k = 0.8276) was very good, appraiser A (agreement = 70%, Value of k = 0.7465) was good, and appraiser C (agreement = 50%, Value of k = 0.5365) was moderate. In the measurements of accuracy, appraiser B (agreement = 70%, Value of k = 0.6812) was good, appraiser A (agreement = 60%, Value of k = 0.6414) was good, and appraiser C (agreement = 0%, Value of k = -0.1000) was poor. The results suggest that accuracy of discrimination of constitutions relatively depend on experience and number of cases of PD. Further large controlled study is needed to evaluate the accuracy of PD.

• Journal of Korean Medicine for Obesity Research
• /
• v.9 no.1
• /
• pp.37-44
• /
• 2009

The study was to investigate the distribution for the diagnosis of pattern identification questionnaire and agreement rate between diagnosis of pattern identification based on obesity pattern identification questionnaire and the clinical diagnosis of pattern' identification by medical specialist. The distribution for the diagnosis of pattern identification based on obesity pattern identification questionnaire was shown in order of stagnation of liver Gi, retention of undigested food, deficiency of Yang at scale of 5, 3, 2 score and the diagnosis rate of single pattern identification at scale of 5, 3, 2 score was 89.96%, 79.33%, 54.64%, respectively the agreement rate between the diagnosis of pattern identification based on obesity pattern identification questionnaire and the clinical diagnosis of pattern identification by medical specialist was 0.1013. Therefore, the complementary management in CRF questionnaires with consultation from experts and the study for score difference of pattern identification will improve the accuracy and agreement rate, which will will be helpful for pattern identification of obesity by clinical experts.

• Journal of Society of Preventive Korean Medicine
• /
• v.20 no.2
• /
• pp.17-26
• /
• 2016

Objectives : We presented the results of reliability study in advance, and analyzed agreement between Korean medicine doctors(KMDs)' diagnosis and cold-heat pattern identification questionnaire(CHPI)'s diagnosis. Methods : This survey was conducted from May 16 to 17, 2015. The subjects were 93 adults living in rural society. Diagnosis of CHPI was performed by 2 KMDs who have clinical experience more than 5 years. The KMDs' diagnosis was set as a reference index, and then we compare 23 items(cold pattern 11 items and heat pattern 12 items) of CHPI questionnaire and 15 items(cold pattern 8 items and heat pattern 7 items) that were brief form of it. We had cut-off value by standard of KMDs' diagnosis using receiver operating characteristic-curve(ROC-curve), with which we calculated agreement including kappa value. Correlation analysis between CHPI evaluation score by KMDs and by the questionnaire was fulfilled as well. Results : Agreement about 11 and 8 cold pattern items showed 87.1% together, and the value of kappa each recorded 0.742 and 0.741. Agreement about 12 and 7 heat pattern items suggested 81.7% and 78.5%, and the value of kappa showed 0.634 and 0.570. Correlation coefficients were 0.803 of 11 items and 0.761 of 8 items about cold pattern. In addition, correlation coefficients were 0.789 of 12 items and 0.767 of 7 items about heat pattern. The significant probability (p-value) was under 0.001. Conclusions : We have developed CHPI questionnaire involving reliability and agreement based on usual symptoms, and hope additional complements so that Korean medicine diagnostics and Korean preventive medicine would be improved.

• Journal of Preventive Medicine and Public Health
• /
• v.43 no.5
• /
• pp.451-454
• /
• 2010

Objectives: The American Diabetes Association (ADA) has recently recommended the HbA1c assay as one of four options for making the diagnosis of diabetes mellitus, with a cut-point of $\geq$ 6.5%. We compared the HbA1c assay and the fasting plasma glucose level for making the diagnosis of diabetes among Korean adults. Methods: We analyzed 8710 adults (age 45-74 years), who were not diagnosed as having diabetes mellitus, from the Namwon study population. A fasting plasma glucose level of $\geq$126 mg/dL and an A1c of $\geq$ 6.5% were used for the diagnosis of diabetes. The kappa index of agreement was calculated to measure the agreement between the diagnosis based on the fasting plasma glucose level and the HbA1c. Results: The kappa index of agreement between the fasting plasma glucose level and HbA1c was 0.50. Conclusions: The agreement between the fasting plasma glucose and HbA1c for the diagnosis of diabetes was moderate for Korean adults.