• Korean Journal of Radiology
• /
• v.23 no.3
• /
• pp.298-307
• /
• 2022

Objective: This study aimed to evaluate the effect of implementing the consensus statement from the Asian Society of Cardiovascular Imaging-Practical Tutorial 2020 (ASCI-PT 2020) on the reliability of cardiac MR with late gadolinium enhancement (CMR-LGE) myocardial viability scoring between observers in the context of ischemic cardiomyopathy. Materials and Methods: A total of 17 cardiovascular imaging experts from five different countries evaluated CMR obtained in 26 patients (male:female, 23:3; median age [interquartile range], 55.5 years [50-61.8]) with ischemic cardiomyopathy. For LGE scoring, based on the 17 segments, the extent of LGE in each segment was graded using a five-point scoring system ranging from 0 to 4 before and after exposure according to the consensus statement. All scoring was performed via web-based review. Scores for slices, vascular territories, and total scores were obtained as the sum of the relevant segmental scores. Interobserver reliability for segment scores was assessed using Fleiss' kappa, while the intraclass correlation coefficient (ICC) was used for slice score, vascular territory score, and total score. Inter-observer agreement was assessed using the limits of agreement from the mean (LoA). Results: Interobserver reliability (Fleiss' kappa) in each segment ranged 0.242-0.662 before the consensus and increased to 0.301-0.774 after the consensus. The interobserver reliability (ICC) for each slice, each vascular territory, and total score increased after the consensus (slice, 0.728-0.805 and 0.849-0.884; vascular territory, 0.756-0.902 and 0.852-0.941; total score, 0.847 and 0.913, before and after implementing the consensus statement, respectively. Interobserver agreement in scoring also improved with the implementation of the consensus for all slices, vascular territories, and total score. The LoA for the total score narrowed from ± 10.36 points to ± 7.12 points. Conclusion: The interobserver reliability and agreement for CMR-LGE scoring for ischemic cardiomyopathy improved when following guidance from the ASCI-PT 2020 consensus statement.

• Imaging Science in Dentistry
• /
• v.36 no.1
• /
• pp.41-48
• /
• 2006

Purpose : To evaluate the reliability and clinical usefulness of ultrasonography in the temporomandibular joint (TMJ). Materials and Methods : Parasagittal and paracoronal 1.5 T MR images and 7.5 MHz ultrasonographs of 40 TMJs in 20 asymptomatic volunteers were obtained. Disc position using MR imaging was evaluated and the distance between the lateral surface of mandibular condyle and the articular capsule using MR image and ultrasonograph of 27 TMJs with normal disc position was measured and compared. Intraobserver and interobserver measurements reliability was evaluated by using interclass correlation coefficients (ICC) and measurement error. Also, the distance measured on ultrasonographs was compared, according to mouth position and disc postion. Results : The normal disc position was found in 27 of 40 asymptomatic joints. At the intraobserver reliability of measurement, ICC at the closed and open mouth position were 0.89 and 0.91. The measurement error was 0.4% and 0.5%. At the interobserver reliability, ICC at the closed and open mouth position were 0.92 and 0.81. The measurement error was 0.4% and 0.7%. At the TMJ with normal disc position, the distances between the lateral surface of mandibular condyle and the articular capsule measured on MR images and ultrasonographs were $2.0{\pm}0.7mm,\;1.8{\pm}0.5mm$, respectively (p<0.05). On the ultrasonographs, the distances at open mouth position were $1.2{\pm}0.5mm$ (p<0.05). At the TMJ with medially displaced disc, the distances at the closed and open mouth position were $1.3{\pm}0.3\;mm\;and\;0.9{\pm}0.2\;mm$ (p<0.05). Conclusion : The results suggest ultrasonography of TMJ is a reliable imaging technique for assessment of normal disc position.

• Imaging Science in Dentistry
• /
• v.52 no.2
• /
• pp.181-186
• /
• 2022

Purpose: This study aimed to investigate inter-observer reliability among observers with different levels of proficiency and the diagnostic imaging reliability of cone-beam computed tomography (CBCT) images of the retromolar canal. Materials and Methods: CBCT images of 307 patients were assessed for the presence of retromolar canals(RMCs) by 3 observers independently. Diagnoses were made twice by each observer at intervals of more than 3 weeks. Interobserver reliability was assessed using the kappa coefficient. One observer had no experience in diagnosis using CBCT images. Therefore, a specialist in diagnostic imaging explained the CBCT images for interpretation and practiced diagnostic imaging together with this observer, while the other observer interpreted the images independently. Thereafter, the observers re-evaluated the images. Results: The interobserver kappa coefficients (including bilateral RMCs) calculated at the first reading were low, ranging from 0.21 to 0.61. Their values ranged from 0.95 (right side) to 1.00 (left side) after one-on-one practice with a diagnostic imaging specialist, while the values ranged from 0.65 (right side) to 0.66 (left side) without one-on-one practice. Conclusion: Diagnostic accuracy was improved through diagnostic imaging practice. To improve the anatomical interpretation of images, it is important to practice diagnostic imaging with a specialist in diagnostic imaging. One-on-one instruction about diagnostic imaging was an effective method of training.

• Journal of Korean Foot and Ankle Society
• /
• v.13 no.1
• /
• pp.1-6
• /
• 2009

Purpose: To study the reliability of intra- and interobserver reliability in angular measurement of hallux valgus deformity by assessing hallux valgus angle (HVA) and the 1st to 2nd intermetatarsal angle (1-2 IMA) through using computerized system. Materials and Methods: 20 cases of moderate to severe hallux valgus patients were included in this study. With the standing anteroposterior view of foot, the HVA and 1-2 IMA were calculated by computerized measurement system of Infinity cooperation, called ${\pi}$-view, with its software tools. Using the statistical software program, SPSS (version 12th), we interpreted the results which were measured by two independent observers. Results: In the intraobserver measurement, the HVA of observer A showed reliability ($32.5^{\circ}{\pm}6.9$ and $33.1^{\circ}{\pm}6.8$)(p<0.05). 1-2 IMA in observer A was not regarded as reliable ($16.9^{\circ}{\pm}2.8$ and $17.1^{\circ}{\pm}2.8$)(p>0.05). In the results of observer B, HVAs were measured as $35.7^{\circ}{\pm}7.6$ and $36.2^{\circ}{\pm}7.7$, and were not reliable (p>0.05). 1-2 IMA in observer B was not reliable as well ($17.0^{\circ}{\pm}0.8$ and $20.8^{\circ}{\pm}1.5$)(p>0.05). In the interobservers' measurements, the first and the second results of HVA were $3.2^{\circ}{\pm}3.6$ and $3.1^{\circ}{\pm}3.1$, reliable within the 95% confidence interval (p<0.05). 1-2 IMAs were $0.1^{\circ}{\pm}1.9$ and $3.73^{\circ}{\pm}1.3$, which were not reliable (p>0.05). Conclusion: In the angular measurement of the hallux valgus by computerized system, the HVA and 1-2 IMA showed less error range in the interobserver's results, compared with the previous studies about the manual measurement. However, our results failed to show the statistical reliability of intra- and interobserver's measuring. Therefore, even the computerized angular measurements in the severity of hallux valgus require development of the measuring methods and software tools.

• Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
• /
• v.15 no.2
• /
• pp.81-86
• /
• 2004

Background and Objectives : In general, ambulatory 24-hour pH monitoring is considered the current gold standard for larynogopharyngeal reflux(LPR). There is no validated instrument whose purpose is to document the physical finding and severity of laryngopharyngeal reflux. The purposes of this study are to revaluate the validity and reliability of the reflux finding score(RFS) and to quantify laryngoscopic findings using reflux finding score. Material and Methods : Thirty-three LPR patients confirmed by dual-probe pH monitoring and thirty patients of control were selected. The RFS was documented for each patient with telescopic laryngoscopy before treatment. For test-retest intraobserver reliability assessment, a blinded laryngologists determined the RFS on two separate occasions. To evaluate interobserver reliability assessment, the RFS was determined by t재 different blinded laryngologists. Results : The mean age of the cohort with pH-documented LPR was 45.8 years and the mean RFS was 11.4. The mean age of cotrol subjects was 52 years and the mean RFS was 5.4. The mean RFS for laryngologist no. 1 was 10.8 at the initial screening and 10.9 at the repeat evaluation. The mean FRS for laryngologist no.2 was 11.1 at the intial test and 10.9 at the repeat evaluation. The correlation coefficient for interobserver variability was 0.93 and intraobserver variability was 0.94. Conclusion : The RFS demonstrates excellent inter-and introaobserver reproducibility and is helpful for quantifying laryngeal finding in LPR. We can be 95% certain that an individual with a RFS greater than 7 has LPR.

• Imaging Science in Dentistry
• /
• v.45 no.3
• /
• pp.169-174
• /
• 2015

Purpose: This study was performed to evaluate the diagnostic efficacy of panoramic radiography and cone-beam computed tomography (CBCT) in detecting sinus pathology. Materials and Methods: This study was based on a retrospective evaluation of patients who had undergone both a panoramic radiograph and a CBCT exam. A total of 100 maxillary sinuses were evaluated. Four examiners with various levels of expertise evaluated the images using a five-point scoring system. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic efficacy of the two modalities. The image analysis was repeated twice, with at least two weeks between the evaluation sessions. Interobserver reliability was assessed using Cronbach's alpha, and intraobserver reliability was assessed using Cohen's kappa. Results: Maxillary sinus pathology was detected in 72% of the patients. High interobserver and intraobserver reliability were observed for both imaging modalities and among the four examiners. Statistical analyses using ROC curves demonstrated that the CBCT images had a larger area under the curve (0.940) than the panoramic radiographs (0.579). Conclusion: Three-dimensional evaluation of the sinus with CBCT was significantly more reliable in detecting pathology than panoramic imaging.

• The Korean Journal of Elementary Counseling
• /
• v.10 no.2
• /
• pp.151-165
• /
• 2011

This study aims to demonstrate how well SCM analysis, which indicates social cognitive map of categorizing peer subgroups of elementary school students, corresponds with that of teachers. To do this, the subject of this study includes two classes of the 3rd and the 5th grade students in D elementary school in B-gu, Busan city. Over 30 students of each gender in each grade were surveyed with social network questionnaires to collect data. The result of the social network survey was analyzed by SCM 4.0 program to categorize peer subgroups within each class. The categorized peer subgroups were reported to the class teacher. Based on the report, the class teachers observed peer subgroups in classes. After the teachers observed and categorized the students into several peer groups, an analysis was conducted to compare the peer subgrouping by students with that by teachers. The result showed the two were 80% correspondent to each other regardless of gender and grade. If interobserver reliability stays within the range of 80-100%, it is considered reliable. And this leads to the conclusion that peer subgrouping by students' cognition and that by teachers' observation can be regarded quite corresponding. In conclusion, peer subgrouping through SCM is significant when peer subgrouping Korean children, and it appears to be more significant when analyzed considering different variables including gender and grade. Peer subgrouping by girls is shown to be more accurate than that by boys.

• Asian Pacific Journal of Cancer Prevention
• /
• v.17 no.2
• /
• pp.491-495
• /
• 2016

Background: Small B-cell non-Hodgkins lymphoma (NHL) is difficult to be distinguished from non-neoplastic reactive processes using conventional haematoxylin-eosin (HE) staining due to different interpretations among pathologists with diagnosis based on morphologic features. Ancillary examinations such as immunohistochemical (IHC) staining are essential. However, negative or doubtful results are still sometimes obtained due to unsatisfactory tissue processing or IHC technique. The polymerase chain reaction (PCR) as a molecular diagnostic technique is very sensitive and specific. Clonality detection of heavy chain immunoglobulin (IgH) gene rearrangement has been widely used to establish diagnosis of B-cell NHL. Aims: To elaborate interobserver variation in small B-cell NHL diagnosis based on morphologic features only and to confirm sensitivity and specificity of the PCR technique as an ancillary method. Materials and Methods: A toptal of 28 samples of small B cell NHL and suspicious lymphoma were interpreted by 3 pathologists in Sardjito General Hospital based on their morphology only. The reliability of assessment and the coefficient of interobserver agreement were calculated by Fleiss kappa statistics. Interpretation results were confirmed with IHC staining (CD20, CD3, Bcl2). PCR was performed to analyze the clonality of IgH gene rearrangement. Results: Interobserver agreement in morphologic evalution of small B cell NHL and chronic lymphadenitis revealed kappa coefficient 0.69 included in the substantial agreement category. The cases were divided into 3 groups based on morphology and IHC results; lymphoma, reactive process and undetermined group. PCR analysis showed 90% sensitivity and 60% specificity. Conclusions: The present study revealed a substantial agreement among pathologists in small B-cell NHL diagnosis. For difficult cases, PCR is useful as complementary method to morphologic and IHC examinations to establish definitive diagnosis.

• Clinics in Shoulder and Elbow
• /
• v.24 no.2
• /
• pp.98-105
• /
• 2021

Background: Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods: Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss' kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results: The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions: Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.

• Journal of Korean Foot and Ankle Society
• /
• v.19 no.4
• /
• pp.165-170
• /
• 2015

Purpose: The purpose of this study is to analyze the measurement differences of simple radiographs according to radiation projection angle using a phantom and to propose methods for objective analysis of simple radiographs. Materials and Methods: We took simple radiographs with different projection angles using a C-arm image intensifier and measured five parameters of the foot on the simple radiographic images. Five parameters include lateral tibiocalcaneal angle, lateral talocalcaneal angle, naviculocuboid overlap, lateral talo-first metatarsal angle, and lateral calcaneo-first metatarsal angle. Intraobserver and interobserver reliability were verified, and then intraclass correlations of parameters were analyzed. Results: Radiographic parameters of the foot showed high intraobserver and interobserver reliability. Lateral tibiocalcaneal angle has a strong negative linear relationship with rotation and a moderate negative linear relationship with tilt. Lateral talocalcaneal angle has a moderate positive linear relationship with rotation and a strong positive linear relationship with tilt. Naviculocuboid overlap has a strong positive linear relationship with rotation and a moderate positive linear relationship with tilt. Lateral talo-first metatarsal angle does not have a linear relationship with rotation and a moderate negative linear relationship with tilt. Lateral calcaneo-first metatarsal angle has a moderate positive linear relationship with rotation and tilt. Conclusion: More precise evaluation of the foot with a simple radiograph can be performed by understanding the changes of radiographic parameters according to radiation projection angle.