• Korean Journal of Radiology
• /
• 제23권3호
• /
• pp.298-307
• /
• 2022

Objective: This study aimed to evaluate the effect of implementing the consensus statement from the Asian Society of Cardiovascular Imaging-Practical Tutorial 2020 (ASCI-PT 2020) on the reliability of cardiac MR with late gadolinium enhancement (CMR-LGE) myocardial viability scoring between observers in the context of ischemic cardiomyopathy. Materials and Methods: A total of 17 cardiovascular imaging experts from five different countries evaluated CMR obtained in 26 patients (male:female, 23:3; median age [interquartile range], 55.5 years [50-61.8]) with ischemic cardiomyopathy. For LGE scoring, based on the 17 segments, the extent of LGE in each segment was graded using a five-point scoring system ranging from 0 to 4 before and after exposure according to the consensus statement. All scoring was performed via web-based review. Scores for slices, vascular territories, and total scores were obtained as the sum of the relevant segmental scores. Interobserver reliability for segment scores was assessed using Fleiss' kappa, while the intraclass correlation coefficient (ICC) was used for slice score, vascular territory score, and total score. Inter-observer agreement was assessed using the limits of agreement from the mean (LoA). Results: Interobserver reliability (Fleiss' kappa) in each segment ranged 0.242-0.662 before the consensus and increased to 0.301-0.774 after the consensus. The interobserver reliability (ICC) for each slice, each vascular territory, and total score increased after the consensus (slice, 0.728-0.805 and 0.849-0.884; vascular territory, 0.756-0.902 and 0.852-0.941; total score, 0.847 and 0.913, before and after implementing the consensus statement, respectively. Interobserver agreement in scoring also improved with the implementation of the consensus for all slices, vascular territories, and total score. The LoA for the total score narrowed from ± 10.36 points to ± 7.12 points. Conclusion: The interobserver reliability and agreement for CMR-LGE scoring for ischemic cardiomyopathy improved when following guidance from the ASCI-PT 2020 consensus statement.

• Imaging Science in Dentistry
• /
• 제36권1호
• /
• pp.41-48
• /
• 2006

Purpose : To evaluate the reliability and clinical usefulness of ultrasonography in the temporomandibular joint (TMJ). Materials and Methods : Parasagittal and paracoronal 1.5 T MR images and 7.5 MHz ultrasonographs of 40 TMJs in 20 asymptomatic volunteers were obtained. Disc position using MR imaging was evaluated and the distance between the lateral surface of mandibular condyle and the articular capsule using MR image and ultrasonograph of 27 TMJs with normal disc position was measured and compared. Intraobserver and interobserver measurements reliability was evaluated by using interclass correlation coefficients (ICC) and measurement error. Also, the distance measured on ultrasonographs was compared, according to mouth position and disc postion. Results : The normal disc position was found in 27 of 40 asymptomatic joints. At the intraobserver reliability of measurement, ICC at the closed and open mouth position were 0.89 and 0.91. The measurement error was 0.4% and 0.5%. At the interobserver reliability, ICC at the closed and open mouth position were 0.92 and 0.81. The measurement error was 0.4% and 0.7%. At the TMJ with normal disc position, the distances between the lateral surface of mandibular condyle and the articular capsule measured on MR images and ultrasonographs were $2.0{\pm}0.7mm,\;1.8{\pm}0.5mm$, respectively (p<0.05). On the ultrasonographs, the distances at open mouth position were $1.2{\pm}0.5mm$ (p<0.05). At the TMJ with medially displaced disc, the distances at the closed and open mouth position were $1.3{\pm}0.3\;mm\;and\;0.9{\pm}0.2\;mm$ (p<0.05). Conclusion : The results suggest ultrasonography of TMJ is a reliable imaging technique for assessment of normal disc position.

• Imaging Science in Dentistry
• /
• 제52권2호
• /
• pp.181-186
• /
• 2022

Purpose: This study aimed to investigate inter-observer reliability among observers with different levels of proficiency and the diagnostic imaging reliability of cone-beam computed tomography (CBCT) images of the retromolar canal. Materials and Methods: CBCT images of 307 patients were assessed for the presence of retromolar canals(RMCs) by 3 observers independently. Diagnoses were made twice by each observer at intervals of more than 3 weeks. Interobserver reliability was assessed using the kappa coefficient. One observer had no experience in diagnosis using CBCT images. Therefore, a specialist in diagnostic imaging explained the CBCT images for interpretation and practiced diagnostic imaging together with this observer, while the other observer interpreted the images independently. Thereafter, the observers re-evaluated the images. Results: The interobserver kappa coefficients (including bilateral RMCs) calculated at the first reading were low, ranging from 0.21 to 0.61. Their values ranged from 0.95 (right side) to 1.00 (left side) after one-on-one practice with a diagnostic imaging specialist, while the values ranged from 0.65 (right side) to 0.66 (left side) without one-on-one practice. Conclusion: Diagnostic accuracy was improved through diagnostic imaging practice. To improve the anatomical interpretation of images, it is important to practice diagnostic imaging with a specialist in diagnostic imaging. One-on-one instruction about diagnostic imaging was an effective method of training.

• 대한족부족관절학회지
• /
• 제13권1호
• /
• pp.1-6
• /
• 2009

Purpose: To study the reliability of intra- and interobserver reliability in angular measurement of hallux valgus deformity by assessing hallux valgus angle (HVA) and the 1st to 2nd intermetatarsal angle (1-2 IMA) through using computerized system. Materials and Methods: 20 cases of moderate to severe hallux valgus patients were included in this study. With the standing anteroposterior view of foot, the HVA and 1-2 IMA were calculated by computerized measurement system of Infinity cooperation, called ${\pi}$-view, with its software tools. Using the statistical software program, SPSS (version 12th), we interpreted the results which were measured by two independent observers. Results: In the intraobserver measurement, the HVA of observer A showed reliability ($32.5^{\circ}{\pm}6.9$ and $33.1^{\circ}{\pm}6.8$)(p<0.05). 1-2 IMA in observer A was not regarded as reliable ($16.9^{\circ}{\pm}2.8$ and $17.1^{\circ}{\pm}2.8$)(p>0.05). In the results of observer B, HVAs were measured as $35.7^{\circ}{\pm}7.6$ and $36.2^{\circ}{\pm}7.7$, and were not reliable (p>0.05). 1-2 IMA in observer B was not reliable as well ($17.0^{\circ}{\pm}0.8$ and $20.8^{\circ}{\pm}1.5$)(p>0.05). In the interobservers' measurements, the first and the second results of HVA were $3.2^{\circ}{\pm}3.6$ and $3.1^{\circ}{\pm}3.1$, reliable within the 95% confidence interval (p<0.05). 1-2 IMAs were $0.1^{\circ}{\pm}1.9$ and $3.73^{\circ}{\pm}1.3$, which were not reliable (p>0.05). Conclusion: In the angular measurement of the hallux valgus by computerized system, the HVA and 1-2 IMA showed less error range in the interobserver's results, compared with the previous studies about the manual measurement. However, our results failed to show the statistical reliability of intra- and interobserver's measuring. Therefore, even the computerized angular measurements in the severity of hallux valgus require development of the measuring methods and software tools.

• 대한후두음성언어의학회지
• /
• 제15권2호
• /
• pp.81-86
• /
• 2004

Background and Objectives : In general, ambulatory 24-hour pH monitoring is considered the current gold standard for larynogopharyngeal reflux(LPR). There is no validated instrument whose purpose is to document the physical finding and severity of laryngopharyngeal reflux. The purposes of this study are to revaluate the validity and reliability of the reflux finding score(RFS) and to quantify laryngoscopic findings using reflux finding score. Material and Methods : Thirty-three LPR patients confirmed by dual-probe pH monitoring and thirty patients of control were selected. The RFS was documented for each patient with telescopic laryngoscopy before treatment. For test-retest intraobserver reliability assessment, a blinded laryngologists determined the RFS on two separate occasions. To evaluate interobserver reliability assessment, the RFS was determined by t재 different blinded laryngologists. Results : The mean age of the cohort with pH-documented LPR was 45.8 years and the mean RFS was 11.4. The mean age of cotrol subjects was 52 years and the mean RFS was 5.4. The mean RFS for laryngologist no. 1 was 10.8 at the initial screening and 10.9 at the repeat evaluation. The mean FRS for laryngologist no.2 was 11.1 at the intial test and 10.9 at the repeat evaluation. The correlation coefficient for interobserver variability was 0.93 and intraobserver variability was 0.94. Conclusion : The RFS demonstrates excellent inter-and introaobserver reproducibility and is helpful for quantifying laryngeal finding in LPR. We can be 95% certain that an individual with a RFS greater than 7 has LPR.

• Imaging Science in Dentistry
• /
• 제45권3호
• /
• pp.169-174
• /
• 2015

Purpose: This study was performed to evaluate the diagnostic efficacy of panoramic radiography and cone-beam computed tomography (CBCT) in detecting sinus pathology. Materials and Methods: This study was based on a retrospective evaluation of patients who had undergone both a panoramic radiograph and a CBCT exam. A total of 100 maxillary sinuses were evaluated. Four examiners with various levels of expertise evaluated the images using a five-point scoring system. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic efficacy of the two modalities. The image analysis was repeated twice, with at least two weeks between the evaluation sessions. Interobserver reliability was assessed using Cronbach's alpha, and intraobserver reliability was assessed using Cohen's kappa. Results: Maxillary sinus pathology was detected in 72% of the patients. High interobserver and intraobserver reliability were observed for both imaging modalities and among the four examiners. Statistical analyses using ROC curves demonstrated that the CBCT images had a larger area under the curve (0.940) than the panoramic radiographs (0.579). Conclusion: Three-dimensional evaluation of the sinus with CBCT was significantly more reliable in detecting pathology than panoramic imaging.

• 초등상담연구
• /
• 제10권2호
• /
• pp.151-165
• /
• 2011

본 연구는 초등학생의 또래하위집단 분류에 대한 사회인지도를 나타내어주는 SCM의 방법이 교사의 관찰 분류와 일치하는지를 알아보는데 그 목적을 두었다. 이를 위하여 본 연구의 연구 대상으로 부산광역시 B구에 소재한 D초등학교 3학년(중학년)과 5학년(고학년)이며 한 학년당 2학급을 선정하였다. 인원은 각 학년당 남녀 각각 30명 이상을 대상으로 했으며 사회적 연결망 질문지를 통해 자료를 수집했다. 연구 대상 아동들의 사회적 연결망 질문지의 결과를 SCM 4.0 분석 프로그램에 입력하여 학급내 또래하위집단 분류를 실시하였다. 아동들의 지각에 근거한 SCM 4.0 분석 프로그램에 의한 또래하위집단 분류 결과를 담임 교사에게 보고한 후, SCM에 의한 또래하위집단 분류 결과를 바탕으로 담임 교사가 학급내 또래하위집단을 관찰하였다. 교사 관찰에 의한 또래하위집단 분류가 종료된 후, 아동들의 지각에 의한 SCM 4.0 분석 프로그램의 또래하위집단 분류와 교사 관찰에 의한 또래하위집단 분류 간의 일치도를 알아보기 위해 관찰자간의 일치도를 분석해보았다. 그 결과 학년이나 성별에 관계없이 관찰자간의 일치도가 80%이상으로 분석되었다. 일반적으로 관찰자 간의 신뢰도(IOR; interobserver reliability)가 80-100% 범위에 있을 때 양호한 것으로 평가되므로(Martin & Pear, 2003), 교사관찰에 의한 또래하위집단 분류와 아동들의 지각에 근거한 SCM 4.0 분석 프로그램에 의한 또래하위집단 분류 간의 일치도는 양호한 것으로 나타났다. 결론적으로 SCM에 의한 또래하위집단 분류는 한국의 아동들에 대한 또래하위집단 분류에서도 유의미하며, SCM 4.0 분석 프로그램을 사용하여 학급내 또래하위집단을 분류할 때 학년에 따라 혹은 성별에 따라 조건을 달리 적용하여 분류하는 것이 더욱더 적합할 가능성을 보여주었다. 또한, 여학생의 또래하위집단 분류는 남학생의 또래하위집단 분류보다 좀 더 정확하게 분류되는 것으로 나타났다.

• Asian Pacific Journal of Cancer Prevention
• /
• 제17권2호
• /
• pp.491-495
• /
• 2016

Background: Small B-cell non-Hodgkins lymphoma (NHL) is difficult to be distinguished from non-neoplastic reactive processes using conventional haematoxylin-eosin (HE) staining due to different interpretations among pathologists with diagnosis based on morphologic features. Ancillary examinations such as immunohistochemical (IHC) staining are essential. However, negative or doubtful results are still sometimes obtained due to unsatisfactory tissue processing or IHC technique. The polymerase chain reaction (PCR) as a molecular diagnostic technique is very sensitive and specific. Clonality detection of heavy chain immunoglobulin (IgH) gene rearrangement has been widely used to establish diagnosis of B-cell NHL. Aims: To elaborate interobserver variation in small B-cell NHL diagnosis based on morphologic features only and to confirm sensitivity and specificity of the PCR technique as an ancillary method. Materials and Methods: A toptal of 28 samples of small B cell NHL and suspicious lymphoma were interpreted by 3 pathologists in Sardjito General Hospital based on their morphology only. The reliability of assessment and the coefficient of interobserver agreement were calculated by Fleiss kappa statistics. Interpretation results were confirmed with IHC staining (CD20, CD3, Bcl2). PCR was performed to analyze the clonality of IgH gene rearrangement. Results: Interobserver agreement in morphologic evalution of small B cell NHL and chronic lymphadenitis revealed kappa coefficient 0.69 included in the substantial agreement category. The cases were divided into 3 groups based on morphology and IHC results; lymphoma, reactive process and undetermined group. PCR analysis showed 90% sensitivity and 60% specificity. Conclusions: The present study revealed a substantial agreement among pathologists in small B-cell NHL diagnosis. For difficult cases, PCR is useful as complementary method to morphologic and IHC examinations to establish definitive diagnosis.

• Clinics in Shoulder and Elbow
• /
• 제24권2호
• /
• pp.98-105
• /
• 2021

Background: Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods: Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss' kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results: The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions: Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.

• 대한족부족관절학회지
• /
• 제19권4호
• /
• pp.165-170
• /
• 2015

Purpose: The purpose of this study is to analyze the measurement differences of simple radiographs according to radiation projection angle using a phantom and to propose methods for objective analysis of simple radiographs. Materials and Methods: We took simple radiographs with different projection angles using a C-arm image intensifier and measured five parameters of the foot on the simple radiographic images. Five parameters include lateral tibiocalcaneal angle, lateral talocalcaneal angle, naviculocuboid overlap, lateral talo-first metatarsal angle, and lateral calcaneo-first metatarsal angle. Intraobserver and interobserver reliability were verified, and then intraclass correlations of parameters were analyzed. Results: Radiographic parameters of the foot showed high intraobserver and interobserver reliability. Lateral tibiocalcaneal angle has a strong negative linear relationship with rotation and a moderate negative linear relationship with tilt. Lateral talocalcaneal angle has a moderate positive linear relationship with rotation and a strong positive linear relationship with tilt. Naviculocuboid overlap has a strong positive linear relationship with rotation and a moderate positive linear relationship with tilt. Lateral talo-first metatarsal angle does not have a linear relationship with rotation and a moderate negative linear relationship with tilt. Lateral calcaneo-first metatarsal angle has a moderate positive linear relationship with rotation and tilt. Conclusion: More precise evaluation of the foot with a simple radiograph can be performed by understanding the changes of radiographic parameters according to radiation projection angle.