Purpose: To study computerized measurements of angular parameters on 100% and 150% resized digital radiography of hallux valgus deformity Materials and Methods: 30 digital radiography of standing foot anteroposterior view of hallux valgus patients were included. Two observers(A, B) independently measured hallux valgus angle (HVA), 1-2 intermetatarsal angle (IMA), and distal metatarsal articular angle (DMAA) in two times on both 100%-size and 150% magnified images respectively, using computerized measurement software tools. The results were interpreted with the statistical software program, Statistical Analysis System, version 9.2. Results: In repeated measurements of each observer, measurements on 150% magnified image showed no differences of all three parameters and with 100%-size image, there were differences of HVA (observer A) and 1-2 IMA (observer B) (p>0.05). When testing interobserver reliability, both observers showed differences in measurement of HVA and DMAA (p<0.05), but no differences in measurement of 1-2 IMA in both images. Within the 95% confidence interval, limits of error of measurements between two observers on HVA, IMA and DMAA were $2.7^{\circ}$$1.4^{\circ}$ and $5.0^{\circ}$ respectively in 100%-size images, and $2.6^{\circ}$, $1.6^{\circ}$ and $4.7^{\circ}$ respectively in 150% magnified images. Conclusion: In computerized measurements for angular parameters of hallux valgus with digital radiography, 150% magnified images showed intraobserver reliability. Both 100% and 150% magnified images failed to show interobserver reliability. Measurement of 1-2 IMA in both 100% and 150% images showed less interobserver error.
Cherry Kim;Chul Hwan Park;Do Yeon Kim;Jaehyung Cha;Bae Young Lee;Chan Ho Park;Eun-Ju Kang;Hyun Jung Koo;Kakuya Kitagawa;Min Jae Cha;Rungroj Krittayaphong;Sang Il Choi;Sanjaya Viswamitra;Sung Min Ko;Sung Mok Kim;Sung Ho Hwang;Nguyen Ngoc Trang;Whal Lee;Young Jin Kim;Jongmin Lee;Dong Hyun Yang
Korean Journal of Radiology
/
v.23
no.3
/
pp.298-307
/
2022
Objective: This study aimed to evaluate the effect of implementing the consensus statement from the Asian Society of Cardiovascular Imaging-Practical Tutorial 2020 (ASCI-PT 2020) on the reliability of cardiac MR with late gadolinium enhancement (CMR-LGE) myocardial viability scoring between observers in the context of ischemic cardiomyopathy. Materials and Methods: A total of 17 cardiovascular imaging experts from five different countries evaluated CMR obtained in 26 patients (male:female, 23:3; median age [interquartile range], 55.5 years [50-61.8]) with ischemic cardiomyopathy. For LGE scoring, based on the 17 segments, the extent of LGE in each segment was graded using a five-point scoring system ranging from 0 to 4 before and after exposure according to the consensus statement. All scoring was performed via web-based review. Scores for slices, vascular territories, and total scores were obtained as the sum of the relevant segmental scores. Interobserver reliability for segment scores was assessed using Fleiss' kappa, while the intraclass correlation coefficient (ICC) was used for slice score, vascular territory score, and total score. Inter-observer agreement was assessed using the limits of agreement from the mean (LoA). Results: Interobserver reliability (Fleiss' kappa) in each segment ranged 0.242-0.662 before the consensus and increased to 0.301-0.774 after the consensus. The interobserver reliability (ICC) for each slice, each vascular territory, and total score increased after the consensus (slice, 0.728-0.805 and 0.849-0.884; vascular territory, 0.756-0.902 and 0.852-0.941; total score, 0.847 and 0.913, before and after implementing the consensus statement, respectively. Interobserver agreement in scoring also improved with the implementation of the consensus for all slices, vascular territories, and total score. The LoA for the total score narrowed from ± 10.36 points to ± 7.12 points. Conclusion: The interobserver reliability and agreement for CMR-LGE scoring for ischemic cardiomyopathy improved when following guidance from the ASCI-PT 2020 consensus statement.
Lee Tae-Wan;Yoo Dong-Soo;Han Won-Jeong;Kim Eun-Kyung
Imaging Science in Dentistry
/
v.36
no.1
/
pp.41-48
/
2006
Purpose : To evaluate the reliability and clinical usefulness of ultrasonography in the temporomandibular joint (TMJ). Materials and Methods : Parasagittal and paracoronal 1.5 T MR images and 7.5 MHz ultrasonographs of 40 TMJs in 20 asymptomatic volunteers were obtained. Disc position using MR imaging was evaluated and the distance between the lateral surface of mandibular condyle and the articular capsule using MR image and ultrasonograph of 27 TMJs with normal disc position was measured and compared. Intraobserver and interobserver measurements reliability was evaluated by using interclass correlation coefficients (ICC) and measurement error. Also, the distance measured on ultrasonographs was compared, according to mouth position and disc postion. Results : The normal disc position was found in 27 of 40 asymptomatic joints. At the intraobserver reliability of measurement, ICC at the closed and open mouth position were 0.89 and 0.91. The measurement error was 0.4% and 0.5%. At the interobserver reliability, ICC at the closed and open mouth position were 0.92 and 0.81. The measurement error was 0.4% and 0.7%. At the TMJ with normal disc position, the distances between the lateral surface of mandibular condyle and the articular capsule measured on MR images and ultrasonographs were $2.0{\pm}0.7mm,\;1.8{\pm}0.5mm$, respectively (p<0.05). On the ultrasonographs, the distances at open mouth position were $1.2{\pm}0.5mm$ (p<0.05). At the TMJ with medially displaced disc, the distances at the closed and open mouth position were $1.3{\pm}0.3\;mm\;and\;0.9{\pm}0.2\;mm$ (p<0.05). Conclusion : The results suggest ultrasonography of TMJ is a reliable imaging technique for assessment of normal disc position.
Purpose: This study aimed to investigate inter-observer reliability among observers with different levels of proficiency and the diagnostic imaging reliability of cone-beam computed tomography (CBCT) images of the retromolar canal. Materials and Methods: CBCT images of 307 patients were assessed for the presence of retromolar canals(RMCs) by 3 observers independently. Diagnoses were made twice by each observer at intervals of more than 3 weeks. Interobserver reliability was assessed using the kappa coefficient. One observer had no experience in diagnosis using CBCT images. Therefore, a specialist in diagnostic imaging explained the CBCT images for interpretation and practiced diagnostic imaging together with this observer, while the other observer interpreted the images independently. Thereafter, the observers re-evaluated the images. Results: The interobserver kappa coefficients (including bilateral RMCs) calculated at the first reading were low, ranging from 0.21 to 0.61. Their values ranged from 0.95 (right side) to 1.00 (left side) after one-on-one practice with a diagnostic imaging specialist, while the values ranged from 0.65 (right side) to 0.66 (left side) without one-on-one practice. Conclusion: Diagnostic accuracy was improved through diagnostic imaging practice. To improve the anatomical interpretation of images, it is important to practice diagnostic imaging with a specialist in diagnostic imaging. One-on-one instruction about diagnostic imaging was an effective method of training.
Purpose: To study the reliability of intra- and interobserver reliability in angular measurement of hallux valgus deformity by assessing hallux valgus angle (HVA) and the 1st to 2nd intermetatarsal angle (1-2 IMA) through using computerized system. Materials and Methods: 20 cases of moderate to severe hallux valgus patients were included in this study. With the standing anteroposterior view of foot, the HVA and 1-2 IMA were calculated by computerized measurement system of Infinity cooperation, called ${\pi}$-view, with its software tools. Using the statistical software program, SPSS (version 12th), we interpreted the results which were measured by two independent observers. Results: In the intraobserver measurement, the HVA of observer A showed reliability ($32.5^{\circ}{\pm}6.9$ and $33.1^{\circ}{\pm}6.8$)(p<0.05). 1-2 IMA in observer A was not regarded as reliable ($16.9^{\circ}{\pm}2.8$ and $17.1^{\circ}{\pm}2.8$)(p>0.05). In the results of observer B, HVAs were measured as $35.7^{\circ}{\pm}7.6$ and $36.2^{\circ}{\pm}7.7$, and were not reliable (p>0.05). 1-2 IMA in observer B was not reliable as well ($17.0^{\circ}{\pm}0.8$ and $20.8^{\circ}{\pm}1.5$)(p>0.05). In the interobservers' measurements, the first and the second results of HVA were $3.2^{\circ}{\pm}3.6$ and $3.1^{\circ}{\pm}3.1$, reliable within the 95% confidence interval (p<0.05). 1-2 IMAs were $0.1^{\circ}{\pm}1.9$ and $3.73^{\circ}{\pm}1.3$, which were not reliable (p>0.05). Conclusion: In the angular measurement of the hallux valgus by computerized system, the HVA and 1-2 IMA showed less error range in the interobserver's results, compared with the previous studies about the manual measurement. However, our results failed to show the statistical reliability of intra- and interobserver's measuring. Therefore, even the computerized angular measurements in the severity of hallux valgus require development of the measuring methods and software tools.
Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
/
v.15
no.2
/
pp.81-86
/
2004
Background and Objectives : In general, ambulatory 24-hour pH monitoring is considered the current gold standard for larynogopharyngeal reflux(LPR). There is no validated instrument whose purpose is to document the physical finding and severity of laryngopharyngeal reflux. The purposes of this study are to revaluate the validity and reliability of the reflux finding score(RFS) and to quantify laryngoscopic findings using reflux finding score. Material and Methods : Thirty-three LPR patients confirmed by dual-probe pH monitoring and thirty patients of control were selected. The RFS was documented for each patient with telescopic laryngoscopy before treatment. For test-retest intraobserver reliability assessment, a blinded laryngologists determined the RFS on two separate occasions. To evaluate interobserver reliability assessment, the RFS was determined by t재 different blinded laryngologists. Results : The mean age of the cohort with pH-documented LPR was 45.8 years and the mean RFS was 11.4. The mean age of cotrol subjects was 52 years and the mean RFS was 5.4. The mean RFS for laryngologist no. 1 was 10.8 at the initial screening and 10.9 at the repeat evaluation. The mean FRS for laryngologist no.2 was 11.1 at the intial test and 10.9 at the repeat evaluation. The correlation coefficient for interobserver variability was 0.93 and intraobserver variability was 0.94. Conclusion : The RFS demonstrates excellent inter-and introaobserver reproducibility and is helpful for quantifying laryngeal finding in LPR. We can be 95% certain that an individual with a RFS greater than 7 has LPR.
Tadinada, Aditya;Fung, Karen;Thacker, Sejal;Mahdian, Mina;Jadhav, Aniket;Schincaglia, Gian Pietro
Imaging Science in Dentistry
/
v.45
no.3
/
pp.169-174
/
2015
Purpose: This study was performed to evaluate the diagnostic efficacy of panoramic radiography and cone-beam computed tomography (CBCT) in detecting sinus pathology. Materials and Methods: This study was based on a retrospective evaluation of patients who had undergone both a panoramic radiograph and a CBCT exam. A total of 100 maxillary sinuses were evaluated. Four examiners with various levels of expertise evaluated the images using a five-point scoring system. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic efficacy of the two modalities. The image analysis was repeated twice, with at least two weeks between the evaluation sessions. Interobserver reliability was assessed using Cronbach's alpha, and intraobserver reliability was assessed using Cohen's kappa. Results: Maxillary sinus pathology was detected in 72% of the patients. High interobserver and intraobserver reliability were observed for both imaging modalities and among the four examiners. Statistical analyses using ROC curves demonstrated that the CBCT images had a larger area under the curve (0.940) than the panoramic radiographs (0.579). Conclusion: Three-dimensional evaluation of the sinus with CBCT was significantly more reliable in detecting pathology than panoramic imaging.
This study aims to demonstrate how well SCM analysis, which indicates social cognitive map of categorizing peer subgroups of elementary school students, corresponds with that of teachers. To do this, the subject of this study includes two classes of the 3rd and the 5th grade students in D elementary school in B-gu, Busan city. Over 30 students of each gender in each grade were surveyed with social network questionnaires to collect data. The result of the social network survey was analyzed by SCM 4.0 program to categorize peer subgroups within each class. The categorized peer subgroups were reported to the class teacher. Based on the report, the class teachers observed peer subgroups in classes. After the teachers observed and categorized the students into several peer groups, an analysis was conducted to compare the peer subgrouping by students with that by teachers. The result showed the two were 80% correspondent to each other regardless of gender and grade. If interobserver reliability stays within the range of 80-100%, it is considered reliable. And this leads to the conclusion that peer subgrouping by students' cognition and that by teachers' observation can be regarded quite corresponding. In conclusion, peer subgrouping through SCM is significant when peer subgrouping Korean children, and it appears to be more significant when analyzed considering different variables including gender and grade. Peer subgrouping by girls is shown to be more accurate than that by boys.
Antoro, Ester Lianawati;Dwianingsih, Ery Kus;Indrawati, Indrawati;Triningsih, FX Ediati;Harijadi, Harijadi
Asian Pacific Journal of Cancer Prevention
/
v.17
no.2
/
pp.491-495
/
2016
Background: Small B-cell non-Hodgkins lymphoma (NHL) is difficult to be distinguished from non-neoplastic reactive processes using conventional haematoxylin-eosin (HE) staining due to different interpretations among pathologists with diagnosis based on morphologic features. Ancillary examinations such as immunohistochemical (IHC) staining are essential. However, negative or doubtful results are still sometimes obtained due to unsatisfactory tissue processing or IHC technique. The polymerase chain reaction (PCR) as a molecular diagnostic technique is very sensitive and specific. Clonality detection of heavy chain immunoglobulin (IgH) gene rearrangement has been widely used to establish diagnosis of B-cell NHL. Aims: To elaborate interobserver variation in small B-cell NHL diagnosis based on morphologic features only and to confirm sensitivity and specificity of the PCR technique as an ancillary method. Materials and Methods: A toptal of 28 samples of small B cell NHL and suspicious lymphoma were interpreted by 3 pathologists in Sardjito General Hospital based on their morphology only. The reliability of assessment and the coefficient of interobserver agreement were calculated by Fleiss kappa statistics. Interpretation results were confirmed with IHC staining (CD20, CD3, Bcl2). PCR was performed to analyze the clonality of IgH gene rearrangement. Results: Interobserver agreement in morphologic evalution of small B cell NHL and chronic lymphadenitis revealed kappa coefficient 0.69 included in the substantial agreement category. The cases were divided into 3 groups based on morphology and IHC results; lymphoma, reactive process and undetermined group. PCR analysis showed 90% sensitivity and 60% specificity. Conclusions: The present study revealed a substantial agreement among pathologists in small B-cell NHL diagnosis. For difficult cases, PCR is useful as complementary method to morphologic and IHC examinations to establish definitive diagnosis.
Alkaduhimi, Hassanin;Saarig, Aimane;Amajjar, Ihsan;van der Linde, Just A.;van Wier, Marieke F.;Willigenburg, Nienke W.;van den Bekerom, Michel P.J.
Clinics in Shoulder and Elbow
/
v.24
no.2
/
pp.98-105
/
2021
Background: Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods: Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss' kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results: The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions: Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.
본 웹사이트에 게시된 이메일 주소가 전자우편 수집 프로그램이나
그 밖의 기술적 장치를 이용하여 무단으로 수집되는 것을 거부하며,
이를 위반시 정보통신망법에 의해 형사 처벌됨을 유념하시기 바랍니다.
[게시일 2004년 10월 1일]
이용약관
제 1 장 총칙
제 1 조 (목적)
이 이용약관은 KoreaScience 홈페이지(이하 “당 사이트”)에서 제공하는 인터넷 서비스(이하 '서비스')의 가입조건 및 이용에 관한 제반 사항과 기타 필요한 사항을 구체적으로 규정함을 목적으로 합니다.
제 2 조 (용어의 정의)
① "이용자"라 함은 당 사이트에 접속하여 이 약관에 따라 당 사이트가 제공하는 서비스를 받는 회원 및 비회원을
말합니다.
② "회원"이라 함은 서비스를 이용하기 위하여 당 사이트에 개인정보를 제공하여 아이디(ID)와 비밀번호를 부여
받은 자를 말합니다.
③ "회원 아이디(ID)"라 함은 회원의 식별 및 서비스 이용을 위하여 자신이 선정한 문자 및 숫자의 조합을
말합니다.
④ "비밀번호(패스워드)"라 함은 회원이 자신의 비밀보호를 위하여 선정한 문자 및 숫자의 조합을 말합니다.
제 3 조 (이용약관의 효력 및 변경)
① 이 약관은 당 사이트에 게시하거나 기타의 방법으로 회원에게 공지함으로써 효력이 발생합니다.
② 당 사이트는 이 약관을 개정할 경우에 적용일자 및 개정사유를 명시하여 현행 약관과 함께 당 사이트의
초기화면에 그 적용일자 7일 이전부터 적용일자 전일까지 공지합니다. 다만, 회원에게 불리하게 약관내용을
변경하는 경우에는 최소한 30일 이상의 사전 유예기간을 두고 공지합니다. 이 경우 당 사이트는 개정 전
내용과 개정 후 내용을 명확하게 비교하여 이용자가 알기 쉽도록 표시합니다.
제 4 조(약관 외 준칙)
① 이 약관은 당 사이트가 제공하는 서비스에 관한 이용안내와 함께 적용됩니다.
② 이 약관에 명시되지 아니한 사항은 관계법령의 규정이 적용됩니다.
제 2 장 이용계약의 체결
제 5 조 (이용계약의 성립 등)
① 이용계약은 이용고객이 당 사이트가 정한 약관에 「동의합니다」를 선택하고, 당 사이트가 정한
온라인신청양식을 작성하여 서비스 이용을 신청한 후, 당 사이트가 이를 승낙함으로써 성립합니다.
② 제1항의 승낙은 당 사이트가 제공하는 과학기술정보검색, 맞춤정보, 서지정보 등 다른 서비스의 이용승낙을
포함합니다.
제 6 조 (회원가입)
서비스를 이용하고자 하는 고객은 당 사이트에서 정한 회원가입양식에 개인정보를 기재하여 가입을 하여야 합니다.
제 7 조 (개인정보의 보호 및 사용)
당 사이트는 관계법령이 정하는 바에 따라 회원 등록정보를 포함한 회원의 개인정보를 보호하기 위해 노력합니다. 회원 개인정보의 보호 및 사용에 대해서는 관련법령 및 당 사이트의 개인정보 보호정책이 적용됩니다.
제 8 조 (이용 신청의 승낙과 제한)
① 당 사이트는 제6조의 규정에 의한 이용신청고객에 대하여 서비스 이용을 승낙합니다.
② 당 사이트는 아래사항에 해당하는 경우에 대해서 승낙하지 아니 합니다.
- 이용계약 신청서의 내용을 허위로 기재한 경우
- 기타 규정한 제반사항을 위반하며 신청하는 경우
제 9 조 (회원 ID 부여 및 변경 등)
① 당 사이트는 이용고객에 대하여 약관에 정하는 바에 따라 자신이 선정한 회원 ID를 부여합니다.
② 회원 ID는 원칙적으로 변경이 불가하며 부득이한 사유로 인하여 변경 하고자 하는 경우에는 해당 ID를
해지하고 재가입해야 합니다.
③ 기타 회원 개인정보 관리 및 변경 등에 관한 사항은 서비스별 안내에 정하는 바에 의합니다.
제 3 장 계약 당사자의 의무
제 10 조 (KISTI의 의무)
① 당 사이트는 이용고객이 희망한 서비스 제공 개시일에 특별한 사정이 없는 한 서비스를 이용할 수 있도록
하여야 합니다.
② 당 사이트는 개인정보 보호를 위해 보안시스템을 구축하며 개인정보 보호정책을 공시하고 준수합니다.
③ 당 사이트는 회원으로부터 제기되는 의견이나 불만이 정당하다고 객관적으로 인정될 경우에는 적절한 절차를
거쳐 즉시 처리하여야 합니다. 다만, 즉시 처리가 곤란한 경우는 회원에게 그 사유와 처리일정을 통보하여야
합니다.
제 11 조 (회원의 의무)
① 이용자는 회원가입 신청 또는 회원정보 변경 시 실명으로 모든 사항을 사실에 근거하여 작성하여야 하며,
허위 또는 타인의 정보를 등록할 경우 일체의 권리를 주장할 수 없습니다.
② 당 사이트가 관계법령 및 개인정보 보호정책에 의거하여 그 책임을 지는 경우를 제외하고 회원에게 부여된
ID의 비밀번호 관리소홀, 부정사용에 의하여 발생하는 모든 결과에 대한 책임은 회원에게 있습니다.
③ 회원은 당 사이트 및 제 3자의 지적 재산권을 침해해서는 안 됩니다.
제 4 장 서비스의 이용
제 12 조 (서비스 이용 시간)
① 서비스 이용은 당 사이트의 업무상 또는 기술상 특별한 지장이 없는 한 연중무휴, 1일 24시간 운영을
원칙으로 합니다. 단, 당 사이트는 시스템 정기점검, 증설 및 교체를 위해 당 사이트가 정한 날이나 시간에
서비스를 일시 중단할 수 있으며, 예정되어 있는 작업으로 인한 서비스 일시중단은 당 사이트 홈페이지를
통해 사전에 공지합니다.
② 당 사이트는 서비스를 특정범위로 분할하여 각 범위별로 이용가능시간을 별도로 지정할 수 있습니다. 다만
이 경우 그 내용을 공지합니다.
제 13 조 (홈페이지 저작권)
① NDSL에서 제공하는 모든 저작물의 저작권은 원저작자에게 있으며, KISTI는 복제/배포/전송권을 확보하고
있습니다.
② NDSL에서 제공하는 콘텐츠를 상업적 및 기타 영리목적으로 복제/배포/전송할 경우 사전에 KISTI의 허락을
받아야 합니다.
③ NDSL에서 제공하는 콘텐츠를 보도, 비평, 교육, 연구 등을 위하여 정당한 범위 안에서 공정한 관행에
합치되게 인용할 수 있습니다.
④ NDSL에서 제공하는 콘텐츠를 무단 복제, 전송, 배포 기타 저작권법에 위반되는 방법으로 이용할 경우
저작권법 제136조에 따라 5년 이하의 징역 또는 5천만 원 이하의 벌금에 처해질 수 있습니다.
제 14 조 (유료서비스)
① 당 사이트 및 협력기관이 정한 유료서비스(원문복사 등)는 별도로 정해진 바에 따르며, 변경사항은 시행 전에
당 사이트 홈페이지를 통하여 회원에게 공지합니다.
② 유료서비스를 이용하려는 회원은 정해진 요금체계에 따라 요금을 납부해야 합니다.
제 5 장 계약 해지 및 이용 제한
제 15 조 (계약 해지)
회원이 이용계약을 해지하고자 하는 때에는 [가입해지] 메뉴를 이용해 직접 해지해야 합니다.
제 16 조 (서비스 이용제한)
① 당 사이트는 회원이 서비스 이용내용에 있어서 본 약관 제 11조 내용을 위반하거나, 다음 각 호에 해당하는
경우 서비스 이용을 제한할 수 있습니다.
- 2년 이상 서비스를 이용한 적이 없는 경우
- 기타 정상적인 서비스 운영에 방해가 될 경우
② 상기 이용제한 규정에 따라 서비스를 이용하는 회원에게 서비스 이용에 대하여 별도 공지 없이 서비스 이용의
일시정지, 이용계약 해지 할 수 있습니다.
제 17 조 (전자우편주소 수집 금지)
회원은 전자우편주소 추출기 등을 이용하여 전자우편주소를 수집 또는 제3자에게 제공할 수 없습니다.
제 6 장 손해배상 및 기타사항
제 18 조 (손해배상)
당 사이트는 무료로 제공되는 서비스와 관련하여 회원에게 어떠한 손해가 발생하더라도 당 사이트가 고의 또는 과실로 인한 손해발생을 제외하고는 이에 대하여 책임을 부담하지 아니합니다.
제 19 조 (관할 법원)
서비스 이용으로 발생한 분쟁에 대해 소송이 제기되는 경우 민사 소송법상의 관할 법원에 제기합니다.
[부 칙]
1. (시행일) 이 약관은 2016년 9월 5일부터 적용되며, 종전 약관은 본 약관으로 대체되며, 개정된 약관의 적용일 이전 가입자도 개정된 약관의 적용을 받습니다.