• Title/Summary/Keyword: Kappa coefficient

Search Result 245, Processing Time 0.027 seconds

Development of the Home Fall Prevention Checklist for Community-dwelling Older Adults (재가노인 낙상환경위험 평가도구 개발)

  • Park, Eunok;Jang, Insun
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.5
    • /
    • pp.354-365
    • /
    • 2013
  • The purpose of the study was to develop the home fall prevention checklist for community-dwelling older adults. And the validity and reliability of the checklist were tested. The preliminary questions were developed through content validity by twenty experts using the CVI(Content Validity Index). Following the establishment of content validity, 52 items of the checklist were developed. Responses of 299 community-dwelling older adults were analyzed to further establish both reliability and validity of the checklist. Reliability using cohen's kappa coefficient and test-retest reliability(rate of concordance(%)), and construct validity using known-group comparison technique were tested. 51 items were over 0.80 in the cohen's kappa coefficient of the checklist, 45 items were over 80.0% in test-retest reliability. Construct validity was established by known-group comparison(t=3.50, p=.001). Validity and reliability of the checklist were confirmed. This checklist will help further studies to develop more safe environment to prevent falls.

Reliability of Scapular Downward Rotation Measurement in Subjects With Scapular Downward Rotation Syndrome

  • Choi, Woo-Jeong;Lee, Ji-Hyun;Jeong, Hyo-Jung;Yoon, Tae-Lim;Cynn, Heon-Seock
    • Physical Therapy Korea
    • /
    • v.21 no.3
    • /
    • pp.73-79
    • /
    • 2014
  • The purposes of the current study were to (1) estimate the inter-rater agreement for visual assessment of scapular downward rotation (SDR), (2) develop the scapular downward rotation index (SDRI) as a method to measure SDR objectively and quantitatively, and (3) analyze the intra- and inter-rater reliability of the SDRI. Twenty subjects with scapular downward rotation syndrome (SDRS) were recruited for this study. The visual assessment and the measurement for the SDRI were conducted by two examiners in two sessions each. The SDRI [$(a-b){\div}a{\times}100$] is calculated with the measurement of two linear distances: One is a perpendicular distance from the root of the scapular spine to the thoracic mid-line (a), and the other is a perpendicular distance from the inferior angle of the scapula to the thoracic mid-line (b). Cohen's kappa coefficient was calculated to estimate the inter-rater agreement for visual assessment. Intra-class correlation coefficients (ICCs) with a 95% confidence interval (CI), the standard error of measurement, and minimal detectable differences were calculated to assess intra- and inter-rater reliability of SDR measurement using the SDRI. The results indicated that the kappa coefficient of inter-rater agreement for visual assessment was fair (${\kappa}=.21$). The intra-rater reliability of SDR measurement using the SDRI was excellent for examiner 1 (ICC=.92, 95% CI=.78~.97) and good for examiner 2 (ICC=.82, 95% CI=.55~.93). The inter-rater reliability was moderate (ICC=.73, 95% CI=.32~.89). These findings showed that SDR measurement using the SDRI for subjects with SDRS may be considered reliable and better than the visual assessment.

Development of Questionnaire for Evaluating Health Effect Associated with Air Pollution (대기오염과 관련된 건강영향을 평가하기 위한 설문 개발)

  • Ju, Yeong-Su;Kim, Dae-Sung;Kang, Jong-Won;Seong, Joo-Heon;Kang, Dae-Hee;Cho, Soo-Hun;Paek, Do-Myung
    • Journal of Preventive Medicine and Public Health
    • /
    • v.30 no.4 s.59
    • /
    • pp.852-869
    • /
    • 1997
  • This study was conducted to develop and evaluate the reliability and the validity of a questionnaire in order to determine the applicability as a screening tool for estimating environmental exposure and health effects related to air pollution. The questionnaire was developed with adopting some items of others such as ISAAC or ATS-DLD. And then we performed test-retest to 89 middle school students and their mothers at interval of three months. Cohen's Kappa values, weighted Kappa values, Spearman's correlation coefficients, and Pearson's correlation coefficients for each item were computed as reliability coefficients. The validity coefficients and validity coefficient bounds were also obtained by simply using these reliability coefficients. As results, Kappa ranged broadly from 0.10 to 0.61 of the items 'diet', $0.52\sim0.79$ of the environmental tobacco smoke, $0.39\sim0.44$ of the functional categories of surrounding environment, and $0.39\sim0.44$ of the using transportation systems; these items were regarded as confounding factors. For items related to health outcomes, Kappa ranged from -0.02 to 0.37 in the respiratory system of past medical history, and from 0.11 to 0.55 in the current health status. But Kappa of the others were over 0.60. In conclusion, if some items can be corrected or modified, the questionnaire developed in this study can be used as a tool for evaluating environmental exposure and health effects associated with air pollution.

  • PDF

A Comparative Study of Image Classification Method to Classify Onion and Garlic Using Unmanned Aerial Vehicle (UAV) Imagery

  • Lee, Kyung-Do;Lee, Ye-Eun;Park, Chan-Won;Na, Sang-Il
    • Korean Journal of Soil Science and Fertilizer
    • /
    • v.49 no.6
    • /
    • pp.743-750
    • /
    • 2016
  • Recently, usage of UAV (Unmanned Aerial Vehicle) has increased in agricultural part. This study was conducted to classify onion and garlic using supervised classification of a fixed-wing UAV (Model : Ebee) images for evaluation of possibility about estimation of onion and garlic cultivation area using UAV images. Aerial images were obtained 11~12 times from study sites in Changryeng-gun and Hapcheon-gun during farming season from 2015 to 2016. The result for accuracy in onion and garlic image classification by R-G-B and R-G-NIR images showed highest Kappa coefficients for the maximum likelihood method. The result for accuracy in onion and garlic classification showed high Kappa coefficients of 0.75~0.97 from DOY 105 to DOY 141, implying that UAV images could be used to estimate onion and garlic cultivation area.

The Preliminary Study on the Possibility of Applying Sasang Constitutional Analysis Tool to Foreign Site based on Yanbian Chinese (연변 거주 중국인 대상자를 통해 살펴본 체질 진단툴(Sasang Constitutional Analysis Tool)의 해외 적용 가능성 탐색 연구)

  • Yoo, Jong-Hyang;Kim, Yun-Young;Do, Jung-Hyung;Park, Ki-Hyun;Jang, Eun-Su
    • Journal of Sasang Constitutional Medicine
    • /
    • v.24 no.3
    • /
    • pp.42-49
    • /
    • 2012
  • Objectives This study aimed to assessing the performance of Sasang constitutional analysis Tool (SCAT) for Chinese as one of method to diagnose Sasang Constitution and evaluating the possibility of applying SCAT to foreign people. Methods This cross-sectional study was approved by IRB (Independent Review Board) at J Hospital in Yanbian. Informed consent to take part in the study was obtained from each of the participants. The performance of SCAT was assessed through Kappa coefficient and the concordance rate between SCAT and expert diagnosis. Results The concordance rate between SCAT and expert was 61.1% in total and the Kappa was 0.408. When the constitutional probability increased, the concordance rate and Kappa showed a increasing tendency. The concordance rate of Chosun race was 62.1% and others 60.7%. Conclusions SCAT, as Sasang constitutional diagnostic supporting system, may help the expert to diagnose Sasang constitution in Yanbian region.

A Study on Flow and Creation and Dissipation of Vorticity around Rectangular Floating Breakwater (부방파제의 유동과 와의 생성 및 소멸에 관한 연구)

  • Yoon, Jung-Sung;Kim, Myoung-Kyu;Jung, Kwang-Hyo;Kim, Ga-Ya
    • Journal of Ocean Engineering and Technology
    • /
    • v.22 no.3
    • /
    • pp.24-33
    • /
    • 2008
  • In this study, flow and creation and dissipation of vorticity around rectangular floating breakwater is investigated both experimentally and numerically. The PIV system(Particle image velocimetry) is employed to obtain the velocity field in the vorticity of rectangular structure. The numerical model, combined with ${\kappa}-{\varepsilon}$ turbulence model and the VOF method based on RANS equation, is used to analyze the turbulence structure. In the results of this study, the vorticity is found around conner of rectangular structure at all time domain, and creation and dissipation of vorticity are closely related to wave period. Separation points of phase of vortex due to flow separation for longer period waves are faster then for shorter period waves.

Three-dimensional numerical simulation of turbulent flow around two high-rise buildings in proximity

  • Liu, Min-Shan
    • Wind and Structures
    • /
    • v.1 no.3
    • /
    • pp.271-284
    • /
    • 1998
  • This paper uses the numerical simulation to investigate the interference effect of 3-D turbulent flow around two high rise buildings in proximity at the different relative heights, gaps, and wind velocities. The computer program used to carry out the simulation is based on the control volume method and the SIMPLEST algorithm. The ${\kappa}-{\varepsilon}$ model was used to simulate turbulence effects. Since the contracted flow between two adjacent buildings enhances the strength of vortex shedding from the object building, the pressure coefficient on each side wall of the object building is generally increased by the presence of apposed building. The effect is increased as the relative height or the gap between the two buildings decreases. The velocity on the vertical center line between two buildings is about 1.4 to 1.5 times the upstream wind velocity.

Development on the Questionnaire of Cold-Heat Pattern Identification Based on Usual Symptoms for Health Promotion - Focused on Reliability Study (건강 증진을 위한 평소 증상 기반의 한열변증 설문지 개발 - 신뢰도를 중심으로)

  • Yeo, Minkyung;Park, Kihyun;Bae, Kwangho;Jang, Eunsu;Lee, Youngseop
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.30 no.2
    • /
    • pp.116-123
    • /
    • 2016
  • This study was performed to develop questionnaire of cold-heat pattern identification(PI) based on usual symptoms for general people, and we analyzed reliability of the questionnaire. We reviewed cold-heat PI questionnaire of advanced research and selected twenty-three items through three time experts meeting. Three hundred and fifty nine healthy subjects were joined in this study. As a results, Cronbach's α of cold-heat PI questionnaire was 0.79 and 0.83. According to the factor analysis about fifteen-chosen cold-heat PI questionnaires, each cold-heat consisted of two factors and each Convergence was 56.46% and 65.93%. Intra-class Correlation Coefficient was 0.67-0.83. Based on the median of samples of primary source, we classified subjects into four category as Cold, Heat, No Cold-Heat, and Cold-heat complex. We examined agreement of diagnosis and coefficient of kappa, and agreement rate of diagnosis was 64.2%, and coefficient of kappa was 0.51. Based on research result, we expect that validity study about questionnaire of cold-heat PI based on usual symptoms will be continued, and hope to be used as subsidiary diagnosis in clinical practice.

Inter-rater·absolute Reliability and Concurrent Validity of Tinetti-gait Scale (Korean version) in Stroke Patients (뇌졸중 환자들의 한국판 Tinetti-보행 척도의 측정자간·절대적 신뢰도와 동시 타당도)

  • An, Seung-Heon;Lee, Dong-Geon;Lee, Yun-Bok;Lee, Gyu-Chang
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.9 no.2
    • /
    • pp.201-211
    • /
    • 2014
  • PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

Comparing Korea Occupational Safety & Health Agency and National Health Insurance Service's cardio-cerebrovascular diseases risk-assessment tools using data from one hospital's health checkups

  • Yunrae Cho;Dong Geon Kim;Byung-Chan Park;Seonhee Yang;Sang Kyu Kim
    • Annals of Occupational and Environmental Medicine
    • /
    • v.35
    • /
    • pp.35.1-35.11
    • /
    • 2023
  • Background: Cardio-cerebrovascular diseases (CVDs) are the most common cause of death worldwide. Various CVD risk assessment tools have been developed. In South Korea, the Korea Occupational Safety & Health Agency (KOSHA) and the National Health Insurance Service (NHIS) have provided CVD risk assessments with health checkups. Since 2018, the KOSHA guide has stated that NHIS CVD risk assessment tool could be used as an alternative of KOSHA assessment tool for evaluating CVD risk of workers. The objective of this study was to determine the correlation and agreement between the KOSHA and the NHIS CVD risk assessment tools. Methods: Subjects of this study were 17,485 examinees aged 20 to 64 years who had undergone medical examinations from January 2021 to December 2021 at a general hospital. We classified subjects into low-risk, moderate-risk, high-risk, and highest-risk groups according to KOSHA and NHIS's CVD risk assessment tools. We then compared them with cross-analysis, Spearman correlation analysis, and linearly weighted kappa coefficient. Results: The correlation between KOSHA and NHIS tools was statistically significant (p-value < 0.001), with a correlation coefficient of 0.403 and a kappa coefficient of 0.203. When we compared risk group distribution using KOSHA and NHIS tools, CVD risk of 6,498 (37.1%) participants showed a concordance. Compared to the NHIS tool, the KOSHA tool classified 9,908 (56.7%) participants into a lower risk category and 1,079 (6.2%) participants into a higher risk category. Conclusions: In this study, KOSHA and NHIS tools showed a moderate correlation with a fair agreement. The NHIS tool showed a tendency to classify participants to higher CVD risk group than the KOSHA tool. To prevent CVD more effectively, a higher estimation tool among verified CVD risk assessment methods should be selected and managements such as early intervention and treatment of risk factors should be performed targeting the high-risk group.