• Title/Summary/Keyword: Consistency in Assessment

Search Result 332, Processing Time 0.026 seconds

Real Time Versus Photographic Assessment of Stool Consistency Using the Brussels Infant and Toddler Stool Scale: Are They Telling Us the Same?

  • Aman, Berthold Albert;Levy, Elvira Ingrid;Hofman, Benjamine;Vandenplas, Yvan;Huysentruyt, Koen
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.24 no.1
    • /
    • pp.38-44
    • /
    • 2021
  • Purpose: Digital communication is becoming increasingly important in clinical practice and research. The finding that stool consistency can be evaluated similarly using either "in vivo" or photographic material by health care professionals will decrease subjective interpretation by parents. The primary outcome of this study was the reliability of stool consistency scoring using the Brussels Infant and Toddler Stool Scale (BITSS) between fresh stools and their photos; the secondary outcome was the inter-rater reliability based on the fresh stools. Methods: Fresh stool samples from healthy children were collected in a day care center. These stools, and one month later the corresponding photos presented in a random order, were presented to 14 observers. Reliabilities were analyzed using absolute agreements and weighted and unweighted Cohen's κ. Results: In total, 202 samples were rated 576 times. Absolute agreement between photographic and real time assessment ranged between 71.1% and 83.3% among observers. This corresponded with substantial agreement (unweighted κ=0.70 [95% CI, 0.61-0.78]; weighted κ=0.86 [95% CI, 0.78-0.88]). The inter-observer agreement showed similar percentages of absolute agreement (81.4-82.0%) and κ-values corresponding with fair-to-moderate agreement. Conclusion: Our findings suggest that the assessment of fresh stool consistency can also reliably be done on photographic material when using the BITSS. This opens opportunities in scientific surroundings and in our daily life communication with parents and caretakers.

The Economic Consistency and the Creditworthiness of Borrower: the Methodical Features of Analysis Using the Concentric Matrix Models

  • VYBOROVA, Elena Nikolaevna
    • East Asian Journal of Business Economics (EAJBE)
    • /
    • v.8 no.4
    • /
    • pp.45-65
    • /
    • 2020
  • Purpose - This paper is to analyze the system and the models of financial analysis in the assessment of economic consistency and the creditability of borrower. To test the process of complex express-analysis, it is utilized by the concentric matrix models by using the matrix of 5×5.. Research design, data, and methodology - The estimation of economic consistency, the creditworthiness, the complex express-analysis with application of concentric matrix models were carried out on the basis of data of the report for the 2017 of corporations POSCO and in the first half of the 2018 Daewoo Shipbuilding & Marine Engineering of South Korea. Results - This paper focused on the unbalance of the corporate financial structure (capital, receivable) and the assessment of sustainability development, taking into account the liquidity, solvency, financial sustainability and economic viability of the enterprise. Conclusions - this paper also consider the theoretical means of regulating receivables. The material is presented in the pedagogical context and appendix of the conclusion.

A Study on the Features of Writing Rater in TOPIK Writing Assessment (한국어능력시험(TOPIK) 쓰기 평가의 채점 특성 연구)

  • Ahn, Su-hyun;Kim, Chung-sook
    • Journal of Korean language education
    • /
    • v.28 no.1
    • /
    • pp.173-196
    • /
    • 2017
  • Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.

Road Safety Assessment by Using Integrated Evaluation Methods of Road Design Consistency (도로선형 설계일관성 통합평가방법론을 활용한 안전성 평가)

  • Ko, Chun-Soo;Lee, Jong-Hak;Ku, Ji-Sun;Noh, Kwan-Sub
    • International Journal of Highway Engineering
    • /
    • v.15 no.1
    • /
    • pp.121-126
    • /
    • 2013
  • PURPOSES: Road Design Consistency Evaluation can guarantee road alignments with safety factors, however it can be hard work to deal with general car accident factors in only this evaluation index. Ideal Road Design Consistency Evaluation is show the mutual balance of road alignment and human factors with a variety of factors for road safety. METHODS: This study carried out overall road safety evaluations which are methods of running speeding consistency and car platoon safety analysis (driver's behaviors factors) as well. RESULTS: Out of 13 sections in a experimental road layout, safety factors of 8 sections showed 'Good' or 'Fair' status. However, 'Poor' results were found out in 5 sections. Particularly, it showed the different outcomes among the 4 evaluation methods used in this study. CONCLUSIONS: Road safety countermeasures were proposed for the potentially dangerous sections in road which failed to identify in the other methods. This study will contribute toward future study of more reliable Road Design Consistency Evaluation in the future for road safety.

Comparative analysis of multiple mathematical models for prediction of consistency and compressive strength of ultra-high performance concrete

  • Alireza Habibi;Meysam Mollazadeh;Aryan Bazrafkan;Naida Ademovic
    • Coupled systems mechanics
    • /
    • v.12 no.6
    • /
    • pp.539-555
    • /
    • 2023
  • Although some prediction models have successfully developed for ultra-high performance concrete (UHPC), they do not provide insights and explicit relations between all constituents and its consistency, and compressive strength. In the present study, based on the experimental results, several mathematical models have been evaluated to predict the consistency and the 28-day compressive strength of UHPC. The models used were Linear, Logarithmic, Inverse, Power, Compound, Quadratic, Cubic, Mixed, Sinusoidal and Cosine equations. The applicability and accuracy of these models were investigated using experimental data, which were collected from literature. The comparisons between the models and the experimental results confirm that the majority of models give acceptable prediction with a high accuracy and trivial error rates, except Linear, Mixed, Sinusoidal and Cosine equations. The assessment of the models using numerical methods revealed that the Quadratic and Inverse equations based models provide the highest predictability of the compressive strength at 28 days and consistency, respectively. Hence, they can be used as a reliable tool in mixture design of the UHPC.

An Objective No-Reference Perceptual Quality Assessment Metric based on Temporal Complexity and Disparity for Stereoscopic Video

  • Ha, Kwangsung;Bae, Sung-Ho;Kim, Munchurl
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.2 no.5
    • /
    • pp.255-265
    • /
    • 2013
  • 3DTV is expected to be a promising next-generation broadcasting service. On the other hand, the visual discomfort/fatigue problems caused by viewing 3D videos have become an important issue. This paper proposes a perceptual quality assessment metric for a stereoscopic video (SV-PQAM). To model the SV-PQAM, this paper presents the following features: temporal variance, disparity variation in intra-frames, disparity variation in inter-frames and disparity distribution of frame boundary areas, which affect the human perception of depth and visual discomfort for stereoscopic views. The four features were combined into the SV-PQAM, which then becomes a no-reference stereoscopic video quality perception model, as an objective quality assessment metric. The proposed SV-PQAM does not require a depth map but instead uses the disparity information by a simple estimation. The model parameters were estimated based on linear regression from the mean score opinion values obtained from the subjective perception quality assessments. The experimental results showed that the proposed SV-PQAM exhibits high consistency with subjective perception quality assessment results in terms of the Pearson correlation coefficient value of 0.808, and the prediction performance exhibited good consistency with a zero outlier ratio value.

  • PDF

Reliability of the Functional Gait Assessment in Patients With Stroke (뇌졸중 환자에 대한 기능적 보행평가의 신뢰도)

  • Won, Jong-Im;Yu, Kyung-Hoon
    • Physical Therapy Korea
    • /
    • v.18 no.1
    • /
    • pp.64-73
    • /
    • 2011
  • After stroke, many people have problems with balance during movement. Balance is essential for the optimal functioning of the locomotor system and the performance of many activities of daily living. The Functional Gait Assessment (FGA) is a clinical tool for evaluating balance ability during walking. The test consists of ten tasks, seven tasks of the Dynamic Gait Index and three additional tasks. The purpose of this study was to evaluate the reliability and internal consistency of data obtained with the Korean version of the FGA when used with people after suffering a stroke. One-hundred participants, at least three months poststroke and able to walk at least six meters with or without a walking aid, participated in the study (age range=30~83 years; $mean{\pm}SD=58.8{\pm}10.9$). Two physical therapists and two physical therapy students rated the FGA. Intrarater and interrater reliability of the FGA were assessed using kappa statistic and intraclass correlation coefficients (2,1). The internal consistency of the FGA was assessed using the Cronbach alpha. The Cronbach alpha was good (${\alpha}$=.86~.93). The intrarater (intraclass correlation coefficient=.92~.95) and interrater reliability (intraclass correlation coefficient=.91, .95) of the total scores administered by the therapists and students were good, whereas the reliability for single item scores when administered by the physical therapists was moderate to good (kapa value=.42~.97). This study found that intrarater and interrater reliability for total FGA scores and internal consistency were good. Therefore, the Korean version of the FGA can be used as a reliable tool to assess the functional gait performance of patients after stroke.

Study of the Reliability and Validity of the WOMAC Index in Patients with Total Knee Replacement (무릎관절 전치환술 환자에 대한 WOMAC 지수의 신뢰도와 타당성에 관한 연구 )

  • Hoon Jo;Kyoung Kim;Sang-Cheol Im
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.18 no.2
    • /
    • pp.93-101
    • /
    • 2023
  • PURPOSE: The Western Ontario and McMaster Universities Arthritis (WOMAC) index has been used to measure the outcome of total knee replacement (TKR), but studies on its reliability and validity are limited. The present study examined the reliability and validity of this index for patients with knee osteoarthritis who underwent TKR. METHODS: Seventy-one inpatients and outpatients who underwent bilateral TKR for knee osteoarthritis were included in this study. The pain assessment scale and WOMAC index were used to evaluate the participants every two weeks to examine the test-retest reliability, internal consistency, and construct validity. RESULTS: The test-retest reliability scores for pain, stiffness, and physical function were .75-.92, .85-.90, and .75-.95, respectively. The corresponding intraclass correlation coefficients were .75-.88, .76-.88, and .71-.95, respectively. The internal consistency score in the first and second examinations was .92. Furthermore, the construct validity scores for pain, stiffness, and physical function were .83, .41, and .58, respectively. CONCLUSION: The application of the WOMAC index in patients who underwent TKR showed high test-retest reliability and internal consistency with the use of the WOMAC index and good validity with the use of the pain assessment scale.

Testing the validity and reliability of an assessment tool for dental hygienists' consideration of patients with mild disabilities (치과위생사의 경증 장애인 환자 진료 고려사항에 대한 지식 측정 도구의 타당도와 신뢰도 검증)

  • Ye-Ji Kim;Hie-Jin Noh;So-Jung Mun;Sun-Young Han
    • Journal of Korean society of Dental Hygiene
    • /
    • v.23 no.1
    • /
    • pp.55-62
    • /
    • 2023
  • Objectives: The purpose of this study was to test the reliability and validity of an assessment tool for dental hygienists' consideration of patients with mild disabilities. Methods: Thirty-seven preliminary questions were compiled through literature review, and thirty-two questions were selected through content validity testing by eight experts. Two hundred and three dental hygienists completed the assessment tool as an online survey. The construct validity, internal consistency, and test-retest reliability of the tool were investigated using the SPSS 26.0 program. The construct validity was assessed using exploratory factor analysis. The internal consistency was assessed using Cronbach's alpha. The intraclass correlation coefficient (ICC) value with 95% confidence intervals was calculated for test-retest reliability. Results: Ten items and four factors were selected through exploratory factor analysis. The internal consistency reliability of the tool was found to be Cronbach's alpha=0.658, and test-retest reliability was found to be ICC=0.812. Conclusions: An assessment tool of care for patients with mild disabilities by dental hygienists is a reliable and valid tool suitable for the job characteristics of dental hygienists. It can be used in clinical practice and research.

Issues Related to the Objectivity of Student Assessment in Medical Education (의학교육 학생평가의 객관성에 대한 쟁점)

  • Min, Kyung-Seok;Yang, Kil-Seok
    • Korean Medical Education Review
    • /
    • v.15 no.3
    • /
    • pp.105-111
    • /
    • 2013
  • This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.