• Title/Summary/Keyword: multifaceted validity

Search Result 11, Processing Time 0.029 seconds

Multifaceted validity analysis of clinical skills test in the educational field setting (교육 현장에서 시행된 임상 술기 시험의 다면적 타당도 분석)

  • Han Chae;Min-jung Lee;Myung-Ho Kim;Kyuseok Kim;Eunbyul Cho
    • The Journal of Korean Medicine
    • /
    • v.45 no.1
    • /
    • pp.1-16
    • /
    • 2024
  • Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

Development of the Hospital Nurses' Silence Behavior Scale (병원 간호사의 침묵 행위 측정도구 개발)

  • Chung, Soojin;Hwang, Jee-In
    • Journal of Korean Academy of Nursing
    • /
    • v.54 no.2
    • /
    • pp.279-295
    • /
    • 2024
  • Purpose: This study aimed to develop a scale to measure hospital nurses' silence behavior and examine its validity and reliability. Methods: A total of 52 preliminary items on hospital nurses' silence behavior were selected using a content validity test by seven experts on 53 candidate items derived from a literature review and in-depth interviews with 14 nurses. A total of 405 hospital nurses participated in a psychometric testing. Data analysis comprised item analysis, exploratory and confirmatory factor analyses, and convergent and discriminant validity tests. Pearson's correlation coefficient was used for assessing concurrent validity, and Cronbach's alpha was used for the reliability test. Results: The final scale consisted of nine factors with 31 items, exhibiting acceptable model fit indices, convergent validity, and discriminant validity. The score of the entire scale was positively correlated with the 'Organizational Silence Scale (OSS)-the issues on which nurses remain silent' (r = .60, p < .001) and 'OSS-the reasons why nurses remain silent' (r = .68, p < .001). Cronbach's α of the scale was .92, and α of each subscale ranged from .71 to .90. Conclusion: The Hospital Nurses' Silence Behavior Scale is a useful tool for assessing multifaceted silence behavior among nurses. It can provide basic data for developing better communication strategies among nurses and other hospital staff.

Development and Validation of a Multidimensional Measure of Positive Body Image

  • Lee, Minsun;Lee, Hyun-Hwa
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.46 no.4
    • /
    • pp.704-722
    • /
    • 2022
  • Current studies validate the Body Positive Scale (BP Scale) as a self-assessment instrument that captures four dimensions of the positive body image construct. We developed and evaluated a 17-item BP Scale using two focus group interviews and four independent samples (n = 1,379) of Korean women who completed online survey questionnaires. We generated an initial pool of items via literature review, content validation with experts, and focus group interviews, subsequently refining the items through exploratory analysis (Study 1). We confirmed the BP Scale's underlying dimensions with young Korean female samples (Study 2, Study 4) and with a community sample (Study 3). We also examined the construct validity, internal consistency, and test-retest reliability over a six-week interval. Overall, the results supported that the four-factor BP Scale demonstrates adequate validity and reliability in measuring positive body image among Korean women. The BP Scale provides a method for researchers and practitioners to understand and assess individuals' positive body image in a multifaceted manner.

A study on the weighting of influence factors for tunnel collapse risk analysis (터널 붕괴 위험도 분석을 위한 영향인자 가중치 산정에 관한 연구)

  • Jeong-Heum Kim
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.26 no.4
    • /
    • pp.315-326
    • /
    • 2024
  • In this study, the Delphi method and AHP (analytic hierarchy process) were used to evaluate tunnel collapse risk from a comprehensive and multifaceted perspective. Influence factors were established through literature reviews, previous studies, and brainstorming sessions with expert groups, resulting in the construction of five main classification systems. A panel of 21 experts was formed, and three rounds of Delphi surveys were conducted to prevent errors and biases in the expert judgment process, thereby enhancing reliability. Ultimately, 14 influence factors were identified through CVR (content validity ratio) and COV (coefficient of variation) analyses of the experts' responses. Subsequently, the AHP method was applied to assess the relative importance of each influence factor and calculate the final composite weights. The timing of support and reinforcement had the highest priority, followed by groundwater inflow, joint conditions, support pattern levels, and auxiliary methods. These findings help identify the key factors affecting tunnel collapse risk and provide a foundation for developing strategies to improve tunnel safety.

Preservice Teachers' Beliefs about Integrating Artificial Intelligence in Mathematics Education: A Scale Development Study

  • Sunghwan Hwang
    • Research in Mathematical Education
    • /
    • v.26 no.4
    • /
    • pp.333-349
    • /
    • 2023
  • Recently, AI has become a crucial tool in mathematics education due to advances in machine learning and deep learning. Considering the importance of AI, examining teachers' beliefs about AI in mathematics education (AIME) is crucial, as these beliefs affect their instruction and student learning experiences. The present study developed a scale to measure preservice teachers' (PST) beliefs about AIME through factor analysis and rigorous reliability and validity analyses. The study analyzed 202 PST's data and developed a scale comprising three factors and 11 items. The first factor gauges PSTs' beliefs regarding their roles in using AI for mathematics education (4 items), the second factor assesses PSTs' beliefs about using AI for mathematics teaching (3 items), and the third factor explores PSTs' beliefs about AI for mathematics learning (4 items). Moreover, the outcomes of confirmatory factor analysis affirm that the three-factor model outperforms other models (a one-factor or a two-factor model). These findings are in line with previous scales examining mathematics teacher beliefs, reinforcing the notion that such beliefs are multifaceted and developed through diverse experiences. Descriptive analysis reveals that overall PSTs exhibit positive beliefs about AIME. However, they show relatively lower levels of beliefs about their roles in using AI for mathematics education. Practical and theoretical implications are discussed.

Instruments to Assess Physical Impairments in Post-Intensive Care Syndrome: A Systematic Review (집중치료 후 증후군의 신체적 장애 측정도구에 관한 체계적 고찰)

  • Kang, Jiyeon;Lee, Minju;Jeong, Yeon Jin;Kim, Soo Kyung;Cho, Young Shin;Park, Jung Hoon;Lee, Soon;Hong, Ji Won
    • Journal of Korean Critical Care Nursing
    • /
    • v.11 no.1
    • /
    • pp.46-66
    • /
    • 2018
  • Purpose : The purpose of this study was to systematically review the instruments utilized to assess physical impairment in post-intensive care syndrome (PICS) of intensive care unit (ICU) survivors. Method : Online databases searched were MEDLINE, Cochrane, CINAHL, and Embase. Studies that met the following criteria were included: 1) the study population exclusively had experience with ICU admission; 2) the study assessed pulmonary, neuromuscular, and physical functions; and 3) the study was published in English language journals after 2007. Results : A total of 56 instruments (2 pulmonary, 25 neuromuscular, 29 physical function) from 94 studies were reviewed. They were classified into self-report, observation, and measurement according to the type of assessment. No instrument measured all 3 areas of physical impairment. Five instruments were originally developed for the ICU patients. The most frequently applied instruments were the Medical Research Council and the 36-item Short Form Survey (physical component summary), which were used in 23 studies each. Only 13.8% of reviewed studies reported the reliability or validity of the instruments. Conclusion : Our results suggest that the appropriateness of instruments assessing physical impairment in PICS cannot be guaranteed. Despite the multidimensional concept of physical disabilities, most studies measured only one area, and studies that reported psychometric properties were limited. Accordingly, we propose to develop a unique and multifaceted instrument for ICU survivors.

Curriculum Redesign for Excellence in Medical Education (의학교육 수월성 제고를 위한 교육과정 재설계)

  • Yang, Eunbae B.
    • Korean Medical Education Review
    • /
    • v.16 no.3
    • /
    • pp.126-131
    • /
    • 2014
  • The purpose of this study is to analyze the medical education system of Korea and to propose a method of curriculum redesign. Although there have been many attempts by medical educators to improve the quality of medical education, the results have not been fruitful. First, there exists a limitation to the dualistic curriculum design based on Flexnerianism, and thus, this model does not provide an integrated experience to medical students. Therefore, we propose a unidimensional model for curriculum redesign. Second, it is impossible to promote excellence in medical education without solving the structural problems of teaching and learning, such as the teaching competency of the faculty, large-scale lectures, and team teaching systems. A curricular strategy that emphasizes mutual interaction and teaching accountability is necessary to promote meaningful learning. Third, the current clinical training system, the circulation model, provides incomplete training as well as a lack of sequence and articulation experiences. This system needs to be redesigned in a way that allows only those students who have mastered both the knowledge and the application of medical education to advance to the next step. Fourth, norm-referenced assessments of a medical college distort the learning process and create unconstructive system energy. A criterion-referenced assessment that values cooperation, independent study, and intrinsic motivation is more important for the reliability and validity of the assessment. Medical students should not focus on formative and informative learning. Medical colleges should investigate the multifaceted potential of the students and provide transformative learning to grow students into change agents. For this to take place, curriculum redesign-not new methods of medical education-is required.

Evaluation Index for the Supply Levels of Pedestrian Facilities in Residential Area Planning (택지개발지구에서 보행자도로 공급수준 평가지표 개발)

  • Choe, Jae-Seong;Hwang, Gyeong-Seong;Kim, Sang-Yeop;Jang, Yeong-Su;Park, Sin-Won
    • Journal of Korean Society of Transportation
    • /
    • v.27 no.2
    • /
    • pp.35-46
    • /
    • 2009
  • This paper presents an evaluation index for the supply levels of pedestrian facilities in residential area planning. The pedestrian facility supply levels reveal the quality of a residential area, and can be associated with the resident living standards and satisfaction, pedestrian safety levels, and the effectiveness of the construction cost. This research conducted multifaceted procedures for the index development, and these procedures start first by identifying dominant influencing factors on pedestrian travel demand by reviewing the final reports of site planning in more than eight already-completed residential development sites. Second, based on the Space Syntax model, which was initially developed in the UK by establishing statistical relationships among an integration index, population size (persons/day), and the total development area, this research formulated a set of pedestrian demand estimation models. Then these models were utilized in forming a pedestrian facility supply index by integrating the new models and their results with the available accepted practice in the residential planning sector. This was necessary because planners want to understand the total supply level of pedestrian facilities in a residential area during the initial design stage. Finally, to test the model validity in satisfying pedestrian satisfaction, the research included a resident satisfaction interview, and it was revealed that the evaluation index developed in this research could provide planners and engineers with more promising results. It is therefore anticipated that this research can be of service when designing pedestrian facilities in future residential area planning and design activities.

Analysis of Research Trends in Tax Compliance using Topic Modeling (토픽모델링을 활용한 조세순응 연구 동향 분석)

  • Kang, Min-Jo;Baek, Pyoung-Gu
    • The Journal of the Korea Contents Association
    • /
    • v.22 no.1
    • /
    • pp.99-115
    • /
    • 2022
  • In this study, domestic academic journal papers on tax compliance, tax consciousness, and faithful tax payment (hereinafter referred to as "tax compliance") were comprehensively analyzed from an interdisciplinary perspective as a representative research topic in the field of tax science. To achieve the research purpose, topic modeling technique was applied as part of text mining. In the flow of data collection-keyword preprocessing-topic model analysis, potential research topics were presented from tax compliance related keywords registered by the researcher in a total of 347 papers. The results of this study can be summarized as follows. First, in the keyword analysis, keywords such as tax investigation, tax avoidance, and honest tax reporting system were included in the top 5 keywords based on simple term-frequency, and in the TF-IDF value considering the relative importance of keywords, they were also included in the top 5 keywords. On the other hand, the keyword, tax evasion, was included in the top keyword based on the TF-IDF value, whereas it was not highlighted in the simple term-frequency. Second, eight potential research topics were derived through topic modeling. The topics covered are (1) tax fairness and suppression of tax offenses, (2) the ideology of the tax law and the validity of tax policies, (3) the principle of substance over form and guarantee of tax receivables (4) tax compliance costs and tax administration services, (5) the tax returns self- assessment system and tax experts, (6) tax climate and strategic tax behavior, (7) multifaceted tax behavior and differential compliance intentions, (8) tax information system and tax resource management. The research comprehensively looked at the various perspectives on the tax compliance from an interdisciplinary perspective, thereby comprehensively grasping past research trends on tax compliance and suggesting the direction of future research.

Trade Facilitation for the Products of the Industry 4.0: The case of Customs Classification of Drone

  • Yi, Ji-Soo;Moon, So-Young
    • Journal of Korea Trade
    • /
    • v.23 no.8
    • /
    • pp.110-131
    • /
    • 2019
  • Purpose - This paper investigates the implications for facilitating trade in the products of Industry 4.0. To identify the issues caused by the conflicts of policy objectives such as applying the tariff concession under the ITA and imposing the export control, by exploring the case of classification of drones. Design/methodology - We adopted a single case study method to gain a deeper understanding of the complex and multifaceted issues of Customs classification in the context of facilitating trade in the products of Industry 4.0. This study employs the case of drones to explore how these issues of Customs classification affect trade facilitation. We ensured the internal validity of the study by confirming the pattern of the results with the existing theories. Findings - Our main findings can be summarised as follows: the intrinsic nature of the products that converge several technologies causes issues in the classification. The inconsistency in product classification delays customs clearance by hindering the Customs risk-management system that pinpoints products subject to controls. To address the issues, therefore, we proposed fundamental reforms of Customs to empower themselves with management roles. Facilitating trade in the products of Industry 4.0 requires more enhanced Customs capability. Therefore, the reforms should include comprehensive capacity-building activities, such as changes in staff-trainings, promotion system, organisation and culture. Customs also need roles in robust designing of cooperative systems to compensate for the lacks of controls and to ensure concrete risk management for expedited Customs procedures. As well, by equipping the Single Window of Customs with crucial control functions of other ministries, Customs need to support the cooperation. The role of harmonising various preaudits of other ministries with its own is another essential role that ensures predictability of clearance procedure. Originality/value - There are scanty studies in the field of knowledge about what obstacles exist and what solution is available in the course of transforming to 'Industry 4.0'. In filling out the gap of knowledge, this paper is of academic significance in that it applies the research theory on trade facilitation for the specific cases of classification of the product of Industry 4.0 to verify its effectiveness and to extend the subject of the studies to the scope of Industry 4.0. It also has practical significance in that the results have provided implications for reforms of Customs procedures to facilitate trade in the products of Industry 4.0.