• Title/Summary/Keyword: Validity Evaluation

Search Result 1,877, Processing Time 0.038 seconds

Preventive Health Management Self-Efficacy related to Premature Labor (PHMSE-PL) scale for Korean women of childbearing age: instrument development and validation

  • Kim, Sun-Hee;Lee, Yu-Jin
    • Child Health Nursing Research
    • /
    • v.28 no.3
    • /
    • pp.218-229
    • /
    • 2022
  • Purpose: This study aimed to develop and examine the validity and reliability of a self-efficacy scale for preventive health management related to premature labor (PHMSE-PL) for women of childbearing age. Methods: Instrument development and validation were undertaken in three steps: conceptualization through a literature review and in-depth interviews, item generation and evaluation of content validity, and evaluation of construct validity and reliability. The content validity, factorial structure validity, and internal consistency reliability of the PHMSE-PL were evaluated, and cognitive interviewing was undertaken. Data were analyzed using confirmatory factor analyses, Cronbach's α, and 95% confidence intervals (CIs). Results: The content validity was assessed by experts and was strengthened through cognitive interviews with women of childbearing age. The PHMSE-PL comprised 34 items across five factors. The construct validity of the PHMSE-PL was supported. Cronbach's α for the total scale was .97 (95% CI=.96-.97). Conclusion: An evaluation of the psychometric properties of the PHMSE-PL scale found it to be a valid and reliable tool for women of childbearing age. The scale appears to be useful for women of childbearing age to self-assess their preventive health management self-efficacy related to premature labor and for health professionals to evaluate and promote women's preventive health management.

A Study on Controlling the External Effect in Student Evaluation of Teaching

  • Lee S. W.;Lee K. H.
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.3
    • /
    • pp.589-601
    • /
    • 2005
  • Student evaluation of university teaching is a common tool for measuring the educational contribution of a professor and improving the quality of classes. There, however, exist external factors in the beyond of control of a instructor, which affect the result of Student's rating to prevent practical use of evaluation for administrative purpose. This paper investigates the factors that spoil the validity and the reliability of student evaluation and proposes a method to control the effect by the statistical analysis of evaluation data of Jeonju University for two years.

Development of Ubiquitous Information Projects Evaluation Models and Indexes (유비쿼터스 정보화사업 평가모형 및 지표 개발에 관한 연구)

  • Kim, Ki-Ho;Kim, Jae-Jon;Lee, Sang-Joon
    • Journal of Digital Convergence
    • /
    • v.6 no.3
    • /
    • pp.1-12
    • /
    • 2008
  • This research aims at developing and distributing models and indexes that can evaluate ubiquitous information projects in order to enhance the objectivity and validity of their evaluation. The research adopts a BSC(Balanced Score Card) concept with four views, economic, policy, social, and technical views. The research induces a model of pre-evaluation and a model of post-evaluation according to each view. In order to secure the validity of the models, they are revised and complemented by obtaining advice through interviews with five experts in related fields, and the validity and application possibility of the indexes are verified by surveying ten people working in those fields. Finally, investigating their weights according to the importance of each view and index, they are evaluated using an AHP (Analytic Hierarchy Process) method.

  • PDF

Development of Program Outcomes Evaluation System for Multidisciplinary Major in Design and Software (디자인과 소프트웨어 융합전공의 프로그램 학습성과 평가체계 개발)

  • Choi, Ji-Eun;Kim, Hakil;Jin, Sung-Hee
    • Journal of Engineering Education Research
    • /
    • v.22 no.6
    • /
    • pp.74-88
    • /
    • 2019
  • In recent years, the design has formed and operated convergence education in conjunction with many other academic fields, and ABEEK also encourages the participation of convergence engineering programs. The purpose of this study is to require design and software convergence major to operate program that accord engineering education certification criteria to develop a program outcomes evaluation system and examine its validity. The program outcomes evaluation system was developed in accordance with development research methods and procedures. As a result, developed evaluation system program outcomes for convergence-based program outcomes: convergence ability, creative thinking ability, entrepreneur ability, and design ability. Finally, it revised and supplemented them through expert validity examine. Expert validity review included 9 experts in engineering, IT engineering, education technology, and design. The validity, usefulness, intelligibility, universality, and explanatory power of the evaluation system were reviewed. The results of this study are expected to provide practical tools for operating ABBEK of convergence programs between design and engineering.

Translation and psychometric evaluation of the Korean version of the fertility awareness and attitudes towards parenthood questionnaire

  • Shin, Hyewon;Hong, Minjoo;Jo, Minjeong;Lee, Jungmin
    • Child Health Nursing Research
    • /
    • v.27 no.3
    • /
    • pp.256-265
    • /
    • 2021
  • Purpose: This study presents a translation, cultural adaptation, and psychometric evaluation of two instruments of the Fertility Awareness and Attitudes Towards Parenthood (FAAP) questionnaire (Conditions and Life changes) for use in South Korea. Methods: This methodological study included 166 university students for psychometric evaluation in the sixth step. The first five steps included forward translation, backward translation, committee review, assessment of content validity, and a pre-test. In the sixth step, psychometric properties, including internal consistency, construct validity, and criterion validity, were evaluated. Exploratory factor analysis and confirmatory factor analysis were conducted to identify the structure of the tool and to assess its validity. Results: The Korean version showed acceptable internal consistency. Cronbach's α was .73 for FAAP-Conditions and .83 for FAAP-Life changes. FAAP-Conditions showed a four-factor structure (social conditions, relationship with partner, external environment, and child-rearing support) and FAAP-Life changes had a two-factor structure (reward and burden). In the confirmatory analysis, CMIN/DF, TLI, IFI, SRMR, CFI, and RMSEA were satisfactory. Conclusion: This study provided preliminary evidence of the acceptability, reliability, and validity of the Korean version of the FAAP questionnaire in university students in South Korea. Nonetheless, further evaluation among Korean young adults is warranted to validate this instrument.

The Validity and Reliability of a Lifestyle Evaluation Tool for Patients with Metabolic Syndrome (대사증후군 대상자의 생활습관 평가 도구 개발을 위한 타당도와 신뢰도 검증)

  • Kang, Se-Won
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.17 no.4
    • /
    • pp.487-497
    • /
    • 2010
  • Purpose: This study examined the validity and reliability to develop a lifestyle evaluation tool for metabolic syndrome patients. Methods: A methodological research design was used. The construct factors and preliminary items were identified by reviewing previous researches and tools related to lifestyle and reviewed by ten experts. It was tested with 195 patients with metabolic syndrome in a university hospital. The data were analyzed with SPSS/WIN 14.0. Results: To test the validity, principal component analyses were used and resulted in the extraction of six components. The convergent validity resulted r= .72 (p<.001) with Health Promotion Lifestyle Profile. The discriminant validity with Center for Epidemiologic Studies Depression Scale resulted r= -.15 (p=.004). The Internal consistency of the tool had an Cronbach's a of .92. The self-report format Lifestyle Evaluation Tool for the patients with metabolic syndrome was developed with 36 items and four-rating scales:'physical activity and weight control' eight items, 'dietary habits' sixteen items, 'drinking and smoking' three items, 'sleep and rest' two items, 'stress' three items, 'drug and health management' four items. Conclusion: This Tool will evaluate health behaviors in patients with metabolic syndrome. Also, it will contribute to the development of nursing intervention to improve the metabolic syndrome patients' lifestyle.

Development of the Program Evaluation Measurement of Continuing Nursing Education Programs (간호사 보수교육 프로그램 평가도구 개발)

  • Jho, Mi Young;Kim, Miyoung
    • Journal of Korean Academy of Nursing
    • /
    • v.43 no.2
    • /
    • pp.236-246
    • /
    • 2013
  • Purpose: This study was done to develop a measurement tool for evaluation of continuing nursing education programs and to verify its validity for effective management and quality of education programs. Methods: The draft of the evaluation measurement was developed from consultation with professionals, focus group interviews targeting groups of nurses, and individual interviews with education program planners. After 6 professionals examined content validity, 46 items were retained. A pilotsurvey was conducted to confirm the time required to complete the questionnaire and the level of understanding of general content and each item in the questionnaire. Construct validity was verified through exploratory factor analysis of data from a survey with 44 items completed by 452 nurses and 59 education program planners. Results: The final evaluation measurement for continuing nursing education programs consisted of 6 evaluation factors and 36 evaluation items. The 6 evaluation factors included identifying program goals and target groups, program planning, performance, operation and management, program outcomes, and program effectiveness. Conclusion: The evaluation measurement for continuing nursing education programs developed in this study is considered suitable to utilize as an evaluation measurement of the quality of continuing education programs for nurses.

Development of an Evaluation Instrument for Service Quality in Nursing Homes (노인요양시설 서비스 질 평가 도구 개발)

  • Lee, Ji-A;Ji, Eun-Sun
    • Journal of Korean Academy of Nursing
    • /
    • v.41 no.4
    • /
    • pp.510-519
    • /
    • 2011
  • Purpose: The purposes of this study were to identify the factors influencing service quality in nursing homes, and to develop an evaluation instrument for service quality. Methods: A three-phase process was employed for the study. 1) The important factors to evaluate the service quality in nursing homes were identified through a literature review, panel discussion and focus group interview, 2) the evaluation instrument was developed, and 3) validity and reliability of the study instrument were tested by factor analysis, Pearson correlation coefficient, Cronbach's ${\alpha}$ and Cohen's Kappa. Results: Factor analysis showed that the factors influencing service quality in nursing homes were healthcare, diet/assistance, therapy, environment and staff. To improve objectivity of the instrument, quantitative as well as qualitative evaluation approaches were adopted. The study instrument was developed with 30 items and showed acceptable construct validity. The criterion-related validity was a Pearson correlation coefficient of .85 in 151 care facilities. The internal consistency was Cronbach's ${\alpha}$=.95. Conclusion: The instrument has acceptable validity and a high degree of reliability. Staff in nursing homes can continuously improve and manage their services using the results of the evaluation instrument.

A study on clinical evaluation method of nursing student in nursing management practice (간호관리실습 평가방법에 관한 연구)

  • 박성애;이병숙
    • Journal of Korean Academy of Nursing
    • /
    • v.14 no.2
    • /
    • pp.5-11
    • /
    • 1984
  • The main purpose of this study were; to determine the reliability and validity of evaluation tool administered to the nursing student in nursing management practice,;to identify the effective evaluation method of nursing student in nursing management practice. The subjects were 46 senior nursing students at Department of Nursing, College of Medicine, Seoul National University in 1983. The evaluation tool was analyzed according to evaluation method; self-evaluation. and head nurse evaluation. Also individual item of evaluation tool was analyzed by item analysis in order to determine the evaluation area, and appropriateness of the test item used. A Summary of the results is as follows; 1. The reliability and validity of evaluation tool were relatively high both in self-evaluation and head nurse evaluation. 2. In comparison of mean scores, there is no significant difference between head nurse evaluation and self-evaluation. 3. The nursing management activities which have the correlation of self-evaluation and head nurse evaluation were in the activity of interpersonal relation, independent activity and implementing nursing process. In general nursing practice and unit management activity, there was no correlation of self-evaluation and head nurse evaluation.

  • PDF

Reliability and Validity Analysis of an Instrument for Pattern Identification and Evaluation in Chemotherapy-Induced Peripheral Neuropathy (항암제 유발 말초신경병증 변증평가도구의 신뢰도 및 타당도 평가)

  • Park, Ji-hye;Jung, In-chul;Lee, Seo-hyun;Lee, Suk-hoon;Choi, Seok-cheol;Yoo, Hwa-seung
    • The Journal of Internal Korean Medicine
    • /
    • v.37 no.4
    • /
    • pp.631-644
    • /
    • 2016
  • Objectives: The purpose of this study was to evaluate the reliability and validity of an instrument for pattern identification and evaluation in chemotherapy-induced peripheral neuropathy (CIPN).Methods: The study consisted of 66 patients with CIPN (visual analog scale ≥30 mm, Eastern Cooperative Oncology Group ≤2). The test-retest reliability of the instrument for pattern identification and evaluation in CIPN was tested twice with the same patients in one week.Results: Pearson’s coefficient test-retest reliability of the instrument was 0.601-0.777. The internal reliability of each part was 0.619-0.811. To confirm the validity of the instrument for pattern identification and evaluation for CIPN, the correlation between the score for each identification pattern and that of other CIPN instruments was analyzed. The results revealed a positive correlation between the Functional Assessment of Cancer Therapy-General and CIPN-20.Conclusion: The reliability of the instrument for pattern identification and evaluation in CIPN was moderate, and the validity analysis revealed a positive correlation.