• Title/Summary/Keyword: Development of evaluation scale

Search Result 981, Processing Time 0.031 seconds

A Preliminary Study for the Development of An Assessment Scale for Early Childhood Programs in Korea (유아교육 프로그램 평가척도 개발에 관한 예비 연구)

  • Rhee, Un Hai;Lee, Ki Sook
    • Korean Journal of Child Studies
    • /
    • v.15 no.1
    • /
    • pp.5-21
    • /
    • 1994
  • The purpose of this study was to develop a scale for evaluation of early childhood programs in Korea. The procedures included content validation and a pilot test. A total of 192 items in 10 major areas was developed based on the review of literature and discussions with professionals in early childhood education. The 10 areas include: scheduling, curriculum, interation, physical environment, materials, nutrition, health and safety, administration, staff qualifications, relationships with parents, and evaluation. The pilot scale was administered to 428 classroom teachers and directors, and 47 college professors in early childhood education. The items were rated on a 3-point scale in terms of importance as evaluation criteria. The methods for data analysis included item means and standard deviations for content validation, Cronbach ${\alpha}$ for reliability, and factor analysis for construct validity. Most items in 10 areas were rated as moderate to highly important (average 2.3), especially items in curriculum and staff qualifications. Two factors emerged from the data: institutional management, and curricular planning and implementation. The Cronbach ${\alpha}$ levels were .70 or higher in most areas, but the range covers from .48 to .91. Based on the pilot data, 143 items were selected for the second year study.

  • PDF

Application of analytic hierarchy process technique for selecting a hydrothermal energy site (수열에너지 입지 선정을 위한 계층화분석법의 적용)

  • Joohyun Ahn;Suwan Park;Changhyun Oh
    • Journal of Korean Society of Water and Wastewater
    • /
    • v.38 no.2
    • /
    • pp.69-81
    • /
    • 2024
  • In this study, an evaluation system that can be used to evaluate the feasibility of developing and supplying hydrothermal energy for the operation of large-scale complex facilities was developed. To this end, this study derived factors to be considered when selecting a location for the use of hydrothermal energy using raw water from multi-purpose dams and regional water supply systems through literature survey and expert interviews. The evaluation indicators derived from this study are divided into four sectors: hydrothermal energy utilization factors, location factors, planning factors, and disaster safety factors, and are composed of 10 mid-level indicators and 34 detailed planning indicators. The relative importance of all factors was derived using the Analytic Hierarchy Process (AHP) technique, and the developed evaluation indicators and relative importance were applied to four multi-purpose dam regions in the country. As a result, it was found that in the development and use of hydrothermal energy utilizing regional raw water supply line the urban planning conditions of the supply site can have a greater impact on the location selection results than the hydrothermal energy development itself. Due to the characteristics of the evaluation indicators developed in this study and their nature as comprehensive indicators, it is believed that the results should be applied to determine the overall adequacy of site selection in the early stages of hydrothermal energy development. In the future, it is believed that it will be necessary to analyze the problems in supplying and operating hydrothermal energy using raw water from multi-purpose dams and regional water resources. Based on the analysis the evaluation system developed in this study is expected to be improved and supplemented.

Development and Psychometric Evaluation of the Resuscitation Self-efficacy Scale for Nurses

  • Roh, Young Sook;Issenberg, S. Barry;Chung, Hyun Soo;Kim, So Sun
    • Journal of Korean Academy of Nursing
    • /
    • v.42 no.7
    • /
    • pp.1079-1086
    • /
    • 2012
  • Purpose: The purpose of this study was to develop and evaluate psychometric properties of the instrument, Resuscitation Self-Efficacy Scale for nurses. Methods: This was a methodological study for instrument development and psychometric testing. The initial item pool derived from literature review and experts resulted in 30 items linked to resuscitation self-efficacy. A convenience sample of 509 Korean nurses from eleven academic teaching hospitals participated in a survey to examine psychometric properties of the scale. To examine construct validity, exploratory factor analysis and known-group comparison were used. Cronbach's coefficient alpha was used to determine the scale's internal consistency reliability. Results: The final scale included 17 items with four-component structure termed 'Recognition', 'Debriefing and recording', 'Responding and rescuing', and 'Reporting'. These four factors accounted for 57.5% of the variance. Each subscale and the total scale demonstrated satisfactory internal consistency: .82; .88; .87; .83; and .91 respectively. Experienced nurses reported significantly higher self-efficacy mean scores in both total and subscales compared to new graduate nurses. Conclusion: The Resuscitation Self-Efficacy Scale for nurses yields reliable and valid results in appraising the level of resuscitation self-efficacy for Korean nurses. Further study is needed to test and refine the scale.

Development of a Task Performance Evaluation Instrument for Clinical Nurses (임상간호사의 업무수행 평정도구개발)

  • Paik, Hyun-Ok;Han, Sang-Sook;Lee, Sang-Chul
    • Journal of Korean Academy of Nursing
    • /
    • v.35 no.1
    • /
    • pp.95-103
    • /
    • 2005
  • Purpose: The purpose of this study was to develop an instrument of task performance evaluation for clinical nurses, thus testing the validity and the reliability of the scale. Method: Data was collected from 84 Head Nurses and 255 General Nurses. A conceptual framework, composed of 4 factors of meaning in task performance evaluation, was identified through review of the relevant literature. A total of 78 items were developed and were used on a five-point likert scale. Through factor analysis, items whose factor loading was below 0.50 were deleted, thus 35 items remained. To test the validity and reliability of the instrument, the SPSS 11.0 windows program was used. Result: The results of the factor analysis indicated that 4 factors were classified and the cumulative percent of variance was 67.54%. The results of the reliability test indicated that Cronbach's coefficient of the total 35 items was over 0.9176. The results of the factor analysis indicated that factor loadings of all items was over 0.50. Conclusively, the validity and the reliability of the scale were proven. Conclusion: This study was identified as a tool with a high degree of reliability and validity.

A Study of Quality Evaluation for SDR System Operating Software (SDR 시스템의 운용소프트웨어 품질평가에 관한 연구)

  • Kim, Min-Soo;Lee, Kun-Joon;Ha, Sung-Jae;Cho, Sang-Young
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.6
    • /
    • pp.657-664
    • /
    • 2014
  • In this paper, we described evaluation software that can propose rating scale and evaluate automatically on SDR(Software-Defined Radio) transmitter system. To deduct suitable rating scale, we extracted requirements based on the operating environment, operating application and operating method because SDR operating software is subordinative to the hardware. And we implementation evaluation software to automatically quality evaluation using rating scale draw from the requirements. The implemented evaluation software has automatically evaluation functions using script, can update the evaluation factor and show visual evaluation result. The implemented evaluation software is used to useful the high quality SDR operating software development.

The Development of An Instrument for Evaluating Inquiry Activity in Science Curricula (과학 탐구 평가표의 개발)

  • Hur, Myung
    • Journal of The Korean Association For Science Education
    • /
    • v.4 no.2
    • /
    • pp.57-63
    • /
    • 1984
  • An inquiry approach in teaching science has been advocated by many science educators for the past few decades, and most elementary and secondary science curricula have incorporated it in varying degrees. It has been proven in recent studies, however, that there exists considerable discrepancy between the expectation of outcomes of the inquiry approach and the actuality. This in part implies that there is a somewhat urgent need for the systematic evaluation of the approach in teaching science. The purpose of this study is to develop a comprehensive instrument for evaluating inquiry teaching approaches embedded in science curricular materials. To develop a more valid and reliable instrument a set of empirical data was used in the developmental procedure, and most of the previous studies regarding inquiry teaching method and inquiry evaluation were consulted. The inquiry evaluation method developed in this study, called the Scientific Inquiry Evaluation Inventory (SIEI), is composed of three parts: (1) analyzing and coding each science process task of inquiry activity; (2) evaluating each inquiry activity as a whole; and (3) evaluating each science laboratory curriculum as a whole. The first part of the instrument consists of twenty science process categories and thirty subcategories grouped into four sections: (1) gathering and organizing data; (2) interpreting and analyzing data; (3) synthesizing results and evaluation; and (4) hypothesizing and designing an experiment. The science process categories are arranged according to the level of difficulty, psychological level of thinking, degree of creativity demand, and the model of the process of scientific inquiry, which is also developed in the study. The second part of the instrument contains four evaluation scales of inquiry activity: (1) competition/cooperation scale; (2) discussion scale; (3) openness scale; and (4) inquiry scope scale. And the last part consists of three methods for evaluating a science laboratory curriculum as a whole: (1) inquiry pyramid; (2) inquiry index; and (3) difficulty index. The instrument is designed to be used by teachers, science curriculum developers and science education evaluators for the purpose of diagnosing the nature and appropriateness of scientific inquiry introduced in secondary science curricular materials, especailly in laboratory work and field work.

  • PDF

Development of a Behavior Rating Scale for Preschool Children (아동의 행동발달 평정척도 개발에 관한 연구)

  • RHEE, Un Hai;KOH, Yun Joo
    • Korean Journal of Child Studies
    • /
    • v.9 no.2
    • /
    • pp.1-28
    • /
    • 1988
  • The purpose of this study was to develop a behavior rating scale for the evaluation of children's development for utilization by preschool teachers. The procedures for the study included content validation, pilot test, and main study. A total of 97 items were retained after the content validation and pilot test. The items of the scale were grouped into five areas (physical, language, cognitive, emotional, and social development) and 11 sub-areas. The resulting "Behavior Rating Scale for Preschool Children" was administered to 479 boys and girls, 3-6 through 6-5 years of age, selected from 10 different kindergartens and early education centers in Seoul, Pusan, and Chonju. The analysis of data was done with SPSS computer programs, including item analysis, Cronbach's ${\alpha}$ for reliability, factor analysis to test construct validity, two-way ANOVA to test age and sex differences, and percentile norms. The 97 items of the scale were found to be satisfactory in terms of item discrimination with indices ranging from .31 to .73. Cronbach's ${\alpha}$ was .98 for the total scale and ranged from .87 to .93 in specific domains, which was considered satisfactory. The factors extracted from each area were consistent with the educational objectives of the Yonsei Open Education Program except for emotional development. The intercorrelations among the domains were relatively high, ranging from .56 to .81. Age differences were significant in cognitive, physical, and language development, but not significant in social and emotional development. Sex differences were significant in all areas with girls higher on the average than the boys. Percentile ranks were drived from the total score for each age group and quartiles were calculated for sub-scores in each domain.

  • PDF

Development of a Quality Evaluation Standard for Educational Serious Games

  • Yoon, Seon-Jeong;Park, Hee-Sook
    • Journal of information and communication convergence engineering
    • /
    • v.11 no.2
    • /
    • pp.103-111
    • /
    • 2013
  • Given the lack of suitable quality evaluation standards for educational serious games (designed for both entertainment and instruction), we designed a development framework for evaluation standards of educational serious games and proceeded to develop standards in accordance with our proposed procedure. Our standards were designed to evaluate the quality of both technical and non-technical elements of educational serious game software products. We conducted a survey on the need for individual elements of the standard. Participants rated the need for each element on a five-point Likert scale. We then performed a reliability analysis of the survey results. Based on the survey results, we established a final standard for quality evaluation composed of 9 main elements and 31 sub-elements. The results of our research will contribute useful information to users as well as to the developers of educational serious games.

Development of the Developmental Support Competency Scale for Nurses Caring for Preterm Infants (미숙아 발달지지를 위한 간호역량 측정도구 개발)

  • Kim, Jeong Soon;Shin, Hee Sun
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.6
    • /
    • pp.793-803
    • /
    • 2016
  • Purpose: Developmental care has been recognized as a very important component for the development and health promotion of preterm infants. However, research on how to assess developmental nursing competency has not been studied as expected. This study was done to develop and evaluate a new scale to measure nursing competency for developmental support of preterm infants. Methods: Concept analysis was done with using the Hybrid model of Schwartz-Barcott and Kim (2000), from which a preliminary new scale (30 items) was developed. To test the validity and reliability of the new scale being developed, data were collected from 122 NICU nurses at 4 hospitals in 3 cities in the Republic of Korea, from December, 2014 to March, 2015. Results: The final version of the Developmental Support Competency Scale for Nurses (DSCS-N) caring for premature infants was a 4-point Likert type scale, consisting of 19 items, and categorized as 6 factors, explaining 62.5% of the total variance. Each of the factors were named as follows; 'environmental support' (4 items), 'parental support' (3 items), 'interaction' (3 items), 'critical thinking' (3 items), 'professional development' (3 items), and 'partnership' (3 items). The Cronbach's ${\alpha}$ coefficient for the scale was .83 and the reliability of the subscales ranged from .60~.76. Conclusion: The psychometric evaluation of the new scale demonstrated an acceptable validity and reliability. Findings indicate that the DSCS-N can be used as the tool to test the effect of educational programs for nurses and contribute to advance developmental care for preterm infants.