• Journal of the Korean Institute of Traditional Landscape Architecture
• /
• v.33 no.3
• /
• pp.103-113
• /
• 2015

This study is an evaluation index development research based on Gyeongju Historic Heritage Sites to identify the attractive Properties of Gyeongju, which decided to competitiveness of the historical city. We got the export Indicator candidate groups by the literature reviews and UNESCO, ICOMOS, and 49 Indicator candidate groups had been selected. In the end, we chose 42 attraction indexes in charm of the cultural heritage side, Cultural heritage tourism resources Side, Restraining force Heritage tourism Side three aspects based on the analysis of Importance(M), Standard deviation(SD), Content Validity Ratio(CVR), Agreement, convergence by using Delphi Technique. We can determine these indicators will be useful basic information, for improving the city's historic attractions. In the future, used these indicators as a basis for Attractions effectiveness evaluation of Gyeongju, Through which the attractions of Gyeongju can be re-recognized.

• Journal of Nutrition and Health
• /
• v.50 no.1
• /
• pp.111-119
• /
• 2017

Purpose: School meal programs should be part of the educational process to promote good eating habits for students. The purpose of this study was to develop an evaluation scale for educational school meal programs and evaluate the achievement level of educational school meal programs using the developed scale. Methods: The evaluation scale for educational school meal programs consisted of 23 items in eight categories and was developed using content validity ratio (CVR) analysis and analytic hierarchy process (AHP) by 15 related experts. The results of a survey on nutrition teachers or dietitians at 91 elementary, middle, and high schools in Gyeonggi province, South Korea were analyzed to evaluate the achievement levels of educational school meal programs. Results: Overall, total average score was 45.7 out of 100, with significant differences among schools (p = 0.005). Elementary schools (51.9) showed a higher average score than middle (41.5) and high schools (37.1). The score for the category of regular nutrition and dietary education was the lowest (5.7 out of 33.7). In addition, school meal environment (5 out of 10), educational activities through school meal time (9.2 out of 19), and extra-curricular experiential activities (3.5 out of 10) also showed inadequate levels. Conclusion: The results show that the overall level of educational school meal programs is not adequate and needs to be improved, especially at middle and high schools. Government support polices need to be implemented to encourage educational activities related to school meal programs.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.42 no.6
• /
• pp.31-38
• /
• 2014

This study is an evaluation index development research based on the Gyeongju Historic Heritage Sites to identify the attractive properties of Gyeongju that have helped determine the competitiveness of this historical city. Through literature reviews on these attractive factors of historic urban landscape, the Vienna memos(UNESCO, 2005) and the International Cultural Tourism Charter(ICOMOS, 1999), two professional investigations were conducted following a backup group of attraction indexes that had been received prior. In the end, 22 attraction indexes were chosen in the Urban Historical and Cultural area, the Heritage Resources area, and the Urban Environment area with three aspects based on the analysis of Importance(M), Standard deviation(SD), Content Validity Ratio(CVR), Agreement, and convergence. These indicators will be useful basic information for improving the city's historic charms. In the future, these indicators can be used as a basis for evaluating the characteristic charms of Gyeongju, through which the charm of Gyeongju can be re-recognized.

• Korea Journal of Hospital Management
• /
• v.23 no.4
• /
• pp.15-25
• /
• 2018

Purposes: The objectives of this study present the direction of the criteria for the separately reimbursement of therapeutic medical device. Methodology: We summarized experts' opinion using Delphi survey and Analytic Hierarchy Process(AHP). 48 experts were gathered from Medical Insurance Review Nurses Association, medical device industry, academy and association, Medical Device Expert Evaluation Committee. Descriptive statistics, consistency index, content validity ratio were analyzed. Findings: Clinical utility, patient safety, infection control, cost-homogeneity, cost-effectiveness showed high feasibility and importance, but market contribution and functional utility showed low feasibility and importance in a relative sense. The results of functional utility differed between clinical and non-clinical experts. Measurability was low across the whole area. Among the criteria for the separately reimbursement of therapeutic medical device. Patient safety/infection control and clinical utility showed the highest relative importance values, analyzed using AHP. Practical Implications: Patient safety and infection control are needed to be considered as one of Value Assessment Criteria. It is important to find out how to improve the measurability of therapeutic medical device.

• Journal of dental hygiene science
• /
• v.22 no.2
• /
• pp.115-125
• /
• 2022

Background: In the dental hygiene curriculum, efforts are being made to introduce an integrated curriculum based on the competency of a dental hygienist. Because there is a connection and overlap in learning contents between Dental Nutrition and Oral Biochemistry, which are basic dental hygiene subjects, it is possible to integrate these two subjects. This study aims to derive Nutritional Biochemistry as an integrated curriculum for Dental Nutrition and Oral Biochemistry, and to develop learning goals and competencies for Dental Nutritional Biochemistry. Methods: The learning contents of the integrated curriculum were composed by referring to the contents of the Dental Nutrition and Oral Biochemistry textbooks, and learning goals were derived from the learning contents. Moreover, competency was developed by analyzing the duties of a dental hygienist that can be performed through the learning goals. The Delphi survey was conducted twice to verify the content validity ratio (CVR) of the competence and the learning goal of the integrated curriculum. Results: In the first Delphi survey, the CVR for two competencies was 0.56 or higher. Moreover, it was revised based on expert's opinions, and as a result of the second Delphi survey after the revision, the CVR was either increased or maintained. Eighty-five learning goals were derived by referring to the textbook. According to CVR and expert opinions, after the first Delphi survey, the number of learning goals was reduced to 69. After the second Delphi survey, 68 learning goals were finally derived. Conclusion: The development process of the integrated curriculum conducted in this study can be utilized for integration between subjects in basic dental hygiene.

• Journal of Acupuncture Research
• /
• v.39 no.2
• /
• pp.105-114
• /
• 2022

Background: The objective structured clinical examination (OSCE) is used in the colleges of Korean Medicine, but few studies have validated the OSCE evaluation criteria or post-education questionnaires. Diagnostic ultrasound is used in Korean medicine treatment including acupuncture, acupotomy, and pharmacopuncture to increase the safety and efficacy of treatment. We aimed to develop and validate a OSCE checklist and questionnaire for diagnostic musculoskeletal ultrasound training. Methods: A OSCE checklist and rubric for diagnostic ultrasound training, and questionnaire was developed using literature research. Eight expert panelists verified each draft item in a single-round survey. Items with a content validity ratio (CVR) < 0.75 were excluded or modified to reflect the experts' opinions. Results: The OSCE checklist and rubric for diagnostic ultrasound training focusing on volar wrist and carpal tunnel syndrome included: 15 items revised according to CVR and expert opinions, the pre-examination procedure, structures to be identified by ultrasound, scans with 2 diagnostic criteria for carpal tunnel syndrome, an explanation of the exam results, and the post exam procedure. The questionnaire consisted of 15 items, including the overall evaluation of training, the effect of the OSCE, and the perception of the ultrasound. All 6 self-evaluation items were not revised, as they had a CVR of ≥ 0.75. Conclusion: An ultrasound OSCE for scanning the volar wrist and diagnosing carpal tunnel syndrome was developed using 15 validated tasks, 15 survey questions about ultrasound training, and 6 questions for self-evaluation. These results may be used in the future for education in diagnostic ultrasound.

• Journal of the Korean Society of Food Culture
• /
• v.39 no.1
• /
• pp.13-29
• /
• 2024

A checklist of dietary behavior items for the elderly was developed based on Korean dietary guidelines. First, a literature review was conducted, and 63 preliminary items, including 30 items on food intake, 12 on eating habits, and 21 on dietary culture, were obtained to evaluate the dietary guidelines. The preliminary items were evaluated by experts using Lawshe's method to verify the content validity. They were then revised, resulting in 52 items: 25, 11, and 16 in the food intake, eating habits, and dietary culture domains, respectively. A face-to-face survey was conducted on 331 people over 65 years of age in the metropolitan area, and their one-day food intake was surveyed using a 24-hour recall method in August 2022. The 48 items, including 24, 11, and 13 items on food intake, eating habits, and dietary culture, respectively, correlated significantly with the evaluation indicators of nutrient intake, such as mean adequacy ratio, dietary diversity score, and nutrient intake density. These items were considered suitable for evaluating the elderly's compliance with dietary guidelines.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.20 no.5
• /
• pp.163-173
• /
• 2020

In this study, on-site corporate instructors participated as student-cum-workers in a degree-linked high skills Meister course to improve job competency and practical ability as proposed in the Work-Study Career Vision. Evaluation questions were then developed and their validity was verified by assessing satisfaction related to expected goals in enhancing advanced training guidance and competency as an evaluator. Satisfaction assessment was conducted based on training preparation, training implementation, training effectiveness and training administration. The Delphi Method was adopted and a total of 48 items were developed in 6 categories under 4 main areas. There were 7 evaluation items on the satisfaction of training course development under training preparation, 21 evaluation items related to the satisfaction of Off-JT and OJT courses under training implementation, 16 evaluation items related to the satisfaction of increased competency as an on-site corporate instructor and the satisfaction of enhanced practical skills and skills application at work under training effectiveness, as well as 6 evaluation items to assess satisfaction with administrative support under training administration. The final conformity assessment was conducted based on the stability, content validity ratio, consensus and convergence indicators of the developed items. Results of this study do not only apply to quality management of the high skills Meister course which is being promoted as a pilot project for work-study programs, but also serves as a rationale that may be considered as a basic research tool in the collection of various opinions to derive overall system improvement factors for the work-study high skills Meister course.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.139-158
• /
• 2023

Defining a competent doctor is important for educating and training doctors. However, competency frameworks have rarely been validated during the process of their development in Korea. The purpose of this study was to validate the patient-centered doctor's competency framework, which had been developed by our expert working group (EWG). Two rounds of Delphi questionnaire surveys were conducted among a panel of experts on medicine and medical education. The panel members were provided with six core competencies, 17 sub-competencies, and 53 enabling competencies, and were asked to rate the importance of these competencies on a 5-point Likert scale. Between April and July 2021, a total of 28 experts completed both rounds. The data of the Delphi study were analyzed for the mean, standard deviation, median, inter-rater agreement (IRA), and content validity ratio (CVR). A CVR >0.36 and IRA ≥0.75 were deemed to indicate validity and agreement. This study found that five enabling competencies were not valid, and agreement was not reached for three sub-competencies and two enabling competencies. In consideration of CVR and the individual opinions of panel members at each session, the final competencies were extracted through consensus meetings of the EWG. The competencies were modified into six core competencies, 16 sub-competencies, and 47 enabling competencies. This study is meaningful in that it proposes patient-centered doctor's competencies enabling the development of residents' milestone competencies, an assessment system, and educational programs.

• The Journal of Korean Medicine
• /
• v.45 no.1
• /
• pp.182-201
• /
• 2024

Objectives: This study was conducted to develop a standard acupotomy consent form that takes into account the unique characteristics of Korean Medicine. The study was motivated by the increasing importance of patient autonomy and the growing number of legal disputes related to medical malpractice in the clinical field of Korean Medicine. Methods: The analysis phase of the study involved a survey of the current status of acupotomy consent forms in Korean Medicine hospitals nationwide. The items of each form were analyzed based on the contents of the Medical law and the standard contract for medical procedures of the Fair Trade Commission (FTC). In the development and evaluation phase, the items and contents of the acupotomy consent form were evaluated using a 5-point Likert scale and content validity was assessed through two rounds of Delphi surveys. In the improvement phase, the contents of the consent form were revised based on the results of a survey of inpatient and outpatient patients in the Department of Acupuncture and Moxibustion at Pusan National University Korean Medicine Hospital, and real-time online meeting. The final version of the standard acupotomy consent form was completed after undergoing proofreading and corrections by a linguistics expert. Results: Only 30% of Korean Medicine hospitals have implemented acupotomy consent forms. The items of the consent forms did not fully include the items presented in the Medical act and the standard contract for medical procedures of the FTC. To address this issue, two rounds of Delphi surveys and a real-time discussion were conducted with a panel of 12 experts on 27 preliminary items of consent forms. The items and contents that met the criteria for content validity ratio, convergence, and consensus were derived. Based on the derived items and content, a standard acupotomy consent form was developed. Conclusions: The standard consent form for acupotomy is anticipated to ensure patient autonomy and enhance transparency and liability in acupotomy. Furthermore, it is expected to serve as evidence in case of medical disputes related to acupotomy and contribute as a reference document for the development of standard consents forms for various procedures of Korean Medicine. However, the limitations of the study include that the survey of consent forms was limited to only training hospitals of Korean Medicine, and the standard consent form is only applicable to adults in Korea. Future studies are needed to address these limitations.