• Journal of Digital Convergence
• /
• v.19 no.8
• /
• pp.275-283
• /
• 2021

This study was intended to help improve assessment in college EFL classes by examining the relationship between formative assessment (FA) and summative assessment (SA). Participants for the study were 75 undergraduates, taking an eight-week optional college English course at a four-year college in China. FA data were collected in the final course of the course by a self-reporting survey using the online training platform Mosoteach. To achieve the finding, the relationship between FA scores and SA scores (final exam and performance scores) was analyzed in SPSS by means of Pearson correlation analyses. Significant positive correlations were found between FA and SA scores overall. In addition, students' performance on chapter tests, online discussions, brainstorming, quick-responses, assignments and the number of thumbs-up clicks by teachers were significantly correlated with SA scores. The results suggested that FA administered through the Mosoteach app could improve students' academic performance, thus providing an empirical basis for improving educational assessment. Based on these findings, implications for assessment in EFL classes were described.

• Korean Medical Education Review
• /
• v.25 no.1
• /
• pp.17-34
• /
• 2023

This study aimed to investigate the current status of faculty development (FD) programs operated by medical colleges and institutions in Korea, and to suggest future-oriented directions for FD. A survey was conducted targeting medical colleges and medical education institutions that operate FD programs. We investigated the reasons for selecting topics, program themes, program operation methods, longitudinal program status, program improvement and quality control methods, the evaluation of the program effects, the outcomes and problems of the programs, and opinions on the latest trends. Twenty-nine out of 40 medical colleges and three out of six institutions responded. Topics were selected based on an analysis of medical education trends and the educational environment in both groups. The most common program themes were assessments in medical colleges, and teaching/learning and curriculum themes in institutions. FD was perceived to induce professors' and administrators' interest in medical education and improve the quality of medical education. The most common program method was workshops. Three medical colleges and one institution had longitudinal programs. Participant surveys constituted the most common method of evaluating programs' effects. Difficulties in publicizing programs and inducing voluntary participation were the most common problems in both groups. New attempts for FD were perceived as the role of external institutions. Based on the results, it is necessary to develop a framework and quality improvement indications for FD programs in the future, and FD programs are expected to be developed through new initiatives, such as longitudinal programs and those focusing on the community of practice.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.12
• /
• pp.1898-1907
• /
• 2022

Every year, many shipping companies provide seaman safety education programs periodically to reduce ocean-traffic accidents. However, undertaking the regular safety training for seaman has been difficult because of litimation of space and time. Recently, VR technolgy is received attentions to overcome previous problems. It can provide users educational interactions between a user and virtual environment and fulfill sustainable teaching. In this paper, VR-based safety education content for sailors has been developed, and it includes four programs. Also, survey was conducted with four questionnaires such as immersiveness, easy to experience, satisfaction of education contents, comparative evaluation between traditional education program and VR education contents. As the result, immersiveness questionnaire could be gain 53.83% positive assessment, and easy to experience could be gain 65.38% positive assessment, and satisfaction could be gain 69.23% positive assessment. Lastly, comparative evaluation between traditional education program and VR education contents could be gain about 46% positive and 34% neutral assessments.

• Korean Journal of Clinical Pharmacy
• /
• v.33 no.2
• /
• pp.106-112
• /
• 2023

Background: The safe use of medication in children is important, as it can have significant implications for their health and wellbeing. Parents or caregivers play a crucial role in the medication administration process. Therefore, this study would evaluate the needs and current status (knowledge, attitude, and practice) of caregivers for children on the safe use of medication. Methods: We conducted questionnaires on 150 caregivers with children under nine years old and asked about their knowledge, attitude, and practice regarding the safe use of medication and their needs. Each question was conducted on a 5-point scale. Results: Of the 150 respondents, 128 were women, 75 were in their 30s, and 63 were in their 40s. Among them, 29 parents answered that they had been educated about the safe use of medicines, and 26 (84%) were satisfied with the education. Knowledge, attitude, and practice assessments on drug safety use (mean±SD) were found to be 3.83±0.44, 3.67±0.38, and 3.53±0.45, respectively. There were significant differences between the educated group and the uneducated group in knowledge and practice, not attitude. Conclusion:To provide appropriate education to caregivers of pediatric patients is necessary to ensure the safe and effective use of medication in children. Moreover, appropriate education can improve caregivers' understanding of medication use and lead to proper administration. Therefore, it is imperative to develop educational materials and strategies for medications that incorporate both specialized knowledge and practical applications for pediatric patients.

• Korean Medical Education Review
• /
• v.25 no.3
• /
• pp.212-228
• /
• 2023

Systems thinking, a linking domain of health systems science (HSS), is an approach that investigates specific problems from a holistic perspective. It supports improving patients' health, fulfilling their health needs, and anticipating issues that threaten patient safety within the healthcare system. It also helps solve problems through critical thinking and ref lection. This study aimed to develop an curriculum on systems thinking, explore the effectiveness of the course, and investigate the applicability of HSS education at individual universities. In this study, the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) model was utilized to design, develop, implement, and evaluate an elective course on systems thinking. In the design process, learning outcomes and goals were developed, and educational content, teaching-learning methods, and student evaluation methods were linked. In the development process, class materials and evaluation materials were prepared. In the implementation process, the course was implemented, and the evaluation process analyzed the results of learning performance and curriculum assessments. The evaluation found the following results. First, the students in the study realized the importance of systems thinking and experienced the need for systems thinking through non-medical and medical situations. Second, the students were very satisfied with the learning activities in the course (mean=4.84), and the results of the self-competence evaluation, conducted before and after the course, also showed a significant improvement. This study confirmed the effectiveness of the elective course, and its results can serve as a reference for developing an HSS curriculum.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.47 no.2
• /
• pp.134-146
• /
• 2024

This study introduces and experimentally validates a novel approach that combines Instruction fine-tuning and Low-Rank Adaptation (LoRA) fine-tuning to optimize the performance of Large Language Models (LLMs). These models have become revolutionary tools in natural language processing, showing remarkable performance across diverse application areas. However, optimizing their performance for specific domains necessitates fine-tuning of the base models (FMs), which is often limited by challenges such as data complexity and resource costs. The proposed approach aims to overcome these limitations by enhancing the performance of LLMs, particularly in the analysis precision and efficiency of national Research and Development (R&D) data. The study provides theoretical foundations and technical implementations of Instruction fine-tuning and LoRA fine-tuning. Through rigorous experimental validation, it is demonstrated that the proposed method significantly improves the precision and efficiency of data analysis, outperforming traditional fine-tuning methods. This enhancement is not only beneficial for national R&D data but also suggests potential applicability in various other data-centric domains, such as medical data analysis, financial forecasting, and educational assessments. The findings highlight the method's broad utility and significant contribution to advancing data analysis techniques in specialized knowledge domains, offering new possibilities for leveraging LLMs in complex and resource-intensive tasks. This research underscores the transformative potential of combining Instruction fine-tuning with LoRA fine-tuning to achieve superior performance in diverse applications, paving the way for more efficient and effective utilization of LLMs in both academic and industrial settings.

• The Mathematical Education
• /
• v.61 no.4
• /
• pp.597-612
• /
• 2022

Recently, large-scale mathematics assessments are shifting from traditional paper-based tests to computer-based tests, nationally and internationally. This study explored the mode effect (the difference in student achievement by the change of test mode) according to the types of test items, the technological function reflected in the items, the characteristics of students' computer use, and the computer-based test environment. To this end, we analyzed the results of the 2020 national assessment of educational achievement of high school mathematics conducted on a paper and computer basis. As a result, firstly, the mode effect induced by the mode transition was generally insignificant, but the mode effect was larger in the extended response type than other types. Secondly, there were differences in the mode effect according to the transition to test with computer mode where innovative items were added. Thirdly, the difference between mode effects was statistically significant according to the student's sense of efficacy in computer use. The results of this study suggest that innovative items should be introduced deliberately according to the targeted content and competency in evaluation, and that assessment design and environment preparation need to be carefully developed so that nonessential abilities other than students' mathematical ability or incidental situation do not distort the assessment results.

• International Journal of Computer Science & Network Security
• /
• v.22 no.7
• /
• pp.35-42
• /
• 2022

The article identifies the problem of monitoring the quality of higher education in three main areas, which are comparative pedagogical systems of education. The first direction is determined by dissertation works, the second - monographs and textbooks, and the third reveals scientific periodicals. According to its internal structure, monitoring the quality of education combines important management components identified in the article (analysis, evaluation and forecasting of processes in education; a set of methods for tracking processes in education; collecting and processing information to prepare recommendations for research processes and make necessary adjustments). Depending on the objectives, three areas of monitoring are identified: informational (involves the accumulation, structuring and dissemination of information), basic (aimed at identifying new problems and threats before they are realized at the management level), problematic (clarification of patterns, processes, hazards, those problems that are known and significant from the point of view of management). According to its internal structure, monitoring the quality of education combines the following important management components: analysis, evaluation and forecasting of processes in education; a set of techniques for tracking processes in education; collection and processing of information in order to prepare recommendations for the development of the studied processes and make the necessary adjustments. One of the priorities of the higher education modernization program during the COVID-19 pandemic is distance learning, which is possible due to the existence of information and educational technologies and communication systems, especially for effective education and its monitoring in higher education. The conditions under which the effectiveness of pedagogical support of monitoring activities in the process of distance learning is achieved are highlighted. According to the results of the survey, the problems faced by higher education seekers are revealed. A survey of students was conducted, which had a certain level of subjectivity in personal assessments, but the sample was quite representative.

• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.601-615
• /
• 1998

Establishing and evaluating science education policies and revising and monitoring the effectiveness of science curriculum should be based upon the results of systematic and scientific research studies. Advanced nations have already been administering and developing national level science assessments for these purposes. The science assessments administered in Korea have been reported having many limitations and problems, and not succeeded in providing data for science education policy making and curriculum reform. The major purpose of the study is developing national level science knowledge assessment system in order to identify longitudinal trends of elementary and secondary school students science knowledge achievements. The research team consisted of science education experts and teachers from various school levels, decided the directions and major elements of national level science knowledge assessment with the consultation of educational evaluation experts. Item developing ability of the researchers was improved by seminars? and workshops on national assessment in advanced nations and developing skills of writing science items. Nearly 500 items were developed and revised. Pilot test was administered with 958 students at various school levels. 380 items were selected and tested with 8766 students, and the characteristics were analyzed in terms of item response theory. The target populations for national level science knowledge assessment are 5th-grade of elementary school, 2nd-grade of middle school, 1st and 2nd-grade of high school students. The proper period for the assessment is February every year. Multi-stage clustered sampling method is desirable and rotated forms are recommendable for the test format. Bridge items should be introduced to compare the results of multiple tests, and various grades. Anchor items should also be used for longitudinal interpretations of the results. The items for elementary school require low to medium abilities, for middle school and first grade of high school require medium to high abilities and for 2nd-grade of high school high abilities. The discrimination ability of the items developed is high.

• The Journal of the Korea Contents Association
• /
• v.12 no.8
• /
• pp.449-460
• /
• 2012

We investigated the differences between the teachers' perception and practice on portfolio assessments in kindergartens and daycare centers, and analyzed their dependence on various underlying factors. The participants of this study include 304 teachers in the kindergartens and daycare centers in J I G cities in Jeollabuk-do. The answers on the questionnaires were analysed by evaluating frequencies, percentage, averages, and standard deviations, and by carrying out paired t-test, ANOVA, and Scheff$\acute{e}$ verification using SPSS 18.0 program. The results of this study are summarized as follows. First, teachers' practice fell meaningfully short of their perception in every sub-categories of the method and the effect of the portfolio assessment. Among the various underlying factors, only teachers' educational level played significant role. The difference between the perception and practice was relatively large among the teachers with regular 4-year college diploma as compared to junior-college graduates. Second, as we examine the difficulties in the portfolio assessment, teachers in general found difficulties on the questionnaires in all sub-categories, although the dependence on the underlying factors varies across the sub-categories. For example, teachers with higher level of education or who work at public kindergartens felt relatively more difficulties in the portfolio assessment.