• Journal of Korean Institute of Industrial Engineers
• /
• v.40 no.1
• /
• pp.84-99
• /
• 2014

In this study, determinant input-output variables are identified for calculating Data Envelopment Analysis (DEA) efficiency scores relating to evaluating the efficiency of government-sponsored research and development (R&D) projects. In particular, this study proposes a systematic framework of design and analysis of experiments, called "all possible DEAs", for pinpointing DEA determinant input-output variables. In addition to correlation analyses, two modified measures of time series analysis are developed in order to check the similarities between a DEA complete data structure (CDS) versus the rest of incomplete data structures (IDSs). In this empirical analysis, a few DEA determinant input-output variables are found to be associated with a typical public R&D performance evaluation logic model, especially oriented to a mid- and long-term performance perspective. Among four variables, only two determinants are identified : "R&D manpower" ($x_2$) and "Sales revenue" ($y_1$). However, it should be pointed out that the input variable "R&D funds" ($x_1$) is insignificant for calculating DEA efficiency score even if it is a critical input for measuring efficiency of a government-sonsored R&D project from a practical point of view a priori. In this context, if practitioners' top priority is to see the efficiency between "R&D funds" ($x_1$) and "Sales revenue" ($y_1$), the DEA efficiency score cannot properly meet their expectations. Therefore, meticulous attention is required when using the DEA application for public R&D performance evaluation, considering that discrepancies can occur between practitioners' expectations and DEA efficiency scores.

• Journal of Korean Home Economics Education Association
• /
• v.18 no.3 s.41
• /
• pp.61-79
• /
• 2006

The purpose of this research was to evaluate concretely how the 7th Technology Home Economics(HE) curriculum was operated In school fields by using context evaluation, input evaluation using the CIPP model focusing HE. In this research. a questionnaire survey was done targeting HE teachers in charge of technology and home economics subject for the 7th curriculum implementation at 250 randomly selected middle schools in Gpoungsangnamdo, and 109 returned questionnaire papers were used for the final analysis. The frequency, percent, mean and standard deviation of these data were obtained by using the SPSS 10.0 for Windows Program. The results of this research were outlined below: First, with a regard to the context evaluation (evaluating educational contexts), the requirement degree of seeking for career appeared to be the highest at the requirement survey of the education goal and character of HE area, and the requirement degree of elevating understanding home living' were very low. Interest and concern of students towards these subject as well as the self-confidence of HE teachers in charge were low. Second, as for the input evaluation (evaluating education plans), time allocation, content level, and content amount were not regarded to be not proper, and the composition of HE educational curriculums and the class guideline of teachers also were not so faithful from the aspect of school level. Among surveyed items, establishing plans in school level towards evaluation was relatively sincere, but discussions about curriculums were not so faithful, suggesting various kinds of content are not fully discussed. As shown by the results above, it is difficult to say that the operation of the 7th HE educational curriculums has secured its position perfectly. It is necessary to examine systematically the educational goals. character of the 7th HE educational curriculum and the appropriateness of curriculum content, and to seek various methods to elevate the self confidence of teachers and the interests of students. Because how to operate national level educational curriculums in school levels with self-regulation and elasticity will be an important variable in realizing educational goals, teachers, the main body of educational curriculums and direct performers, should establish and perform educational plans in school levels to elevated the satisfaction of teachers and educational effects for normally operating educational curriculums. In addition, educational curriculums should be operated and evaluated mainly by teachers at school fields to make it possible to confirm and check the achievement of the goals of educational curriculums qualitatively.

• Journal of Information Processing Systems
• /
• v.18 no.5
• /
• pp.614-627
• /
• 2022

Aspect-based sentiment analysis is to discover the sentiment polarity towards an aspect from user-generated natural language. So far, most of the methods only use the implicit position information of the aspect in the context, instead of directly utilizing the position relationship between the aspect and the sentiment terms. In fact, neighboring words of the aspect terms should be given more attention than other words in the context. This paper studies the influence of different position embedding methods on the sentimental polarities of given aspects, and proposes a position embedding interactive attention network based on a long short-term memory network. Firstly, it uses the position information of the context simultaneously in the input layer and the attention layer. Secondly, it mines the importance of different context words for the aspect with the interactive attention mechanism. Finally, it generates a valid representation of the aspect and the context for sentiment classification. The model which has been posed was evaluated on the datasets of the Semantic Evaluation 2014. Compared with other baseline models, the accuracy of our model increases by about 2% on the restaurant dataset and 1% on the laptop dataset.

• Journal of Gifted/Talented Education
• /
• v.23 no.2
• /
• pp.193-213
• /
• 2013

The purpose of this study was to develop and validate the evaluation criteria for gifted curriculum in visual arts. For this purpose, a draft of evaluation criteria for gifted curriculum in arts were first developed through literature review and opinions of experts in educational assessment, gifted education, visual art education. Then, the Delphi method was employed to validate the evaluation criteria. Delphi survey was carried out twice with 30 panelists consisting of experts in educational assessment, experts in gifted education, experts in arts(gifted) education and administrators in gifted education. Delphi survey was analyzed using the mean, content validity ratio, and the degree of consensus. Results were as followed. First, 58 evaluation criteria for gifted curriculum in arts were developed through literature review and expert opinions. The evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 12 process evaluation criteria, and 9 product evaluation criteria. Second, through the first and second Delphi survey, 2 evaluation criteria were not validated and finally were removed. The final evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 10 process evaluation criteria, and 9 product evaluation criteria. The evaluation criteria developed by this study can be used as a standard to establish the institution assessment system at the national level and evaluate institutions and programs.

• Journal of Fisheries and Marine Sciences Education
• /
• v.26 no.5
• /
• pp.1108-1118
• /
• 2014

The purpose of this study was to spread the education of human creativity program and its possibility of consistency, and its application to school system by exploring the evaluation system that determines the valuable and useful decisions. This study was based on the evaluation system according to CIPP model regarding the program's general ideas and its role. The interest of the education of human creativity was increasing as well as its progress of program, and we searched 13 figures and 55 evaluation index according to increase the program's effectiveness and nation-wise situation of evaluation model. The conclusion of this study was that the human creativity program's evaluation was composed of six compartments. And the context evaluation was composed of three evaluation models and eleven index, and input evaluation was composed of three evaluation model and 15 index, while process evaluation is composed of three evaluation models and thirteen evaluation index. Lastly, output evaluation had four evaluation model and sixteen index.

• Hwankyungkyoyuk
• /
• v.20 no.1
• /
• pp.106-117
• /
• 2007

The purpose of this study was to evaluate the environmental education of public servants in National Institute of Environmental Human Resource Development(NIERD). Based on CIPP model, Evaluation areas and items were made. The data were collected through interviews, questionnaires and training and development team's internal information from November, 2005 to January, 2006. Based on the interviews and survey of 11 employee from training and development team, context factors, input factors, process factors, product factors were evaluated. The major findings of this study were as follows: First, the problem of the environmental education of environmental officials indicated lack of interest about education of Ministry of Environment, lack of education expense, lack of expertise of employee in training and development team, and so on. Second, the curriculum for environmental officials was not considered the environmental officials' readiness for education, developmental level and competency. Suggestions for future research were offered.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.79-86
• /
• 2013

The purpose of this study was to analyze the factors related to the satisfaction of the introductory engineering education program for the employees, who majored liberal arts or commerce, among the educational programs for industrial workers which are performed as an effort to spread the performance of the Innovation Center for Engineering Education, and reinforce the competitiveness through effective program operation. This study was performed on the basis of CIPP evaluation model (context, input, process, product). A factorial analysis and a regression analysis were conducted based on a survey made on 87 persons who completed the introductory engineering education program among the employees of D group who majored liberal arts or commerce. It is expected that this study will contribute toward suggesting the implications for designing and operating the educational programs for industrial workers in order to find out the important factors of satisfaction and to conduct the education operation with professionalism.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.11
• /
• pp.473-478
• /
• 2022

Evaluation learning based on code testing is becoming a popular solution in programming education via Online judge(OJ). In the recent past, many papers have been published on how to detect plagiarism through source code similarity analysis to support OJ. However, deep learning-based research to support automated tutoring is insufficient. In this paper, we propose Input & Output side FiLM models to predict whether the input code will pass or fail. By applying Feature-wise Linear Modulation(FiLM) technique to GRU, our model can learn combined information of Java byte codes and problem information that it tries to solve. On experimental design, a balanced sampling technique was applied to evenly distribute the data due to the occurrence of asymmetry in data collected by OJ. Among the proposed models, the Input Side FiLM model showed the highest performance of 73.63%. Based on result, it has been shown that students can check whether their codes will pass or fail before receiving the OJ evaluation which could provide basic feedback for improvements.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 1996.10a
• /
• pp.19-22
• /
• 1996

A traditional approach to the prediction of economic and financial variables takes the form of statistical models to summarize past observations and to project them into the envisioned future. Over the past decade, an increasing number of organizations has turned to the use of neural networks. To date, however, many spheres of interest still lack a systematic evaluation of the statistical and neural approaches. One of these lies in the prediction of corporate bond yields for Korea. This paper reports on a comparative evaluation of ARIMA models and neural networks in the context of interest rate prediction. An additional experiment relates to an integration of the two methods. More specifically, the statistical model serves as a filter by providing estimtes which are then used as input into the neural network models.

• ETRI Journal
• /
• v.46 no.2
• /
• pp.277-289
• /
• 2024

In this paper, we describe a neural network-based application that recommends multiple items using dialog context input and simultaneously outputs a response sentence. Further, we describe a multi-item recommendation by specifying it as a set of clothing recommendations. For this, a multimodal fusion approach that can process both cloth-related text and images is required. We also examine achieving the requirements of downstream models using a pretrained language model. Moreover, we propose a gate-based multimodal fusion and multiprompt learning based on a pretrained language model. Specifically, we propose an automatic evaluation technique to solve the one-to-many mapping problem of multi-item recommendations. A fashion-domain multimodal dataset based on Koreans is constructed and tested. Various experimental environment settings are verified using an automatic evaluation method. The results show that our proposed method can be used to obtain confidence scores for multi-item recommendation results, which is different from traditional accuracy evaluation.