• The Journal of Korean Academic Society of Nursing Education
• /
• v.8 no.1
• /
• pp.84-94
• /
• 2002

The purpose of this descriptive study was to identify problems and solving strategies on student evaluation of clinical nursing education. Subjects were 239 nurses in 18 hospitals from February to July, 1999. Content analysis using qualitative research method was used to analyze data taking into account the semi-structured questionnaire. The results of this study were as follows: Four categories about problems and solving strategies on the evaluation of clinical nursing education were identified: 'The environment of the clinical nursing education'; 'contents and items of evaluation tool'; 'criteria of evaluation tool'; and 'problems with evaluators in clinical settings'. The problems of the environment of the clinical nursing education were due to the lack of co-ordination between nursing schools and hospitals. In order to solve these problems, the following strategies were suggested: 'initiate a joint meeting between nursing schools and hospitals'; 'do not change the clinical settings frequently'; 'evaluate students after being familiar with them'; and 'evaluate them immediately after clinical practice was ended'. In the problems of contents and items of the evaluation tool, the contents of the tool were very abstract and general. The strategies for treating these problems were to evaluate student using the concrete evaluation items'; refrain from evaluation of nursing knowledge', develop the evaluation tools that are fit for a specific clinical setting'; develop the evaluation tools in line with students' knowledge level; and 'carry out evaluation using the proper contents of tool. The problems of criteria of the evaluation tools were the results of the lack of the clear criteria. The strategies for treating these problems were 'develop the criteria of the evaluation tool'; simplify the range of the cores or evaluate students using check-list'; to evaluate students in objective manner'. The problem of evaluators in clinical settings was due to the failure by evaluators who were not prepared for the task. The strategies were 'to educate and prepare the evaluators before evaluation'.

• Journal of the Korean Dietetic Association
• /
• v.14 no.4
• /
• pp.382-395
• /
• 2008

This study was conducted to evaluate the sanitary performance and knowledge of elementary school foodservice employees. The specific aim of this study was to decipher why employees cannot apply learned knowledge to real work situations. In total, 437 foodservice operation employees attended a regular sanitary education program under the auspices of Seoul Gangdong and Gangseo district offices. The five sanitary practice performance evaluators included personal hygiene, ingredient control, process control, safety management, and sanitary education. These dimensions were self-evaluated using the Likert 5-point scale. Collected data were subjected to descriptive and comparative analysis using SPSS (Version 12.0, SPSS Inc., Chicago, IL, USA) statistical package. The main results are summarized as follows: 93.6% of the respondents were women and 57% were aged between 40$\sim$49. Total mean score of the five sanitary performance evaluators was 4.73 for elementary school. Ingredient control score was 4.86, process control 4.80, and personal hygiene 4.79. But the sanitary education field score was 4.48, which was significantly lower than the total mean score. Safety management score was 4.73. The main source of sanitary education for school foodservice employees was verbal education.

• The Mathematical Education
• /
• v.44 no.2 s.109
• /
• pp.215-228
• /
• 2005

The purpose of this study is to development the scoring framework for teacher knowledge of fractions. This framework is qualified in the content-validity by professional educators' evaluation and in the reliability by correlation coefficient. 2 math educators judged that this framework is composed of appropriate scoring category, scoring criterion, and scoring level. After 2 teachers scored the tasks, correlation coefficient was calculated between evaluators. The coefficient is evaluated high in that it is more than 0.80.

• Journal of Technology Innovation
• /
• v.21 no.1
• /
• pp.331-364
• /
• 2013

This work aims firstly to analyse the evaluation expertise in the National IT Industry Promotion Agency(NIPA) which is charge of funding and promoting R&D programs in the field of IT industry, a main part of 'Technology Innovation Program for Knowledge Economy' supported by the Ministry of Knowledge Economy. It will also discuss the policy means for improvement of the evaluation expertise of the NIPA. The results show that the evaluation system of the NIPA has been fair in stage of the selection of evaluators and the career management system of evaluators. But it will be necessary for improvement in stage of the surroundings supporting the expertise during evaluation practise. Therefore, in order to improve the evaluation expertise of the NIPA, I suggested and discussed 12 policy means in accordance with the short term perspective and long term one.

• Journal of the military operations research society of Korea
• /
• v.30 no.2
• /
• pp.122-132
• /
• 2004

The aim of this paper is to show the process of R&D Project-Priority Ordering in the Defense Technology field. We propose specific methods (Delphi, Analytic Hierarchy Process (AHP), Scoring) to order the R&D Project-Priority. In general, to decide the priority of R&D projects most of researches depend on questionnaires which are surveyed by experts. However, it is criticized that this process cannot reflect the limitation of experience and knowledge of experts. In this process, we separate evaluators in two parts: the first is strategic experts, the second is technical experts. Evaluators can choose and evaluate the alternatives which they are familiar with, so we can obtain reliable results. Finally, based on our process of the R&D Project-Priority Ordering we formulate policy implications for managing the defense technology.

• Journal of The Korean Association For Science Education
• /
• v.15 no.2
• /
• pp.173-184
• /
• 1995

The purpose of this study was to analyse the problems of 'Science Inquiry Experiment Contest(SIEC)' which was one of 8 programs of 'The 2nd Student Science Inquiry Olympic Meet(SSIOM)'. The results and conclusions of this study were as follows: 1. It needs to reconsider the role of practical work within science experiment because practical work skills form one of the mainstays in current science. But the assessment of students' laboratory skills in the contest was made little account of. It is necessary to remind of what it means to be 'good at science'. There are two aspects: knowing and doing. Both are important and, in certain respects, quite distinct. Doing science is more of a craft activity, relying more on craft skill and tacit knowledge than on the conscious application of explicit knowledge. Doing science is also divided into two aspects, 'process' and 'skill' by many science educators. 2. The report's and checklist's assessment items were overlapped. Therefore it was suggested that the checklist assessment items were set limit to the students' acts which can't be found in reports. It is important to identify those activities which produce a permanent assessable product, and those which do not. Skills connected with recording and reporting are likely to produce permanent evidence which can be evaluated after the experiment. Those connected with manipulative skills involving processes are more ephemeral and need to be assessed as they occur. The division of student's experimental skills will contribute to the accurate assess of student's scientific inquiry experimental ability. 3. There was a wide difference among the scores of one participant recorded by three evaluators. This means that there was no concrete discussion among the evaluators before the contest. Despite the items of the checklists were set by preparers of the contest experiments, the concrete discussions before the contest were necessary because students' experimental acts were very diverse. There is a variety of scientific skills. So it is necessary to assess the performance of individual students in a range of skills. But the most of the difficulties in the assessment of skills arise from the interaction between measurement and the use. To overcome the difficulties, not only must the mark needed for each skill be recorded, something which all examination groups obviously need, but also a description of the work that the student did when the skill was assessed must also be given, and not all groups need this. Fuller details must also be available for the purposes of moderation. This is a requirement for all students that there must be provision for samples of any end-product or other tangible form of evidence of candidates' work to be submitted for inspection. This is rather important if one is to be as fair as possible to students because, not only can this work be made available to moderators if necessary, but also it can be used to help in arriving at common standards among several evaluators, and in ensuring consistent standards from one evaluator over the assessment period. This need arises because there are problems associated with assessing different students on the same skill in different activities. 4. Most of the students' reports were assessed intuitively by the evaluators despite the assessment items were established concretely by preparers of the experiment. This result means that the evaluators were new to grasp the essence of the established assessment items of the experiment report and that the students' assessment scores were short of objectivity. Lastly, there are suggestions from the results and the conclusions. The students' experimental acts which were difficult to observe because they occur in a flash and which can be easily imitated should be excluded from the assessment items. Evaluators are likely to miss the time to observe the acts, and the students who are assessed later have more opportunity to practise the skill which is being assessed. It is necessary to be aware of these problems and try to reduce their influence or remove them. The skills and processes analysis has made a very useful checklist for scientific inquiry experiment assessment. But in itself it is of little value. It must be seen alongside the other vital attributes needed in the making of a good scientist, the affective aspects of commitment and confidence, the personal insights which come both through formal and informal learning, and the tacit knowledge that comes through experience, both structured and acquired in play. These four aspects must be continually interacting, in a flexible and individualistic way, throughout the scientific education of students. An increasing ability to be good at science, to be good at doing investigational practical work, will be gained through continually, successively, but often unpredictably, developing more experience, developing more insights, developing more skills, and producing more confidence and commitment.

• The Journal of the Korea Contents Association
• /
• v.13 no.6
• /
• pp.401-411
• /
• 2013

Selection of profitable research and development (R&D) projects is one of the major factors affecting sustained growth of firms and countries. This paper analyze what influences the knowledge on the business model exerted on selection of a R&D project. A business model converts the technology value to the customer value, and comprehensively describes the target customers for commercializing a new technology, core values, behaviors within organizations, resources, and external partners. Thus, understanding a business model would make R&D project evaluators place the feasibility and profitability of the business above the merits of the proposed technology in evaluating the technology development. To verify this hypothesis, we had 78 R&D project evaluators acquire the knowledge on the business model and measured how their criteria for R&D project selection have changed using the AHP method. The results shows that feasibility and profitability are more important than the merit of proposed technology, especially capability of company and business development are more important than the levels of technology innovation.

• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• Journal of Gifted/Talented Education
• /
• v.26 no.4
• /
• pp.677-697
• /
• 2016

This study analyzed the difference in evaluation results in evaluating identical products by applying two different types of evaluating scales, Creative Product Analysis Matrix (CPAM) and Creative Product Semantic Scale (CPSS) by O'Quin and Bessember (1989). As a result, evaluation based on explicit knowledge scored lower than evaluation based on implicit knowledge, implying that the evaluation becomes stricter. When evaluated with CPSS, which as relatively more segmentalized grading criteria, all sub-dimensions of creativity showed low scores, and it show that when evaluator's first impression or personal evaluation standard on the products is firm, they may not be evaluated by the evaluation tools. Gifted education teachers were giving similar evaluations as experts in creative product evaluation, and understanding the product evaluation tool fully in advance before teaching or evaluating products may lead to the generation of newer, more useful and appropriate, and highly creative product with high solvability.

• The Journal of Information Systems
• /
• v.18 no.4
• /
• pp.41-57
• /
• 2009

Although financial information is a great influence upon determining of the group which use them, detection of management fraud and earning manipulation is a difficult task using normal audit procedures and corporate credit evaluation processes, due to the shortage of knowledge concerning the characteristics of management fraud, and the limitation of time and cost. These limitations suggest the need of systemic process for !he effective risk of earning manipulation for credit evaluators, external auditors, financial analysts, and regulators. Moot researches on management fraud have examined how various characteristics of the company's management features affect the occurrence of corporate fraud. This study examines financial characteristics of companies engaged in fraudulent financial reporting and suggests a model and system for detecting GAAP violations to improve reliability of accounting information and transparency of their management. Since the detection of management fraud has limited proven theory, this study used the detecting method of outlier(upper, and lower bound) financial ratio, as a real-field application. The strength of outlier detecting method is its use of easiness and understandability. In the suggested model, 14 variables of the 7 useful variable categories among the 76 financial ratio variables are examined through the distribution analysis as possible indicators of fraudulent financial statements accounts. The developed model from these variables show a 80.82% of hit ratio for the holdout sample. This model was developed as a financial outlier detecting system for a financial institution. External auditors, financial analysts, regulators, and other users of financial statements might use this model to pre-screen potential earnings manipulators in the credit evaluation system. Especially, this model will be helpful for the loan evaluators of financial institutes to decide more objective and effective credit ratings and to improve the quality of financial statements.