• Journal of Engineering Education Research
• /
• v.24 no.6
• /
• pp.30-39
• /
• 2021

The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

• Journal of Educational Research in Mathematics
• /
• v.18 no.3
• /
• pp.283-308
• /
• 2008

A poor achievement of basic competency leads to obstacles of the same subject and other subjects from a series of accumulative losses and social life. The Grade 3 National Diagnostic Assessment of Basic Competency (NDAHC) dated from 2002, Teaching Plan Responsible to Basic Competency and compensational education materials for students of the below-basic level has marked a line in the chain of policy to realize educational welfare. The goal of NDABC is to collect information of the reason with regard to learning deficiency and individual student's information, and ultimately teach them on the basis of those informations. This study analyzed the characteristics of below-basic students in the basic mathematics with data from NDABC from 2003 to 2007. Students of the below-basic level were affected in achievement by numerical distinction, regrouping, arrangement and descriptive form of item, information-providing way, typical example, familiarity, frequency in use in daily life etc. This study provides a basic important information with regard to teaching below-basic students and suggestions with compensational education materials for them.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.28 no.4
• /
• pp.345-356
• /
• 2022

Purpose: This study aimed to develop a Core Competency Scale for clinical nursing student educators. Methods: In this study, we constructed a conceptual framework, selected initial items, verified the content validity, conducted two rounds of Delphi expert consultation, selected secondary and tertiary items, and extracted the final items. The study included 242 clinical educators for nursing students. Item analysis, factor analysis, criterion validity, and internal consistency were used for the data analyses. Results: For the final scale, 35 items were selected and 5 factors were categorized, which together explain 61.7% of the total variance. The factors were education and evaluation, research and cooperation, ethical/legal principles, presenting leadership, and clinical practice. The scores for the scale significantly correlated with the teaching efficacy scale for clinical nursing instructors. The Cronbach's alpha coefficient for the 35 items was .96. Conclusion: The findings of this study demonstrated that the core competency scale has good validity and reliability. This scale can be used to assess the competency of clinical educators for nursing students; hence, it will help in evaluating the relationship between the skills of clinical educators for nursing students and the self-efficacy of those students.

• Journal of Intelligence and Information Systems
• /
• v.27 no.1
• /
• pp.1-21
• /
• 2021

As the global business environment changes, uncertainties in technology development and market needs increase, and competition among companies intensifies, interests and demands for R&D activities of individual companies are increasing. In order to cope with these environmental changes, R&D companies are strengthening R&D investment as one of the means to enhance the qualitative competitiveness of R&D while paying more attention to facility investment. As a result, facilities or R&D investment elements are inevitably a burden for R&D companies to bear future uncertainties. It is true that the management strategy of increasing investment in R&D as a means of enhancing R&D capability is highly uncertain in terms of corporate performance. In this study, the structural factors that influence the R&D capabilities of companies are explored in terms of technology management capabilities, R&D capabilities, and corporate classification attributes by utilizing data mining techniques, and the characteristics these individual factors present according to the level of R&D capabilities are analyzed. This study also showed cluster analysis and experimental results based on evidence data for all domestic R&D companies, and is expected to provide important implications for corporate management strategies to enhance R&D capabilities of individual companies. For each of the three viewpoints, detailed evaluation indexes were composed of 7, 2, and 4, respectively, to quantitatively measure individual levels in the corresponding area. In the case of technology management capability and R&D capability, the sub-item evaluation indexes that are being used by current domestic technology evaluation agencies were referenced, and the final detailed evaluation index was newly constructed in consideration of whether data could be obtained quantitatively. In the case of corporate classification attributes, the most basic corporate classification profile information is considered. In particular, in order to grasp the homogeneity of the R&D competency level, a comprehensive score for each company was given using detailed evaluation indicators of technology management capability and R&D capability, and the competency level was classified into five grades and compared with the cluster analysis results. In order to give the meaning according to the comparative evaluation between the analyzed cluster and the competency level grade, the clusters with high and low trends in R&D competency level were searched for each cluster. Afterwards, characteristics according to detailed evaluation indicators were analyzed in the cluster. Through this method of conducting research, two groups with high R&D competency and one with low level of R&D competency were analyzed, and the remaining two clusters were similar with almost high incidence. As a result, in this study, individual characteristics according to detailed evaluation indexes were analyzed for two clusters with high competency level and one cluster with low competency level. The implications of the results of this study are that the faster the replacement cycle of professional managers who can effectively respond to changes in technology and market demand, the more likely they will contribute to enhancing R&D capabilities. In the case of a private company, it is necessary to increase the intensity of input of R&D capabilities by enhancing the sense of belonging of R&D personnel to the company through conversion to a corporate company, and to provide the accuracy of responsibility and authority through the organization of the team unit. Since the number of technical commercialization achievements and technology certifications are occurring both in the case of contributing to capacity improvement and in case of not, it was confirmed that there is a limit in reviewing it as an important factor for enhancing R&D capacity from the perspective of management. Lastly, the experience of utility model filing was identified as a factor that has an important influence on R&D capability, and it was confirmed the need to provide motivation to encourage utility model filings in order to enhance R&D capability. As such, the results of this study are expected to provide important implications for corporate management strategies to enhance individual companies' R&D capabilities.

• Journal of Educational Research in Mathematics
• /
• v.24 no.4
• /
• pp.573-594
• /
• 2014

Capacity of making assessment items among teacher's assessment competency is essential element in validity and reliability of assessment. Errors in test items on the formal and content aspects can be a big stumbling block to derive a correct evaluation result. Through this assessment, the positive feedback can not be derived. In this study, By analyzing midterm and final 60 exam papers for geometry and vector in 45 high Schools of Seoul GyeonggiIncheon area, We argue error items and improvements on the formal and content aspect the paper-based assessment of mathematics. Through this, Our intention is to improve the skills of teachers for making assessment items.

• Journal of Venture Innovation
• /
• v.7 no.3
• /
• pp.183-228
• /
• 2024

This study aimed to develop a competency evaluation scale tailored to the specific needs of key talent in the ICT startup sector. Existing competency assessment tools are mostly designed for environments in large corporations or traditional small and medium-sized enterprises, failing to adequately reflect the dynamic requirements of rapidly evolving startups. For startups, where a small number of individuals directly impact company success, key talent is a critical asset. Accordingly, this study sought to create a scale that measures the competencies suited to the challenges and opportunities faced by startups, helping domestic startups establish more effective talent management strategies. The research initially selected 71 items through a literature review and in-depth interviews. Based on expert feedback that emphasized the need for more precise and clear descriptions, the item descriptions were revised, and a total of 65 items were developed through four rounds of content validation. Following preliminary and main surveys, a final set of 58 items was developed. The main survey conducted further factor analysis based on the three broad competency factors?knowledge, skills, and attitude?identified in the preliminary survey. As a result, 10 latent factors emerged: 6 items for task comprehension, 6 items for practical experience (tacit knowledge), 6 items for collaboration, 9 items for management and problem-solving, 9 items for practical skills, 4 items for self-direction, 5 items for goal orientation, 5 items for adaptability, 5 items for relationship orientation, and 3 items for organizational loyalty. The developed scale comprehensively covers the multifaceted nature of competencies, allowing for a thorough evaluation of essential skills such as technical ability, teamwork, innovation, and leadership, which are critical for startups. Therefore, the scale provides a tool that helps startup managers objectively and accurately assess candidates' competencies. It also supports the growth of employees within startups, maximizing the overall organizational performance. By utilizing this tool, startups can build a strong internal talent pool and continuously enhance employees' competencies, thereby strengthening organizational competitiveness. In conclusion, the competency evaluation scale developed in this study is a customized tool that aligns with the characteristics of startups and plays a crucial role in securing sustainable competitiveness in rapidly changing market environments. Additionally, it offers practical guidance to support the successful growth of domestic startups and help them maintain their competitive edge in the market, contributing to the development of the startup ecosystem and the growth of the national economy.

• Research in Community and Public Health Nursing
• /
• v.30 no.3
• /
• pp.281-294
• /
• 2019

Purpose: This study is to develop the Cultural Competence Scale for Registered Nurses (CCS-RN) and to examine its validity and reliability. Methods: The item pool was generated based on related scales, a wide review of the literature, and in-depth interviews with nurses according to Purnell's cultural competence model. Content validity was verified by nursing experts. Construct validity using exploratory factor analysis, convergent validity using correlation coefficients, discriminant validity, internal consistency reliability, and test-retest reliability were examined. Results: The CCS-RN consists of a 35-item/7-factor solution with 54.1% of the total variance explained. The convergent validity of CCS-RN was supported. Cronbach's ${\alpha}$ was .94 for the total scale and ranged from .77 to .90 for the seven factors. Test-retest reliability was moderate. Conclusion: The evaluation of the psychometric properties of the CCS-RN shows that this scale is expected to be a valid and reliable measure of cultural competence among nurses. This scale may be useful for assessing nurses' own cultural competence and thus contribute to strengthening cultural competence.

• Journal of Korean Critical Care Nursing
• /
• v.5 no.2
• /
• pp.15-27
• /
• 2012

Purpose: To evaluate the applicability of Lasater Clinical Judgment Rubric (LCJR) as an evaluation tool for hypoglycemia simulation practicum on Korean nursing students. Methods: The methodological study was done to evaluate the reliability and validity of the LCJR. Based on Benner's 4 levels of nursing grading rubric, ten items of the LCJR was evaluated for interrater reliability and internal consistency. The content validity was tested by eight experts and concurrent validity was done by Clark (2006)'s clinical simulation grading rubric. Fifty five video-taped cases of senior nursing students in Y University were used for the reliability and concurrent validity of the LCJR. Results: The interrater reliability was r=.90 (p<.001); Kendall tau b=.87 (p <.001), and Cronbach's alpha was .90. A value of item content validity index of the LCJR was .97 and correlation coefficient between the LCJR and Clark's instrument was .90 (p<.001). The mean (${\pm}SD$) of the nursing students' clinical judgment was 2.04 (${\pm}50$). Conclusion: The LCJR is a useful tool to examine the simulation performance evaluation for improving competency among nursing students. The results indicated that the LCJR may provide valuable information regarding clinical judgment of nursing students and thus, suggested to use to develop a simulation-based education program.

• Journal of Korean Academy of Nursing
• /
• v.48 no.1
• /
• pp.12-25
• /
• 2018

Purpose: This study was performed to develop the Job Satisfaction Scale for Clinical Nurses (JSS-CN) and verify its validity and reliability. Methods: A preliminary 42-item version of the JSS-CN was developed through literature reviews and in-depth interviews. The draft scale was developed using thirty-seven items selected following content validity evaluation. Finally, thirty-three items with response options on a 5-point Likert scale were selected based on internal consistency reliability and construct validity. Subsequently, the test-retest reliability and convergent validity of the JSS-CN were verified. Results: Six factors, namely, recognition from the organization and professional achievement, personal maturation through the nursing profession, interpersonal interaction with respect and recognition, accomplishment of accountability as a nurse, display of professional competency, and stability and job worth, were identified, which explained 59.7% of the total variance. The JSS-CN's Cronbach's ${\alpha}$ for the total scale was .95, and the intra-class correlation coefficient was .90. The correlation coefficient between the scores of the JSS-CN and Slavitt's scale was .75, and that between the JSS-CN and job performance was .53. Conclusion: Results showed that the JSS-CN has good reliability and validity. Therefore, it is concluded that the JSS-CN could be a useful tool for the measurement of the job satisfaction of clinical nurses in Korea.

• The Journal of the Korea Contents Association
• /
• v.20 no.4
• /
• pp.571-581
• /
• 2020

There are large, medium, and small items in the evaluation test for medical interpreter professionals personnel and the criteria and level are not clear, which may cause confusion for those preparing for the test. Therefore, we would like to suggest that the qualification requirements for the medical translation ability test and the criteria for the evaluation items are consistent with the medical system in Korea. The survey on the medical interpreter competency test conducted was collected from domestic and foreign data, compared with similar test and overseas test. We also examined the perception of the test by experts with experience in developing and interpreting the medical interpretation test. As a result, in the 'International Culture' evaluation category, 'Language-oriented culture' was changed to 'Medical-oriented culture' and 'Interpretation ethics' was changed to 'Medical interpretation ethics'. In the evaluation items of the hospital system, the 'Medical Dispute Mediation Act', which is 「ACT ON MEDIATION OF MEDICAL DISPUTES」 of the middle item was changed the 「ACT ON REMEDIES FOR INJURIES FROM MEDICAL MALPRACTICE AND MEDIATION OF MEDICAL DISPUTES」 and the Act also reduced the four items related to the 'Medical Tourism Law' to two and added the 「ACT ON SUPPORTING THE ADVANCEMENT OF MEDICAL OVERSEAS AND ATTRACTING FOREIGN PATIENTS」. If the Medical Interpretation Proficiency Test is prepared in accordance with the medical culture of Korea, it is expected that there will be a stable opportunity for professionals who pass the examination to act as experts.