• Title/Summary/Keyword: evaluation question

Search Result 494, Processing Time 0.029 seconds

Factor-analysis based questionnaire categorization method for reliability improvement of evaluation of working conditions in construction enterprises

  • Lin, Jeng-Wen;Shen, Pu Fun
    • Structural Engineering and Mechanics
    • /
    • v.51 no.6
    • /
    • pp.973-988
    • /
    • 2014
  • This paper presents a factor-analysis based questionnaire categorization method to improve the reliability of the evaluation of working conditions without influencing the completeness of the questionnaire both in Taiwanese and Chinese construction enterprises for structural engineering applications. The proposed approach springs from the AI application and expert systems in structural engineering. Questions with a similar response pattern are grouped into or categorized as one factor. Questions that form a single factor usually have higher reliability than the entire questionnaire, especially in the case when the questionnaire is complex and inconsistent. By classifying questions based on the meanings of the words used in them and the responded scores, reliability could be increased. The principle for classification was that 90% of the questions in the same classified group must satisfy the proposed classification rule and consequently the lowest one was 92%. The results show that the question classification method could improve the reliability of the questionnaires for at least 0.7. Compared to the question deletion method using SPSS, 75% of the questions left were verified the same as the results obtained by applying the classification method.

A Design Scheme of Online Test and Evaluation System (온라인 시험 및 평가 시스템 설계 방안)

  • Choi, Kyungsoo;Lee, Kilhung
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.13 no.1
    • /
    • pp.13-21
    • /
    • 2017
  • This paper describes a design scheme of a system that tests or polls from the students at online class. By online test, the teacher can test the pre-knowledge level of the students and know how much students understand the lecture of the class. As the number of test increases, the burden of the preparation of setting question, evaluation of the test, and management of the test results is increased. In this environments, an online test management system make it easy to test and evaluate, and thus it would be a good tool for maintaining and managing the total procedure of the test or poll of the students. For evaluating the design of the system, we made a test system prototype and performed evaluations of the online test system. The online test and evaluation system provides a good tool for testing and evaluation of student's knowledge at the class with easy and fast way.

Scientific EVALUATION in Korea

  • Rhie, Won-Geun
    • Proceedings of the Korea Technology Innovation Society Conference
    • /
    • 1999.11c
    • /
    • pp.557-575
    • /
    • 1999
  • The task evaluating science and technology is becoming more important in every country trying to develop and improve overall national R&D capability in an effort to sustain national prosperity and public welfare. However, the way in which evaluation organisation is approached in each country may differ from nation to nation reflecting national R&D systems and S&T policies as well as the specific roles of scientists and policy- makers at various levels. Over the past two decades or so, Korean evaluation system has been transplanted form the West and they modified, In addition, Korea borrowed elements from the Japanese. Whether such systems have been well rooted in our specific circumstances is a critical question. In this context, it would be meaningful to diagnoses the current Korean evaluation system and also makes some suggestions for improving this system. For this purpose, this paper also attempts to approach to the theoretical aspects of evaluation as a starting-point.

  • PDF

A study on Improvement in evaluation method of practical skill test of national technique qualification of Master Craftsman Welding based on NCS (NCS기반 국가기술자격 용접기능장 실기평가 방법 개선에 관한 연구)

  • Jeong, Sang-Cheol;Chol, Sung-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.2
    • /
    • pp.596-600
    • /
    • 2016
  • This paper describes the research aimed at improving the evaluation method of practical exams in a field of welding on a national technical qualification examination based on national competency standards (NCS). In this study, new evaluation methods of practical exams on master craftsman welding reflect the latest welding technique trends and are applied to the ability unit and the fulfillment criteria of the national competency standards. The effects are then verified through an advisory conference and demonstration evaluation. The practical exams on the master craftsman welding in the current welding field were analyzed systematically. In the future, the national technical qualification examination of master crafts welding will be applied after completing the revision of the question standards through an expert group in its duty fields based on this research.

Ergonomic Evaluation of Indoor Bike Coordinated with Virtual Images (가상 영상과 조합된 실내 자전거의 인간공학적 평가)

  • Han, Seung Jo;Kim, Sun-Uk;Cho, Jae-Hyung;Koo, Kyo-Chan
    • Journal of Digital Convergence
    • /
    • v.15 no.5
    • /
    • pp.443-451
    • /
    • 2017
  • This paper's objectives are to investigate the criteria for ergonomic evaluation of indoor bike coordinated with virtual images, and to compare HMD-based VR bike with 2D-based one. 12 experts performed delphi method with an aim to determine ergonomic evaluation criteria that were classified into 4 categories(Usability, Emotion, User Values, Reality). 2D-based bike and HMD-based one were compared according to part of final criteria through fuzzy-logic question performed by 20 subjects. Though there were no confidential difference in usability, HMD-based VR bicycle resulted in greater scores than 2D-based one in elements related with emotion, user value and reality statistically. It is expected that this research results will be used as references to evaluate ergonomic design of other indoor exercise equipments combined with VR or AR.

A Survey Study on the Science Education Evaluation and Objectives -attached perception and actual state of middle school science teachers in pusan- (과학교육평가(科孝敎育評價)와 목표(目標)에 관(開)한 중등고학교사(中等科學敎師)의 인식(認識) 조사(調査) 연구(硏究))

  • Woo, Jong-Ok;Lee, Kyung-Hoon;Son, Eun-Joo
    • Journal of The Korean Association For Science Education
    • /
    • v.5 no.1
    • /
    • pp.63-79
    • /
    • 1985
  • The purpose of our survey study was to investigate the status on perception and actual state toward science educational evaluation and objectives of middle school science teachers in Pusan. The perception and actual state were surveyed by the questionaire which was developed by Jong-Ok Woo et. al. We developed two kinds of questionaire. One is designed to use Likert type scale and is composed of two main category(SE; Science educational evaluation, SO; Science educational objectives) which contains 21 question items, and the other has 16 question items From 313 science teacger's responses of 75 middle schools in pusan, the tendency. of total(SE+SO) and each sub category, and the contrast with their background and actual state were analized by SPSS program of KAIST. Some results of our survey study can be summarized as follows; 1. Total tendency of science educational evaluation(SE) and objectives(SO) of middle school science teachers in pusan shows a positive and right tendency of conception in general(m-85.8/100). 2. Tendency of SE(m-87.8/100) are slightly higher than SO(m-81.7/100). At the level of 5% significance, there are correlated but shows low correlation (r=0.12(4). 3. In each correlation toward total tendency(SE+SO), SE is highly correlated(r-0.8486) but SO is moderately correlated(r=0.6297) at the level of 0.1% significance. 4. Tendencies of 5sub category (PE, PC, PD, PO, PB) shows considerably right tendencies (m=$73.4/100{\sim}92.7/100$), there are moderately correlated foward total tendency(SE+SO) at the level of 0.1% significance (r=$0.49{\sim}0.60$). 5. At the level of 5%significance, total means are no differences which their background(Sex, Final alma mate, Major, Difference of training), but there is differences to teaching career at the level of 5% significance.

  • PDF

Research on the Movie Reviews Regarded as Unsuccessful in Box Office Outcomes in Korea: Based on Big Data Posted on Naver Movie Portal

  • Jeon, Ho-Seong
    • Asia-Pacific Journal of Business
    • /
    • v.12 no.3
    • /
    • pp.51-69
    • /
    • 2021
  • Purpose - Based on literature studies of movie reviews and movie ratings, this study raised two research questions on the contents of online word of mouth and the number of movie screens as mediator variables. Research question 1 wanted to figure out which topics of word groups had a positive or negative impact on movie ratings. Research question 2 tried to identify the role of the number of movie screens between movie ratings and box office outcomes. Design/methodology/approach - Through R program, this study collected about 82,000 movie reviews and movie ratings posted on Naver's movie website to examine the role of online word of mouths and movie screen counts in 10 movies that were considered commercially unsuccessful with fewer than 2 million viewers despite securing about 1,000 movie screens. To confirm research question 1, topic modeling, a text mining technique, was conducted on movie reviews. In addition, this study linked the movie ratings posted on Naver with information of KOBIS by date, to identify the research question 2. Findings - Through topic modeling, 5 topics were identified. Topics found in this study were largely organized into two groups, the content of the movie (topic 1, 2, 3) and the evaluation of the movie (topics 4, 5). When analyzing the relationship between movie reviews and movie ratings with 5 mediators identified in topic modeling to probe research question 1, the topic word groups related to topic 2, 3 and 5 appeared having a negative effect on the netizen's movie ratings. In addition, by connecting two secondary data by date, analysis for research question 2 was implemented. The outcomes showed that the causal relationship between movie ratings and audience numbers was mediated by the number of movie screens. Research implications or Originality - The results suggested that the information presented in text format was harder to quantify than the information provided in scores, but if content information could be digitalized through text mining techniques, it could become variable and be analyzed to identify causality with other variables. The outcomes in research question 2 showed that movie ratings had a direct impact on the number of viewers, but also had indirect effects through changes in the number of movie screens. An interesting point is that the direct effect of movie ratings on the number of viewers is found in most American films released in Korea.

Criteria for Critique of Qualitative Nursing Research (질적 연구평가 기준)

  • 신경림
    • Journal of Korean Academy of Nursing
    • /
    • v.26 no.2
    • /
    • pp.497-506
    • /
    • 1996
  • Gradually, there has been increase in the use of qualitative research methods in nursing research. Nursing scholars are using qualitative research methods to explore the essence of nursing and discover its meaning. However, there has been lack of standards for evaluating qualitative nursing research. Often nursing researchers are applying quantitative research evaluation standards to qualitative nursing research. Thus, there has not been any notable qualitative research done to date. In order to improve the quality of nursing research done to discover new knowledge for the nursing, & for development of nursing theory, criteria for critiquing qualitative research should be established. Therefore, this researcher introduced standards as criteria for critiquing qualitative research which are based on literature reviews and re search experiences. The suggested criteria are developed several question's as follows : 1) description of the research phenomena, 2) significance, 3) research purpose, 4) research question, 5) assumptions, 6) researcher's abilities, 7) selection of research samples, 8) data collection, 9) human subjects, 10) data analysis, 11) description of researcher's results, 12) literature review. Follow-up of concrete questions for each of the criterias have been developed.

  • PDF

KorQATeC2.0: Construction of Test Collection for Evaluation of Question Answering System (KorQATeC2.0: 질의/응답 시스템의 성능 평가를 위한 평가집합 구축)

  • Kim, Jae-Ho;Lee, Kyung-Soon;Oh, Jong-Hoon;Chang, Du-Seong;Choi, Key-Sun
    • Annual Conference on Human and Language Technology
    • /
    • 2001.10d
    • /
    • pp.397-404
    • /
    • 2001
  • 본 논문에서는 질의/응답 시스템의 평가를 위해 구축된 평가집합 (Korean Question Answering Test Collection 2.0: KorQATeC2.0)에 대하여 기술한다. KorQATeC2.0은 총 120개의 질의와 207,067개의 문서로 구성되어 있으며, 120개의 질의는 질의에 대한 정답을 제시하는 방식에 따라 기본 과제 질의, 나열 과제 질의, 문맥 과제 질의, 요약 과제 질의로 나누어진다. 또한 KorQATeCl.0과는 달리 여러 문서를 참조하여 정답을 구성하는 질의와 문서집합에 정답이 존재하지 않는 질의를 포함시킴으로써 질의/응답 시스템의 평가를 다양하게 할 수 있도록 하였다. 본 논문에서 기술하는 평가집합은 질의/응답 시스템의 객관적 평가를 가능하게 한다는 점에서 그 의의가 있다.

  • PDF

A Comparison of the Different Question Formats in the Contingent Valuation Method for the Evaluation of Recreational Benefit (휴양자원가치(休養資源價値) 평가(評價)를 위한 CVM 질문형(質問型) 비교(比較))

  • Kim, Joon-Soon
    • Journal of Korean Society of Forest Science
    • /
    • v.88 no.3
    • /
    • pp.400-407
    • /
    • 1999
  • The purpose of thin paper is to test difference of the two question formats, open-ended and dichotomous choice formats, in the contingent valuation method using the estimated recreational benefits. The data were collected from the visitors at the Songnisan National Park. The recreational benefit based on the equivalent variation. The two question formats, but the same content, were asked of the same individuals. In this analysis, it was used travel cost and monthly income as the exogenous variables, which assumed a linear functional form for the WTP equation. The model assumed a bivariate normal distribution on the basis of the probit and tobit model concerning the censored zero WTP. The result showed no differences in the recreational benefits from the different question formats under a same respondent. The mean benefit was estimated 25.556 Won per 5 years per visitors.

  • PDF