• Title/Summary/Keyword: Scoring difficulty

Search Result 41, Processing Time 0.023 seconds

An Analysis of IT Proposal Evaluation Results using Big Data-based Opinion Mining (빅데이터 분석 기반의 오피니언 마이닝을 이용한 정보화 사업 평가 분석)

  • Kim, Hong Sam;Kim, Chong Su
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.41 no.1
    • /
    • pp.1-10
    • /
    • 2018
  • Current evaluation practices for IT projects suffer from several problems, which include the difficulty of self-explanation for the evaluation results and the improperly scaled scoring system. This study aims to develop a methodology of opinion mining to extract key factors for the causal relationship analysis and to assess the feasibility of quantifying evaluation scores from text comments using opinion mining based on big data analysis. The research has been performed on the domain of publicly procured IT proposal evaluations, which are managed by the National Procurement Service. Around 10,000 sets of comments and evaluation scores have been gathered, most of which are in the form of digital data but some in paper documents. Thus, more refined form of text has been prepared using various tools. From them, keywords for factors and polarity indicators have been extracted, and experts on this domain have selected some of them as the key factors and indicators. Also, those keywords have been grouped into into dimensions. Causal relationship between keyword or dimension factors and evaluation scores were analyzed based on the two research models-a keyword-based model and a dimension-based model, using the correlation analysis and the regression analysis. The results show that keyword factors such as planning, strategy, technology and PM mostly affects the evaluation result and that the keywords are more appropriate forms of factors for causal relationship analysis than the dimensions. Also, it can be asserted from the analysis that evaluation scores can be composed or calculated from the unstructured text comments using opinion mining, when a comprehensive dictionary of polarity for Korean language can be provided. This study may contribute to the area of big data-based evaluation methodology and opinion mining for IT proposal evaluation, leading to a more reliable and effective IT proposal evaluation method.

Effect of Guessing on the Correct Answer in a Multiple Choice (객관식 선다형문항에서 추측이 정답에 미치는 영향)

  • Kwon, Boseob
    • The Journal of Korean Association of Computer Education
    • /
    • v.23 no.1
    • /
    • pp.29-36
    • /
    • 2020
  • Various items were used as evaluation tools that identify the student's abilities accurately to confirm the completion of learning. Among them, the multiple choice item has the advantages of high objectivity and reliability in scoring, but it cannot remove the factor of guessing. In this paper, the multiple choice items are classified into two types according to the relationship between the questionnaire and the choices. One is the type used in the classical test theory with the probability of guessing 1/k for k choices and the other is the novel proposed type which introduces the concept of partial knowledge. In the proposed type, the probability of guessing when the number of knowledge i is (i+1)/k for k choices. Based on the assumptions of the previous theories about multiple choice items, we derive the guessing parameter about the proposed type. And we analyzed the effect of the guess on the correct answer in the existing type and the proposed type. This shows that the proposed type has more question guessing than the existing type.

A Case Report of Severe Femoral Neuropathy with Motor Weakness and Hypoesthesia Treated by Combined Western-Korean Medicine Treatment (근력저하 및 감각저하를 호소하는 중증 대퇴신경병증 환자에 대한 양⋅한방 병용 치료 1례)

  • So-min Jung;Seon-uk Jeon;Moon-young Ki;Ye-chae Hwang;Gyeongmuk Kim;Han-Gyul Lee;Sang-Kwan Moon;Woo-Sang Jung;Seungwon Kwon
    • The Journal of Internal Korean Medicine
    • /
    • v.45 no.2
    • /
    • pp.176-189
    • /
    • 2024
  • In femoral neuropathy, the femoral nerve is compressed or ischemic. Patients with femoral neuropathy experience muscle atrophy, difficulty flexing the hip joint and extending the knee, decreased sensation of the lower extremities, and loss of patellar tendon reflex. The prognosis of femoral neuropathy is reported to vary, as it takes several days to several months for neurological abnormalities to resolve. We describe a case of a 58-year-old female with a diagnosis of severe femoral neuropathy and complaints of motor weakness and hypoesthesia. The patient underwent combined Western-Korean medicine treatment. The Toronto Clinical Neuropathy Scoring System, Overall Neuropathy Limitations Scale, and Berg Balance Scale were used as evaluation tools during the treatment period. The combined Western-Korean medicine treatment led to a significant improvement in symptoms in this patient with severe femoral neuropathy where the cause was unclear and the prognosis was expected to be poor.

Automatic Detection of Stage 1 Sleep Utilizing Simultaneous Analyses of EEG Spectrum and Slow Eye Movement (느린 안구 운동(SEM)과 뇌파의 스펙트럼 동시 분석을 이용한 1단계 수면탐지)

  • Shin, Hong-Beom;Han, Jong-Hee;Jeong, Do-Un;Park, Kwang-Suk
    • Sleep Medicine and Psychophysiology
    • /
    • v.10 no.1
    • /
    • pp.52-60
    • /
    • 2003
  • Objectives: Stage 1 sleep provides important information regarding interpretation of nocturnal polysomnography, particularly sleep onset. It is a short transition period from wakeful consciousness to sleep. The lack of prominent sleep events characterizing stage 1 sleep is a major obstacle in automatic sleep stage scoring. In this study, utilization of simultaneous EEG and EOG processing and analyses to detect stage 1 sleep automatically were attempted. Methods: Relative powers of the alpha waves and the theta waves were calculated from spectral estimation. A relative power of alpha waves less than 50% or relative power of theta waves more than 23% was regarded as stage 1 sleep. SEM(slow eye movement) was defined as the duration of both-eye movement ranging from 1.5 to 4 seconds, and was also regarded as stage 1 sleep. If one of these three criteria was met, the epoch was regarded as stage 1 sleep. Results were compared to the manual rating results done by two polysomnography experts. Results: A total of 169 epochs were analyzed. The agreement rate for stage 1 sleep between automatic detection and manual scoring was 79.3% and Cohen’s Kappa was 0.586 (p<0.01). A significant portion (32%) of automatically detected stage 1 sleep included SEM. Conclusion: Generally, digitally-scored sleep staging shows accuracy up to 70%. Considering potential difficulty in stage 1 sleep scoring, accuracy of 79.3% in this study seems to be strong enough. Simultaneous analysis of EOG differentiates this study from previous ones which mainly depended on EEG analysis. The issue of close relationship between SEM and stage 1 sleep raised by Kinnari remains a valid one in this study.

  • PDF

Analysis of Interactions in Multiple Genes using IFSA(Independent Feature Subspace Analysis) (IFSA 알고리즘을 이용한 유전자 상호 관계 분석)

  • Kim, Hye-Jin;Choi, Seung-Jin;Bang, Sung-Yang
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.33 no.3
    • /
    • pp.157-165
    • /
    • 2006
  • The change of external/internal factors of the cell rquires specific biological functions to maintain life. Such functions encourage particular genes to jnteract/regulate each other in multiple ways. Accordingly, we applied a linear decomposition model IFSA, which derives hidden variables, called the 'expression mode' that corresponds to the functions. To interpret gene interaction/regulation, we used a cross-correlation method given an expression mode. Linear decomposition models such as principal component analysis (PCA) and independent component analysis (ICA) were shown to be useful in analyzing high dimensional DNA microarray data, compared to clustering methods. These methods assume that gene expression is controlled by a linear combination of uncorrelated/indepdendent latent variables. However these methods have some difficulty in grouping similar patterns which are slightly time-delayed or asymmetric since only exactly matched Patterns are considered. In order to overcome this, we employ the (IFSA) method of [1] to locate phase- and shut-invariant features. Membership scoring functions play an important role to classify genes since linear decomposition models basically aim at data reduction not but at grouping data. We address a new function essential to the IFSA method. In this paper we stress that IFSA is useful in grouping functionally-related genes in the presence of time-shift and expression phase variance. Ultimately, we propose a new approach to investigate the multiple interaction information of genes.

Math Creative Problem Solving Ability Test for Identification of the Mathematically Gifted Middle School Students (중학교 수학 영재 판별을 위한 수학 창의적 문제해결력 검사 개발)

  • Cho, Seok-Hee;Hwang, Dong-Jou
    • Journal of Gifted/Talented Education
    • /
    • v.17 no.1
    • /
    • pp.1-26
    • /
    • 2007
  • The purpose of this study was to develop a math test for identification of the mathematically gifted on the basis of their math creative problem solving ability and to evaluate the goodness of the test. Especially, testing reliability and validity of scoring method on the basis of fluency only for evaluation of math creative problem solving ability was one of the main purposes. Ten closed math problems and 5 open math problems were developed requiring math thinking abilities such as intuitive insight, organization of information, inductive and deductive reasoning, generalization and application, and reflective thinking. The 10 closed math test items of Type I and the 5 open math test items of Type II were administered to 1,032 Grade 7 students who were recommended by their teachers as candidates for gifted education programs. Students' responses were scored by math teachers. Their responses were analyzed by BIGSTEPS and 1 parameter model of item analyses technique. The item analyses revealed that the problems were good in reliability, validity, item difficulty and item discriminating power even when creativity was scored based on the single criteria of fluency. This also confirmed that the open problems which are less-defined, less-structured and non-entrenched were good in measuring math creative problem solving ability of the candidates for math gifted education programs. In addition, it was found that the math creative problem solving tests discriminated applicants for the two different gifted educational institutions.

Conjoint analysis by merging attributes (속성 병합에 의한 컨조인트 분석)

  • Lim, Yong B.;Park, Gahee;Chung, Jong Hee
    • Journal of Korean Society for Quality Management
    • /
    • v.45 no.1
    • /
    • pp.55-64
    • /
    • 2017
  • Purpose: A large number of attributes with mixed levels are often considered in the conjoint analysis. The respondents may have difficulty with scoring their preferences accurately because of many attribute items involved in each survey question. We research on the technique for reducing the number of attribute items. Methods: In order to reduce the number of attribute items in a survey question, we make a new attribute by merging two original attributes. A 'No question' option is also included as a new level in a merged attribute. Results: We propose BIB $6^4$ design in the case where we have four attributes with 2 levels and 3 levels, respectively and then analyze all the respondents survey data generated by the repeated simulation study in order to compare various model selection methods. Conclusion: How to reduce the number of attribute items is proposed and how to design and analyze the survey data are illustrated.

Arthroscopically Assited Reconstruction of the Anterior Cruciate Ligament using the Flexible Reamer (유연성 연마기를 이용한 관절경적 전방 십자 인대 재건술)

  • Lee Seoung-Joon;Park Jung-Ho;Chae In-Jung
    • Journal of the Korean Arthroscopy Society
    • /
    • v.7 no.2
    • /
    • pp.176-182
    • /
    • 2003
  • Purpose : The purpose of this study is to describe the surgical technique of ACL reconstruction with the flexible reamer and evaluate the clinical results of this method. Materials and Methods : Twenty four patients who followed for 12 months were included. The results were evaluated by Lachman test, KT-2000 arthrometer, Lysholm score, and postoperative roentgenogram of the knee. Results : The range of motion of the affected knee was acceptable except one case(10 to 90 degree) and at the last follow up, two cases were positive in Lachman test. Mean Lysholm knee scoring scale was 63.7 point preoperatively and 91.4 point at the last follow up. The results of KT-2000 arthrometer was 6.6mm preoperatively and 1.5mm at the last follow up. In operative time, there were decrease of mean 13.5 minute than ACL reconstruction without the flexible reamer, Conclusion : ACL reconstruction with the flexible reamer achieves the ideal isometric point of tibia and femur with no difficulty, proper notchplasty preventing from the impingement, and lessens the operative time.

  • PDF

An Empirical Analysis on Determinant Factors of Patent Valuation and Technology Transaction Prices (특허가치 결정요인과 기술거래금액에 관한 실증 분석)

  • Sung, Tae-Eung;Kim, Da Seul;Jang, Jong-Moon;Park, Hyun-Woo
    • Journal of Korea Technology Innovation Society
    • /
    • v.19 no.2
    • /
    • pp.254-279
    • /
    • 2016
  • Recently, with the conversion towards knowledge-based economy era, the importance of the evaluation for patent valuation has been growing rapidly because technology transactions are increasing with the purpose of practically utilizing R&D outcomes such as technology commercialization and technology transfer. Nevertheless, there is a lack of research on determinants of patent valuation by analyzing technology transactions due to the difficulty of collecting data in practice. Hence, to suggest quantitative determinants for the patent valuation which could be applied to scoring methods, 15 patent valuation models domestically and overseas are analysed in order to assure the objectiveness for subjective results from qualitative methods such as expert surveys, comparison assessment, etc. Through this analysis, the important 6 common determinants are drawn and patent information is matched which can be used as proxy variables of individual determinant factors by advanced researches. In addition, to validate whether the model proposed has a statistically meaningful effect, total 517 technology transactions are collected from both public and private technology transaction offices and analysed by multiple regression analysis, which led to significant patent determinant factors in deciding its value. As a result, it is herein presented that patent connectivity(number of literature cited) and commercialization stage in market influence significantly on patent valuation. The meaning of this study is in that it suggests the significant quantitative determinants of patent valuation based on the technology transactions data in practice, and if research results by industry are systematically verified through seamless collection of transaction data and their monitoring, we would propose the customized patent valuation model by industry which is applicable for both strategic planning of patent registration and achievement assessment of research projects (with representative patents).

Small Business Research and Development Assessment System based on Fuzzy-AHP (Fuzzy-AHP 기반 중소기업 R&D 평가 시스템)

  • Park, Seong-Ho;Oh, Jae-Taek;Lee, Sang-Yong
    • Journal of Digital Convergence
    • /
    • v.18 no.9
    • /
    • pp.323-329
    • /
    • 2020
  • There is a system of mandating the allocation of support to small business in certain percentage or more to facilitate technological innovation at small business. Trying to assess small business R&D projects, which receive a budget of three trillion won or more from the government every year, for their possibilities of success, a group of experts perform a technological evaluation with their technologies and their difficulty levels and review closely the possibilities of their commercialization and success. Used in such a review, the Analytic Hierarchy Process technique cannot make an objective judgment of evaluation criteria for evaluation items and guarantee the professionalism and fairness of small business R&D projects due to the inherent ambiguity and uncertainty of the evaluation criteria. This study proposed an R&D evaluation system based on Fuzzy-AHP for small business to provide objective weight for the evaluation items and assess the possibilities of such projects' success. The evaluation criteria were make objective as they were applied as section values based on triangular fuzzy numbers. Weight was assigned and applied according to the management guidelines of supportive projects for small business' technological development so that it could be reflected on actual assessment. The findings of the study will be helpful for reflecting the scoring weight of these evaluation items again when an expert is appointed for a new project and guaranteeing the professionalism and fairness of small business R&D project based on them.