• Title/Summary/Keyword: relevance evaluation

Search Result 292, Processing Time 0.024 seconds

Acceptable Values of Kappa for Comparison of Two Groups

  • Seigel Daniel G.;Podgor Marvin J.;Remaley Nancy A.
    • 대한예방의학회:학술대회논문집
    • /
    • 1994.02b
    • /
    • pp.129-136
    • /
    • 1994
  • A model was developed for a simple clinical trial in which graders had defined probabilities of misclassifying pathologic material to disease present or absent. The authors compared Kappa between graders, and efficiency and bias in the clinical trial in the presence of misclassification. Though related to bias and efficiency, Kappa did not predict these two statistics well. These results pertain generally to evaluation of systems for encoding medical information, and the relevance of Kappa in determining whether such systems are ready for use in comparative studies. The authors conclude that, by itself, Kappa is not informative Enough to evaluate the appropriateness of a grading scheme for comparative studies. Additional, and perhaps difficult, questions must be addressed for such evaluation.

  • PDF

A Study on the Evaluation of Ride Comfort using Human Model (인체모델을 사용한 승차감의 정량적 평가에 관한 연구)

  • Kim, Kwangsuk
    • Journal of the Korean Society of Mechanical Technology
    • /
    • v.13 no.3
    • /
    • pp.57-64
    • /
    • 2011
  • Vibrations on the floor in a car are transmitted to the foot, hip, and back from the seat. Human body recognizes these vibrations, but the sensitivity for each vibration is different. To evaluate these vibrations, RMS(root mean square) of accelerations, VDV(vibration does value) are commonly used. The ride comfort evaluation is usually carried out by experiments of real cars which are expensive. The purpose of this paper is to briefly review the status of several ride vibration standards and criteria having relevance to construction machinery vehicles and to suggest recommendations for the effective use of such criteria in vehicle / component development.

Analysis for SEM of ARCS Factor and Persistent Learning-Intension in Educational Mobile App (교육용 모바일 앱의 ARCS 요인과 학습지속의도에 관한 구조모형 분석)

  • Choi, Byongsu;Yoo, Sang-Mi
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.4
    • /
    • pp.239-247
    • /
    • 2013
  • This study is aimed to perform the qualitative evaluation based on the ARCS Model of educational mobile applications for smart phones. The evaluation has been performed targeting 60 students who attending the subject of informational education in 3 different universities in 2012 by allowing them to select the available educational mobile App installed in their smart phone. After, the level of persistent learning-intension from each student and the efficacy of ARCS motivational strategy was measured at learner's perspective. The structural equation model(SEM) was established and analyzed with PLS method to understand the relationship between the ARCS motivational strategy and the persistent learning-intension. The results of the study could be summarized as followings. First, the educational mobile App in various the motivational strategies showed different results that is the highest attention as well as the lowest satisfactory level. Second, the relevance in motivation strategies had the statistically significant effect in attention, confidence, and satisfaction. On the other hand, the other factors of attention, relevance, and confidence showed statistically significant effect in satisfaction. Finally, result demonstrate that the relevance is the critical factor inducing the significant effect in persistent learning-intension among the motivational strategies.

Using Community-Based Participatory Research(CBPR) for Health Promotion (건강증진을 위한 지역사회 기반 참여연구의 적용 방안)

  • Yoo, Seung-Hyun
    • Korean Journal of Health Education and Promotion
    • /
    • v.26 no.1
    • /
    • pp.141-158
    • /
    • 2009
  • Community-Based Participatory Research(CBPR) has gained attention as a public health approach to develop community health interventions to address health disparities in recognition of the community relevance of specific health issues associated with social determinants of health. It emphasizes community involvement in equal partnership with researchers and public health professionals to address community-identified needs. The characteristics and principles of CBPR discussed in this paper highlight participatory nature, capacity development, partnership building, and process-orientation of CBPR. A 6-step process model for community empowerment is then introduced as a CBPR operationalization strategy. Mixed methods research approaches are valuable in CBPR as well as process evaluation. For the application of CBPR in Korean contexts, the Diffusion of Innovation theory is suggested as a theoretical framework for implementation. Building public health partnerships between public and private sectors to create partnership synergy is a necessary condition for successful CBPR for health promotion in Korea. Accompanying critical factors for the CBPR application include: common understanding of CBPR and its values, establishment of the definition of 'community,' 'community-based' and 'participation' in community health, development of accommodating research infrastructure for CBPR, recognition of the importance of program evaluation (particularly process evaluation), and training CBPR specialists.

A Literature Review for an Emotion Evaluation Protocols Based on Skin Temperature for Home Appliances (피부온을 기반으로 한 가전제품의 감성 평가 프로토콜 수립을 위한 문헌 조사)

  • Jeon, Eun-Jin;Lee, Seung-hoon;Kim, Hee-Eun;You, Hee-Cheon
    • Fashion & Textile Research Journal
    • /
    • v.22 no.2
    • /
    • pp.240-249
    • /
    • 2020
  • This study reviews studies that used skin temperature in order to establish an emotion evaluation protocol based on skin temperature for home appliances. A survey of skin temperature evaluation papers was conducted by the following five stages: (1) keyword search, (2) title screening, (3) abstract screening, (4) full paper screening, and (5) relevance evaluation. Selected papers were reviewed for: purpose, recruitment criteria of participants, the number of participants, apparatus, procedure, measures, analysis methods, and major findings. Thermistor sensors and thermography are used for the measurement of skin temperature. Skin temperature sensors are attached to 4 - 10 locations on the body and their mean of skin temperature is calculated by Ramanatan's 4-point or Hardy & Dubois's 7-point method. Semantic differential (SD) method and thermography measuring facial surface temperature have been used for emotion evaluation. The SD method provides a set of adjective pairs related to a product and evaluates changes in emotion from the use of the product. The range of facial surface analyzed is defined in the thermal image and temperature changes before and after the evaluation are analyzed. The evaluation items of home appliances include form, color, material, aesthetics, satisfaction, novelty, convenience, pleasantness, and excellence. Many existing emotion studies using skin temperature do not apply physiological and psychological methods. This study provides basic data to establish a skin temperature and emotion evaluation protocol by examining literature for skin temperature and evaluation of sensitivity.

Result Based Evaluation Model and Its Application to Peace Operation of the ROK Military Contingent to UN Mission (한국군의 UN평화활동에 대한 성과기반 평가모델개발과 적용)

  • KWON, Goosoon
    • International Area Studies Review
    • /
    • v.21 no.1
    • /
    • pp.303-324
    • /
    • 2017
  • Current methods to evaluate the performance of ROK military contingents to UN missions unnecessarily raises the issues of relevance, validity and reliability. Thus, this article aims to suggest how the result based evaluation (RBE) model which is widely adopted in the UN field missions as well as the international development community would be modified and applied to peace operation of the ROK contingent. As a result of the study, the model presents a framework that integrates the planning process and monitoring and evaluation with a logical framework, which entails a cycle of assessment of pre-deployment planning, monitoring and phased evaluation, and post-deployment evaluation. Secondly, according to measurement of RBE benchmarks to the present ROK's monitoring and evaluation system, factors in an evaluation unit and a logical framework approach are unmet or partly met to the benchmarks. In addition, ex-post impact evaluation has been rarely performed. Finally, the policy recommendations for resolution of the aforementioned challenges as well as a joint evaluation unit, participated by experts in a civilian, public, and a military domain are proposed.

Students' Awareness of Questions for Course Evaluation in Department of Dental Hygiene (치위생과 학생의 강의평가 문항에 대한 인식)

  • Cho, Mi-Suk;Kim, Chang-Suk
    • The Journal of the Korea Contents Association
    • /
    • v.14 no.2
    • /
    • pp.450-456
    • /
    • 2014
  • This study has been conducted to investigate the awareness of questions for course evaluation with targets of 968 students in Department of Dental Hygiene at 6 colleges(universities) in Busan, Gyeongnam and Ulsan areas. The reliability, Cronbach' ${\alpha}$, of awareness of questions for course evaluation was .862, which was high. Data analysis was performed by using SPSS IBM. SPSS. Statistics. v. 19.0 program with the significance level of 0.05. As the results of this study, first, awareness score of questions for course evaluation was the average of 2.99, which was high. Second, the important factor of questions for course evaluation in entire grade was contents of class and teaching methods, and it was 59.3%, which was the highest. Third, the relevance between important factors of course evaluation and reliability of questions for course evaluation was the average of 3.06, which was higher than the validity of 2.97. Fourth, the correlation between reliability and validity of questions for course evaluation was 0.608, which showed a strong positive correlation.

A Study on the Design of Sustainability Evaluation Model Applied to Systems Engineering Technical Process : Focused on the Mobile Industry (시스템엔지니어링 기술 프로세스를 적용한 지속 가능 평가모델 설계 연구 : 모바일 산업 중심으로)

  • Kim, Sang Jin;Cha, Woo Chang
    • Journal of the Korean Society of Systems Engineering
    • /
    • v.17 no.2
    • /
    • pp.9-22
    • /
    • 2021
  • A study on the sustainability evaluation of the requirements of the mobile industry closely related to the human factor was needed. We conducted the sustainability evaluation of the mobile industry using a quantitative evaluation method with the AHP tool and a qualitative evaluation method reflecting the technological age flow of the philosophical thoughts to improve the reliability of the evaluation results of the model verification. And this evaluation is to evaluate the consistency of the connection between the national sustainability and the mobile industry. In order to draw the conclusion of the relevance, the team member Delphi 5-point scale was used. As a result, the priority was confirmed in the national sustainable development indicator and mobile industry indicator. Quantitative and qualitative evaluation was applied to the discontinued model of mobile to derive insufficient indicators, and it was confirmed that if the indicators were improved and reflected, it would be sustainable. And in order to secure reliability and accuracy, we made a proposal to apply the systems engineering process to the development of the model evaluation field. The systems engineering technology process meets the needs and requirements of stakeholders throughout the lifecycle and it is suitable for the development model of the industry's sustainability assessment.

Effects of Narrative Identity and Historical Nostalgia and Inducing Factors on Historical Contents Evaluation (역사콘텐츠의 긍정평가에 영향을 주는 내러티브 정체성과 역사적 노스탤지어 효과와 유도 요인 연구)

  • LIM, Ah-Young
    • The Journal of Industrial Distribution & Business
    • /
    • v.10 no.9
    • /
    • pp.25-36
    • /
    • 2019
  • Purpose - Consumers have memories of their past time that they have not experienced. So consumers want to experience the past time and get pleasure through historical contents such as movies or dramas. This is because the re-created the past time sets the identity of the consumers who live today, and in the process, it give consumers emotional comfort. Consumers do not remember and sympathize with all of their historical time. In general, consumers remember the time that their communities are proud of. As s result, historical content is seen as a hero, and through that, consumers can check their identity. Also consumers experience positive emotions such as self-esteem, gratitude and pride through identification with heroes. That is, through historical contents, consumers can identify themselves and replace the current negative emotions with positive ones. Therefore, this study presents narrative identity and historical nostalgia that can affect positive evaluation of historical contents and suggest the factors the can induce such effects. This study was conducted to explain what the consumption effect of historical content is from a marketing perspective and what constitutes a component of historical content as a factor driving this effect. Research design, data, and methodology - This study has developed a questionnaire with 8 Hypotheses. The Films ('Masquerade(2012)', 'Roaring Current(2014)', 'Assassination(2015)', 'The Age of Shadow(2016)') and dramas('Six Flying Dragon(2015-2016)', 'Mr. Sunshine(2018-2019)') were used as experimental contents. 268 college students participated in this empirical study, and structural equation model was used to verify hypotheses. Results - Frist, narrative identity affects positive evaluation of historical contents. Nostalgia affect positive evaluation of historical contents. and narrative identity affects positive response of historical nostalgia. Second, character act relevance, circumstance similarity, and character attractiveness have positive influence upon response of narrative identity. Lastly, empathy for story and vividness of representation have also positive influence upon response of historical nostalgia. Conclusion - This study contributes to the theoretical and managemental development of historical contents. This study shows that narrative identity and historical nostalgia are important for success of historical contents. In order for historical content to be successful, it must manage elements of character act relevance, circumstance similarity, and character attractiveness, empathy for story and vividness of representation.

A User-centered Evaluation of Korean Alta Viasta and Naver (국내 인터넷 탐색엔진에 대한 이용자 중심의 평가에 관한 연구 - 한글알타비스타와 네이버를 중심으로 -)

  • Oh, Sam-Gyun;Park, Hee-Jin
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.34 no.2
    • /
    • pp.117-133
    • /
    • 2000
  • This study evaluated two Korean search engines, Korean AltaVista and Naver, using user-based measures by Su(1998). Measures are based on four evaluation criteria: efficiency, precision, validity of the links, user satisfaction. For this study, users conducted searches on two engines with their own search queries and performed relevance judgement. Study results indicate that efficiency, validity of the links, and user' s satisfaction ratios of system features are significantly different between two search engines, although there is no significant difference of precision. This study can be used as a framework for usercentered evaluation and utilized to enhance Korean search engines.

  • PDF