• The Journal of Society for e-Business Studies
• /
• v.27 no.1
• /
• pp.81-94
• /
• 2022

In the service sectors, the qualitative evaluation method in the form of a survey is widely used as a major assessment tool to evaluate the quality of service. However, the results obtained from a survey can involve the subjective judgment of the respondent. In this study, we propose a method to secure objectivity by excluding subjectivity that may be included in the qualitative evaluation results. In particular, we deal with a situation where the same type of qualitative evaluation tool is used repeatedly by several service providers. To this end, by utilizing both the Ordered Probit model and third-party evaluation results, we determine whether subjectivity is involved in the results. After correcting subjectivity, the final results are obtained through statistical analysis. The application analyzed in this study is the medical service area. With the actual evaluation results supplied by the service providers, we explain how objectivity can be secured from the assessment data by applying our proposed approach.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.34 no.1
• /
• pp.189-207
• /
• 2023

This study focused on the public library evaluation indicators in 2022 to examine the changes and improvement recommendations. In addition, this study analyzed the results of changes in the proportion between the qualitative and quantitative evaluation. Eventually, there was a comparison between the current and previous evaluation outcomes. Furthermore, we examined the effectiveness of the current evaluation groupings of libraries. Then, we tried to discover new quantitative evaluation variables that affected the evaluation score calculation. Finally, we proposed a method for estimating variables through standardization and individualization, as well as a scheme to encourage the voluntary participation of public libraries in the evaluation.

• Journal of Korean Library and Information Science Society
• /
• v.46 no.3
• /
• pp.255-275
• /
• 2015

The purpose of this study is to develop an approach to teaching qualitative research methods (TQRM) for Library and Information Science. To draw trend of TQRM, 76 course syllabi collected in the research oriented universities' master and doctoral programs, were analyzed using content analysis. The study proposes both common topics and essential strategies for TQRM in terms of the paradigm of qualitative research, research design, wide range of approaches to QR, diversity of collecting and analyzing data, writing, and evaluation criteria. It is very important to identify qualitative stance and to understand paradigms and philosophical and theoretical frameworks of QR for conducting QR reiteratively, creatively, reflectively.

• Journal of the Korean Society for Railway
• /
• v.10 no.4
• /
• pp.420-430
• /
• 2007

It is reported that many users of the subways in Seoul are not currently satisfied with the subway services. The cause of the dissatisfaction is that the qualitative items and indexes are not considered properly, and also does not diversify the evaluation items to follow the change of subway environment. Therefore in this study the evaluation items and indexes that can reflect of the subway users' characteristics are examined and synthesized. Then the characteristics of service are analyzed for the senior subway system users and junior subway system users that are classified with the cluster analysis. The result of the study is that the majority of users on subway are not satisfied the qualitative items which are safety, kindness, comfortableness, convenience excepting for punctuality and accessibility. So, if the service of subway users improve, the qualitative items is needed to consider with quantitative items.

• Journal of Korean Critical Care Nursing
• /
• v.4 no.2
• /
• pp.1-14
• /
• 2011

Purpose: This study was aimed to understand and describe the Korean critical care advanced practice nurses' work experience. Methods: Data was collected through 2 focus group interviews that were held in two different university hospitals in Seoul, Korea. All interviews were recorded and transcribed, and data were analysed using modified qualitative content analysis. Results: Ten themes were drawn from data analysis. They are "Various and complex tasks", "Excellency of advanced nursing practice", "Pressure and responsibility accompanied with pride", "Role identity confusion", "Role conflict", "Leaping and evolving role", "Gap between role and outcome evaluation", "Underestimated outcomes", "Where are my outcomes?" "Searching for outcomes: publicize the role". Conclusion: The results of this study help to understand the role of Korean critical care advanced practice nurses and to guide to outcome evaluation of their role effectiveness. Developing qualitative outcome indicators, cost-effectiveness ananlysis of Korean critical care advanced practice nurses' role, and accumulation of evidences through researches on outcome evaluation will be needed to successfully settle down advanced practice nursing in Korea.

• Archives of design research
• /
• v.9
• /
• pp.801-810
• /
• 1994

Design Problems are often both multidimensional and highly interactive. Very rarely does any part of a designed thing serve only one purpose. The activity of designing is thus a goal-directed activity and normally a goal-directed problem-solving activity. This means, problem solving is finding a way to get from some initial situation to a desired goal. Designers are transforming agents within a society whose goals are to improve the human condition through physical metamorphosis. Many theorist have agreed that designing involves problem solving or decision making. Accordingly evaluation plays an essential role in design activity. The evaluation factors include all attributes that have levels specified by quantitative and qualitative objectives Alternatives in multi-objective decision prOblems generally possess numerous attributes by which they can be described and compared. The evaluation factors include all attributes that have levels specified by quantitative and qualitative objectives. However since qualitative factors are difficult to quantify as numeral estimates, these factors have tended to be ignored without regard for their importance to human content. We adapted the Accumulative Evaluation Model as an evaluation algorithm for IDES. Industrial Design Evaluation System (IDES) consists of 3 major modules ( 1 Design Element, 2.Matrix, 3.Evaluation). It is intended to be an aid for design evaluation. The luther thinks IDES is a new design evaluation approach which could provide effective rating of design values to make value judgements. It is an attempt to provide industrial designers with access to design evaluation. The author's aim is to produce an Object-Oriented Evaluation System which can guide the designers and decision makers under complex design projects. It uses\ulcorner an Object-Oriented Programming for this prototype, Because of managing complexity (Flexibility and Reusability) and improving productivity(Extensibility & Maintainability and Programming by User) in software development process. The author has chose the C++ because it is a hybrid, rather than pure Object-Oriented Language.

• Journal of Korean Academy of Fundamentals of Nursing
• /
• v.22 no.4
• /
• pp.442-451
• /
• 2015

Purpose: The purpose of this study was to analyze reports of qualitative research published in Journal of Korean Academy of Fundamentals of Nursing (JKAFN). Methods: Twenty four qualitative research studies using in-depth interviews and focus group interviews published in JKAFN from 1994 to 2014 were selected for analysis. Chosen reports were analyzed by consolidated criteria for reporting qualitative research (COREQ), which is a reporting guideline for qualitative research. COREQ consists of 32 items and 3 domains. Results: In the 1st domain, the relationship of researchers and research participants, bias and understanding of the researchers on the study phenomenon were analyzed less than other items. In the 2nd domain, methodological research was carried out across various qualitative studies, but the description of the research environment and research questions for the interview guidelines was insufficient. In the 3rd domain, research results and data were consistent, but data showing opposing content and explanations of negative practices were not done at all. Conclusion: These results indicate a need for the development of evaluation tools for qualitative research and items should be added to improve the reliability and validity, research should be related to the ethics in the framework of the COREQ.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.6
• /
• pp.765-773
• /
• 2011

Objective: This study aims towards exploring a model of the HCI evaluation methods to improve the usability of mobile device, based on a case of a Mobile PDA system in a Museum context. Background: Mobile PDA systems in a Museum context is widely utilized for the educational purposes, but it is criticized for low usability that the device only play a role in textbooks on legs without any interactive educational activities. Therefore, the usability improvements on the mobile PDA system should be considered. Method 1: This model was developed with a combination of the expert review and the user testing, and with a combination of the qualitative and quantitative studies. In more details, first of all, a qualitative study was conducted as a combination of three different methods: 1) expert review with heuristics, 2) interviews with persons working in a museum, and 3) contextual enquiry. Results 1: The experts review provided with critical usability issues, and the semi-constructive interview helped to understand the background of the mobile device. Lastly, the contextual enquiry showed user experience problems and directions of improving the device from user's perspective. Method 2: Based on the results of the qualitative study, a questionnaire was designed. Results 2: The analysis of the quantitative study was conducted to generalize the problems, and prioritize the direction of improving the device within the limitation of the cost and time in a museum. Conclusion: This study has implications in developing an example of a HCI evaluation model to improve the user experience of the mobile device as well as finding problems and directions of how to improve the mobile PDA systems in the museum. Application: In fact, most of the studies related to the evaluation of the mobile device have been conducted in a laboratory context due to the cost and time. This paper, however, attempted to apply to various HCI research techniques from different constituents in real context.

• Journal of Engineering Education Research
• /
• v.26 no.6
• /
• pp.62-70
• /
• 2023

The purpose of this study is to derive implications for improving related policies and evaluation criteria in the future by analyzing trends of evaluation criteria for industry-university cooperation in Korea. For this purpose, five surveys on industry-university cooperation by government departments, major general university evaluations, and evaluation indicators of specialized industry-university evaluations by the Ministry of Education were analyzed. As a result, most of the evaluation criteria for domestic industry-university cooperation have been composed of quantitative indicators and have a limited character as quantitative performance management for government projects. Although the Ministry of Education's evaluation criteria for industry-university cooperation projects has gradually changed to a segmented index considering universities, industries, and regions, it needs to be supplemented for sustainability of industry-university cooperation. In order to promote sustainable industry-university cooperation in the future, it was suggested that first, it is necessary to supplementation of qualitative Indicators considering each university's characteristics, second, the composition of indicators related to reflect on demand in the process of the cooperation, and third, to build a virtuous cycle system for future operation of evaluation criteria.

• Archives of design research
• /
• v.2 no.1
• /
• pp.117-130
• /
• 1989

Evaluation is to be seen a~ a central component of design activity. It is an attempt to ensure that the proposal which arises is accepted and that the resulting artefact itself suited to its purposes in practice. Recent surveys of Evaluation show that most methods require quantitative and explicit attributes. Always a significant part of the attributes of design proposals is qualitative. Therefore we need some study that convert qualitative attributes into quantitative scale values, because in many cases con\ulcornerclusions can be drawn about the order of the overall value of the design proposals. Following to Thurstone's psychological scaling methods, attributive values are assigned by ruting scale methods, met, hod of rank-order and method of paired comparisons. The problem of psycho\ulcornerlogical scaling is then to determine whether the stimuli can be ordered on a psychological continuum with respect to the degree of the attributes each possesses. The law of comparative judgement assumes that for a given stimulus there is associated a most frequently aroused or modal discriminal process on a psychological continuum. This paper is based upon the premise that the modal discriminul process will also be the same as the mean or median of the distribution.The objective of this paper is to argue for an acceptance of qualitative approaches to the evalua\ulcornertion of Design as a complement to the existing quantitative techniques. The scale values of 10 attri\ulcornerbutes \ulcorner(1) originality, (2) aesthetics, (3) satisfaction, (4) effeciency, (5) function, (6) size, (7) texture, (8) simplicity, (9) symbol, and (10) facility) in case of TV sets are obtained and their interactions are examined.