• 제목/요약/키워드: qualitative evaluation study

검색결과 1,182건 처리시간 0.031초

순서형 프로빗 모델을 활용한 정성적 평가 결과의 객관성 확보방안 (Securing Objectivity of Qualitative Assessment Results using Ordered Probit Model)

  • 정민규;강윤철;김남철;정광헌
    • 한국전자거래학회지
    • /
    • 제27권1호
    • /
    • pp.81-94
    • /
    • 2022
  • 서비스 산업에서 널리 사용되는 설문조사 형태의 정성적 평가방법은 서비스 품질을 평가하는 주요한 평가 수단으로 활용되는데, 이때 설문조사 결과에 응답자의 주관적 판단이 개입될 수 있는 여지가 존재한다. 본 연구에서는 이러한 정성적 평가 결과에 포함될 수 있는 주관적 판단을 최대한 배제하고 객관성을 확보하기 위한 방안을 제시한다. 특히 같은 종류의 정성적 평가도구가 여러 사람에 의해 반복적으로 사용되는 상황에서의 객관성 확보 방안에 대해 연구하였다. 이를 위해, Ordered Probit 모델 및 제3자 평가 결과를 함께 활용하여 주관성 개입 여부를 판단하고, 주관성을 보정한 후, 최종 결과에 대해 통계적으로 검증하는 절차를 수행하였다. 본 연구에서 분석한 어플리케이션은 의료서비스 분야이며, 특히 특정 의료서비스 제공 환경에서 해당 서비스 제공자가 자가 진단한 실제 평가 결과를 본 연구에서 제안하는 방법론을 통해 어떻게 객관성이 확보될 수 있는지 구체적으로 설명하였다.

공공도서관 평가의 최근 변화 분석 및 향후 방향에 대한 제안 (Analysis of Recent Changes in Public Library Evaluation and Recommendations for Future Directions)

  • 감미아;이지연
    • 한국비블리아학회지
    • /
    • 제34권1호
    • /
    • pp.189-207
    • /
    • 2023
  • 본 연구는 2022년 전국 도서관 운영평가 중 공공도서관에 집중하여, 최근 변화 양상을 분석하고 향후 방향성을 논의하고자 하였다. 본 연구에서는 공공도서관 평가의 정성·정량평가 비율 변화 및 변화 전·후 평가 결과의 특성을 분석하였다. 우선 각 정성평가 및 정량평가의 비율 변화에 따른 과거와 현재의 평가 결과 비교 분석을 수행한 후, 도서관의 규모에 따른 그룹화에 대해 실효성을 논하고자 하였다. 더 나아가서는 각 평가점수에 대한 계산 방식의 변화 및 총점과의 상관계수 분석을 통한 새로운 정량평가 변수의 발견을 시도하였다. 이러한 과정을 통해 표준화 및 개별화를 적용한 변수의 계산 방식, 다양한 영역에 대한 비중의 균형화, 도서관들의 자발적인 평가 참여를 고무할 방안을 제안하였다.

문헌정보학의 질적 연구방법 교육내용 개발 (Teaching Qualitative Research Methods in Library and Information Science)

  • 김갑선
    • 한국도서관정보학회지
    • /
    • 제46권3호
    • /
    • pp.255-275
    • /
    • 2015
  • 본 연구의 목적은 질적 연구방법 교과목의 교육내용에 관한 기초자료를 제시하여 문헌정보학 대학원 과정의 질적 연구방법 교과목 개발에 일조하고자 한다. 국내 대학원에서 개설하고 있는 76편의 질적 연구방법 교과목 강의계획서의 내용분석을 통하여 질적 연구방법의 교육 경향을 도출하였다. 이를 근거로 문헌정보학 교육을 위한 핵심내용으로 질적 연구패러다임, 연구설계, 다양한 질적 연구 유형, 자료수집과 분석의 다양성, 글쓰기, 질적 연구의 평가준거를 제시하고 교수전략을 논하였다. 좋은 질적 연구를 수행하고 개발하기 위해서는 순환적, 창조적, 성찰적인 연구 실제가 가능하도록 교육해야 할 것이다. 이를 위해서는 질적 연구의 토대로서 질적 연구의 다양한 패러다임과 철학적 이론적 전통을 이해하는 것이 선행되어야 한다. 질적 연구자는 자신의 질적 입장(qualitative stance)을 인식하고 질적 연구를 행하는 것이 매우 중요하다.

IPA분석을 이용한 지하철 이용자 서비스 특성에 관한 연구 (The Analysis of Service Characteristics for Subway Passengers Using The Importance-Performance Analysis(IPA))

  • 박정수;윤상훈;배기목;김태호
    • 한국철도학회논문집
    • /
    • 제10권4호
    • /
    • pp.420-430
    • /
    • 2007
  • It is reported that many users of the subways in Seoul are not currently satisfied with the subway services. The cause of the dissatisfaction is that the qualitative items and indexes are not considered properly, and also does not diversify the evaluation items to follow the change of subway environment. Therefore in this study the evaluation items and indexes that can reflect of the subway users' characteristics are examined and synthesized. Then the characteristics of service are analyzed for the senior subway system users and junior subway system users that are classified with the cluster analysis. The result of the study is that the majority of users on subway are not satisfied the qualitative items which are safety, kindness, comfortableness, convenience excepting for punctuality and accessibility. So, if the service of subway users improve, the qualitative items is needed to consider with quantitative items.

A Study on Securing Objectivity in Small-Scale Environmental Impact Assessments Using Delphi Analysis

  • Dong-Myung CHO;Ju-Yeon LEE;Woo-Taeg KWON
    • 웰빙융합연구
    • /
    • 제7권3호
    • /
    • pp.73-95
    • /
    • 2024
  • Purpose: Since August 2000, the small-scale environmental impact assessment system has prevented indiscriminate development. However, its qualitative reports lack objectivity and consistency. This study analyzes these issues through literature and expert surveys and proposes improvements. Research Methodology: Samples were selected based on regional consultation numbers. Mitigation measures were categorized into qualitative and quantitative factors. Issues were identified, and improvements suggested. The Delphi method helped select evaluation items and propose a scoring table. Results and Conclusions: The Delphi method selected 14 absolute and 22 relative evaluation items, excluding 3 invalid ones. A 100-point scoring table was created, with points assigned based on element significance. A 1-point bonus was added for top-scoring elements to promote eco-friendly planning.

중환자전문간호사들의 실무경험: 포커스 그룹 연구 (Korean Critical Care Advanced Practice Nurses' Work Experience: A Focus Group Study)

  • 김금순;김복자;이영희;강지연
    • 중환자간호학회지
    • /
    • 제4권2호
    • /
    • pp.1-14
    • /
    • 2011
  • Purpose: This study was aimed to understand and describe the Korean critical care advanced practice nurses' work experience. Methods: Data was collected through 2 focus group interviews that were held in two different university hospitals in Seoul, Korea. All interviews were recorded and transcribed, and data were analysed using modified qualitative content analysis. Results: Ten themes were drawn from data analysis. They are "Various and complex tasks", "Excellency of advanced nursing practice", "Pressure and responsibility accompanied with pride", "Role identity confusion", "Role conflict", "Leaping and evolving role", "Gap between role and outcome evaluation", "Underestimated outcomes", "Where are my outcomes?" "Searching for outcomes: publicize the role". Conclusion: The results of this study help to understand the role of Korean critical care advanced practice nurses and to guide to outcome evaluation of their role effectiveness. Developing qualitative outcome indicators, cost-effectiveness ananlysis of Korean critical care advanced practice nurses' role, and accumulation of evidences through researches on outcome evaluation will be needed to successfully settle down advanced practice nursing in Korea.

  • PDF

산업디자인 제품화 개발을 위한 정략적모듈의 개발 (A Study on the Development of a Quantified Module for the Evaluation of industrial Design Proposals)

  • 우흥룡;신학수;고을한;한석우;홍석기;김창현
    • 디자인학연구
    • /
    • 제9권
    • /
    • pp.801-810
    • /
    • 1994
  • Design Problems are often both multidimensional and highly interactive. Very rarely does any part of a designed thing serve only one purpose. The activity of designing is thus a goal-directed activity and normally a goal-directed problem-solving activity. This means, problem solving is finding a way to get from some initial situation to a desired goal. Designers are transforming agents within a society whose goals are to improve the human condition through physical metamorphosis. Many theorist have agreed that designing involves problem solving or decision making. Accordingly evaluation plays an essential role in design activity. The evaluation factors include all attributes that have levels specified by quantitative and qualitative objectives Alternatives in multi-objective decision prOblems generally possess numerous attributes by which they can be described and compared. The evaluation factors include all attributes that have levels specified by quantitative and qualitative objectives. However since qualitative factors are difficult to quantify as numeral estimates, these factors have tended to be ignored without regard for their importance to human content. We adapted the Accumulative Evaluation Model as an evaluation algorithm for IDES. Industrial Design Evaluation System (IDES) consists of 3 major modules ( 1 Design Element, 2.Matrix, 3.Evaluation). It is intended to be an aid for design evaluation. The luther thinks IDES is a new design evaluation approach which could provide effective rating of design values to make value judgements. It is an attempt to provide industrial designers with access to design evaluation. The author's aim is to produce an Object-Oriented Evaluation System which can guide the designers and decision makers under complex design projects. It uses\ulcorner an Object-Oriented Programming for this prototype, Because of managing complexity (Flexibility and Reusability) and improving productivity(Extensibility & Maintainability and Programming by User) in software development process. The author has chose the C++ because it is a hybrid, rather than pure Object-Oriented Language.

  • PDF

기본간호학회지에 게재된 질적 연구의 분석 (Analysis of Qualitative Research Published by Journal of Korean Academy of Fundamentals of Nursing)

  • 박형숙;김영미
    • 기본간호학회지
    • /
    • 제22권4호
    • /
    • pp.442-451
    • /
    • 2015
  • Purpose: The purpose of this study was to analyze reports of qualitative research published in Journal of Korean Academy of Fundamentals of Nursing (JKAFN). Methods: Twenty four qualitative research studies using in-depth interviews and focus group interviews published in JKAFN from 1994 to 2014 were selected for analysis. Chosen reports were analyzed by consolidated criteria for reporting qualitative research (COREQ), which is a reporting guideline for qualitative research. COREQ consists of 32 items and 3 domains. Results: In the 1st domain, the relationship of researchers and research participants, bias and understanding of the researchers on the study phenomenon were analyzed less than other items. In the 2nd domain, methodological research was carried out across various qualitative studies, but the description of the research environment and research questions for the interview guidelines was insufficient. In the 3rd domain, research results and data were consistent, but data showing opposing content and explanations of negative practices were not done at all. Conclusion: These results indicate a need for the development of evaluation tools for qualitative research and items should be added to improve the reliability and validity, research should be related to the ethics in the framework of the COREQ.

An Exploration of Various Evaluation Methods to Improve Usability of Museum Mobile Device

  • Ahn, Mi-Lee;Cha, Hyun-Jin;Hwang, Yun-Ja;Kim, Hee-Jin
    • 대한인간공학회지
    • /
    • 제30권6호
    • /
    • pp.765-773
    • /
    • 2011
  • Objective: This study aims towards exploring a model of the HCI evaluation methods to improve the usability of mobile device, based on a case of a Mobile PDA system in a Museum context. Background: Mobile PDA systems in a Museum context is widely utilized for the educational purposes, but it is criticized for low usability that the device only play a role in textbooks on legs without any interactive educational activities. Therefore, the usability improvements on the mobile PDA system should be considered. Method 1: This model was developed with a combination of the expert review and the user testing, and with a combination of the qualitative and quantitative studies. In more details, first of all, a qualitative study was conducted as a combination of three different methods: 1) expert review with heuristics, 2) interviews with persons working in a museum, and 3) contextual enquiry. Results 1: The experts review provided with critical usability issues, and the semi-constructive interview helped to understand the background of the mobile device. Lastly, the contextual enquiry showed user experience problems and directions of improving the device from user's perspective. Method 2: Based on the results of the qualitative study, a questionnaire was designed. Results 2: The analysis of the quantitative study was conducted to generalize the problems, and prioritize the direction of improving the device within the limitation of the cost and time in a museum. Conclusion: This study has implications in developing an example of a HCI evaluation model to improve the user experience of the mobile device as well as finding problems and directions of how to improve the mobile PDA systems in the museum. Application: In fact, most of the studies related to the evaluation of the mobile device have been conducted in a laboratory context due to the cost and time. This paper, however, attempted to apply to various HCI research techniques from different constituents in real context.

국내의 대학 산학협력 평가준거 동향에 대한 연구 (A Study on the Trends of Evaluation Criteria for Industry-University Cooperation in Korea)

  • 곽진영
    • 공학교육연구
    • /
    • 제26권6호
    • /
    • pp.62-70
    • /
    • 2023
  • The purpose of this study is to derive implications for improving related policies and evaluation criteria in the future by analyzing trends of evaluation criteria for industry-university cooperation in Korea. For this purpose, five surveys on industry-university cooperation by government departments, major general university evaluations, and evaluation indicators of specialized industry-university evaluations by the Ministry of Education were analyzed. As a result, most of the evaluation criteria for domestic industry-university cooperation have been composed of quantitative indicators and have a limited character as quantitative performance management for government projects. Although the Ministry of Education's evaluation criteria for industry-university cooperation projects has gradually changed to a segmented index considering universities, industries, and regions, it needs to be supplemented for sustainability of industry-university cooperation. In order to promote sustainable industry-university cooperation in the future, it was suggested that first, it is necessary to supplementation of qualitative Indicators considering each university's characteristics, second, the composition of indicators related to reflect on demand in the process of the cooperation, and third, to build a virtuous cycle system for future operation of evaluation criteria.