• Title/Summary/Keyword: Delphi Survey Method

Search Result 243, Processing Time 0.03 seconds

A Qualitative Study on the Period-Specific Changes of Job Factors and Performance Features in Academic Libraries (질적 분석을 통한 대학도서관 업무의 시대별 수행 형태 및 요소 변화에 관한 연구)

  • Cho, Chul-Hyun;Noh, Dong-Jo
    • Journal of the Korean Society for information Management
    • /
    • v.32 no.4
    • /
    • pp.137-165
    • /
    • 2015
  • This study aimed to investigate the period-specific changes (Library 1.0, Library 2.0, Library 3.0 Period) of job factors and performance features in academic libraries. For this, the study categorized an academic library's job into five dimensions: 1) library administration 2) collection development and management 3) information organization 4) information services and 5) information system development and management, After the categorized library's job was defined in detail, the Delphi survey was conducted twice on librarians and professors of library and information science. The result showed that there were many changes in job factors and performance features in academic libraries towards the period of library 2.0 characterized by user participation, sharing and openness and into library 3.0 characterized by social network and semantic web. Library 3.0 is likely to bring about a significant change in user services with ever changing technological advances stemming from library 2.0, such as mobile services, RFID and NFC etc. The finding of the study suggest that library systems need to be continually upgraded in the period of library 3.0.

The Usability Evaluation Indicators for Services Design Platform (서비스디자인 플랫폼을 위한 사용성 평가지표 연구)

  • Jung, Hoe Jun;Kim, Kwang Myung;Jo, Sun;Ko, Young Jun
    • Korea Science and Art Forum
    • /
    • v.20
    • /
    • pp.409-419
    • /
    • 2015
  • Service Design Platform which has been developing under the sponsorship of the Ministry of Knowledge Economy is aimed at facilitating service design consultancy to carry out service design projects smoothly online. In the development process in order to verify and improve the usability of the platform, heuristic evaluations by usability experts along with usability test done by user participation are required. This study was conducted for the purpose of deriving appropriate evaluation areas and detailed evaluation indices prior to carrying out the heuristic evaluation. For the study, first, the concept of the service design platform was identified and the features of its component were analyzed. Second, based on literature study of standards which are related to usability evaluation indices, usability evaluation areas and indices were analyzed. Third, in order to establish and verify evaluation areas and indices which are appropriate for the evaluation, Delphi survey was conducted and its validity was verified. Through this study, evaluation indices with 4 evaluation areas and 45 detailed items were derived. Derived evaluation indices was made in the form of checklist and will be utilized for heuristic evaluation by usability experts.

A Study on the Intelligent Online Judging System Using User-Based Collaborative Filtering

  • Hyun Woo Kim;Hye Jin Yun;Kwihoon Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.1
    • /
    • pp.273-285
    • /
    • 2024
  • With the active utilization of Online Judge (OJ) systems in the field of education, various studies utilizing learner data have emerged. This research proposes a problem recommendation based on a user-based collaborative filtering approach with learner data to support learners in their problem selection. Assistance in learners' problem selection within the OJ system is crucial for enhancing the effectiveness of education as it impacts the learning path. To achieve this, this system identifies learners with similar problem-solving tendencies and utilizes their problem-solving history. The proposed technique has been implemented on an OJ site in the fields of algorithms and programming, operated by the Chungbuk Education Research and Information Institute. The technique's service utility and usability were assessed through expert reviews using the Delphi technique. Additionally, it was piloted with site users, and an analysis of the ratio of correctness revealed approximately a 16% higher submission rate for recommended problems compared to the overall submissions. A survey targeting users who used the recommended problems yielded a 78% response rate, with the majority indicating that the feature was helpful. However, low selection rates of recommended problems and low response rates within the subset of users who used recommended problems highlight the need for future research focusing on improving accessibility, enhancing user feedback collection, and diversifying learner data analysis.

The Relationship between Perceived Importance of Space and Users' Satisfaction (치유의 숲 산림명상공간 인자의 중요도와 만족도)

  • Kyung-Mi Jung;Won-Sop Shin
    • Korean Journal of Environment and Ecology
    • /
    • v.37 no.4
    • /
    • pp.273-288
    • /
    • 2023
  • Although many studies have been conducted on techniques and effects that can be applied to forest meditation in domestic forest healing meditation research, there has been little research on the space where forest meditation takes place. Nevertheless, a meditation space is not just a place concept but a forest environment element responsible for the healing function of a forest, i.e., a place containing healing factors, and can be an essential clue to the healing mechanism. Therefore, to determine whether a healing forest meditation space is suitable for meditation, this study selected the attribute items of the meditation space using the Delphi expert survey and then surveyed the user satisfaction of the healing forest meditation space using the IPA (Importance Performance Analysis) technique. The survey was conducted from August to November 2022, targeting 315 adults who used the forest meditation space at the National Center for Forest Therapy, the Saneum Healing Forest, and the Jathyanggi Pureunsup Arboretum in Gyeonggi Province. The result of the IPA analysis showed the average satisfaction with the forest meditation space was relatively high at 4.33 points on a 5-point Likert scale (4.33 points for the National Center for Forest Therapy, 4.34 points for the Saneum Healing Forest, and 4.37 points for the Jathyanggi Pureunsup Arboretum), indicating that the three healing forest meditation spaces were suitable for forest meditation. Satisfaction with the "Sounds of nature" was high in all three forests. On the other hand, all three forests showed a relatively low satisfaction with "Quietness," indicating it to be a priority problem to be addressed. Also, an open-ended questionnaire survey showed that the mediation space's natural elements, such as natural sounds, scenery, air, forest spaces, and scents, had a higher positive impact on meditation satisfaction than artificial elements, such as facilities. Therefore, it is essential to secure sound resources such as the sound of water and birds around the meditation space, and it is also necessary to consider ways to create a meditation forest in an independent area to avoid encounters with visitors and allow only participants in the forest healing meditation program to enter to increase satisfaction with forest meditation.

The Development and Application of Integrating Instruction with Evaluation Materials for Strengthening of Independent Living Competence: Focused on Technology and Home Economics Education (기술·가정과 생활자립역량 함양을 위한 교수학습-평가 연계 자료 개발 및 적용)

  • Lim, Yun Jin;Kim, Eun Jeung
    • Journal of Korean Home Economics Education Association
    • /
    • v.31 no.3
    • /
    • pp.23-39
    • /
    • 2019
  • The purpose of the study was to analyze the home economics education experts' and teachers' perception of ways to align instruction with evaluation, based on the 2015 revised technology and home economics curriculum for the purpose of developing the independent living competencies, and to provide examples of alignment in practice. The analysis is based on the data from a Delphi study (10 experts) and a survey of technology and home economics teachers(n=422). The results of survey indicated that experts and teachers perceived the instruction-assessment alignment to be most appropriate for project learning-project assessment, followed by project learning-portfolio assessment, problem solving learning-portfolio assessment, and problem solving learning-project assessment, in order. Based on the survey results, a model of instruction-assessment alignment and a teaching-learing plan were presented, based on 'Development task of life cycle and Life plan' unit. This was considered to be a proper method of instructional alignment for the purpose of developing 'independent living competence' with project-learning/project-assessment. The model focuses on consistency between instruction and evaluation, unity in methods, and the availablility of feedbacks of assessment for the improvement of independent living competencies. In conclusion, this study contributes as foundational information for teaching and learning-assessment alignment. Diverse methods of instruction-evaluation alignment is expected for future research.

A Priority Analysis on E-Commerce Security Factors - Focused on Researchers and Practitioners (전자상거래를 위한 보안 항목 우선순위 분석: 연구자그룹과 실무자그룹을 중심으로)

  • Kim, Hyun-Woo
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.16 no.5
    • /
    • pp.163-171
    • /
    • 2011
  • In e-commerce environment, security should be considered as an essential factor for success. In this paper, we analyze security requirements for e-commerce system, and it is focused on the practical usage, not theoretical contribution, in the field of e-commerce security. To identify the security requirements being specific to e-commerce environment, the researches related to e-commerce security are surveyed and a phase of Delphi method and Analytic Hierarchy Process(AHP) are used to determine the relative importance of e-commerce security factors. Since researchers and practitioners can have significantly different views because of each different work environment, we divide the professionals into two respondents' group. This survey result can be useful security guidelines in the development of e-commerce service system from the initial system development step to the completion.

The Development of E-learning Competency Modeling and Education Roadmap for Human Resource in Science & Technology (과학기술인력 이러닝 역량모델링 및 교육로드맵 개발)

  • Kwak, Jin Sun;Ko, Eun-Joung;Kim, Seongcheol
    • The Journal of Korean Association of Computer Education
    • /
    • v.20 no.1
    • /
    • pp.75-86
    • /
    • 2017
  • E-learning has become one of the popular educational method in these day. In recognition of the growing e-learning, numerous researchers of S&T have utilized for the training aimed at enhancing competency. In the circumstances, previous studies have yield interesting results regarding certain factors that competency based programs may increase effectiveness of education. Therefore this research described here contributes to design competency modeling and education roadmap for human resource in S&T. The study uses survey, FGI, delphi technique, and expert workshop for selecting the main competencies. In particular, the results are including training roadmap of 5 level in each of two groups as researchers and S&T managers. These findings can be possible to develop customized programs and supported long-term career development path plan for human resource in S&T.

The Design and Application of a Meta-evaluation Model for National R&D Programs (국가연구개발사업 메타평가모형 설계와 응용)

  • Ryu, Youngsoo;Choi, Byungdae;Choi, Sang Ok
    • Journal of Korea Technology Innovation Society
    • /
    • v.17 no.4
    • /
    • pp.703-732
    • /
    • 2014
  • Meta-evaluation for national R&D programs should be established within the framework of whole R&D system linked with science and technology needs and objectives. The R&D program evaluation system can be understood as a circulation of input, implementation, output, and utilization. In the result of the Delphi survey, which consisted of twenty-four experts (performed in three rounds), twenty-four indices were developed. The meta-evaluation model included sub-items which were important points of view of it as follow (eight items): propriety of planning, sufficiency of information, and propriety of evaluators in evaluation input; appropriateness of method and appropriateness of procedure in evaluation implementation; credibility of output in evaluation output; and usefulness of report and application of evaluation utilization. As the application of the meta-evaluation model, the total mean was lower than 3.0 of the median value of 2.73 (5 point Likert scale). Finally, it was suggested that the feedback of evaluation results should be more enforced to R&D program improvement particularly (evaluation utilization 2.50).

A Study on the Influence Factors for Virtual Enterprise (가상기업의 성과요인에 관한 연구)

  • Park, Kyung-Hye;Choi, Se-Yeon
    • Journal of Information Technology Applications and Management
    • /
    • v.14 no.1
    • /
    • pp.117-135
    • /
    • 2007
  • Globalization changes in market structures and consumer needs, as well as technology innovations force organizations to adopt new structures and collaborative networks to cope with rapidly changing environments. These Collaborative Networks are based on the Idea of virtual enterprise. A virtual enterprise(VE) is a temporary alliance of globally distributed independent enterprises that share core competencies and computer networks. This paper presents a proposal for a methodology to measure a key factor of success and risk First of all, we chose thirty experts' defines on virtual enterprise, fifteen are academic specialist and other fifteen are from industry. For this study we define twenty two factors determining VE's success and seventeen factors determining VE's risk using by Delphi method. And we built the influence model on virtual enterprise. A research model was established according to preceeding research and consensus on experts then the revised model of key factors on virtual enterprise. This survey was based on the Analytical Hierarchy Process (AHP). AHP is an approach to decision making that involves structuring multiple choice criteria into a hierarchy, the assessing the relative important of these criteria, comparing alternative for each criteria, and determining an overall ranking of the alternatives. A model was constructed as 3 level hierarchy. The hierarches are organizational, strategic, technical criteria. for success model on VE has 22 factors and 17 factors for risk model. They are selected by all 30 experts. 14 copies among 30 copies distributed to carry out on the Analytical Hierarchy Process (AHP). Consistency ratio confirm high validity and reliability of instrument and support theoretical model. The results of this study are summarized as follows. (1) This study presented success on VE influenced strategic criteria, and essential factor is Creating a value. Risk on VE influenced strategic criteria, and essential factor is Outcome/Distribution. (2) Its enable that ranking the criteria influence on VE. These are supported VE management and using guideline of VE.

  • PDF

A Study on the Curriculum Design and Training Method for Fostering Librarians Specialized in Reading Healing (독서치유 전문사서 육성을 위한 교육과정 개발 및 양성방안 연구)

  • Cha, Sung-Jong;Hoang, Gum-Sook;Kim, Soo-Kyoung
    • Journal of Korean Library and Information Science Society
    • /
    • v.49 no.3
    • /
    • pp.77-109
    • /
    • 2018
  • The purpose of this study is to strengthen librarian's capacity by developing curriculum and training system for fostering '(tentative name)Librarians Specialized in Reading Healing' as a field of professional librarians. For this purpose, curriculum and training system for fostering librarians specialized in reading healing are designed and presented through research methods including literature study, case study and 1, 2nd delphi survey. The final curriculum is composed of curriculum for 1st and 2nd grade licensed librarians specialized in reading healing and refresher training based on job description of librarians specialized in reading healing. The training system is based on the first and second level certification granted by completion of the course, thus is designed to meet requirements both for academic achievement and for career development in each grade.