• The Journal of Sustainable Design and Educational Environment Research
• /
• v.22 no.2
• /
• pp.1-16
• /
• 2023

This paper reports on three Delphi surveys based on draft evaluation items with the aim of deriving evaluation items prior to developing a BF certification index for school facilities in order to make the index safe and convenient. To this end, problems were formulated using content analysis and follow-up evaluation of existing BF certification indicators. Draft BF certification evaluation items for school facilities were proposed. The adequacy of each evaluation item was verified using a Delphi survey. Experts and working-level groups, such as university professors, architects, public officials, certification agencies, and organizations for disabled persons, provided feedback for all evaluation items for school facility BF, which was incorporated in the final evaluation items. As a result of the Delphi surveys, in addition to the existing 8 evaluation items, a total of 75 evaluation items were proposed as maintenance items, 12 as improvement review items, and 15 as new evaluation items.

• Journal of the Korean Society for information Management
• /
• v.19 no.4
• /
• pp.258-296
• /
• 2002

This study is to consider varying factors of jnternal/external informational and operational environments in libraries, and develop a new evaluation indicators for university libraries in digital environments. The main research results are as follows. First, the results through the Delphi method that was to adopted to verify evaluation items and indicators determined by the literature review show that the repressed values for each evaluation category is greater than 3.00, overall average is 4.02, and standard deviation is ranged from 0.40 to 0.62 for each category. This means that the evaluation indicators are valid. Second, the factor analysis was performed to verify .the construct validity of evaluation indicators. As a result, the cumulative variance of evaluation indicators consisting of 11 dimensions per factor is 72.733%. In turn, this result shows that the validity of these indicators is very reliable. Third, t-test and one-way ANOVA are performed within significance probability 0.05 in order to verify differences in each librarians point of views for the degree of importance in evaluation indicators. Based on the Delphi study and our own analysis, we developed a new evaluation indicators that consists of 7 evaluation categories, 35 evaluation items, and 92 evaluation indicators.

• Journal of Korea Society of Industrial Information Systems
• /
• v.10 no.4
• /
• pp.40-53
• /
• 2005

Recently, many companies and organizations have interests in 'Business Process Management Systems (BPMS)'. In this research, we surveyed and analyzed the objects and the required functions of BPMS for companies to implement BPMS. The Delphi Method was employed for this research. As a result, the categorization of the objectives and required functions, and weights representing the importance of functions are established. Finally, discussions on the framework to evaluate and select the effective BPMS solutions for each company or organization are proved.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2003.05c
• /
• pp.1681-1684
• /
• 2003

정보시스템의 위험분석은 평가결과의 신뢰성을 위해 전문지식을 가진 여러 명의 평가자에 의해 실시된다. 위험분석은 평가자의 주관적인 관점이 많이 작용하며 평가결과들 간에 편차가 생긴다. 따라서, 평가자 간에 의견을 조정하고 절충하는 절차가 필요하다. 하지만 일반적인 면대면(面對面) 의견조정 방법은 여러 가지 부작용이 있다. 본 연구에서는 비대면(非對面) 전문가 의견조정 방법인 델파이 방법을 연구하고 이를 위험분석 도구에 적용하기 위하여 웹기반 델파이의견조정시스템을 설계 및 구현해 보인다.

• Journal of the Korean Data and Information Science Society
• /
• v.26 no.4
• /
• pp.947-956
• /
• 2015

In the knowledge and information age, to discover and protect Intellectual Properties would be very important for their economic value as a major growth engine. This study evaluated the reliability of a Delphi survey conducted by experts to assess the value of agricultural resources knowledge obtained from literature reviews and field interviews. Delphi method is collecting the opinions of experts for several rounds repeatedly, in the next round the experts have chance to modify their opinion. Scores between two rounds are highly correlated and standard deviations are declined for second round to imply that some correction of their evaluations are made. To check reliability of Delphi survey of two rounds Cronbach's reliability coefficient and Generalizability coefficient are derived. The Cronbach alpha's supported the reliability of the method, but the Generalizability analysis revealed some unexpected results while checking the variance components of sources of measurement errors. Despite the increased reliability coefficients, the deviations between the raters are increased which means that additional rounds are required to get consensus, the goal of Delphi research.

• Proceedings of the Korean Society for Quality Management Conference
• /
• 2009.10a
• /
• pp.182-185
• /
• 2009

특정분야의 기술에 대한 중요도를 평가할 경우 일반적으로 해당 분야 기술의 전문가들의 의견을 델파이 방법을 이용하여 수렴하고 AHP 분석을 통해 기술의 우선순위를 결정하곤 한다. 그러나 전문가들의 직관적 판단에 의존하는 델파이 기법과 AHP 분석은 전문가 집단을 어떻게 선정하느냐에 따라 다른 결과를 초래하거나 항상 최적의 대안을 제시한다는 보장을 하지 못하므로 이에 대한 보완이 필요하다. 본 연구는 해당 기술 분야의 객관적인 자료인 특허 문서를 분석하여 델파이를 통해 도출된 전문가들의 기술 평가 결과의 타당성을 확인하도록 특허맵 분석을 활용할 것과 많은 대상 기술과 다양한 기술 평가 기준을 한꺼번에 고려하여 기술간 우선순위, 기술간 유사성, 기술군간 관련성을 쉽게 확인할 수 있는 SOM 신경망 분석을 활용할 것을 제안한다.

• Tunnel and Underground Space
• /
• v.25 no.1
• /
• pp.86-96
• /
• 2015

In this study, the performance-based evaluation factors for rock slopes have been deducted using Delphi-method. Validity of the result was verified through factor analysis. Performance of rock slope is classified as soundness, stability and durability. Through the Delphi survey, 17 factors including discontinuity orientation are deducted for soundness, 4 factors and 3 factors are selected for stability and durability, respectively. Validation is conducted using Exploratory Factor Analysis (EFA) for 24 factors, and all factors are found to be valid. As a result of Exploratory Factor Analysis (EFA), 3-types of performance were subdivided into internal soundness, external soundness, risk, damage and durability of slopes and protection (reinforcement) facilities.

• Journal of Digital Convergence
• /
• v.10 no.8
• /
• pp.15-20
• /
• 2012

South Korea is carrying out and expanding smart grid pilot projects to build a framework for a national smart grid and expand overseas markets. It is important to properly evaluate performance for the projects and further develop related businesses in a more desirable direction. This study is to provide evaluation criteria for the performance of smart grid pilot projects and a basis for further continuous development according to the type of projects. Evaluation criteria were selected through reviews of documental materials and expert discussions. The viability of the proposed draft in the situation of South Korea was examined by expert Delphi surveys. The Delphi surveys were conducted twice, and therefrom drawn were 18 evaluation criteria for 6 evaluation categories.

• Journal of Gifted/Talented Education
• /
• v.23 no.2
• /
• pp.193-213
• /
• 2013

The purpose of this study was to develop and validate the evaluation criteria for gifted curriculum in visual arts. For this purpose, a draft of evaluation criteria for gifted curriculum in arts were first developed through literature review and opinions of experts in educational assessment, gifted education, visual art education. Then, the Delphi method was employed to validate the evaluation criteria. Delphi survey was carried out twice with 30 panelists consisting of experts in educational assessment, experts in gifted education, experts in arts(gifted) education and administrators in gifted education. Delphi survey was analyzed using the mean, content validity ratio, and the degree of consensus. Results were as followed. First, 58 evaluation criteria for gifted curriculum in arts were developed through literature review and expert opinions. The evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 12 process evaluation criteria, and 9 product evaluation criteria. Second, through the first and second Delphi survey, 2 evaluation criteria were not validated and finally were removed. The final evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 10 process evaluation criteria, and 9 product evaluation criteria. The evaluation criteria developed by this study can be used as a standard to establish the institution assessment system at the national level and evaluate institutions and programs.

• Culinary science and hospitality research
• /
• v.22 no.4
• /
• pp.288-301
• /
• 2016

This paper employed typology and stratification as key elements to estimate quality evaluation of vinegar drink through Delphi and AHP(analytical hierarchical process) method to contribute the market expansion of the vinegar drink as a health drink. Through literature research and brainstorming with professionals, the first round of Delphi method was conducted with the open-ended questions including five upper concepts, i.e. 'ingredients', 'production method', 'product characteristics', 'functions' and 'packaging design'. Original study had 50 lower concepts as a result of the first round and added 'marketing' as an additional upper concept. The second and third round of Delphi method have been conducted with closed-ended questions based on the 50 lower concepts resulted from the first round. To seek concordant objectivity among the answers from the survey, the study used Kendall's W coefficient of concordance. 11 items were removed while 16 items were removed at the third round leaving 23 items through second round of Delphi method. For the final round, this study utilized the Pairwise Comparison Method to figure out the relative importance of the 23 items for the prioritization. Finally, current study formulated the final items which should be considered as an important factor in the quality evaluation of vinegar drink.