• The Journal of Bigdata
• /
• v.8 no.1
• /
• pp.111-129
• /
• 2023

With the diffusion of digital innovation, the adoption of innovative medical technologies based on artificial intelligence is increasing in the medical field. This is driving the launch and adoption of AI-based SaMD(Software as a Medical Device), but there is a lack of research on the factors that influence the adoption of SaMD by medical institutions. The purpose of this study is to identify key factors that influence medical institutions' decisions to adopt AI-based SaMDs, and to analyze the weights and priorities of these factors. For this purpose, we conducted Delphi surveys based on the results of literature studies on technology acceptance models in healthcare industry, medical AI and SaMD, and developed a research model by combining HOTE(Human, Organization, Technology and Environment) framework and HABIO(Holistic Approach {Business, Information, Organizational}) framework. Based on the research model with 5 main criteria and 22 sub-criteria, we conducted an AHP(Analytical Hierarchy Process) analysis among the experts from domestic medical institutions and SaMD providers to empirically analyze SaMD adoption factors. The results of this study showed that the priority of the main criteria for determining the adoption of AI-based SaMD was in the order of technical factors, economic factors, human factors, organizational factors, and environmental factors. The priority of sub-criteria was in the order of reliability, cost reduction, medical staff's acceptance, safety, top management's support, security, and licensing & regulatory levels. Specifically, technical factors such as reliability, safety, and security were found to be the most important factors for SaMD adoption. In addition, the comparisons and analyses of the weights and priorities of each group showed that the weights and priorities of SaMD adoption factors varied by type of institution, type of medical institution, and type of job in the medical institution.

• The Journal of Information Systems
• /
• v.28 no.4
• /
• pp.403-424
• /
• 2019

Purpose The objective of this study is to determine the programming language for improving algorithmic thinking of basic software education for non-majors, which has recently been receiving attention to nurture talents needed in the era of the Fourth Industrial Revolution. Design/methodology/approach In this study, Delphi method was used to select the suitable programming language for the features of each of five departments for basic software education for non-majors in order to develop the capability of algorithmic thinking. The survey was conducted three times to 21 experts, and the results were analyzed using quantitative analysis (CVR) values and stability. Findings For the most suitable programming language for each department determined in this study, App Inventor was selected for humanities department, RUR-PLE for natural science department, App Inventor for social science department, Python for engineering department, and Scratch for fine arts department. This is expected to be used as the basis for determining the direction of curriculum and operation of universities starting basic software education through programming language by department proposed in this study.

• Korean Journal of Construction Engineering and Management
• /
• v.7 no.1 s.29
• /
• pp.55-63
• /
• 2006

As value engineering in design phase is big in the effect of application, analysis by systematic procedures is required. The most important part is the stage of creation for making of idea. It takes much time for us to make good idea involving the brainstorming and delphi in recent making idea. It is expected because most experts in participating in design value engineering is to approach with less effective method. In this study we suggest that application of ASIT(Advanced Systematic Inventive Thinking) is the method as way of creative idea making. ASIT is expected to perform Idea making with systematic procedure and to create effective idea in short time.

• Journal of Nutrition and Health
• /
• v.44 no.1
• /
• pp.41-48
• /
• 2011

Constructs with seven latent evaluation indicators and 18 observable survey questions were developed by food and nutrition experts to calculate a food safety recognition and practice index for children. The purpose of this study was to suggest statistical approaches to test construction validity on the constructs, obtain weights of the evaluation indicators, and develop questionnaires to calculate a children's food recognition and practice index. Survey data of 2,400 elementary fifth grade students were used as empirical results. Test validity was evaluated by exploratory factor analysis and confirmed to be highly significant by confirmatory factor analysis [i.e., linear structural relations (LISREL) analysis]. Standardized path coefficients of the LISREL analysis were suggested based on weights, and the weights were compared using the AHP and Delphi methods.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2020.06a
• /
• pp.385-385
• /
• 2020

본 연구에서는 가뭄과 연관되는 다양한 관련 요인을 포함한 가뭄취약성 평가방안을 수립하고 이를 적용하는 것을 목표로 하였다. 평가기법은 평가인자와 가중치 선정, 평가자료 데이터베이스 구축, 평가자료와 가중치를 조합한 평가의 세 단계로 구성되었으며 평가인자 및 가중치 선정에는 Delphi 조사기법을 적용하고 평가기법으로는 최근 널리 적용되고 있는 MCDM (Multi-Criteria Decision Making) 방법인 TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) 기법을 활용하였다. 평가인자는 기상분야(Meteorological factors), 농업분야(Agricultural factors), 사회경제분야(Socioeconomic factors), 환경분야(Natural System)로 구성하였으며 선정된 인자에 대한 데이터베이스를 구성하기 위하여 기상청, 농어촌공사, 수자원공사 등의 관계기관이 관리하는 자료를 수집하였다. 수립한 가뭄취약성 평가방안을 2016년 3월부터 2019년 9월까지 우리나라 시군구 행정구역 단위, 총 167개 지역이며 순위법, 비율법, fuzzy 등 가중치 선정방법에 따라 결과에 약간의 차이가 나타난다. 가뭄예보결과와 취약성 평가결과를 비교해 보면 충청남도 홍성군이 동기간 동안 가뭄예경보 발령 횟수가 가장 많았으며, 충청남도 보령시와 서산시도 매우 높은 빈도로 확인되었다. 평가 결과, 충청북도, 경상남도, 전라남도에 가뭄 취약지역이 다수 도출 되어 이들 지역에 대한 가뭄 대응 방안 수립이 필요한 것으로 분석되었다.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• Journal of Engineering Education Research
• /
• v.12 no.2
• /
• pp.24-35
• /
• 2009

This study was conducted to establish a principle on the fields of National Technical Qualification(NTQ), and aimed at developing criteria on requirements of the qualification that will be managed as the national technical qualification. In order to achieve the objective of the study, we examined the directions of setting the Jurisdiction of national technical qualification through role assignment between the state and private sectors. Also, we reviewed related documents, conducted Delphi survey, consulted the expert group and had an interview session for this study. There are five criteria of the jurisdiction of NTQ presented as follows. First is the field which disturbs social orders or has possibility of harming the good public morals; second, the field that requires high standards of ethics or is directly linked to life, health and safety of the public; third, the field which requires national attention for training of manpower as it is an area that is difficult for private sector to approach or it requires national management; fourth, the field which requires repair or maintenance of resources of traditional culture but is difficult for the private sector to have an access to and fifth, the field where it needs to protect the interest of the nation in the inter-nation relationships. The concrete and detailed standard on the five criteria is also presented in the study.

• Korean Journal of Construction Engineering and Management
• /
• v.20 no.4
• /
• pp.34-45
• /
• 2019

To drive construction project successful, a construction manager with good competency is needed. In order to select appropriate construction manager, there should be a standard and a method for appropriately evaluating the competency of construction manager. There have been many researches on the competency of construction managers, but there are two points to be supplemented. One is that construction manager's competency measurement was not concrete and objective, and the other is that construction project performance directly reflects individual manager's performance. The purpose of this study is to derive a construction manager competency evaluation index by using the Notational Analysis technique that is used when deriving an indicator that measures the athlete's competency in sports. This analysis was drawn with Delphi method. Finally, the 'measurable behaviors'were derived that can evaluate the competency of construction managers. Through this, it is possible to express each manager's expertise, leadership, and personal characteristics in numerical expression. This will help decision makers when selecting construction managers. It is anticipated that decision makers will be able to make the decision to select the necessary construction managers easier because it can evaluate the construction managers through a scientific approach based on the record by supplementing the existing method which only relied on intuition.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.22 no.5
• /
• pp.127-136
• /
• 2023

Gyeonggi Province has established a bus information system to provide real-time bus arrival information, aiming to make bus usage convenient for its residents. While the Gyeonggi bus information system is becoming more advanced through the application of IT technology, there are still information-vulnerable groups finding it difficult to use. In particular, the elderly have a low level of digital information literacy and habe difficulty using it. In this regard, this study aims to address the information usage disparity among the elderly in public transportation by utilizing expert in-depth survey methodology known as the Delphi technique. The study classified the policy initiatives that Gyeonggi Province should undertake into three categories: user education and expanded promotion, technological development and dissemination, and providing convenient usage environment. Through two rounds of surveys, the study assessed the priority of ten specific sub-tasks within these categories. Additionally, it gathered opinions on the effectiveness and feasibility of each item. The results yielded prioritization and evaluation of effectiveness and feasibility for nine sub-tasks. Based on these outcomes, the study proposed future projects that Gyeonggi Province should implement to address the information disparity among the elderly, offering a comprehensive approach to bridge the gap.

• Journal of the Korea Society of Computer and Information
• /
• v.29 no.1
• /
• pp.273-285
• /
• 2024

With the active utilization of Online Judge (OJ) systems in the field of education, various studies utilizing learner data have emerged. This research proposes a problem recommendation based on a user-based collaborative filtering approach with learner data to support learners in their problem selection. Assistance in learners' problem selection within the OJ system is crucial for enhancing the effectiveness of education as it impacts the learning path. To achieve this, this system identifies learners with similar problem-solving tendencies and utilizes their problem-solving history. The proposed technique has been implemented on an OJ site in the fields of algorithms and programming, operated by the Chungbuk Education Research and Information Institute. The technique's service utility and usability were assessed through expert reviews using the Delphi technique. Additionally, it was piloted with site users, and an analysis of the ratio of correctness revealed approximately a 16% higher submission rate for recommended problems compared to the overall submissions. A survey targeting users who used the recommended problems yielded a 78% response rate, with the majority indicating that the feature was helpful. However, low selection rates of recommended problems and low response rates within the subset of users who used recommended problems highlight the need for future research focusing on improving accessibility, enhancing user feedback collection, and diversifying learner data analysis.