• Title/Summary/Keyword: content validity ratio

Search Result 107, Processing Time 0.023 seconds

Development of Satisfaction Evaluation Items for Degree-linked High Skills Meister Courses using the Delphi Method (Delphi 기법을 활용한 학위연계형 고숙련마이스터 과정의 만족도 평가 문항 개발)

  • Kim, Seung-Hee
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.5
    • /
    • pp.163-173
    • /
    • 2020
  • In this study, on-site corporate instructors participated as student-cum-workers in a degree-linked high skills Meister course to improve job competency and practical ability as proposed in the Work-Study Career Vision. Evaluation questions were then developed and their validity was verified by assessing satisfaction related to expected goals in enhancing advanced training guidance and competency as an evaluator. Satisfaction assessment was conducted based on training preparation, training implementation, training effectiveness and training administration. The Delphi Method was adopted and a total of 48 items were developed in 6 categories under 4 main areas. There were 7 evaluation items on the satisfaction of training course development under training preparation, 21 evaluation items related to the satisfaction of Off-JT and OJT courses under training implementation, 16 evaluation items related to the satisfaction of increased competency as an on-site corporate instructor and the satisfaction of enhanced practical skills and skills application at work under training effectiveness, as well as 6 evaluation items to assess satisfaction with administrative support under training administration. The final conformity assessment was conducted based on the stability, content validity ratio, consensus and convergence indicators of the developed items. Results of this study do not only apply to quality management of the high skills Meister course which is being promoted as a pilot project for work-study programs, but also serves as a rationale that may be considered as a basic research tool in the collection of various opinions to derive overall system improvement factors for the work-study high skills Meister course.

A Delphi Study to Validate the Patient-Centered Doctor's Competency Framework in Korea (한국의 환자 중심 의사 역량 프레임 타당화를 위한 델파이 연구 )

  • Sunju Im;Young-Jon Kim;Chanwoong Kim;Geon-Ho Lee;Sun-Woo Lee;Woo-Taek Jeon;Hanna Jung;Sojung Yune
    • Korean Medical Education Review
    • /
    • v.25 no.2
    • /
    • pp.139-158
    • /
    • 2023
  • Defining a competent doctor is important for educating and training doctors. However, competency frameworks have rarely been validated during the process of their development in Korea. The purpose of this study was to validate the patient-centered doctor's competency framework, which had been developed by our expert working group (EWG). Two rounds of Delphi questionnaire surveys were conducted among a panel of experts on medicine and medical education. The panel members were provided with six core competencies, 17 sub-competencies, and 53 enabling competencies, and were asked to rate the importance of these competencies on a 5-point Likert scale. Between April and July 2021, a total of 28 experts completed both rounds. The data of the Delphi study were analyzed for the mean, standard deviation, median, inter-rater agreement (IRA), and content validity ratio (CVR). A CVR >0.36 and IRA ≥0.75 were deemed to indicate validity and agreement. This study found that five enabling competencies were not valid, and agreement was not reached for three sub-competencies and two enabling competencies. In consideration of CVR and the individual opinions of panel members at each session, the final competencies were extracted through consensus meetings of the EWG. The competencies were modified into six core competencies, 16 sub-competencies, and 47 enabling competencies. This study is meaningful in that it proposes patient-centered doctor's competencies enabling the development of residents' milestone competencies, an assessment system, and educational programs.

Current Status of Informed Consent Form for Acupotomy in Korean Medicine Hospitals and Development of a Standard Informed Consent Form Using Delphi Method (한방병원의 침도 시술 동의서의 현황 조사와 델파이 기법을 활용한 표준 시술 동의서 개발)

  • Jihun Kim;Bonhyuk Goo;Hyongjun Kim;Kyoungsuk Seo;Myungjin Oh;Myungseok Ryu;Sang-Hoon Yoon;Kwang Ho Lee;Hyun-Jong Lee;Jungtae Leem;Hyungsun Jun;Jeong Ihn Sook;Sung Woon Choi;Tae Wook Lee;Yeonhak Kim;Yoona Oh;Kunhyung Kim;Gi Young Yang;Eunseok Kim
    • The Journal of Korean Medicine
    • /
    • v.45 no.1
    • /
    • pp.182-201
    • /
    • 2024
  • Objectives: This study was conducted to develop a standard acupotomy consent form that takes into account the unique characteristics of Korean Medicine. The study was motivated by the increasing importance of patient autonomy and the growing number of legal disputes related to medical malpractice in the clinical field of Korean Medicine. Methods: The analysis phase of the study involved a survey of the current status of acupotomy consent forms in Korean Medicine hospitals nationwide. The items of each form were analyzed based on the contents of the Medical law and the standard contract for medical procedures of the Fair Trade Commission (FTC). In the development and evaluation phase, the items and contents of the acupotomy consent form were evaluated using a 5-point Likert scale and content validity was assessed through two rounds of Delphi surveys. In the improvement phase, the contents of the consent form were revised based on the results of a survey of inpatient and outpatient patients in the Department of Acupuncture and Moxibustion at Pusan National University Korean Medicine Hospital, and real-time online meeting. The final version of the standard acupotomy consent form was completed after undergoing proofreading and corrections by a linguistics expert. Results: Only 30% of Korean Medicine hospitals have implemented acupotomy consent forms. The items of the consent forms did not fully include the items presented in the Medical act and the standard contract for medical procedures of the FTC. To address this issue, two rounds of Delphi surveys and a real-time discussion were conducted with a panel of 12 experts on 27 preliminary items of consent forms. The items and contents that met the criteria for content validity ratio, convergence, and consensus were derived. Based on the derived items and content, a standard acupotomy consent form was developed. Conclusions: The standard consent form for acupotomy is anticipated to ensure patient autonomy and enhance transparency and liability in acupotomy. Furthermore, it is expected to serve as evidence in case of medical disputes related to acupotomy and contribute as a reference document for the development of standard consents forms for various procedures of Korean Medicine. However, the limitations of the study include that the survey of consent forms was limited to only training hospitals of Korean Medicine, and the standard consent form is only applicable to adults in Korea. Future studies are needed to address these limitations.

A Systemic Review of Positive Behavior Support Intervention Studies on Problem Behaviors of Children With Autism Spectrum Disorders: Focusing on Korean Single-Subject Research Design (자폐스펙트럼장애 아동의 문제행동에 대한 긍정적 행동지원 중재 연구의 체계적 고찰: 단일대상연구 설계를 중심으로)

  • Yoo, Yung-Mee;Choi, Yoo-Im
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.4
    • /
    • pp.7-24
    • /
    • 2021
  • Objective : This study examined the characteristics of the literature involving a single-subject research design among positive behavior support intervention studies to improve problem behavior in children with autism spectrum disorders and assess the quality level. Methods : This is a literature study, and the targets of analysis were nine single-subject research papers published between 2011 and 2020. The subject papers were analyzed by dividing them into general characteristics and the qualitative levels according to the content of the research method. Results : Analysis of analyzing the contents of the study showed that the subjects were preschool and elementary school-age children at the same ratio. Furthermore, the study design involved mostly the middle and multiple baseline designs among the behaviors. All papers presented social validity, intervention fidelity, and observer reliability. Problem behaviors included self-injury and aggression behaviors, disturbing behaviors, and seat break-away behaviors, while the most dependent variables were measured through partial interval recording. As a result of confirming the intervention effect, the effect was confirmed in intervention, maintenance, and generalization. All analysis studies showed high-quality levels. Conclusion : This study confirmed the content and qualitative level of the thesis that applied the single-subject research design among positive behavior support intervention studies for problem behaviors of children with autism spectrum disorders. Positive behavior support intervention, an evidence-based intervention for children with autism spectrum disorders, was confirmed an effective intervention for autism spectrum disorders.

An Empirical Study on the Relationship between Performance and Behaviors of Participants in the Knowledge Sharing Virtual Community (지식공유 가상커뮤니티에서 사용자의 성과와 행동에 관한 실증연구)

  • Cho, Hurn-Jin;Jahng, Jung-Joo
    • Asia pacific journal of information systems
    • /
    • v.19 no.1
    • /
    • pp.63-82
    • /
    • 2009
  • Virtual community is a social aggregation to attain some goals in an IT-supported virtual space (Lee et al., 2002). As lots of virtual communities generate robust and reliable outputs with low control and low incentive, previous researchers was interested in the questions, "why do they participate?" or "how are they controlled?". But. as Katz (1964) said, the most important part of the high-performing organization is the behaviors of members in the organization. Therefore, this research is to examine the relationship between the performance and the behaviors of participants in the virtual community. First, we propose 6 types of behaviors related to high performance in the virtual community: 'Continuous Attendance', 'Complying with the organizational value, policies, and regulations', 'Protection', 'Suggestion for the improving', 'Self-training', and 'Favorable behavior'. The six types of behaviors are extracted from the framework of Katz (1964) and Brief and Motowidlo (1986). The reason why each behavior is positively related with high-performance is that those who continuously attend have more responsibility than temporary participants do; complying with the rules of a virtual community means that they may make more reliable outcome; 'Protection' is one of the prosocial-behaviors and those who protect the community may concern the benefit of the virtual community when they participate: those who suggest some ideas for improvement may contribute to the virtual community; 'Self-training' behavior means that participants really want to have high quality in their contribution: those who have 'Favorable attitude' consider other members in the virtual community when they participate. Then, we perform an empirical analysis with the survey from participants in the Knowledge service of Naver.com, to show those behaviors are associated with the high-performance. To make the measurement for the six behaviors, we use CVR (content validity ratio) method (Lawshe, 1975), interviewing 12 experts. The dependent variable, performance of participation, is measured by 'ratio of selected answer' given by the Naver.com. We use email survey. We sent 1200 emails to randomly selected participants in the knowledge service and received 282 responses. The results of our empirical analysis show that 4('Continuous Attendance', 'Suggestion for the improving', 'Self-training', 'Favorable attitude') are positively related to the performance, but 2('Complying with the organizational value, policies, and regulations' and 'Protection') are not significant. In line with Fitzgerald (2006), we expect that participants in the virtual community may behave similarly to employees in the off-line firms for the high performance. But 2 behaviors have different results. The reason that the 'Complying with the organizational value' behavior is not sufficiently related to performance is that the motivation of participants is more related to intrinsic pleasure or altruism than external reward. Also, the 'Protection' behavior has no significant relationship with performance, which means that the high-performing participants have little concern about the problems in the community.

A New Item Recommendation Procedure Using Preference Boundary

  • Kim, Hyea-Kyeong;Jang, Moon-Kyoung;Kim, Jae-Kyeong;Cho, Yoon-Ho
    • Asia pacific journal of information systems
    • /
    • v.20 no.1
    • /
    • pp.81-99
    • /
    • 2010
  • Lately, in consumers' markets the number of new items is rapidly increasing at an overwhelming rate while consumers have limited access to information about those new products in making a sensible, well-informed purchase. Therefore, item providers and customers need a system which recommends right items to right customers. Also, whenever new items are released, for instance, the recommender system specializing in new items can help item providers locate and identify potential customers. Currently, new items are being added to an existing system without being specially noted to consumers, making it difficult for consumers to identify and evaluate new products introduced in the markets. Most of previous approaches for recommender systems have to rely on the usage history of customers. For new items, this content-based (CB) approach is simply not available for the system to recommend those new items to potential consumers. Although collaborative filtering (CF) approach is not directly applicable to solve the new item problem, it would be a good idea to use the basic principle of CF which identifies similar customers, i,e. neighbors, and recommend items to those customers who have liked the similar items in the past. This research aims to suggest a hybrid recommendation procedure based on the preference boundary of target customer. We suggest the hybrid recommendation procedure using the preference boundary in the feature space for recommending new items only. The basic principle is that if a new item belongs within the preference boundary of a target customer, then it is evaluated to be preferred by the customer. Customers' preferences and characteristics of items including new items are represented in a feature space, and the scope or boundary of the target customer's preference is extended to those of neighbors'. The new item recommendation procedure consists of three steps. The first step is analyzing the profile of items, which are represented as k-dimensional feature values. The second step is to determine the representative point of the target customer's preference boundary, the centroid, based on a personal information set. To determine the centroid of preference boundary of a target customer, three algorithms are developed in this research: one is using the centroid of a target customer only (TC), the other is using centroid of a (dummy) big target customer that is composed of a target customer and his/her neighbors (BC), and another is using centroids of a target customer and his/her neighbors (NC). The third step is to determine the range of the preference boundary, the radius. The suggested algorithm Is using the average distance (AD) between the centroid and all purchased items. We test whether the CF-based approach to determine the centroid of the preference boundary improves the recommendation quality or not. For this purpose, we develop two hybrid algorithms, BC and NC, which use neighbors when deciding centroid of the preference boundary. To test the validity of hybrid algorithms, BC and NC, we developed CB-algorithm, TC, which uses target customers only. We measured effectiveness scores of suggested algorithms and compared them through a series of experiments with a set of real mobile image transaction data. We spilt the period between 1st June 2004 and 31st July and the period between 1st August and 31st August 2004 as a training set and a test set, respectively. The training set Is used to make the preference boundary, and the test set is used to evaluate the performance of the suggested hybrid recommendation procedure. The main aim of this research Is to compare the hybrid recommendation algorithm with the CB algorithm. To evaluate the performance of each algorithm, we compare the purchased new item list in test period with the recommended item list which is recommended by suggested algorithms. So we employ the evaluation metric to hit the ratio for evaluating our algorithms. The hit ratio is defined as the ratio of the hit set size to the recommended set size. The hit set size means the number of success of recommendations in our experiment, and the test set size means the number of purchased items during the test period. Experimental test result shows the hit ratio of BC and NC is bigger than that of TC. This means using neighbors Is more effective to recommend new items. That is hybrid algorithm using CF is more effective when recommending to consumers new items than the algorithm using only CB. The reason of the smaller hit ratio of BC than that of NC is that BC is defined as a dummy or virtual customer who purchased all items of target customers' and neighbors'. That is centroid of BC often shifts from that of TC, so it tends to reflect skewed characters of target customer. So the recommendation algorithm using NC shows the best hit ratio, because NC has sufficient information about target customers and their neighbors without damaging the information about the target customers.

Analysis of Trends of Character-Related Research in Science Education (과학교육에서 인성 관련 연구의 동향 분석)

  • Nam, Ilkyun;Im, Sungmin
    • Journal of The Korean Association For Science Education
    • /
    • v.37 no.3
    • /
    • pp.493-505
    • /
    • 2017
  • The purpose of this study is to investigate the trends of character-related research in science education by analyzing science education research literatures in South Korea. To this end, literatures on character were extracted from the KCI-listed journals and theses from 1990 to December 2016, and analyzed according to the criteria such as terms relating to character, year of publication, research design and method, and research content. A total of 54 KCI-listed papers and 67 theses were extracted. As a result, 46%, 49%, and 5% of the researches include the terms like character, ethic, and moral in their titles. According to the year of publication, it was found that the number of research papers related to character increased rapidly by more than two times in 2012 as compared to the past years. According to research objects, researches about gifted students were the most common, and when considering the ratio of gifted students to general students, many studies related to character concentrated on gifted students. Starting 2009, research papers on qualitative and hybrid research design begin to advance as compared the number of papers in quantitative research design. With regards to research methods used, seven methods were classified; five of them ranged from 16% to 19% while interpretive research method was 12% and test tool validity study was the lowest at 2%. By extracting 30 representative keywords so as to analyze the contents of character-related researches, we found various implications to character in relation to nature and researches about SSI, etc. As time passed by, the contents of character-related research in science education became more diversified and the number of researches increased. New research contents appeared due to the needs of the times.

The Characteristics of Undrained Shear Strength for Normally Consolidated Decomposed Weathered Mudstone Soil (정규압밀된 재성형 이암풍화토의 비배수 전단특성)

  • 김영수;김기영;문홍득
    • Journal of the Korean Geotechnical Society
    • /
    • v.18 no.5
    • /
    • pp.7-18
    • /
    • 2002
  • Generally, natural soils are affected by one-dimensional consolidation so that the behavior characteristic could be somewhat different from the isotropic consolidation specimen. But, due to experimental difficulties and the lack of equipment, the isotropic triaxial tests are mainly performed in most lab. tests. So it seems to be very effective if it is possible to predict pore water pressure and undrained shear strength in the $K_o$ state as the results of isotropic triaxial consolidation test. In this study, isotropic triaxial consolidation test and $K_o$ triaxial consolidation test were performed and we obtained parameters related to pore water pressure ratio using the Hyperbolic model. And then we predicted the behavior of pore water pressure that occurred in the $K_o$ state from the results obtained in the isotropic triaxial cosolidation test through the equation suggested by Lo(1969). It is possible to seize the validity of Lo(1969) equation. Also, considering undrained shear strength obtained from consolidation method in relation with water content, we find that consolidation method have an effect on undrained shear strength. Finally, using the Wroth(1984) equation that is based on the theory of critical state, undrained shear strength in the $K_o$ state was predicted from that of the isotropic triaxial consolidation test. The usefulness of the equation was verified by comparing the predicted value with experimental results.

A Preliminary Study on Family Function Components Affecting Individual Health and Disease: A Delphi Study (개인의 건강과 질병에 영향을 미치는 가족기능 구성요소에 관한 사전연구: 델파이 연구)

  • Kim, Ah-Ram;Jeong, Seong-Woo;Jeong, Jiin;Kim, Jung-Ran
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.3
    • /
    • pp.83-96
    • /
    • 2021
  • Objective : This study aimed to determine Korea-type family function factors that affect individual growth and social activities, and examine check the appropriate contents and domestic culture components based on the McMaster model, a family function evaluation tool, through the Delphi technique. Methods : The Delphi technique was applied to 12 expert panels in fields related to family function. The period lasted 9 weeks, from May to June 2020. The Delphi survey was conducted twice. In the first survey, the domestic culture and appropriate contents of the McMaster model were selected and localized, and expert' opinions about the components were collected using closed and open-ended questions. In the second survey, the fitness and importance of the components were investigated. Results : As a result of the first Delphi investigation, 18 items were deleted from the 53 items presented. After adding 11 items and excluding any overlapping items, a total of 40 items were selected. Subsequently, sentences that were difficult to understand were revised to familiar vocabulary. A second survey was constructed, with an example sentence. In the second Delphi investigation, 33 items were selected. The average content validity ratio for the final selected component was 0.76, and the stability was 0.28. Conclusion : Family function and the factors influencing domestic family function identified though this study can be used to conduct family function evaluations and interventions in clinical sites or relevant research studies.

Shielding Performance of PLA and Tungsten Mixture using Research Extruder (연구용 압출기를 활용한 PLA와 텅스텐 혼합물의 차폐 성능)

  • Do-Seong Kim;Tae-Hyung Kim;Myeong-Seong Yoon;Sang-Hyun Kim
    • Journal of the Korean Society of Radiology
    • /
    • v.17 no.4
    • /
    • pp.557-564
    • /
    • 2023
  • In this study, 3D printing technology was used to compensate for the shortcomings of the use of lead, which has proven to have excellent shielding performance, and to control unnecessary human exposure. 3D printers can implement three-dimensional shapes and can immediately apply individual ideas, which has great advantages in maintaining technology supplementation while reducing the cost and duration of prototyping. Among the various special 3D printers, the FDM method was adopted, and the filament used for output was manufactured using a research extruder by mixing two materials, PLA (Poly-Lactic-Acid) and tungsten. The purpose was to verify the validity through dose evaluation and to provide basic information on the production of chapezones of various materials. The mixed filament was implemented as a morphological shield. Filaments made of a research extruder by mixing PLA and tungsten were divided into 10 %, 20 %, 30 %, 40 %, and 50 % according to the tungsten content ratio. Through the process of 3D Modeling, STL File storage, G-code generation, and output, 10 cm × 10 cm × 0.5 cm was manufactured, respectively, and dose and shielding ability were evaluated under the conditions of tube voltages of 60 kVp, 80 kVp, 100 kVp, 120 kVp, and tube currents of 20 mAs and 40 mAs.