• Title/Summary/Keyword: assessing Instrument

Search Result 155, Processing Time 0.027 seconds

EEPERF(Experiential Education PERFormance): An Instrument for Measuring Service Quality in Experiential Education (체험형 교육 서비스 품질 측정 항목에 관한 연구: 창의적 체험활동을 중심으로)

  • Park, Ky-Yoon;Kim, Hyun-Sik
    • Journal of Distribution Science
    • /
    • v.10 no.2
    • /
    • pp.43-52
    • /
    • 2012
  • As experiential education services are growing, the need for proper management is increasing. Considering that adequate measures are an essential factor for achieving success in managing something, it is important for managers to use a proper system of metrics to measure the performance of experiential education services. However, in spite of this need, little research has been done to develop a valid and reliable set of metrics for assessing the quality of experiential education services. The current study aims to develop a multi-item instrument for assessing the service quality of experiential education. The specific procedure is as follows. First, we generated a pool of possible metrics based on diverse literature on service quality. We elicited possiblemetric items not only from general service quality metrics such as SERVQUAL and SERVPERF but also from educational service quality metrics such as HEdPERF and PESPERF. Second, specialist teachers in the experiential education area screened the initial metrics to boost face validity. Third, we proceeded with multiple rounds of empirical validation of those metrics. Based on this processes, we refined the metrics to determine the final metrics to be used. Fourth, we examined predictive validity by checking the well-established positive relationship between each dimension of metrics and customer satisfaction. In sum, starting with the initial pool of scale items elicited from the previous literature and purifying them empirically through the surveying method, we developed a four-dimensional systemized scale to measure the superiority of experiential education and named it "Experiential Education PERFormance" (EEPERF). Our findings indicate that students (consumers) perceive the superiority of the experiential education (EE) service in the following four dimensions: EE-empathy, EE-reliability, EE-outcome, and EE-landscape. EE-empathy is a judgment in response to the question, "How empathetically does the experiential educational service provider interact with me?" Principal measures are "How well does the service provider understand my needs?," and "How well does the service provider listen to my voice?" Next, EE-reliability is a judgment in response to the question, "How reliably does the experiential educational service provider interact with me?" Major measures are "How reliable is the schedule here?," and "How credible is the service provider?" EE-outcome is a judgmentin response to the question, "What results could I get from this experiential educational service encounter?" Representative measures are "How good is the information that I will acquire form this service encounter?," and "How useful is this service encounter in helping me develop creativity?" Finally, EE-landscape is a judgment about the physical environment. Essential measures are "How convenient is the access to the service encounter?,"and "How well managed are the facilities?" We showed the reliability and validity of the system of metrics. All four dimensions influence customer satisfaction significantly. Practitioners may use the results in planning experiential educational service programs and evaluating each service encounter. The current study isexpected to act as a stepping-stone for future scale improvement. In this case, researchers may use the experience quality paradigm that has recently arisen.

  • PDF

A Study on Teaching-Learning and Evaluation Methods of Environmental Studies in the Middle School (중학교 "환경" 교과의 교수.학습 및 평가 방법 연구)

  • 남상준
    • Hwankyungkyoyuk
    • /
    • v.7 no.1
    • /
    • pp.1-17
    • /
    • 1994
  • This study was performed to determine appropriate teaching-learning and evaluation methods for Environmental Studies. To promote the relevance of our study to the needs of the schools and concerned educational communities of environmental education, we reviewed related literature, conducted questionnaire surveys, interviewed related teachers and administrator, held meetings with experts, and field-tested our findings. For selecting and developing teaching-learning methods of Environmental Studies, findings of educational research in general are considered. moreover, principles of environmental education, general aim of environmental education, orientations of environmental education, and developmental stages of middle school students in educational psychology were attended. In addition, relevance to the purpose of the Environmental Studies curriculum, appropriateness for value inquiry as well as knowledge inquiry, small group centered class organization, social interaction centered teaching-learning process, regional environmental situation, significance of personal environment, evaluation methods of Environmental Studies, multi- and inter-disciplinary contents of the Environmental Studies textbook, suitability to the evaluation methods of Environmental Studies, and emphasis on the social interaction in teaching-learning process were regarded. It was learned the Environmental Studies can be taught most effectively in via of holding discussion sessions, conducting actual investigation, doing experiment-practice, doing games and plate, role-playing and carrying out simulation activities, and doing inquiry. These teaching-learning methods were field-tested and proved appropriate methods for the subject. For selecting and developing evaluation method of Environmental Studies, such principles and characteristics of Environmental Studies as objective domains stated in the Environmental Studies curriculum, diversity of teaching-learning organization, were appreciated. We categorized nine evaluation methods: the teacher may conduct questionnaire surveys, testings, interviews, non-participatory observations; they may evaluate student's experiment-practice performances, reports preparation ability, ability to establish a research project, the teacher may ask the students to conduct a self-evaluation, or reciprocal evaluation. To maximize the effect of these methods, we further developed an application system. It considered three variables, that is, evaluates, evaluation objectives domains, and evaluation agent, and showed how to choose the most appropriate methods and, when necessary, how to combine uses of different methods depending on these variables. A sample evaluation instrument made on the basis of this application system was developed and tested in the classes. The system proved effective. Pilot applications of the teaching-learning methods and evaluation method were made simultaneously; and the results and their implications are as follows. Discussion program was applied in a lesson dealing with the problems of waste disposal, in which students showed active participation and creative thinking. The evaluation method used in this lesson was a multiple-choice written test for knowledge and skills. It was shown that this evaluation method and device are effective in helping students' revision of the lesson and in stimulating their creative interpretations and responces. Pupils showed great interests in the actual investigation program, and this programme was proved to be effective in enhancing students' participation. However, it was also turned out that there must be pre-arranged plans for the objects, contents and procedures of survey if this program is to effective. In this lesson, non-participatory observation methods were used with a focus on the attitudes of students. A scaled reported in general description rather than in grade. Experiment-practice programme was adopted in a lesson for purifying contaminated water and in this lesson, instruction objectives were properly established, the teaching-learning process was clearly specified and students were highly motivated. On the other hand, however, it was difficult to control the class when some groups of students require more times to complete their experiment, and sometimes different results. As regards to evaluation, performance observation test were used for assessing skills and attitudes. If teachers use well-prepared Likert scale, evaluation of all groups within a reasonablely short period of time will be possible. The most effective and successful programme in therms of students' participation and enjoyment, was the 'ah-nah-bah-dah-market' program, which is kind of game of the flea market. For better organized program of this kind, however, are essential, In this program, students appraise their own attitudes and behavior by responding to a written questionnaire. In addition, students were asked to record any anecdotes relating to self-appraisal of changes on one's own attitudes and behaviours. Even after the lesson, students keep recording those changes on letters to herself. Role-playing and simulation game programme was applied to a case of 'NIMBY', in which students should decide where to located a refuse dumping ground. For this kind of programme to e successful, concepts and words used in the script should be appropriate for students' intellectual levels, and students should by adequately introduced into the objective and the procedures of the lessons. Written questionnaire was used to assess individual students' attitudes after the lesson, but in order to acquire information on the changes of students' attitudes and skills, pre-test may have to be made. Doing inquiry programme, in which advantages in which students actually investigated the environmental influence of the areas where school os located, had advantages in developing students' ability to study the environmental problems and to present the results of their studies. For this programme to be more efficient, areas of investigation should be clearly divided and alloted to each group so that repetition or overlap in areas of study and presentation be avoided, and complementary wok between groups bee enhanced. In this programme, teacher assessed students' knowledge and attitudes on the basis of reports prepared by each group. However, there were found some difficults in assessing students' attitudes and behaviours solely on the grounds of written report. Perhaps, using a scaled checklist assessing students' attitudes while their presentation could help to relieve the difficulties.

  • PDF

A Survey on Nurses' Attitudes for Computerization in Nursing Practice in Kyung In Province (경인지역 임상간호사의 간호업무 전산화활용에 관한 태도 조사연구)

  • Kang, Ik-Wha;Hwang, Eun-Ah
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.1 no.2
    • /
    • pp.325-337
    • /
    • 1995
  • This study attempted to increase quality of nursing care by assessing the nurses' attitudes for computerization in nursing practice and ensuring right recognition and attitude for computerized system. Study subjects are 311 nurses who are working at 4 general hospitals. Those hospitals are selected according to the degree of computerized in Kyoung In Province. Study instrument consists of 20 items and 12 general questionnaire which was developed by Brodt and Stronge(1985) and modified by Lee(1991). Data collection was done from april 19th in 1995 to april 29th. Data gathered were analized number, t-test, ANOVA by using SPSS. The study results are as follows : 1. Study subject's attitude for computer application showed positive response as mean score of 3.44 especially nurses who had experience using computer showed 100% pro-response. 2. Study subject's attitude by age was significant statistically(F=3.9589, p=.0038), among them age 25-30 revealed the highest positive scores, and age 40 showed the lowest positive scores. 3. Study subject's attitude by education level showed no significant difference(F=1.4182, 2437), and those who are more educated showed more positive response. 4. Study subject's attitude by duty years showed no significant difference(F=2.2648, p=.0622), and those who had 7- 9 duty years had the highest positive attitude however those who have 10 duty years showed lowest positive attitude. 5. Study subject's attitude by position revealed no significant difference(F=2.0017, p=.1369), and the charge nurse groups who were using computer showed the highest scores. 6. Study subject's attitude by computerized type showed significant difference(F=23.9665, p=.0000), and G hospital which had computer system in nursing area obtained the highest positive scores. 7. study subject's attitude by presence of computer education showed no significant differenec(F=.9002, P=.3435), and non computer educated groups showed the highest positive response. 8. Study subject's attitude by computer education place revealed no significant difference(F=4.3723, p=.0020). and the groups who were taught individually or in the institution obtained the highest positive scores. 9. Study subject's attitude by duty year computer use showed no significant response(F=.9591, P=.3282), and groups of computer use showed the high degree of positive response. 10. Study subject's attitude by duty year using computer showed significant difference(F=5.9174, p=.0009),and the groups using computer for 6 years or group of 4-6 years showed the highest degree of positive response and the groups using computer for 1 year showed the lowest degree of positive response.

  • PDF

A Study of Development and Implementation of Problem-based Learning Program in Communication Curriculum of Nursing Education (문제중심 학습방법을 적용한 의사소통론 교과목 개발 및 적용)

  • Hyun, Myung-Sun;Kang, In-Ae;Kong, Seong-Sook
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.9 no.1
    • /
    • pp.144-154
    • /
    • 2003
  • Recently, in the academic disciplines critical thinking has been emphasized as the new evolution in education. Problem-based learning is suggested as the evolutionary learning method in developing critical thinking. In the nursing education, PBL is offered as an appropriate teaching method to prepare nurse student for professional. PBL is a student-centered learning strategy aimed at developing critical thinking, motivating self-directed study and attaining autonomy. The purpose of this study was to develop the communication curriculum of nursing education based on PBL and implementing of it. PBL module was developed focused on five communication situations. And learning strategies to facilitate the learning process and the guided questions to stimulate student inquiry were also developed. This PBL education was conducted for six students in the master's course during the 14 weeks from March, 2000 to June, 2000. The outcomes of the PBL education were examined based on the content analysis of the students reflective journal. As a result, it was found that students experienced the effect of it focused on self-oriented, group-oriented, and practice-oriented domain. In the self-oriented domain, the findings indicate that there were 5 kinds of concepts including 'motivation for self-directed study', 'transition toward certainty in knowledge acquisition', 'attempt to apply their prior knowledge into new situation', 'enhancement of self-image in real situation', 'self-growth with self reflection'. In the group-oriented domain, there were 3 kinds of concepts including 'cognitive work in group', 'perception of co-responsibility in attaining learning objectives', 'socialization with group members'. In the practice-oriented domain, there were 3 kinds of concepts including 'linkage theoretical knowledge with real situation', 'attempt to apply in real situation', 'development problem solving skill in real situation'. In conclusion, PBL had a significant effect on self, group, and clinical domain. And assessing PBL outcomes is challenging because standardized instrument do not develop yet. So the findings of this study can suggest the basic data for examining the PBL outcome.

  • PDF

Development and Evaluation of a Patient-Reported Outcome (PRO) Scale for Breast Cancer

  • Zhang, Jun;Yao, Yu-Feng;Zha, Xiao-Ming;Pan, Li-Qun;Bian, Wei-He;Tang, Jin Hai
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.18
    • /
    • pp.8573-8578
    • /
    • 2016
  • Background: This study was guided by principles of the theoretical system of evidence-based medicine. In particular, when searching for evidence of breast cancer, a measuring scale is an instrument for evaluating curative effects in accordance with the laws and characteristics of medicine and exploring the establishment of a system for medically assessing curative effects. At present, there exist few tools for evaluating curative effects. Patient-reported outcomes (PROs) refer to outcomes directly reported by patients (without input or explanations from doctors or other intermediaries) with respect to all aspects of their health. Data obtained from PROs provide evidence of treatment effects. Materials and Methods: In accordance with the tenets of theoretical medicine and ancient medical theory regarding breast cancer, principles for developing a PRO scale were established, and a theoretical model was developed and a literature review was performed, items from this pool were combined and split, and an initial scale was constructed. After a pilot survey and additional modifications, a pre-questionnaire scale was formed and used in a field investigation. After the application of statistical methods, the item pool was used to create a formal scale. The reliability, validity and feasibility of this formal scale were then assessed. Results: In a clinical investigation, 479 responses were recovered, with an acceptance rate of 95%. a combination of various methods was employed, and the items that were selected by all methods or more than half of the methods were employed in the questionnaire. In these cases, the screening methods were combined with certain features of the item, A total of four domains and 38 items were reserved. The reliability analysis indicated that the PRO scale was relatively reliable. Conclusions: Scientific assessment proved that the proposed scale exhibited good reliability and validity. This scale was readily accepted and could be used to assess the curative effects of medical therapy. However, given the limited scope of this investigation, the capacity for adapting this scale to incorporate other theories could not be determined.

Assessing Technology Leadership Perception of Teachers in Digital Textbook Utilizing Schools (디지털교과서 활용 학교 교사의 테크놀로지 리더십 인식수준 분석)

  • Song, Yeon-Ok;Byun, Ho-Seung
    • The Journal of Korean Association of Computer Education
    • /
    • v.14 no.1
    • /
    • pp.147-158
    • /
    • 2011
  • The purpose of this study is to define the teachers' perception for technology leadership when utilizing the Digital Textbook (DT). The subjects of this study were 97 elementary school teachers (40 males and 57 females) working in digital textbook research schools that implemented digital textbooks in 2009. Needs assessment instrument was revised based on previous instruments. Perception was calculated using Borich formula. According to the results, teachers of digital textbook research schools recognized 'teachers' instructional methods' as the most important area, while the least recognized area was 'support by the school'. The highest technology leadership needs by categories included 'role setting between members when implementing digital textbooks', 'instructional methods to cultivate creativity when using digital textbooks', 'troubleshooting digital textbook problems', 'additional staff support in case of problems', 'development of various assessment tools for measuring the effect of the digital textbook', and 'support of digital textbook resources for students with disabilities'. Based on these results, the study proposed specific methods to enhance technology leadership for the successful introduction of digital textbooks in schools.

  • PDF

Assessing the Positioning Accuracy of High density Point Clouds produced from Rotary Wing Quadrocopter Unmanned Aerial System based Imagery (회전익 UAS 영상기반 고밀도 측점자료의 위치 정확도 평가)

  • Lee, Yong Chang
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.23 no.2
    • /
    • pp.39-48
    • /
    • 2015
  • Lately, Unmanned Aerial Vehicles(UAV), Unmanned Aerial Systems(UAS) or also often known as drones, as a data acquisition platform and as a measurement instrument are becoming attractive for many photogrammetric surveying applications, especially generation of the high density point clouds(HDPC). This paper presents the performance evaluation of a low-cost rotary wing quadrocopter UAS for generation of the HDPC in a test bed environment. Its performance was assessed by comparing the coordinates of UAS based HDPC to the results of Network RTK GNSS surveying with 62 ground check points. The results indicate that the position RMSE of the check points are ${\sigma}_H={\pm}0.102m$ in Horizonatal plane, and ${\sigma}_V={\pm}0.209m$ in vertical, and the maxium deviation of Elevation was 0.570m within block area of ortho-photo mosaic. Therefore the required level of accuracy at NGII for production of ortho-images mosaic at a scale of 1:1000 was reached, UAS based imagery was found to make use of it to update scale 1:1000 map. And also, since this results are less than or equal to the required level in working rule agreement for airborne laser scanning surveying of NGII for Digital Elevation Model generation of grids $1m{\times}1m$ and 1:1000 scale, could be applied with production of topographic map and ortho-image mosaic at a scale of 1:1000~1:2500 over small-scale areas.

Preliminary Development of A Social Work Skills Inventory (사회복지실천기술 척도의 예비적 개발)

  • Kim, Yong Seok
    • Korean Journal of Social Welfare
    • /
    • v.64 no.4
    • /
    • pp.57-87
    • /
    • 2012
  • The purpose of this study was to develop the first social work skills inventory in Korea. Based upon the literature review of social work skills, the examination of an existing scale, and the comments from professionals in this field, 57 preliminary items were developed. Preliminary items were evaluated with a total of 370 social workers who were working in various fields of social work in Seoul and surrounding areas. A series of exploratory factor analyses were conducted to find out the optimal structure of the scale. After deleting 30 items with low factor loadings or being cross-loaded, the scale is composed of five factors. Confirmatory factor analysis confirmed the factor structure of the scale obtained by exploratory factor analysis. The first factor was named preparatory and assessing skills to be mostly used in the beginning phase of th social work process, the second factor was named change facilitating skills to be used to strengthen motivation to change, third factor was named ending and evaluating skills to be used to terminate the professional relationship and evaluate the outcome of the relationship, the fourth factor was named resource linking and utilizing skills to be used to utilize resources in order to solve clients' problems and the fifth factor was named ethical practice skills. Each component of the social work skills inventory is found to be reliable and valid. In sum, the social work skills inventory is an instrument encompassing basic skills necessary for social work process, skills for ethical social work practice, and skills necessary for utilizing environmental resources.

  • PDF

Effects of the Course with Handbook Correcting Life Science Misconceptions for Preservice Elementary School Teachers on Science Teaching Efficacy and Misconceptions (생명과학 오개념 교정 소책자를 이용한 강좌가 초등 예비교사들의 과학 교수효능감과 오개념에 미치는 효과)

  • Kim, Eun-Jin
    • Journal of The Korean Association For Science Education
    • /
    • v.33 no.6
    • /
    • pp.1139-1153
    • /
    • 2013
  • Misconceptions are one of the most important and long-lasting studied themes on science education. It is because their nature is obstinate and settled as well as they corrupt students' understanding of science concepts. This study examines whether preservice elementary school teachers enrolled in biology teaching material research course changed positively on science teaching efficacy and correcting life science misconceptions when they used the handbook developed for this study. The handbook comprises 203 life science concepts surveyed among preservice teachers holding from advanced researches and arranged by 2007 Revised Science Curriculum. 107 preservice elementary school teachers participated in the study. Forty-six (46) of them were assigned to the experimental group and the other 61 to the control group. ANOVA was conducted for analyzing data. Science Teaching Efficacy Belief Instrument (STEBI) and the life science misconception test which was developed for this study, were administrated as assessing instruments for pretest and posttest. The experimental group, using the handbook, acquired higher scores in both tests on statistical significance level than the control group who were not using the handbook. The results indicate the handbook developed for correcting life science misconceptions for this study is effective in enhancing science teaching efficacy and correcting life science misconceptions.

The Development of Physical Functioning Scale for Community-Dwelling Older Persons (지역사회 노인의 신체기능 평가도구 개발)

  • Lee, Kyung-Jong;Han, Geun-Shik;Yoon, Soo-Jin;Lee, Yeon-Kyung;Kim, Chan-Ho;Kim, Jeong-Lim;Lee, Yun-Hwan
    • Journal of Preventive Medicine and Public Health
    • /
    • v.35 no.4
    • /
    • pp.359-374
    • /
    • 2002
  • Objectives : To develop a physical functioning instrument for older adults living in the community. Methods : A representative sample of 979 people aged 65 years or over were interviewed in-person. Of these, 199 people also completed a detailed in-hospital examination. The scale items were selected based on the frequency of endorsement, along with the item-total and inter-item correlations. The associations of the scale with their physical performance and clinical examination were analyzed to evaluate the criterion-related validity. Construct validity was assessed using factor analysis, and internal consistency through Cronbach's alpha and item-total correlations. Test-retest reliability was measured by agreement between the household survey and the repeat survey at the in-hospital examination. Results : Initially, 23 items on the level of difficulty, ranging from no difficulty to an inability to complete a task, with the specific mobility and self-care tasks were included. Those with a high frequency of endorsement and a low inter-item or item-total correlations were excluded, resulting in a 10-item Physical Functioning (PT) scale. Equal weights were given to each item and a summated score was calculated. Significant associations were found between the PF scores and the physical performance, surrey and clinical data. The scale revealed a 2-factor (mobility and self-care) structure. Cronbach's alpha was 0.92 and the item-total correlations were in the 0.63 to 0.78 range. Pearson's correlations for the test-retest ranged between 0.56 and 0.61. Conclusions : The newly developed Physical Functioning (PF) scale showed good psychometric properties in older people. Further work, however, is needed to improve its sensitivity to discriminate higher levels of functioning, in addition to assessing its predictive value in detecting changes in health.