• Title/Summary/Keyword: Item Reliability

Search Result 987, Processing Time 0.023 seconds

Development of Park Performance Assessment Tool (PPAT) for the Qualitative Improvement of Urban Neighborhood Parks (근린공원 서비스의 질적 개선을 위한 공원성능평가도구 개발)

  • Kim, Yong-Gook;Kim, Young-Hyeon;Yoo, Ye-Seul
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.51 no.2
    • /
    • pp.120-130
    • /
    • 2023
  • This study aims to develop a Park Performance Assessment Tool (PPAT) to qualitatively evaluate the level of urban neighborhood park services. The Park Performance Assessment Tool (PPAT) development process is as follows. First, a pool of evaluation items was formed by analyzing domestic and foreign cases related to the Park Performance Evaluation Tool (PPAT). Second, evaluation items were refined considering domestic park conditions through expert advisory meetings and pilot evaluations. Third, the reliability of the Park Performance Evaluation Tool (PPAT) was verified through pilot evaluations. Fourth, weights for each evaluation item were derived through an expert survey and AHP analysis. Fifth, a Park Performance Evaluation Tool (PPAT) evaluation table and evaluation guidelines were prepared. The developed Park Performance Assessment Tool (PPAT) was applied to 22 neighborhood parks in Bupyeong-gu, Incheon to evaluate the quality of the physical environment. As a result of the evaluation, several urban neighborhood parks that need improved park services were identified. The Park Performance Evaluation Tool (PPAT) is expected to be used to establish a basic plan for parks and green spaces, select priority and project promotion methods for park maintenance projects, and certify excellent parks

Controversial Issues and Policy Alternatives in Promotion of Arts and Culture Grant Program: Focusing on Space and Exhibition Support Project of Visual Arts (문화예술지원사업 추진상의 쟁점과 정책방향 - 시각예술창작산실 공간·전시 지원사업을 중심으로 -)

  • Ko, Jeong-Min;Jang, Shinjeung;Chang, Yoonjeong
    • Korean Association of Arts Management
    • /
    • no.52
    • /
    • pp.39-73
    • /
    • 2019
  • The purpose of this study is to explore the issues and alternatives in the promotion of space and exhibition support projects in visual arts, and to suggest an applicable direction of the government grant program. For this study, FGI and in-depth interviews were conducted in the direct beneficiaries of the grant program, the staff of the grant program, and the group of visual arts expert. As a result, the deliberation and selection of the support project should be carried out with sufficient time in consideration of the specificity of the support project. And the project requires to divide into two kinds of the projects based on the understanding of the social role and differentiation of non-profit exhibition spaces and private art museums. For the grant application and assessments, a long-term support is necessary to bring the capability and issues in efficient allocation of the budget, flexibility of budget item, and the budget shortfalls. Furthermore, the reliability between the grant program and beneficiaries needs to form a healthy partnership, and the evaluation criteria and eNARADOEUM system should be more practical and rationally established. Through this analysis, the implications of understanding the specificity of visual arts support projects, establishment of sustainable visual arts creation policies, and budget utilization were derived. Consequently, cultural and artistic support projects were directed to place more emphasis on efficiency than control, direction considering the position of consumers than suppliers, and long-term business planning rather than short-term perspective.

An Analysis of Relationships among Quality, Satisfaction and Utilization Perceived by Family Caregivers in Standard LTC Utilization Plan (가족수발자가 인지하는 표준장기요양이용계획서의 질과 만족도, 활용도 간의 관계분석)

  • Lee, Jung-Suk;Han, Eun-Jeong;Kwon, Jinhee
    • 한국노년학
    • /
    • v.31 no.4
    • /
    • pp.871-884
    • /
    • 2011
  • Standard Long-term care(LTC) Utilization Plan is a kind of care plan, which aims to help beneficiaries and their family choose services to meet their care needs. The objective of this study is to determine the relationships among family caregivers' perceived quality, overall satisfaction and utilization in Standard LTC Utilization Plan. Data were gathered from family caregivers with beneficiaries who have used community service in long-term care insurance system. A national cross-sectional descriptive survey was conducted in December 2008, using proportionate quota sampling. Finally, 351 family caregivers completed questionnaires which included demographic characteristics, perceived quality(9 items), overall satisfaction(1 item) and utilization(2 items). Path analysis was conducted to find a causal relationship. This study shows firstly, the quality of Standard LTC Utilization Plan was categorized into three dimensions, that is, assessment of care needs, recommended care plan, and management of monthly benefits. Secondly, reliability and validity of quality items were satisfied. Finally, in the effect of perceived quality and satisfaction for utilization, assessment of care needs(indirect effect, path coefficients=0.077) and overall satisfaction(total effect, path coefficients=0.324) were statistically significant. The findings of this study would be helpful in developing the strategies, which is needed to improve the role of Standard LTC Utilization Plan.

Developing Measurement Items for the Service Quality of Clinical Trials based on the Brady & Cronin Model (Brady & Cronin의 모델에 기반한 임상시험 서비스 질 측정 문항 개발)

  • Go-Eun Lee;Sanghee Kim;Sue Kim;Sang Hui Chu;Jeong-Ho Seok;So Yoon Kim
    • The Journal of KAIRB
    • /
    • v.6 no.1
    • /
    • pp.17-31
    • /
    • 2024
  • Purpose: This study aims to develop preliminary items for measuring the perceived service quality of clinical trials among participants and to verify content validity. Methods: This study was designed as a methodological study. A conceptual framework was established based on Brady and Cronin's hierarchical model, and preliminary items were prepared through translation-back-translation, a review of existing instruments, and in-depth interviews with clinical trial participants and clinical research coordinators. The final items were completed through content validity testing by experts and a review of items by clinical trial participants for the prepared preliminary items. Results: Through this study, a set of 58 items across four domains (quality of interaction with researchers, the physical environment, performance procedures, and performance results) and 9 components (information·education·communication, trust, respect for participant preferences, securing facilities and space, accessibility, comfortability, informed consent, coordination of care, subjective understanding of clinical trials) on the service quality of clinical trials were completed. The scale content validity index of all preliminary items was 0.96, meeting the recommended standards. The individual-item content validity index also meets the recommended criteria for most items, excluding four items. Conclusion: This study holds significance in developing items to measure the quality of clinical trial execution from the perspective of participants. By verifying the reliability and validity of these items through subsequent research, it is expected that they can be utilized as a valuable instrument to devise strategies for improving the quality of clinical trials.

  • PDF

A Preliminary Study of The Singer-Loomis Type Deployment Inventory for the Korean Version (싱어 루미스 심리 유형 검사의 한국판 제작을 위한 예비연구)

  • Hyoin Park
    • Sim-seong Yeon-gu
    • /
    • v.28 no.2
    • /
    • pp.139-153
    • /
    • 2013
  • Psychological typology in analytic psychology is used not only for ascertaining the attitude or function of the conscious ego, but also as one blueprint for the individuation process. We all know the need to emphasize an awareness of the deployment and development of the superior function, the secondary function, the third function and the inferior function for the individuation process. This study has the goal of refining our awareness of this deployment and development of typological functions. The questionnaires of the Myers-Briggs Type Inventory and the Gray Wheelwrights Jungian Type Survey use the method of a forced-choice questionnaire, on the assumption of a bi-polarity hypothesis. But the questionnaire of the Singer-Loomis Type Deployment Inventory uses the Likert scale. It is able to show the deployment of the superior function, the secondary function, the third function and the inferior function visibly. It allows us to test the subject at stated periods for his/her development or change of psychological typology. The Singer-Loomis Type Deployment Inventory is a statistically superior method for showing Jung's psychological typology relative to both the Myers-Briggs Type Inventory and the Gray Wheelwrights Jungian Type Survey. I have studied how the original authors of The Singer-Loomis Type Deployment Inventory understood Jung's psychological typology. I produced the reliability and the item-discrimination power of the Korean Version of the Singer-Loomis Type Deployment Inventory. On the basis of this study, I produced the revised Korean version 1 of Singer-Loomis Type Deployment Inventory.

Consumer Responses to Retailer's Location-based Mobile Shopping Service : Focusing on PAD Emotional State Model and Information Relevance (유통업체의 위치기반 모바일 쇼핑서비스 제공에 대한 소비자 반응 : PAD 감정모델과 정보의 상황관련성을 중심으로)

  • Lee, Hyun-Hwa;Moon, Hee-Kang
    • Journal of Distribution Research
    • /
    • v.17 no.2
    • /
    • pp.63-92
    • /
    • 2012
  • This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective responses. Information relevancy was integrated into pleasure-arousal-dominance (PAD) emotional state model in the present study as a conceptual framework. The results of an online survey of 335 mobile phone users in the U.S. indicated the positive effects of arousal and information relevancy on pleasure. In addition, there was a significant relationship between pleasure and intention to use a LBMSS. However, the relationship between dominance and pleasure was not statistically significant. The results of the present study provides insight to retailers and marketers as to what factors they need to consider to implement location-based mobile shopping services to improve their business performance. Extended Abstract : Location aware technology has expanded the marketer's reach by reducing space and time between a consumer's receipt of advertising and purchase, offering real-time information and coupons to consumers in purchasing situations (Dickenger and Kleijnen, 2008; Malhotra and Malhotra, 2009). LBMSS increases the relevancy of SMS marketing by linking advertisements to a user's location (Bamba and Barnes, 2007; Malhotra and Malhotra, 2009). This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective response. The purpose of the study was to examine the relationship among information relevancy and affective variables and their effects on intention to use LBMSS. Thus, information relevancy was integrated into pleasure-arousal-dominance (PAD) model and generated the following hypotheses. Hypothesis 1. There will be a positive influence of arousal concerning LBMSS on pleasure in regard to LBMSS. Hypothesis 2. There will be a positive influence of dominance in LBMSS on pleasure in regard to LBMSS. Hypothesis 3. There will be a positive influence of information relevancy on pleasure in regard to LBMSS. Hypothesis 4. There will be a positive influence of pleasure about LBMSS on intention to use LBMSS. E-mail invitations were sent out to a randomly selected sample of three thousand consumers who are older than 18 years old and mobile phone owners, acquired from an independent marketing research company. An online survey technique was employed utilizing Dillman's (2000) online survey method and follow-ups. A total of 335 valid responses were used for the data analysis in the present study. Before the respondents answer any of the questions, they were told to read a document describing LBMSS. The document included definitions and examples of LBMSS provided by various service providers. After that, they were exposed to a scenario describing the participant as taking a saturday shopping trip to a mall and then receiving a short message from the mall. The short message included new product information and coupons for same day use at participating stores. They then completed a questionnaire containing various questions. To assess arousal, dominance, and pleasure, we adapted and modified scales used in the previous studies in the context of location-based mobile shopping service, each of the five items from Mehrabian and Russell (1974). A total of 15 items were measured on a seven-point bipolar scale. To measure information relevancy, four items were borrowed from Mason et al. (1995). Intention to use LBMSS was captured using two items developed by Blackwell, and Miniard (1995) and one items developed by the authors. Data analyses were conducted using SPSS 19.0 and LISREL 8.72. A total of usable 335 data were obtained after deleting the incomplete responses, which results in a response rate of 11.20%. A little over half of the respondents were male (53.9%) and approximately 60% of respondents were married (57.4%). The mean age of the sample was 29.44 years with a range from 19 to 60 years. In terms of the ethnicity there were European Americans (54.5%), Hispanic American (5.3%), African-American (3.6%), and Asian American (2.9%), respectively. The respondents were highly educated; close to 62.5% of participants in the study reported holding a college degree or its equivalent and 14.5% of the participants had graduate degree. The sample represents all income categories: less than $24,999 (10.8%), $25,000-$49,999 (28.34%), $50,000-$74,999 (13.8%), and $75,000 or more (10.23%). The respondents of the study indicated that they were employed in many occupations. Responses came from all 42 states in the U.S. To identify the dimensions of research constructs, Exploratory Factor Analysis (EFA) using a varimax rotation was conducted. As indicated in table 1, these dimensions: arousal, dominance, relevancy, pleasure, and intention to use, suggested by the EFA, explained 82.29% of the total variance with factor loadings ranged from .74 to .89. As a next step, CFA was conducted to validate the dimensions that were identified from the exploratory factor analysis and to further refine the scale. Table 1 exhibits the results of measurement model analysis and revealed a chi-square of 202.13 with degree-of-freedom of 89 (p =.002), GFI of .93, AGFI = .89, CFI of .99, NFI of .98, which indicates of the evidence of a good model fit to the data (Bagozzi and Yi, 1998; Hair et al., 1998). As table 1 shows, reliability was estimated with Cronbach's alpha and composite reliability (CR) for all multi-item scales. All the values met evidence of satisfactory reliability in multi-item measure for alpha (>.91) and CR (>.80). In addition, we tested the convergent validity of the measure using average variance extracted (AVE) by following recommendations from Fornell and Larcker (1981). The AVE values for the model constructs ranged from .74 through .85, which are higher than the threshold suggested by Fornell and Larcker (1981). To examine discriminant validity of the measure, we again followed the recommendations from Fornell and Larcker (1981). The shared variances between constructs were smaller than the AVE of the research constructs and confirm discriminant validity of the measure. The causal model testing was conducted using LISREL 8.72 with a maximum-likelihood estimation method. Table 2 shows the results of the hypotheses testing. The results for the conceptual model revealed good overall fit for the proposed model. Chi-square was 342.00 (df = 92, p =.000), NFI was .97, NNFI was .97, GFI was .89, AGFI was .83, and RMSEA was .08. All paths in the proposed model received significant statistical support except H2. The paths from arousal to pleasure (H1: ${\ss}$=.70; t = 11.44), from information relevancy to intention to use (H3 ${\ss}$ =.12; t = 2.36), from information relevancy to pleasure (H4 ${\ss}$ =.15; t = 2.86), and pleasure to intention to use (H5: ${\ss}$=.54; t = 9.05) were significant. However, the path from dominance to pleasure was not supported. This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective responses. Information relevancy was integrated into pleasure-arousal-dominance (PAD) emotional state model as a conceptual framework. The results of the present study support previous studies indicating that emotional responses as well as cognitive responses have a strong impact on accepting new technology. The findings of this study suggest potential marketing strategies to mobile service developers and retailers who are considering the implementation of LBMSS. It would be rewarding to develop location-based mobile services that integrate information relevancy and which cause positive emotional responses.

  • PDF

Development of dietary behavior items available in Korea National Health and Nutrition Examination Survey (국민건강영양조사에 활용 가능한 식생활 조사항목 개발 및 유용성 검증)

  • Lim, A-Hyun;Choi, Suk-Young;Shim, Jae-Eun;Hwang, Ji-Yun;Moon, Hyun-Kyung;Kim, Kirang
    • Journal of Nutrition and Health
    • /
    • v.48 no.5
    • /
    • pp.407-418
    • /
    • 2015
  • Purpose: Given that the indicators related to chronic diseases are important to evaluating goals of the national health policy, the aim of this study was to develop dietary behavior items available in the Korea National Health and Nutrition Examination Survey. Methods: The dietary behavior items were developed based on the literature reviews, need assessment of the field, expert focus-group interviews, and expert advisory meeting. Questions for each dietary behavior item were developed by reflecting on environmental, personal, and behavior factors of the ecological frame and then revised through expert focus-group interview and expert advisory meeting. The understanding and reliability of the developed questionnaire were assessed by cognitive interview and test-retest reliability. Results: The developed items were sodium and salt intake, added and simple sugar intake, enough time to consume a meal for all ages, caffeine drinks and fresh/healthy food intake for children and adolescents, and limited dietary intake, fresh/healthy food intake for seniors. In most questions except some questions on sodium and salt intake, subjects understood over 70% and consistency of responses based on the kappa values was acceptable. Conclusion: Developed dietary behavior items are expected to be useful for evidence-based nutrition policy, interventions and research targeting dietary patterns through investigating and monitoring dietary behavior patterns.

Development of Work-related Musculoskeletal Disorder Questionnaire Using Receiver Operating Characteristic Analysis (Receiver Operating Characteristic 분석법을 이용한 업무관련성 근골격계질환 설문지 개발)

  • Kwon, Ho-Jang;Ju, Yeong-Su;Cho, Soo-Hun;Kang, Dae-Hee;Sung, Joo-Hon;Choi, Seong-Woo;Choi, Jae-Wook;Kim, Jae-Young;Kim, Don-Gyu;Kim, Jai-Yong
    • Journal of Preventive Medicine and Public Health
    • /
    • v.32 no.3
    • /
    • pp.361-373
    • /
    • 1999
  • Objectives: Receive Operating Characteristic(ROC) curve with the area under the ROC curve(AUC) is one of the most popular indicator to evaluate the criterion validity of the measurement tool. This study was conducted to develop a standardized questionnaire to discriminate workers at high-risk of work-related musculoskeletal disorders using ROC analysis. Methods: The diagnostic results determined by rehabilitation medicine specialists in 370 persons(89 shipyard CAD workers, 113 telephone directory assistant operators, 79 women with occupation, and 89 housewives) were compared with participant's own replies to 'the questionnair on the worker's subjective physical symptoms'(Kwon, 1996). The AUC's from four models with different methods in item selection and weighting were compared with each other. These 4 models were applied to 225 persons, working in an assembly line of motor vehicle, for the purpose of AUC reliability test. Results: In a weighted model with 11 items, the AUC was 0.8155 in the primary study population, and 0.8026 in the secondary study population(p=0.3780). It was superior in the aspects of discriminability, reliability and convenience. A new questionnaire of musculoskeletal disorder could be constructed by this model. Conclusion: A more valid questionnaire with a small number of items and the quantitative weight scores useful for the relative comparisons are the main results of this study. While the absolute reference value applicable to the wide range of populations was not estimated, the basic intent of this study, developing a surveillance fool through quantitative validation of the measures, would serve for the systematic disease prevention activities.

  • PDF

Usefulness of MRI 3D Image Reconstruction Techniques for the Diagnosis and Treatment of Femoral Acetabular Impingement Syndrome(Cam type) (대퇴 골두 충돌 증후군(Cam type)의 진단과 치료를 위한 자기공명 3D 영상 재구성 기법의 유용성)

  • Kwak, Yeong-Gon;Kim, Chong-Yeal;Cho, Yeong-Gi
    • The Journal of the Korea Contents Association
    • /
    • v.15 no.11
    • /
    • pp.313-321
    • /
    • 2015
  • To minimize CT examination for Hip FAI diagnosis and operation plan. also, whether the MRI 3D images can replace Hip Clock face image was evaluated when performing Hip FAI MRI by using additional 3D image. This study analyzed Hip MRI and 3D Hip CT images of 31 patients in this hospital. For the purpose of evaluating the images, one orthopedic surgeon and one radiology specialist reconstructed Clock face, at MR and CT modality, by superior 12 o'clock, labrum front 3 o'clock, and the other side 9 o'clock, centering on Hip joint articular transverse ligament 6 o'clock. Afterwards, by the Likert Scale 5 point scale (independent t-test p<0.005), this study evaluated the check-up of A. retinacular vessel, B. head neck junction at 11 o'clock, A. Epiphyseal line, B. Cam lesion at 12 o'clock, and Cam lesion, Posterior Cam lesion at 1,2,3 and 4 o'clock. As for the verification of reliability among observers, this study verified coincidence by Cohen's weighted Kappa verification. As a result of Likert scale for the purpose of qualitative evaluation about the image, 11 o'clock A. retinacular vessel MR average was $3.69{\pm}1.0$ and CT average was $2.8{\pm}0.78$. B. head neck juncton didn't have a difference between two observers (p <0.416). 12 o'clock A. Epiphyseal line MR average was $3.54{\pm}1.00$ and CT average was $4.5{\pm}0.62$(p<0.000). B. Cam lesion didn't have a difference between two observers (p <0.532). 1,2,3,4 Cam lesion and Posterior Cam lesion were not statistically significant (p <0.656, p <0.658). As a result of weighted Kappa verification, 11 o'clock A.retinacular vessel CT K value was 0.663 and the lowest conformity. As a result of coincidence evaluation on respective item, a very high result was drawn, and two observers showed high reliability.

Developing and Applying the Questionnaire to Measure Science Core Competencies Based on the 2015 Revised National Science Curriculum (2015 개정 과학과 교육과정에 기초한 과학과 핵심역량 조사 문항의 개발 및 적용)

  • Ha, Minsu;Park, HyunJu;Kim, Yong-Jin;Kang, Nam-Hwa;Oh, Phil Seok;Kim, Mi-Jum;Min, Jae-Sik;Lee, Yoonhyeong;Han, Hyo-Jeong;Kim, Moogyeong;Ko, Sung-Woo;Son, Mi-Hyun
    • Journal of The Korean Association For Science Education
    • /
    • v.38 no.4
    • /
    • pp.495-504
    • /
    • 2018
  • This study was conducted to develop items to measure scientific core competency based on statements of scientific core competencies presented in the 2015 revised national science curriculum and to identify the validity and reliability of the newly developed items. Based on the explanations of scientific reasoning, scientific inquiry ability, scientific problem-solving ability, scientific communication ability, participation/lifelong learning in science presented in the 2015 revised national science curriculum, 25 items were developed by five science education experts. To explore the validity and reliability of the developed items, data were collected from 11,348 students in elementary, middle, and high schools nationwide. The content validity, substantive validity, the internal structure validity, and generalization validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there were no nonconformity in the 25 items. The confirmatory factor analysis using the structural equation modeling revealed that the five-factor model was a suitable model. The differential item functioning analyses by gender and school level revealed that the nonconformity DIF value was found in only two out of 175 cases. The results of the multivariate analysis of variance by gender and school level showed significant differences of test scores between schools and genders, and the interaction effect was also significant. The assessment items of science core competency based on the 2015 revised national science curriculum are valid from a psychometric point of view and can be used in the science education field.