• Title/Summary/Keyword: generalizability analysis

Search Result 56, Processing Time 0.023 seconds

An Analysis on Rater Error in Holistic Scoring for Performance Assessments of Middle School Students' Science Investigation Activities (중학생 과학탐구활동 수행평가 시 총체적 채점에서 나타나는 채점자간 불일치 유형 분석)

  • Kim, Hyung-Jun;Yoo, June-Hee
    • Journal of The Korean Association For Science Education
    • /
    • v.32 no.1
    • /
    • pp.160-181
    • /
    • 2012
  • The purpose of this study is to understand raters' errors in rating performance assessments of science inquiry. For this, 60 middle school students performed scientific inquiry about sound propagation and 4 trained raters rated their activity sheets. Variance components estimation for the result of the generalizability analysis for the person, task, rater design, the variance components for rater, rater by person and rater by task are about 25%. Among 4 raters, 2 raters' severity is higher than the other two raters and their severities were stabilized. Four raters' rating agreed with each other in 51 cases among the 240 cases. Through the raters' conferences, the rater error types for 189 disagreed cases were identified as one of three types; different salience, severity, and overlooking. The error type 1, different salience, showed 38% of the disagreed cases. Salient task and salient assessment components are different among the raters. The error type 2, severity, showed 25% and the error type 3, overlooking showed 31%. The error type 2 seemed to have happened when the students responses were on the borders of two levels. Error type 3 seemed to have happened when raters overlooked some important part of students' responses because she or he immersed her or himself in one's own salience. To reduce the above rater errors, raters' conference in salience of task and assesment components are needed before performing the holistic scoring of complex tasks. Also raters need to recognize her/his severity and efforts to keep one's own severity. Multiple raters are needed to prevent the errors from being overlooked. The further studies in raters' tendencies and sources of different interpretations on the rubric are suggested.

Survey on the Hospice Care Needs of Hospice Volunteers (호스피스 자원봉사자의 호스피스 케어 요구도 분석)

  • Cho, Hyun;Kang, Hee-Sook;Kim, Jeoung-Hee
    • Journal of Hospice and Palliative Care
    • /
    • v.5 no.2
    • /
    • pp.155-162
    • /
    • 2002
  • Purpose : The purpose of this study is to provide preliminary information on the hospice care needs of hospice volunteers. Methods : The sample of this study was obtained from those who completed the hospice volunteer education program in three different areas in Korea. This study was conducted by a self-administered questionnaire. The sample analyzed for this study contained 88 hospice volunteers. Frequency, percentage, mean, standard deviation, and logistic regression analysis were performed to produce the findings of this study. Results : The characteristics of the study sample were $40{\sim}49$ aged, middle class, christianity, married women with high school diplomas. They attended at the hospice center with less than 1 year experience. Majority of them had no family members who received a hospice care. The hospice care was strongly required in the field of information, particularly regarding their diseases and treatments. The identified hospice care needs were the prevention and treatment of gangrene in the field of physical needs, the maintenance of closer relationship with their doctors in the field of emotional needs, and the support of supporting medical insurance in the field of socioeconomic needs. The significant predictors were 'having hospice care taker among family members' in the field of the total hospice care needs and physical needs. Two predictable variables were found in the field of emotional needs. However, none were found to be a predictable variable in the field of information and socioeconomic needs. Conclusion : The findings or this study have a weekness of generalizability due to the sampling methodology used in this study. Thus, further research should be designed in relation to this topic with a probability sampling method.

  • PDF

Development and Implementation of a Process-Based Evaluation Program on School Space Design: Focusing on the Housing Life Area of Home Economics Curriculum in Middle School (학교 공간 디자인을 주제로 한 과정중심평가 프로그램 개발 및 실행: 중학교 가정교과 주생활 영역을 중심으로)

  • Kang, Eun Young;Park, Mi Jeong
    • Journal of Korean Home Economics Education Association
    • /
    • v.32 no.4
    • /
    • pp.81-101
    • /
    • 2020
  • The purpose of this study is to develop and implement a process-based evaluation program with the theme of school space design in the housing area of the middle school home economics. In order to achieve For thispurpose, a process-based evaluation program based on the theme of school space design was developed following the ADDIE instructional design model, and the program was executed to a total of 93 students. A questionnaire survey and in-depth interview were conducted for the evaluation of the program. The results of this study are as follows. First, based on the results of a 2015-Revised Curriculum analysis, a school space design program evaluation plan was established, and two evaluation tasks were developed. Accordingly, scoring criteria were prepared and 8 evaluation materials for students and 2 evaluation materials for teachers were developed. A total of 9 sessions were developed for teaching and learning activities and evaluation-linked operation procedures to perform evaluation tasks. As a result of an expert validity test for the program, all items were verified to be appropriate in content validity and content composition with an average of 3.6 to 4 points (4 points). Second, after conducting the school space design program, a survey on students were conducted, and as a result, all three areas of school space design class, process-based evaluation, interest scored high in average scores of 4.12 to 4.27 out of 5. According to the survey and interview results, the program provided new learning opportunities for school space design, the students were able to reach the suggested achievement goals, and the self-assessment, peer evaluation and teacher feedback positively affected the students during the learning process so that they could reflect on their learning and actively participate in the subsequent learning activity. This study has a limitation in generalizability in that the program was conducted on a limited number of students, and future studies are expected to expand the scope in terms of research participants, evaluation criteria, and school space design classes. This study laid the foundation for theory and practice by developing and implementing a process-based evaluation program for home economics education, and it has contribution in that it suggested the possibility that teachers and students can take the initiatives in school space design, focusing on the housing content elements of home economics.

Surrogate Internet Shopping Malls: The Effects of Consumers' Perceived Risk and Product Evaluations on Country-of-Buying-Origin Image (망상대구점(网上代购店): 소비자감지풍험화산품평개대원산국형상적영향(消费者感知风险和产品评价对原产国形象的影响))

  • Lee, Hyun-Joung;Shin, So-Hyoun;Kim, Sang-Uk
    • Journal of Global Scholars of Marketing Science
    • /
    • v.20 no.2
    • /
    • pp.208-218
    • /
    • 2010
  • Internet has grown fast and become one of the most important retail channels now. Various types of Internet retailers, hereafter etailers, have been introduced so far and as one type of Internet shopping mall, 'surrogate Internet shopping mall' has been prosperous and attracting consumers in the domestic market. Surrogate Internet shopping mall is a unique type of etailer that globally purchases well-known brand goods that are not imported in the market, completes delivery in the favor of individual buyers, and collects fees for these specific services. The consumers, who are usually interested in purchasing high-end and unique but not eligible brands, have difficulties to purchase these items overseas directly from the retailers or brands in other countries due to worries of payment failure and no address available for their usually domestic only delivery. In Korea, both numbers of surrogate Internet shopping malls and the magnitude of sales have been growing rapidly up to more than 430 active malls and 500 billion Korean won in 2008 since the population of consumers who want this agent shopping service is also expending. This etail business concept is originated from 'surrogate-mediated purchase' and this type of shopping agent has existed in many different forms and also in wide ranges of context level for quite a long time. As marketers face their individual buyers' representatives instead of a direct contact with them in many occasions, the impact of surrogate shoppers on consumer's decision making has been enormously important and many scholars have explored various range of agent's impact on consumer's purchase decisions in marketing and psychology field. However, not much rigorous research in the Internet commerce has been conveyed yet. Moreover, since as one of the shopping agent surrogate Internet shopping malls specifically connect overseas brands or retailers to domestic consumers, one specific character of the mall's, image of surrogate buying country, where surrogate purchases are conducted in, may play an important role to form consumers' attitude and purchase intention toward products. Furthermore it also possibly affects various dimensions of perceived risk in consumer's information processing. However, though tremendous researches have been carried exploring the effects of diverse dimensions of country of origin, related studies in Internet context has been rarely executed. There have been some studies that prove the positive impact of country of origin on consumer's evaluations as one of information clues in product manufacture descriptions, yet studies detecting the relationship between country image of surrogate buying origin and product evaluations rarely undertaken regarding this specific mall type. Thus, the authors have found it well-worth investigating in this specific retail channel and explored systematic relationships among focal constructs and elaborated their different paths. The authors have proven that country image of surrogate buying origin in the mall, where surrogate malls purchase products in and brings them from for buyers, not only has a positive effect on consumers' product evaluations including attitude and purchase intention but also has a negative effect on all three dimensions of perceived risk: product-related risk, shipping-related risk, and post-purchase risk. Specifically among all the perceived risk, product-related risk which is arisen from high uncertainty of product performance is most affected (${\beta}$= -.30) by negative country image of surrogate buying origin, and also shipping-related risk (${\beta}$= -.18) and post-purchase risk (${\beta}$= -.15) get influenced in order. Its direct effects on product attitude (${\beta}$= .10) and purchase intention (${\beta}$= .14) are also secured. Each of perceived risk dimension is proven to have a negative effect on purchase intention through product attitude as a mediator (${\beta}$= -.57: product-related risk ${\rightarrow}$ product attitude; ${\beta}$= -.24: shipping-related risk ${\rightarrow}$ product attitude; ${\beta}$= -.44: post-purchase risk ${\rightarrow}$ product attitude) as well. From the additional analysis, the paths of consumers' information processing are shown to be different based on their levels of product knowledge. While novice consumers with low level of knowledge consider only perceived risk important, expert consumers with high level of knowledge take both the country image, where surrogate services are conducted in, and perceived risk seriously to build their attitudes and formulate decisions toward products more delicately and systematically, which is in line with previous studies. This study suggests several pieces of academic and practical advice. Precisely, country image of surrogate buying origin does affect on consumer's risk perceptions and behavioral consequences. Therefore a careful selection of surrogate buying origin is recommended. Furthermore, reducing consumers' risk level is required to blossom this new type of retail business whether its consumer are novices or experts. Additionally, since consumer take different paths of elaborating information based on their knowledge levels, sophisticated marketing approaches to each group of consumers are required. For novice buyers strong devices for risk mitigation are needed to induce them to form better attitudes and for experts selections of better and advanced countries as surrogate buying origins are advised while endorsement strategy for the site might work as a reliable information clue to all consumers to mitigate the barriers to purchase goods online. The authors have also explained that the study suffers from some limitations, including generalizability. In future studies, tests of and comparisons among different types of etailers with relevant constructs are recommended to broaden the findings.

Study on the Relationships Among Perceived Shopping Values, Brand Equity, and Store Loyalty of Korean and Chinese Consumers: A Case of Large Discount Store (한국과 중국 소비자의 쇼핑 경험가치 지각과 브랜드자산 및 점포충성도의 관계에 관한 비교 연구: 대형 할인점을 중심으로)

  • Hwang, Soonho;Oh, Jongchul;Yoon, Sungjoon
    • Asia Marketing Journal
    • /
    • v.14 no.2
    • /
    • pp.209-237
    • /
    • 2012
  • 1. Research Purpose Consumers rely on various clues to evaluate their decision to patronize a retail store, and store brand is one of them (Dodds 1991; Grewal et al. 1998). As consumers find ever increasing variety of contact points connecting them to specific store, the value of experiential shopping as a means of increasing store's brand equity warrants greater attention from scholars of retail management. Retail shopping values are credited for creating not only cognitive experiences like brand knowledge but also emotional experiences such as shopping pleasure and pride (Schmitt 1999). This may be because today's consumers place emphasis on emotional values associated with shopping pleasure, lifestyle brought to life, brand relationship, and store atmosphere more than utilitarian values such as product quality and price. Many previous literature found this to be true (Ahn and Lee 2011; Mathwick et al. 2001). This brings forth important research issues and questions regarding the roles of shopping experiential values and brand equity with regard to consumer's retail patronage choice. However, despite this importance, research on this area remains quite inadequate (Hwang 2010). For this reason, this study aims to verify the relationships among experiential shopping values, retail store brand equity and tries to link that with customer loyalty by surveying large-scale discount store shoppers in Korea and China. 2. Research Contents In order to carry out the research objective, this study conducted comprehensive literature survey on previous literature by discussing major findings and implications with regard to shopping values and retail brand equity and store loyalty. For data collection, researcher employed survey-based research method where data were collected in two major cities of Korea (Seoul) and China (Bejing) and sampling frame was based on patrons of large discount stores in both countries. Specific research questions raised in this study are as follows; RQ1: How do Korean and Chinese consumers differently perceive of shopping values regarding shopping at large-sclae discount stores? RQ2: Are there differences in consumers' emotional consumption propensities? RQ3: Do Korean and Chinese consumers display different perceptions of brand equity towards large-scale discount stores? RQ4: Are there differences in relationships between shopping values and brand equity for Korean and Chinese consumers? For statistical analysis, SPSS17.0, AMOS17.0 and SmartPLS were employed. 3. Research Results The data collected through face-to-face survey conducted in Seoul and Bejing revealed appropriate data validity and reliability as a result of exploratory/confirmatory factor analysis and reliability tests, andh SEM model yielding satisfactory model fitness. The result of the study may be summarized by three main points. First, as a result of testing differences in consumption dispositions, Chinese consumers showed higher scores in aesthetic and symbolic dispositions, whereas Korean consumers scored higher in hedonic disposition. Second, testing on perceptions toward brand equity of large discount stores showed that Korean consumers exhibited more positive perceptions of brand awareness and brand image than Chinese counterparts. Third, the result of exploratory factor analysis on the experiential shopping values revealed different factors for each country. On Korean side, consumer interest value, aesthetic value, and hedonic value were prominent, whereas on Chinese side, hedonic value, aesthetic value, consumer interest value, and service excellence value were found salient. 4. Research Implications While many previous studies on inter-country differences in retailing area mainly focused on cultural dispositions or orientations to explain the differences, this study sets itself apart by specifically targeting individual consumer's shopping values from an experiential viewpoint. The study result provides important theoretical as well as practical implications for large-scale discount store, especially the impotance of fully exploring the linkage between shopping values and brand equity, which has significant influence on loyalty. Therefore, the specific implications deriving from the result shed some important insights upon the consumption values based on shopping experiences and brand equity. The differences found in store shoppers between the two countries may also provide useful insights for Korean and Chinese retailers who plan to expand their operations globally. Related strategic implications derived from this study is the importance of localizing retail strategy which is based on the differences found in experiential shopping values between the two country groups. Especially the finding that Chinese consumers value consumer interest and service excellence, whereas Koreans place importance on hedonic or aesthetic values indicates the need to differentiate the consumer's psychographical profiles when it comes to expanding retail operations globally. Particularly important will be to pursue price-orienated strategy in China in consideration of the high emphasis on consumer interests and service excellence, but to emphasize the symbolic aspects of brand equity in Korea by maximizing the brand equity associated with aesthetic values and hedonic orientations. 5. Recommendations This study focused on generic retail branded discount stores in both countries, thus making it difficult to tease out store-specific strategies based on specific retail brands. Future studies may benefit fro employing actual brand names in survey questionnaire to verify relationship between shopping values and brand-based store strategy. As with other studies of this nature, this study needs to strengthen the result's generalizability by selecting respondents from a wider spectrum of respondents.

  • PDF

The Impact of Market Environments on Optimal Channel Strategy Involving an Internet Channel: A Game Theoretic Approach (시장 환경이 인터넷 경로를 포함한 다중 경로 관리에 미치는 영향에 관한 연구: 게임 이론적 접근방법)

  • Yoo, Weon-Sang
    • Journal of Distribution Research
    • /
    • v.16 no.2
    • /
    • pp.119-138
    • /
    • 2011
  • Internet commerce has been growing at a rapid pace for the last decade. Many firms try to reach wider consumer markets by adding the Internet channel to the existing traditional channels. Despite the various benefits of the Internet channel, a significant number of firms failed in managing the new type of channel. Previous studies could not cleary explain these conflicting results associated with the Internet channel. One of the major reasons is most of the previous studies conducted analyses under a specific market condition and claimed that as the impact of Internet channel introduction. Therefore, their results are strongly influenced by the specific market settings. However, firms face various market conditions in the real worlddensity and disutility of using the Internet. The purpose of this study is to investigate the impact of various market environments on a firm's optimal channel strategy by employing a flexible game theory model. We capture various market conditions with consumer density and disutility of using the Internet.

    shows the channel structures analyzed in this study. Before the Internet channel is introduced, a monopoly manufacturer sells its products through an independent physical store. From this structure, the manufacturer could introduce its own Internet channel (MI). The independent physical store could also introduce its own Internet channel and coordinate it with the existing physical store (RI). An independent Internet retailer such as Amazon could enter this market (II). In this case, two types of independent retailers compete with each other. In this model, consumers are uniformly distributed on the two dimensional space. Consumer heterogeneity is captured by a consumer's geographical location (ci) and his disutility of using the Internet channel (${\delta}_{N_i}$).
    shows various market conditions captured by the two consumer heterogeneities.
    (a) illustrates a market with symmetric consumer distributions. The model captures explicitly the asymmetric distributions of consumer disutility in a market as well. In a market like that is represented in
    (c), the average consumer disutility of using an Internet store is relatively smaller than that of using a physical store. For example, this case represents the market in which 1) the product is suitable for Internet transactions (e.g., books) or 2) the level of E-Commerce readiness is high such as in Denmark or Finland. On the other hand, the average consumer disutility when using an Internet store is relatively greater than that of using a physical store in a market like (b). Countries like Ukraine and Bulgaria, or the market for "experience goods" such as shoes, could be examples of this market condition. summarizes the various scenarios of consumer distributions analyzed in this study. The range for disutility of using the Internet (${\delta}_{N_i}$) is held constant, while the range of consumer distribution (${\chi}_i$) varies from -25 to 25, from -50 to 50, from -100 to 100, from -150 to 150, and from -200 to 200.
    summarizes the analysis results. As the average travel cost in a market decreases while the average disutility of Internet use remains the same, average retail price, total quantity sold, physical store profit, monopoly manufacturer profit, and thus, total channel profit increase. On the other hand, the quantity sold through the Internet and the profit of the Internet store decrease with a decreasing average travel cost relative to the average disutility of Internet use. We find that a channel that has an advantage over the other kind of channel serves a larger portion of the market. In a market with a high average travel cost, in which the Internet store has a relative advantage over the physical store, for example, the Internet store becomes a mass-retailer serving a larger portion of the market. This result implies that the Internet becomes a more significant distribution channel in those markets characterized by greater geographical dispersion of buyers, or as consumers become more proficient in Internet usage. The results indicate that the degree of price discrimination also varies depending on the distribution of consumer disutility in a market. The manufacturer in a market in which the average travel cost is higher than the average disutility of using the Internet has a stronger incentive for price discrimination than the manufacturer in a market where the average travel cost is relatively lower. We also find that the manufacturer has a stronger incentive to maintain a high price level when the average travel cost in a market is relatively low. Additionally, the retail competition effect due to Internet channel introduction strengthens as average travel cost in a market decreases. This result indicates that a manufacturer's channel power relative to that of the independent physical retailer becomes stronger with a decreasing average travel cost. This implication is counter-intuitive, because it is widely believed that the negative impact of Internet channel introduction on a competing physical retailer is more significant in a market like Russia, where consumers are more geographically dispersed, than in a market like Hong Kong, that has a condensed geographic distribution of consumers.
    illustrates how this happens. When mangers consider the overall impact of the Internet channel, however, they should consider not only channel power, but also sales volume. When both are considered, the introduction of the Internet channel is revealed as more harmful to a physical retailer in Russia than one in Hong Kong, because the sales volume decrease for a physical store due to Internet channel competition is much greater in Russia than in Hong Kong. The results show that manufacturer is always better off with any type of Internet store introduction. The independent physical store benefits from opening its own Internet store when the average travel cost is higher relative to the disutility of using the Internet. Under an opposite market condition, however, the independent physical retailer could be worse off when it opens its own Internet outlet and coordinates both outlets (RI). This is because the low average travel cost significantly reduces the channel power of the independent physical retailer, further aggravating the already weak channel power caused by myopic inter-channel price coordination. The results implies that channel members and policy makers should explicitly consider the factors determining the relative distributions of both kinds of consumer disutility, when they make a channel decision involving an Internet channel. These factors include the suitability of a product for Internet shopping, the level of E-Commerce readiness of a market, and the degree of geographic dispersion of consumers in a market. Despite the academic contributions and managerial implications, this study is limited in the following ways. First, a series of numerical analyses were conducted to derive equilibrium solutions due to the complex forms of demand functions. In the process, we set up V=100, ${\lambda}$=1, and ${\beta}$=0.01. Future research may change this parameter value set to check the generalizability of this study. Second, the five different scenarios for market conditions were analyzed. Future research could try different sets of parameter ranges. Finally, the model setting allows only one monopoly manufacturer in the market. Accommodating competing multiple manufacturers (brands) would generate more realistic results.

  • PDF

  • (34141) Korea Institute of Science and Technology Information, 245, Daehak-ro, Yuseong-gu, Daejeon
    Copyright (C) KISTI. All Rights Reserved.