Browse > Article
http://dx.doi.org/10.9716/KITS.2012.11.4.135

Development of Formative Constructs and Measurements for Performance Evaluation of Information Systems  

Kim, Sanghoon (광운대학교 경영정보학과)
Kim, Changkyu (광운대학교 정보화혁신연구실)
Publication Information
Journal of Information Technology Services / v.11, no.4, 2012 , pp. 135-151 More about this Journal
Abstract
Traditionally in IS studies, the relationship between construct and its measurement items tends to be assumed to be reflective, meaning that the measurements are a reflection of the construct. In reality, however, the nature of the construct can be often formative, which means that its measurement items describe and define the construct rather than vice versa. The purpose of this study was to investigate theoretical and empirically-analysed differences between formative construct and reflective construct through comprehensive interdisciplinary literature review. And then on the basis of these differences, we intended to derive the rule of specifying whether the construct is formative or reflective and propose the methodology of testing the validity(content validity, construct validity, internal consistency and external construct) of formative construct and its measurements, differentiated from that in the case of reflective construct. Also, we suggested the concrete statistical testing methods such as VTT(Vanishing Tetrad Test), MIMIC(Multiple Indicators and Multiple Causes) test and multi-collinearity test. In order to examine the applicability of this methodology to developing the constructs for performance evaluation of IS(Information Systems), we tried to identify its attribute(formative or reflective) and test the validity for the construct arbitrarily chosen among them which had been derived in our previous IS performance evaluation study by using this methodology. The result of the examination was that the methodology proposed in this study was significantly valid and effective in the area of IS performance evaluation.
Keywords
IS(Information Systems) Performance Evaluation; Formative Construct; Reflective Construct; VTT(Vanishing Tetrad Test); MIMIC(Multiple Indicator, Multiple Cause); Multi-Collinearity Test;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Bentler, P. M. and D. G. Bonett., "Significance Tests and Goodness of Fit in the Analysis of Covariance Structures", Psychological Bulletin, Vol.88, No.3(1980), pp. 588-606.   DOI
2 Barki, H., R. Titah, and C. Boffo, "Information System use-related Activity：An Expanded Behavioral Conceptualization of Individual-Level Information System use", Information Systems Research, Vol.18, No.2 (2007), pp.173-192.   DOI
3 Gable, G. G. and D. Sedera, "Formative and Reflective Measurement and Validation Mismatch in Survey Research：An Archival Analysis of Information Systems Success Constructs 1985-2007", In Proceedings of the Thirtieth International Conference on Information Systems, Association for Information Systems, Phoenix, Arizona, 2009.
4 김상훈, 최점기, 진동욱, 조승철, 박일규, 김창규, 박미선, 김민욱, 강석열, 전범종, "중소기업 정보화지원정책 성과평가체계 연구", 중소기업청과 중소기업정보화경영원, 서울, 2005.
5 송재욱, 정호원, "사이버보안 지수 개발 및 실증：금융권 대상으로", 한국IT서비스학회 추계학술대회, (2011), pp.508-512.
6 Petter, S., D. Straub, and A. Rai, "Specifying Formative Constructs in Information Systems Research", MIS Quarterly, Vol.31, No.4(2007), pp.623-656.
7 Kim, G., B. Shin, and V. Grover, "Investigating Two Contradictory Views of Formative Measurement in Information Systems Research", MIS Quarterly, Vol.34, No.2(2010), pp.345-365.
8 Gefen, D., D. W. Straub, and M. C. Boudreau, "Structural Equation Modeling and Regression： Guidelines for Research Practice", Communications of the Association for Information Systems, Vol.4(2000).
9 Chin, W. W. and P. A. Todd, "On the use, Usefulness, and Ease of use of Structural Equation Modeling in MIS Research：A Note of Caution", MIS Quarterly, Vol.19, No.2(1995), pp.237-246.   DOI   ScienceOn
10 Cenfetelli, R. T. and G. Bassellier, "Interpretation of Formative Measurement in Information Systems Research", MIS Quarterly, Vol.33, No.4(2009), pp.689-707.
11 Jarvis, C. B., S. B. MacKenzie, and P. M. Podsakoff, "A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research", Journal of Consumer Research, Vol.30, No.2(2003), pp.199-218.   DOI   ScienceOn
12 MacCallum, R. C. and M. W. Browne, "The use of Causal Indicators in Covariance Structure Models：Some Practical Issues", Psychological Bulletin, Vol.114, No.3(1993), pp. 533-541.   DOI
13 Bollen, K. and R. Lennox, "Conventional Wisdom on Measurement：A Structural Equation Perspective", Psychological Bulletin, Vol.110, No.2(1991), pp.305-314.   DOI
14 Bollen, K. A. and K. Ting, "Confirmatory Tetrad Analysis", Anonymous American Sociological Association, Washington, DC, 1993.
15 Bollen, K. A. and K. Ting, "A Tetrad Test for Causal Indicators", Psychological Methods, Vol.5, No.1(2000), pp.3-22.   DOI
16 Bollen, K. A., Structural equations with latent variables, John Wiley and Sons, New York, 1989.
17 Bollen, K. A., "Overall Fit in Covariance Structure Models：Two Types of Sample Size Effects", Psychological Bulletin, Vol. 107, No.2(1990), pp.256-259.   DOI
18 Chin, W. W., "Commentary：Issues and Opinion on Structural Equation Modeling", MIS Quarterly, Vol.22, No.1(1998), pp.vii-xvi.
19 Bollen, K. A., "Interpretational Confounding Is Due to Misspecification, Not to Type of Indicator：Comment on Howll, Breivik, and Wilcox", Psychological Methods, Vol.12, No.2 (2007), pp.219-228.   DOI
20 Burt, R. S., "Interpretational Confounding of Unobserved Variables in Structural Equation Models", Sociological Methods and Research, Vol.5, No.1(1976), pp.3-52.   DOI
21 Spearman, C., "General Intelligence, Objectively Determined and Measured", The American Journal of Psychology, Vol.15, No.2 (1904), pp.201-292.   DOI
22 Diamantopoulos, A. and J. A. Siguaw, "Formative Versus Reflective Indicators in Organizational Measure Development：A Comparison and Empirical Illustration", British Journal of Management, Vol.17, No.4(2006), pp.263-282.   DOI
23 Coltman, T., T. M. Devinney, D. F. Midgley, and S. Venaik, "Formative Versus Reflective Measurement Models：Two Applications of Formative Measurement", Journal of Business Research, Vol.61, No.12(2008), pp.1250-1262.   DOI
24 Bagozzi, R. P., "Measurement and Meaning in Information Systems and Organizational Research：Methodological and Philosophical Foundations", MIS Quarterly, Vol.35, No.2 (2011), pp.261-292.
25 Borsboom, D., G. J. Mellenbergh, and J. Heerden, "The theoretical status of latent variables", Psychol Rev, Vol.110, No.2(2003), pp.203-219.   DOI
26 Borsboom, D., G. J. Mellenbergh, and J. Heerden, "The concept of validity", Psychol Rev, Vol.111, No.4(2004), pp.1061-1071.   DOI
27 Cronbach, L. J., "Coefficient alpha and the internal structure of test", Psychometrica, Vol.16, No.3(1951), pp.297-334.   DOI
28 Edwards, J. R. and R. P. Bagozzi, "On the Nature and Direction of Relationships between Constructs and Measures", Psychological Methods, Vol.5, No.2(2000), pp.155- 174.   DOI
29 Rossiter, J. R., "The C-OAR-SE procedure for scale development in marketing", International Journal of Research in Marketing, Vol.19, No.4(2002), pp.305-335.   DOI
30 Joreskog, K. G. and A. S. Goldberger, "Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable", Journal of the American Statistical Association, Vol.70, No.351(1975), pp. 631-639.   DOI   ScienceOn
31 Nunnully, J. C. and I. Bernstein, Psychometric Theory 1978, McGraw-Hill, New York, 1994.
32 Churchill, Jr, G. A., "A Paradigm for Developing Better Measures of Marketing Constructs", Journal of Marketing Research, Vol.16, No.1(1979), pp.64-73.   DOI   ScienceOn
33 Diamantopoulos, A. and H. M. Winklehoffer, "Index construction with formative indicatiors： an alternative to scale development", Journal of Marketing Research, Vol.38, No.2 (2001), pp.269-277.   DOI   ScienceOn
34 Hipp, J. R., D. J. Bauer, and K. A. Bollen, "Conducting Tetrad Tests of Model Fit and Contrasts of Tetrad-Nested Models：A New SAS Macro", Structural Equation Modeling, Vol.12, No.1(2005), pp.76-93.   DOI
35 Low, K. S. and C. Wong, "Multidimensional constructs in structural equation analysis： An illustration using the job perception and job satisfaction constructs", Journal of Management, Vol.25, No.2(1999), pp.143-160.   DOI   ScienceOn
36 Hodge, R. W. and D. J. Treiman, "Social Participation and Social Status", American Sociological Review, Vol.33, No.5(1968), pp. 722-740.   DOI