Browse > Article
http://dx.doi.org/10.9722/JGTE.2016.26.4.699

An Investigation into the Equivalence of Three Pictures for Creative Story Writing: 'Dog Owners', 'Lost Dog', and 'Overslept'  

Suh, Heejung (Kyungpook National University)
Bae, Jungok (Kyungpook National University)
Publication Information
Journal of Gifted/Talented Education / v.26, no.4, 2016 , pp. 699-719 More about this Journal
Abstract
Alternate pictures that are proven to be equivalent are in high demand to assess creative thinking and language skills. This study aimed to investigate the equivalence of three pictures ('Dog owners,' 'Lost Dog,' and 'Overslept') recently developed for use in a creative writing task. Middle school students (N=183) wrote a story in English based on one of the three prompts distributed randomly. Four writing features (fluency, syntactic complexity, lexical diversity, and temporality) were analyzed with Coh-Metrix and MANCOVA. The three prompts were largely equivalent in their capacity to detect differences among writers in all the features of writing. The difficulty levels of the three prompts, however, were not necessarily the same. Two prompts, Dog Owners and Lost Dog, were verified as equivalent prompts, and therefore, they are recommended as alternate forms to assess creative language skills in repeated measurements. The Overslept prompt had greater facility in eliciting diverse words and more temporal connectives in composing stories. The differential difficulty shown among the prompts suggests that the validity of using different picture versions in repeated assessment remains questionable unless those versions undergo equivalence verification.
Keywords
Picture prompts; Creative writing; Stories; Equivalence; Repeated meas;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Oswald, F. L., Friede, A. J., Schmitt, N., Kim, B. H., & Ramsay, L. J. (2005). Extending a practical method for developing alternate test forms using independent sets of items. Organizational Research Methods, 8(2), 149-164.   DOI
2 Pena, E. D., Gillam, R. B., Malek, M., Ruiz-Felter, R., Resendiz, M., Fiestas, C., & Sabel, T. (2006). Dynamic assessment of school-age children's narrative ability: An experimental investigation of classification accuracy. Journal of Speech, Language, and Hearing Research, 49(5), 1037-1057.   DOI
3 Peterson, C., & Dodsworth, P. (1991). A longitudinal analysis of young children's cohesion and noun specification in narratives. Journal of Child Language, 18(2), 397-415.   DOI
4 Quereshi, M. Y. (2003). Absence of parallel forms for the traditional individual intelligence tests. Current Psychology, 22(2), 149-154.   DOI
5 Raymond, M. R., Neustel, S., & Anderson, D. (2007). Retest effects on identical and parallel forms in certification and licensure testing. Personnel Psychology, 60(2), 367-396.   DOI
6 Schneider, P., & Dube, R. V. (2005). Story presentation effects on children's retell content. American Journal of Speech-Language Pathology, 14(1), 52-60.   DOI
7 Schweizer, M. L. (1999). The effect of content, style, and color of picture prompts on narrative writing: An analysis of fifth and Eighth grade students' writing. Unpublished doctoral dissertation, Virginia Polytechnic Institute and State University, Blacksburg, VA.
8 Shapiro, L. R., & Hudson, J. A. (1991). Tell me a make-believe story: Coherence and cohesion in young children's picture-elicited narratives. Developmental Psychology, 27(6), 960-974.   DOI
9 Skehan, P. (1996). A framework for the implementation of task-based instruction. Applied Linguistics, 17(1), 38-62.   DOI
10 Pearce, W. M. (2003). Does the choice of stimulus affect the complexity of children's oral narratives? Advances in Speech-Language Pathology, 5(2), 95-103.   DOI
11 Bae, J., Bentler, P. M., & Lee, Y. S. (2016). On the role of content in writing assessment. Language Assessment Quarterly, 13(4), 302-328.   DOI
12 Ackerman, J. M. (1991). Reading, writing, and knowing: The role of disciplinary knowledge in comprehension and composing. Research in the Teaching of English, 25(2), 133-178.
13 American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Authors.
14 Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, UK: Oxford University Press.
15 Bae, J. (2007). Development of English skills need not suffer as a result of immersion: Grades 1 and 2 writing assessment in a Korean/English Two‐Way Immersion Program. Language Learning, 57(2), 299-332.   DOI
16 Weir, C. J., & Wu, J. R. (2006). Establishing test form and individual task comparability: Case study of a semi-direct speaking test. Language Testing, 23(2), 167-197.   DOI
17 Wolfe-Quintero, K., Inagaki, S., & Kim, H. Y. (1998). Second language development in writing: Measures of fluency, accuracy and complexity. Honolulu, HI: University of Hawaii at Manoa.
18 Young, K. M., & Leinhardt, G. (1998). Writing from primary documents: A way of knowing in history. Written Communication, 15(1), 25-68.   DOI
19 Bae, J. (2014). The confirmation of equivalence of two picture series for children's story writing: 'Pizza' and 'Amusement Park.' Journal of Educational Evaluation, 27(1), 209-229.
20 Bae, J., & Lee, Y. S. (2011). The validation of parallel test forms: 'Mountain' and 'beach' picture series for assessment of language skills. Language Testing, 28(2), 155-177.   DOI
21 Bae, J., Jordahl, J., & Lee, Y. S. (2012, May). The effect of relative simplicity or complexity of picture prompt on language and creativity performances in writing. Paper presented at the 2012 Annual International Conference of the Korea English Language Testing Association, Seoul, Korea.
22 Baker, E. L., & Quellmalz, E. (1979). Results of pilot studies: Effects of variations in writing task stimuli on the analysis of student writing performance. Studies in measurement and methodology. Work unit 1: Design and use of tests. Los Angeles: University of California at Los Angeles.
23 Berman, R. A., & Slobin, D. I. (1994). Relating events in narrative: A crosslinguistic developmental study. Hillsdale, NJ: Erlbaum.
24 Cleaver, B., Scheurer, P., & Shorey, M. (1993). Children's responses to silhouette illustrations in picture books. Rochester NY: International Visual Literacy Association.
25 Cliffordson, C. (2004). Effects of practice and intellectual growth on performance on the Swedish Scholastic Aptitude Test (SweSAT). European Journal of Psychological Assessment, 20(3), 192-204.   DOI
26 DeCoster, J. (2006). Testing group difference using T-tests, ANOVA, and nonparametric measures. Retrieved June 30, 2016 from http://www.stat-help.com/notes.html.
27 Crisp, V., & Sweiry, E. (2006). Can a picture ruin a thousand words? The effects of visual resources in exam questions. Educational Research, 48(2), 139-154.   DOI
28 Cronbach, L. J. (1947). Test 'reliability': Its meaning and determination. Psychometrika, 12(1), 1-16.   DOI
29 Cycowicz, Y. M., Friedman, D., Rothstein, M., & Snodgrass, J. G. (1997). Picture naming by young children: Norms for name agreement, familiarity, and visual complexity. Journal of Experimental Child Psychology, 65(2), 171-237.   DOI
30 Department for Education and Employment (1998). The National Literacy Strategy: a framework for teaching. London: Author.
31 Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient:Relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248-261.   DOI
32 Duran, N. D., McCarthy, P. M., Graesser, A. C., & McNamara, D. S. (2007). Using temporal cohesion to predict temporal coherence in narrative and expository texts. Behavior Research Methods, 39(2), 212-223.   DOI
33 Fillmore, C. (1982). Frame semantics. In The Linguistic Society of Korea (Ed.), Linguistics in the morning calm (pp. 111-137). Seoul: Hanshin.
34 Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z. (2004). Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2), 193-202.   DOI
35 Greenhoot, A. D., & Semb, P. A. (2008). Do illustrations enhance preschoolers' memories for stories? Age-related change in the picture facilitation effect. Journal of Experimental Child Psychology, 99(4), 271-287.   DOI
36 Kintsch, E. (2005). Comprehension theory as a guide for the design of thoughtful questions. Topics in Language Disorders, 25(1), 51-64.   DOI
37 Halliday, M. A. K., & Hasan, R. (1976). Cohesion in English. London: Longman.
38 Hausknecht, J. P., Halpert, J. A., Di Paolo, N. T., & Gerrard, M. O. (2007). Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology, 92(2), 373-385.   DOI
39 Jung, J., & Bae, J. (2013). The influence of picture prompt variation on writing performance: 'Series' vs. 'Imagine Before and After.' English Language Teaching, 25(2), 27-46.   DOI
40 Kim, H., Koo, S., & Bae, J. (2015). Positive, negative, and nil effects of connectives in written stories:Analysis by proficiency groups. Linguistic Research, 32, 105-124.   DOI
41 Koizumi, R., & In'nami, Y. (2012). Effects of text length on lexical diversity measures: Using short texts with less than 200 tokens. System, 40(4), 554-564.   DOI
42 Laufer, B., & Nation, P. (1995). Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics, 16(3), 307-322.   DOI
43 Lee, S-D., & Koh, W-J. (2013). The structural model analysis of related variables on English reading comprehension ability of gifted students. The Journal of the Korean Society for the Gifted and Talented, 12(1), 53-80.
44 Lee, K., & Lee, Y. (2008). The effects of language activity programs using fairy tales on progress in children’s creativity. The Journal of the Koran Society for the Gifted and Talented, 7(1), 29-46.
45 Liu, Y. (2002). Analyzing RM ANOVA related data using SPSS 10. Measurement in Physical and Exercise Science, 6(1), 43-60.
46 McCarthy, P. M., & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior research methods, 42(2), 381-392.   DOI
47 Lomax, R. G. (2001). Statistical concepts: A second course for education and the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum Publishers.
48 McCaffrey, R. J., Duff, K., & Westervelt, H. J. (Eds.). (2000). Practitioner's guide to evaluating change with neuropsychological assessment instruments. New York: Kluwer Academic/Plenum Publishers.
49 McCarthy, P. M., & Jarvis, S. (2007). vocd: A theoretical and empirical evaluation. Language Testing, 24(4), 459-488.   DOI
50 McCutchen, D. (1986). Domain knowledge and linguistic knowledge in the development of writing ability. Journal of Memory and Language, 25(4), 431-444.   DOI
51 McCutchen, D. (1996). A capacity theory of writing: Working memory in composition. Educational Psychology Review, 8(3), 299-325.   DOI
52 McCutchen, D. (2000). Knowledge, processing, and working memory: Implications for a Theory of Writing. Educational Psychologist, 35(1), 13-23.   DOI
53 McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, N.J: Lawrence Erlbaum.
54 McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication, 27(1), 57-86.   DOI
55 Meyers, L.S., Gamst, G., & Guarino, A. J. (2006). Applied multivariate research: design and interpretation. London: Sage Publications.