International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Psychometrics of Perspective Taking in Writing: CombiningManualCoding and Computational Approaches

  • Minkyung, Cho (School of Education, University of California)
  • Received : 2023.01.25
  • Accepted : 2023.02.02
  • Published : 2023.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Perspective taking, one's knowledge of their own mental and emotional states and inferences about others' mental and emotional states, is an important higher order cognitive skill required in successful writing. However, there has not been much research on the identification and examiantion of the psychometrics of perspective taking. To fill in this gap, I reviewed the psychological and cognitive frameworks of perspective taking including theory of mind, audience awareness, development of epistemological understanding, and argumentation schema. I also reviewed various methods of examining the psychometric properties of perspective taking in written composition, including both manual and computational approaches. The review of literature yielded suggestions on the development of manual coding scheme for perspective taking as well as the selection of indexes to draw from natural language processing tools. Challenges and affordances of combining the manual and computational approach are discussed along with future research directions to advance the field of psycholinguistics.

Keywords

References

  1. A. N. Applebee, "Writing and reasoning," Review of Educational Research, Vol. 54, pp. 577-596, 1984. https://doi.org/10.3102/00346543054004577
  2. M. A. Britt, J. F. Rouet, D. Blaum, and K. K. Millis, "A reasoned approach to dealing with fake news," Policy Insights from the Behavioral and Brain Sciences, Vol.6, pp. 94-101, 2019. https://doi.org/10.1177/2372732218814855
  3. L. Duhaylongsod, C. E. Snow, R. L., Selman, and M. S. Donovan, "Toward disciplinary literacy: Dilemmas and challenges in designing history curriculum to support middle school students," Harvard Educational Review, Vol. 85, pp. 587-608, 2015. https://doi.org/10.17763/0017-8055.85.4.587
  4. Y.-S. G. Kim and S. Park, "Unpacking pathways using the Direct and Indirect Effects Model of Writing (DIEW) and the contributions of higher order cognitive skills to writing," Reading and Writing: An Interdisciplinary Journal, Vol. 32, No. 5, pp. 1319-1343, 2019. https://doi.org/10.1007/s11145-018-9913-y
  5. M. Cho, Y. S. G. Kim, and C. B. Olson, "Does perspective taking matter for writing? Perspective taking in sourcebased analytical writing of secondary students," Reading and writing, Vol. 34, No. 8, pp. 2081-2101, 2021. https://doi.org/10.1007/s11145-021-10136-7
  6. M. Cho, Y. S. G. Kim, and J. Wang, "Perspective taking and language features in secondary students' text-based analytical writing," Scientific Studies of Reading, pp. 1-16, 2022. https://doi.org/10.1080/10888438.2022.2132864
  7. Y. S. G. Kim and C. Schatschneider, "Expanding the developmental models of writing: A direct and indirect effects model of developmental writing (DIEW)," Journal of Educational Psychology, Vol. 109, pp. 35-50, 2017. https://doi.org/10.1037/edu0000129
  8. R. Berman, H. Ragnarsdottir, and S. Stromqvist, "Discourse stance: Written and spoken language," Written Language & Literacy, Vol. 5, No. 2, pp. 255-289, 2002. https://doi.org/10.1007/s11145-007-9107-5
  9. J. S. Reilly, E. Baruch, H. Jisa, and R. A. Berman, "Propositional attitudes in written and spoken language," Written Language and Literacy, Vol. 5, No. 2, pp. 183-218, 2002. https://doi.org/10.1075/wll.5.2.04rei
  10. D. Kuhn and A. Crowell, "Dialogic argumentation as a vehicle for developing young adolescents' thinking," Psychological Science, Vol. 22, No. 4, pp. 545-552, 2011. https://doi.org/10.1177/0956797611402512
  11. K. S. Taylor, J. F. Lawrence, C. M. Connor, and C. E. Snow, "Cognitive and linguistic features of adolescent argumentative writing: Do connectives signal more complex reasoning?" Reading and Writing, Vol. 32, No 4, pp. 983-1007, 2019. https://doi.org/10.1007/s11145-018-9898-6
  12. J. E. Wollman-Bonilla, "Can first-grade writers demonstrate audience awareness?" Reading Research Quarterly, Vol. 36, pp. 184-201. 2001. https://doi.org/10.1598/RRQ.36.2.4.
  13. A. Valle, D. Massaro, I. Castelli, and A. Marchetti, "Theory of mind development in adolescence and early adulthood: The growing complexity of recursive thinking ability," Europe's journal of psychology, Vol. 11, No 1, pp. 112-124. 2015. https://doi.org/10.5964/ejop.v11i1.829
  14. S. Diazgranados, R. L. Selman, and M. Dionne, "Acts of social perspective taking: A functional construct and the validation of a performance measure for early adolescents," Social Development, Vol. 25, No. 3, pp. 572-601, 2016. https ://doi.org/10.1111/sode.12157
  15. M. LaRusso, H. Y. Kim, R. Selman, P. Uccelli, T. Dawson, S. Jones, S. Donovan and C. Snow, "Contributions of academic language, perspective taking, and complex reasoning to deep reading comprehension," Journal of Research on Educational Effectiveness, Vol. 9, No. 2, pp. 201-222, 2016. https://doi.org/10.1080/19345747.2015.1116035
  16. J. B. Carvalho, "Developing audience awareness in writing," Journal of Research in Reading, Vol. 25, No. 3, pp. 271-282, 2002. https://doi.org/10.1111/1467-9817.00175
  17. C. Bereiter and M. Scardamalia, "Two models of composing process," In Psychology of written composition, pp. 3-29, New Jersey: Lawrence Erlbaum Associates, 1987.
  18. A. M. Magnifico, "Writing for whom? Cognition, motivation and a writer's audience," Educational Psychologist, Vol. 45, No. 3, pp. 167-184, 2010. https://doi.org/10.1080/00461520.2010.493470
  19. C. A. MacArthur, "Best practices in teaching evaluation and revision," In S. Graham, C. A. MacArthur, and J. Fitzgerald (Eds.), Best practices in writing instruction, pp. 141-162, New York: Guilford, 2007.
  20. E. Midgette, P. Haria, and C. MacArthur, "The effects of content and audience awareness goals for revision on the persuasive essays of fifth- and eighth-grade students," Reading and Writing: An Interdisciplinary Journal, Vol. 21, No. 1/2, pp. 131-151, 2008. https://doi.org/10.1007/s1114 5-007-9067-9
  21. D. Kuhn, R. Cheney, and M. Weinstock, "The development of epistemological understanding," Cognitive Development, Vol. 15, pp. 309-328, 2000. https ://doi.org/10.1016/S0885-2014(00)00030-7
  22. S. Barzilai and M. Weinstock, "Measuring epistemic thinking within and across topics: A scenario based approach," Contemporary Educational Psychology, Vol. 42, pp. 141-158, 2015. https://doi.org/10.1016/j.cedpsych.2015.06.006
  23. S. Barzilai, Y and Eshet-Alkalai, "The role of epistemic perspectives in comprehension of multiple author viewpoints," Learning and Instruction, Vol. 36, pp. 86-103, 2015. https://doi.org/10.1016/j.learninstruc.2014.12.003
  24. A. Reznitskaya and R. C. Anderson, "The argument schema and learning to reason," In C.C. Block & M. Pressley (Eds.), Comprehension instruction: Research-based best practices, pp. 319-334, New York: Guilford, 2002.
  25. C. R. Wolfe and M. A. Britt, "Locus of the myside bias in written argumentation," Thinking & Reasoning, Vol. 14, pp. 1-27, 2008. https://doi.org/10.1080/13546 78070 1527674
  26. C. R. Wolfe, "Individual differences in the "myside bias" in reasoning and written argumentation," Written Communication, Vol. 29, No. 4, pp. 477-501, 2012. https://doi.org/10.1177/0741088312457909
  27. D. McNamara, L. K. Allen, S. A. Crossley, M. Dascalu, and C. A. Perret, "Natural language processing and learning analytics," In Lang, C., Siemens, G., Wise, A. F., and Gaevic, D. (Eds.), The handbook of learning Analytics, 1st ed. pp. 93-104. Society for Learning Analytics Research (SoLAR), Alberta, Canada, 2017.
  28. J. Miller, and A. Iglesias, Systematic Analysis of Language Transcripts (SALT) (Research Version 2012) [Computer software]. SALT Software, 2012.
  29. B. MacWhinney, The CHILDES project: Tools for analyzing talk (3rd ed.). Erlbaum, 2000.
  30. S. Knight and S. Buckingham Shum, "Theory and learning analytics," In Lang, C., Siemens, G., Wise, A. F., and Gaevic, D., editors, The handbook of learning analytics, 1st ed. pp. 17-22, Society for Learning Analytics Research (SoLAR), Alberta, Canada, 2017.
  31. S. Joksimovic, V. Kovanovic, and S. Dawson, "The journey of learning analytics," HERDSA Review of Higher Education, Vol. 6, pp. 37-63, 2019.
  32. A. C. Graesser, D. S. McNamara, and J. M. Kulikowich, "Coh-Metrix: Providing multilevel analyses of text characteristics," Educational Researcher, Vol. 40, No. 5, pp. 223-234, 2011. https://doi.org/10.3102/0013189X11413260
  33. L. K. Allen, M. E. Jacovina, and D. S. McNamara, "Computer-based writing instruction," In C. A. MacArthur, S. Graham & J. Fitzgerald (Eds.), Handbook of writing research, 2nd ed. pp. 316-329, New York: The Guilford Press, 2016.
  34. N. M. Dowell, A. C. Graesser, and Z. Cai, "Language and discourse analysis with Coh-Metrix: Applications from educational material to learning environments at scale," Journal of Learning Analytics, Vol. 3, No. 3, pp. 72-95, 2016. https://doi.org/10.18608/jla.2016.33.5
  35. J. W. Pennebaker, R. L. Boyd, K. Jordan, and K. Blackburn, The development and psychometric properties of LIWC2015. Austin, TX: University of Texas at Austin, 2015.
  36. J. W. Pennebaker, C. K. Chung, J. Frazee, G. M. Lavergne, and D. I. Beaver, "When small words foretell academic success: The case of college admissions essays," PLOS ONE, Vol. 9, No. 12, 2014. https://doi.org/10.1371/journal.pone.0115844
  37. M. Cho and Y. S. G. Kim, "Do second graders adjust their language by discourse context?" Language, Speech, and Hearing Services in Schools, pp. 1-15, 2023. https://doi.org/10.1044/2022LSHSS-22-00100
  38. M. L. Newman, J. W. Pennebaker, D. S. Berry, and J. M. Richards, "Lying words: Predicting deception from linguistic styles," Personality and Social Psychology Bulletin, Vol. 29, No. 5, pp. 665-675, 2003. https://doi.org/10.1177/0146167203029005010
  39. E. Kacewicz, J. W. Pennebaker, M. Davis, M. Jeon, and A. C. Graesser, "Pronoun use reflects standings in social hierarchies," Journal of Language and Social Psychology, Vol. 33, No 2, pp. 125-143, 2014. https://doi.org/10.1177/0261927X13502654
  40. M. A. Cohn, M. R. Mehl, and J. W. Pennebaker, "Linguistic markers of psychological change surrounding S eptember 11, 2001," Psychological Science, Vol. 15, No. 10, pp. 687-693, 2004. https://doi.org/10.1111/j.0956-7976.2004.00741.x