Journal of Computing Science and Engineering

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지
DOI QR코드

DOI QR Code

A Model-Based Method for Information Alignment: A Case Study on Educational Standards

  • Choi, Namyoun (Mathematics/Information and Digital Systems Department, Immaculata University) ;
  • Song, Il-Yeol (College of Computing and Informatics, Drexel University) ;
  • Zhu, Yongjun (College of Computing and Informatics, Drexel University)
  • Received : 2016.09.10
  • Accepted : 2016.09.12
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

We propose a model-based method for information alignment using educational standards as a case study. Discrepancies and inconsistencies in educational standards across different states/cities hinder the retrieval and sharing of educational resources. Unlike existing educational standards alignment systems that only give binary judgments (either "aligned" or "not-aligned"), our proposed system classifies each pair of educational standard statements in one of seven levels of alignments: Strongly Fully-aligned, Weakly Fully-aligned, Partially-$aligned^{***}$, Partially-$aligned^{**}$, Partially-$aligned^*$, Poorly-aligned, and Not-aligned. Such a 7-level categorization extends the notion of binary alignment and provides a finer-grained system for comparing educational standards that can broaden categories of resource discovery and retrieval. This study continues our previous use of mathematics education as a domain, because of its generally unambiguous concepts. We adopt a materialization pattern (MP) model developed in our earlier work to represent each standard statement as a verb-phrase graph and a noun-phrase graph; we align a pair of statements using graph matching based on Bloom's Taxonomy, WordNet, and taxonomy of mathematics concepts. Our experiments on data sets of mathematics educational standards show that our proposed system can provide alignment results with a high degree of agreement with domain expert's judgments.

Keywords

References

  1. N. Choi, I. Y. Song, and H. Han, "A survey on ontology mapping," ACM SIGMOD Record, vol. 35, no. 3, pp. 34-41, 2006. https://doi.org/10.1145/1168092.1168097
  2. W. M. P. van der Aalst, "Business alignment: using process mining as a tool for Delta analysis and conformance testing," Requirement Engineering, vol. 10, no. 3, pp. 198-211, 2005. https://doi.org/10.1007/s00766-005-0001-x
  3. E. Rahm and P. A. Bernstein, "A survey of approaches to automatic schema matching," The VLDB Journal, vol. 10, no. 4, pp. 334-350, 2001. https://doi.org/10.1007/s007780100057
  4. S. Melnik, H. Garcia-Molina, and E. Rahm, "Similarity flooding: a versatile graph matching algorithm and its application to schema matching," in Proceedings of the 18th International Conference on Data Engineering, San Jose, CA, 2002, pp. 117-128.
  5. H. B. Mitchell, Multi-Sensor Data Fusion: An Introduction, Berlin: Springer, 2007.
  6. North Dakota Department of Public Instruction, North Dakota Standards and Assessments Development Protocols, Bismarck, ND: North Dakota Department of Public Instruction, 2002.
  7. L, Hamilton, B. Stecher, and K. Yuan, "Standards-based reform in the United States: History, research, and future directions," Rand Education, Santa Monica, CA, 2008.
  8. Instron, http://www.instron.com.
  9. S. A. Sutton and D. Golder, "Achievement Standards Network (ASN): an application profile for mapping K-12 educational resources to achievement standards," in Proceedings of the International Conference on Dublin Core and Metadata Applications, Berlin, Germany, 2008, pp. 69-79.
  10. O. Yilmazel, N. Balasubramanian, S. C. Harwell, J. Bailey, A. R. Diekema, and E. D. Liddy, "Text categorization for aligning educational standards," in Proceedings of the Hawaii International Conference on System Sciences, Waikoloa, HI, 2007.
  11. A. R. Diekema and E. D. Liddy, "Computer-assisted content standard assignment & alignment," presented at the National Science Digital Library Annual Meeting, Chicago, IL, 2004.
  12. G. Nasstrom and W. Henriksson, "Alignment of standards and assessment: a theoretical and empirical study of methods for alignment," Electronic Journal of Research in Educational Psychology, vol. 6, no. 3, pp. 667-690, 2008.
  13. J. B. Biggs, Teaching for Quality Learning at University, New York, NY: Open University Press, 1999.
  14. N. L. Webb, "Alignment of science and mathematics standards and assessments in four states (Research Monograph No. 18)," National Institute for Science Education, Madison, WI, 1999.
  15. P. M. La Marca, "Alignment of standards and assessments as an accountability criterion," Practical Assessment, Research & Evaluation, vol. 7, article no. 21, 2001.
  16. S. Ananda, "Achieving alignment," Leadership, vol. 33, no. 1, pp. 18-21, 2003.
  17. Align to Achieve, http://www.aligntoachieve.com.
  18. McREL International, http://www.mcrel.org.
  19. N. Choi, I. Y. Song, and Y. An, "Developing and analyzing the MP (Materialization Pattern) model for math educational standards," Journal of Universal Computer Science, vol. 16, no. 17, pp. 2394-2414, 2010.
  20. North Carolina Standards, "ACRE: Accountability and Curriculum Reform Effort," http://www.ncpublicschools.org/acre/standards/.
  21. S. W. Ambler, "UML 2 class diagrams: an agile introduction," http://www.agilemodeling.com/artifacts/classDiagram.htm.
  22. R. Skvarcius and W. B. Robinson, Discrete Mathematics with Computer Science Applications, Menlo Park, CA: Benjamin-Cummings Publishing, 1986.
  23. B. S. Bloom, Taxonomy of Educational Objectives: The Classification of Educational Goals, New York: Longmans, 1956.
  24. A. Reed, and B. Kellogg, Graded Lessons in English: An Elementary English Grammar, Consisting of One Hundred Practical Lessons, Carefully Graded and Adapted to the Class-Room, New York: Maynard, Merrill & Company, 1897.
  25. G. Booch, J. Rumbaugh, and I. Jacobson, The Unified Modeling Language User Guide, 2nd ed., Upper Saddle River, NJ: Addison-Wesley, 2005.
  26. C. Fellbaum, WordNet: An Electronic Lexical Database, Cambridge, MA: The MIT Press, 1998.
  27. R. Barzilay and N. Elhadad, "Sentence alignment for mono lingual comparable corpora," in Proceedings of the Conference on Empirical Methods in Natural Language Processing, Sapporo, Japan, 2003, pp. 25-32.
  28. P. Resnik, "Semantic similarity in a taxonomy: an information-based measure and its application to problems of ambiguity in natural language," Journal of Artificial Intelligence Research, vol. 11, pp. 95-130, 1999. https://doi.org/10.1613/jair.514
  29. T. Simpson and T. Dao, "WordNet-based semantic similarity measurement," 2016; http://www.codeproject.com/Articles/11835/WordNet-based-semantic-similarity-measurement.
  30. Z. Wu, and M. Palmer, "Verb semantics and lexical selection," in Proceedings of the Annual Meeting on Associations for Computational Linguistics, Las Cruces, New Mexico, 1994, pp. 133-138.
  31. N. Choi, "A semi-automatic alignment method for math educational standards using the MP (Materialization Pattern) model," Ph.D. dissertation, Drexel University, PA, 2011.
  32. J. Cohen, "Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit," Psychological Bulletin, vol. 70, no. 4, pp. 213-220, 1968. https://doi.org/10.1037/h0026256
  33. J. L. Fleiss, Statistical Methods for Rates and Proportions, 2nd ed., New York: John Wiley & Sons, 1981, pp. 38-46.