International Journal of Computer Science & Network Security

International Journal of Computer Science & Network Security (국제컴퓨터통신보호논문지학회)
권호 표지
DOI QR코드

DOI QR Code

The Effectiveness of the Use of Distance-Evaluation Tools and Methods among Students with Learning-Difficulties from the Teachers' Point of View

  • Almaleki, Deyab A. (Department of Evaluation, Measurement and Research, Umm Al-Qura University) ;
  • Khayat, Wejdan W. (Department of Evaluation, Measurement and Research, Umm Al-Qura University) ;
  • Yally, Taghreed F. (Department of Evaluation, Measurement and Research, Umm Al-Qura University) ;
  • Al-hajjaji, Aysha A. (Department of Evaluation, Measurement and Research, Umm Al-Qura University)
  • Received : 2021.05.05
  • Published : 2021.05.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study aimed to identify the effectiveness of the use of distance-evaluation tools and methods among students with learning difficulties from the teachers' point of view, to achieve this goal. A scale was built, and the psychometric characteristics were validated. It consisted, in its final form, of 17 items distributed on four axes, in addition to three open questions. It was applied to a random sample of (149) teachers of students with learning difficulties in Makkah Region. The results showed that teachers' keenness to encourage students with learning difficulties, so that they would not feel frustrated with the distance learning process. It was also evident that teachers did not use achievement portfolios in the evaluation process. In connection with the appropriate evaluation methods, the majority indicated the use of work sheets and visual evaluation methods that rely on audio and visual skills, such as presenting videos, pictures, audio and games, and applying short objective tests. Among the proposals to improve evaluation methods and tools: Individual evaluation, attention to individual treatment, obligating personal attendance of students to school, splitting the required tasks, and not increasing the skills required to be mastered. As for the obstacles that teachers face: Lack of time, difficulty in communicating with students with distance learning difficulties and problems related to the Internet such as interruption, weakness, or lack of availability.

Keywords

References

  1. L. A. Alea, M. F. Fabrea, R. D. A. Roldan, and A. Z. Farooqi, "Teachers' Covid-19 awareness, distance learning education experiences and perceptions towards institutional readiness and challenges," Int. J. Learn. Teach. Educ. Res., vol. 19, no. 6, pp. 127-144, 2020.
  2. D. Almaleki, "Empirical Evaluation of Different Features of Design in Confirmatory Factor Analysis," 2016.
  3. M. Kara, F. Erdogdu, M. Kokoc, and K. Cagiltay, "Challenges faced by adult learners in online distance education: A literature review," Open Prax., vol. 11, no. 1, pp. 5-22, 2019. https://doi.org/10.5944/openpraxis.11.1.929
  4. C. S. Wardley, E. B. Applegate, A. D. Almaleki, and J. A. Van Rhee, "A comparison of Students' perceptions of stress in parallel problem-based and lecture-based curricula," J. Physician Assist. Educ., vol. 27, no. 1, pp. 7-16, 2016. https://doi.org/10.1097/JPA.0000000000000060
  5. E. T. Baloran, "Knowledge, attitudes, anxiety, and coping strategies of students during COVID-19 pandemic," J. Loss Trauma, vol. 25, no. 8, pp. 635-642, 2020. https://doi.org/10.1080/15325024.2020.1769300
  6. G. Basilaia and D. Kvavadze, "Transition to online education in schools during a SARS-CoV-2 coronavirus (COVID-19) pandemic in Georgia.," Pedagog. Res., vol. 5, no. 4, 2020.
  7. J. Daniel, "Education and the COVID-19 pandemic," Prospects, vol. 49, no. 1, pp. 91-96, 2020. https://doi.org/10.1007/s11125-020-09464-3
  8. C. S. Wardley, E. B. Applegate, A. D. Almaleki, and J. A. Van Rhee, "Is Student Stress Related to Personality or Learning Environment in a Physician Assistant Program?," J. Physician Assist. Educ., vol. 30, no. 1, pp. 9-19, 2019. https://doi.org/10.1097/JPA.0000000000000241
  9. G. T. Brown, "Is assessment for learning really assessment?," in Frontiers in Education, 2019, vol. 4, p. 64. https://doi.org/10.3389/feduc.2019.00064
  10. A. Podsiadlik, "The Blended Learning Experiences Of Students With Specific Learning Difficulties: A Qualitative Case Study Located In One British Higher Education Institution," Int. J. Disabil. Dev. Educ., pp. 1-16, 2021.
  11. K. Stalker, "Theorising the position of people with learning difficulties within disability studies: Progress and pitfalls," in Routledge handbook of disability studies, Routledge, 2019, pp. 158-171.
  12. T. Downer, M. Gray, and T. Capper, "Online learning and teaching approaches used in midwifery programs: A scoping review," Nurse Educ. Today, p. 104980, 2021.
  13. D. Almaleki, "Examinee Characteristics and their Impact on the Psychometric Properties of a Multiple Choice Test According to the Item Response Theory (IRT)," Eng. Technol. Appl. Sci. Res., vol. 11, no. 2, pp. 6889-6901, 2021. https://doi.org/10.48084/etasr.4056
  14. D. Almaleki, "Stability of the Data-Model Fit over Increasing Levels of Factorial Invariance for Different Features of Design in Factor Analysis," Eng. Technol. Appl. Sci. Res., vol. 11, no. 2, pp. 6849-6856, 2021. https://doi.org/10.48084/etasr.4047
  15. D. Almaleki, "The Precision of the Overall Data-Model Fit for Different Design Features in Confirmatory Factor Analysis," Eng. Technol. Appl. Sci. Res., vol. 11, no. 1, pp. 6766-6774, 2021. https://doi.org/10.48084/etasr.4025
  16. S. Dhawan, "Online learning: A panacea in the time of COVID-19 crisis," J. Educ. Technol. Syst., vol. 49, no. 1, pp. 5-22, 2020. https://doi.org/10.1177/0047239520934018
  17. M. Ebner et al., "COVID-19 epidemic as E-learning boost? Chronological development and effects at an Austrian university against the background of the concept of 'E-Learning Readiness,'" Future Internet, vol. 12, no. 6, p. 94, 2020. https://doi.org/10.3390/fi12060094
  18. B. O. Ogunleye and V. Island, "Strategies for reducing science learning difficulties at lower educational levels and promoting effective science education in Nigeria," KIU J. Educ., vol. 14, no. 1, pp. 141-154, 2019.
  19. P. Ferguson, M. McKenzie, D. Mercieca, D. P. Mercieca, and L. Sutherland, "Primary Head Teachers' construction and re-negotiation of care in COVID-19 lockdown in Scotland," in Frontiers in Education, 2021, vol. 6, p. 88.
  20. J. Neroni, C. Meijs, H. J. Gijselaers, P. A. Kirschner, and R. H. de Groot, "Learning strategies and academic performance in distance education," Learn. Individ. Differ., vol. 73, pp. 1-7, 2019. https://doi.org/10.1016/j.lindif.2019.04.007
  21. D. Vlachopoulos and A. Makri, "Online communication and interaction in distance higher education: A framework study of good practice," Int. Rev. Educ., vol. 65, no. 4, pp. 605-632, 2019. https://doi.org/10.1007/s11159-019-09792-3
  22. M. H. Rajab, A. M. Gazal, and K. Alkattan, "Challenges to online medical education during the COVID-19 pandemic," Cureus, vol. 12, no. 7, 2020.
  23. A. Fritz, V. G. Haase, and P. Rasanen, "International handbook of mathematical learning difficulties," Lab. Classr. Cham Springer, 2019.
  24. T. Hart, D. Bird, and R. Farmer, "Using blackboard collaborate, a digital web conference tool, to support nursing students placement learning: A pilot study exploring its impact," Nurse Educ. Pract., vol. 38, pp. 72-78, 2019. https://doi.org/10.1016/j.nepr.2019.05.009
  25. A. Ikhwan, "Management Of Learning Assessment Using Curriculum 2013 (Case Study In Islamic Primary School (MI) Muhammadiyah 5 Wonoasri Ponorogo-East Java-Indonesia)," MUADDIB Studi Kependidikan Dan Keislam., vol. 8, no. 2, pp. 108-123, 2019. https://doi.org/10.24269/muaddib.v8i2.1422
  26. I. A. Dominguez, M. del Mar Espinosa, L. Romero, and M. Dominguez, "Blended learning in industrial design," Hosted UNED Madr. Spain, p. 48.
  27. J. T. Clark, "Distance education," in Clinical engineering handbook, Elsevier, 2020, pp. 410-415.
  28. M. C. Reynolds, M. A. Sutherland, and I. Palacios, "Exploring the use of technology for sexual health risk-reduction among ecuadorean adolescents," Ann. Glob. Health, vol. 85, no. 1, 2019.
  29. T. Van Veen et al., "Potential of mobile health technology to reduce health disparities in underserved communities," West. J. Emerg. Med., vol. 20, no. 5, p. 799, 2019.
  30. M. Simonson, S. M. Zvacek, and S. Smaldino, "Teaching and Learning at a Distance: Foundations of Distance Education 7th Edition," 2019.
  31. M. Garcia-Alberti, F. Suarez, I. Chiyon, and J. C. Mosquera Feijoo, "Challenges and Experiences of Online Evaluation in Courses of Civil Engineering during the Lockdown Learning Due to the COVID-19 Pandemic," Educ. Sci., vol. 11, no. 2, p. 59, 2021. https://doi.org/10.3390/educsci11020059
  32. E. P. Marpa, "Technology in the teaching of mathematics: An analysis of teachers' attitudes during the COVID-19 pandemic," Int. J. Stud. Educ., vol. 3, no. 2, pp. 92-102, 2021. https://doi.org/10.46328/ijonse.36
  33. M. Churiyah, S. Sholikhan, F. Filianti, and D. A. Sakdiyyah, "Indonesia education readiness conducting distance learning in Covid-19 pandemic situation," Int. J. Multicult. Multireligious Underst., vol. 7, no. 6, pp. 491-507, 2020. https://doi.org/10.18415/ijmmu.v7i6.1833
  34. K. M. L'Ecuyer, "Clinical education of nursing students with learning difficulties: An integrative review (part 1)," Nurse Educ. Pract., vol. 34, pp. 173-184, 2019. https://doi.org/10.1016/j.nepr.2018.11.015
  35. T. Raharjo and S. Wimbarti, "Assessment of learning difficulties in the category of children with dyslexia," J. Konseling Dan Pendidik., vol. 8, no. 2, pp. 79-85, 2020. https://doi.org/10.29210/141600
  36. S. El Firdoussi, M. Lachgar, H. Kabaili, A. Rochdi, D. Goujdami, and L. El Firdoussi, "Assessing Distance Learning in Higher Education during the COVID-19 Pandemic," Educ. Res. Int., vol. 2020, 2020.
  37. J. B. Osuna, J. Gutierrez-Castillo, M. Llorente-Cejudo, and R. V. Ortiz, "Difficulties in the incorporation of augmented reality in university education: Visions from the experts," J. New Approaches Educ. Res. NAER J., vol. 8, no. 2, pp. 126-141, 2019. https://doi.org/10.7821/naer.2019.7.409
  38. K. E. Stonard, "'Technology was designed for this': Adolescents' perceptions of the role and impact of the use of technology in cyber dating violence," Comput. Hum. Behav., vol. 105, p. 106211, 2020. https://doi.org/10.1016/j.chb.2019.106211
  39. S. S. Tzanova and R. I. Radonov, "Evaluation of Multimedia Learning Materials in Microelectronics," in 2019 IEEE XXVIII International Scientific Conference Electronics (ET), 2019, pp. 1-4.
  40. Z. Ardi et al., "Exploring the elementary students learning difficulties risks on mathematics based on students mathematic anxiety, mathematics self-efficacy and value beliefs using rasch measurement," in Journal of Physics: Conference Series, 2019, vol. 1157, no. 3, p. 032095. https://doi.org/10.1088/1742-6596/1157/3/032095
  41. H. Kishino and M. Hasegawa, "Evaluation of the maximum likelihood estimate of the evolutionary tree topologies from DNA sequence data, and the branching order in Hominoidea," J. Mol. Evol., vol. 29, no. 2, pp. 170-179, 1989. https://doi.org/10.1007/BF02100115
  42. T. Strachan et al., "Using a Projection IRT Method for Vertical Scaling When Construct Shift Is Present," J. Educ. Meas., 2020.
  43. H. Swaminathan, R. K. Hambleton, and J. Algina, "Reliability of criterion-referenced tests: A decision-theoretic formulation," J. Educ. Meas., vol. 11, no. 4, pp. 263-267, 1974. https://doi.org/10.1111/j.1745-3984.1974.tb00998.x
  44. T. Strachan, E. Ip, Y. Fu, T. Ackerman, S.-H. Chen, and J. Willse, "Robustness of projective IRT to misspecification of the underlying multidimensional model," Appl. Psychol. Meas., vol. 44, no. 5, pp. 362-375, 2020. https://doi.org/10.1177/0146621620909894
  45. S. Tibi, A. A. Edwards, C. Schatschneider, L. J. Lombardino, J. R. Kirby, and S. H. Salha, "IRT analyses of Arabic letter knowledge in Kindergarten," Read. Writ., pp. 1-26, 2020.
  46. M. Krischler and I. M. Pit-ten Cate, "Pre-and in-service teachers' attitudes toward students with learning difficulties and challenging behavior," Front. Psychol., vol. 10, p. 327, 2019. https://doi.org/10.3389/fpsyg.2019.00327
  47. C. H. Liu, C. Stevens, S. H. Wong, M. Yasui, and J. A. Chen, "The prevalence and predictors of mental health diagnoses and suicide among US college students: Implications for addressing disparities in service use," Depress. Anxiety, vol. 36, no. 1, pp. 8-17, 2019. https://doi.org/10.1002/da.22830
  48. Z. Kaya, O. N. Kaya, S. Aydemir, and J. Ebenezer, "Knowledge of Student Learning Difficulties as a Plausible Conceptual Change Pathway Between Content Knowledge and Pedagogical Content Knowledge," Res. Sci. Educ., pp. 1-33, 2021. https://doi.org/10.1007/s11165-004-3952-x
  49. K. Baishya and H. V. Samalia, "Extending unified theory of acceptance and use of technology with perceived monetary value for smartphone adoption at the bottom of the pyramid," Int. J. Inf. Manag., vol. 51, p. 102036, 2020. https://doi.org/10.1016/j.ijinfomgt.2019.11.004
  50. S. Iftikhar, A. Saqib, M. R. Sarwar, M. Sarfraz, M. Arafat, and Q. Shoaib, "Capacity and willingness to use information technology for managing chronic diseases among patients: A cross-sectional study in Lahore, Pakistan," PloS One, vol. 14, no. 1, p. e0209654, 2019. https://doi.org/10.1371/journal.pone.0209654
  51. E. Mayhew, L. Stuttard, and B. Beresford, "An Assessment of the Psychometric Properties of the GHQ-12 in an English Population of Autistic Adults Without Learning Difficulties," J. Autism Dev. Disord., vol. 51, no. 4, pp. 1093-1106, 2021. https://doi.org/10.1007/s10803-020-04604-2
  52. C. Ellis, "The importance of e-portfolios for effective student-facing learning analytics," in E-portfolios in higher education, Springer, 2017, pp. 35-49.
  53. M. Sata and I. Karakaya, "Investigation of the Use of Electronic Portfolios in the Determination of Student Achievement in Higher Education Using the Many-Facet Rasch Measurement Model.," Educ. Policy Anal. Strateg. Res., vol. 15, no. 1, pp. 7-21, 2020. https://doi.org/10.29329/epasr.2020.236.1
  54. L. L. Briceland and R. A. Hamilton, "Electronic reflective student portfolios to demonstrate achievement of ability-based outcomes during advanced pharmacy practice experiences," Am. J. Pharm. Educ., vol. 74, no. 5, 2010.
  55. H. Pandya, W. Slemming, and H. Saloojee, "Reflective portfolios support learning, personal growth and competency achievement in postgraduate public health education," Afr. J. Health Prof. Educ., vol. 9, no. 2, pp. 78-82, 2017.
  56. M. R. Bebber, L. B. Spurlock, and M. Fisch, "A performance-based evaluation of chemically similar (carbonate) tempers from Late Prehistoric (AD 1200-1700) Ohio: Implications for human selection and production of ceramic technology," PloS One, vol. 13, no. 3, p. e0194992, 2018. https://doi.org/10.1371/journal.pone.0194992
  57. M. Marra, "The ambiguities of performance-based governance reforms in Italy: Reviving the fortunes of evaluation and performance measurement," Eval. Program Plann., vol. 69, pp. 173-182, 2018. https://doi.org/10.1016/j.evalprogplan.2017.02.006
  58. S. Wang et al., "Evaluation of performance-based outcome measures for the upper limb: a comprehensive narrative review," PM&R, vol. 10, no. 9, pp. 951-962, 2018. https://doi.org/10.1016/j.pmrj.2018.02.008
  59. R. Montuori, E. Nastri, V. Piluso, and P. Todisco, "A simplified performance based approach for the evaluation of seismic performances of steel frames," Eng. Struct., vol. 224, p. 111222, 2020. https://doi.org/10.1016/j.engstruct.2020.111222
  60. G. Ebaid and E. T. Leader, "The International Journal for Recording Achievement, Planning and Portfolios," Int. J. Rec. Achiev. Plan. Portf., p. 72.
  61. S. Lu, Y. Liu, Y. Li, and R. Wang, "Multidimensional performance-based evaluation method of high-performance cold source in green building," Energy Build., vol. 231, p. 110618, 2021. https://doi.org/10.1016/j.enbuild.2020.110618
  62. X. Zhang, Q. Zhang, T. Sun, Y. Zou, and H. Chen, "Evaluation of urban public transport priority performance based on the improved TOPSIS method: A case study of Wuhan," Sustain. Cities Soc., vol. 43, pp. 357-365, 2018. https://doi.org/10.1016/j.scs.2018.08.013
  63. A. Gaitan and D. Pritchard, "The International Journal for Recording Achievement, Planning and Portfolios," Int. J. Rec. Achiev. Plan. Portf., vol. 3, p. 6, 2017.
  64. R. P. Mills, "Using student portfolios to assess achievement," Educ. Dig., vol. 55, no. 8, p. 51, 1990.
  65. S. Kotlarski et al., "Observational uncertainty and regional climate model evaluation: A pan-European perspective," Int. J. Climatol., vol. 39, no. 9, pp. 3730-3749, 2019. https://doi.org/10.1002/joc.5249
  66. L. J. Moore et al., "Prospective Observational Evaluation of the ER-REBOA Catheter at 6 US Trauma Centers," Ann. Surg., 2021.
  67. L. Hu et al., "An observational study of deep learning and automated evaluation of cervical images for cancer screening," JNCI J. Natl. Cancer Inst., vol. 111, no. 9, pp. 923-932, 2019. https://doi.org/10.1093/jnci/djy225
  68. S. L. Campbell and M. Ronfeldt, "Observational evaluation of teachers: Measuring more than we bargained for?," Am. Educ. Res. J., vol. 55, no. 6, pp. 1233-1267, 2018. https://doi.org/10.3102/0002831218776216
  69. H. B. Edwards et al., "Use of a primary care online consultation system, by whom, when and why: evaluation of a pilot observational study in 36 general practices in South West England," BMJ Open, vol. 7, no. 11, 2017.
  70. M. P. Morato, O. L. P. da C. Furtado, D. H. Gamero, T. P. Magalhaes, and J. J. G. de Almeida, "Development and evaluation of an observational system for goalball match analysis," Rev. Bras. Cienc. Esporte, vol. 39, no. 4, pp. 398-407, 2017. https://doi.org/10.1016/j.rbce.2016.08.002
  71. C. Trevitt, A. Macduff, and A. Steed, "[e] portfolios for learning and as evidence of achievement: Scoping the academic practice development agenda ahead," Internet High. Educ., vol. 20, pp. 69-78, 2014. https://doi.org/10.1016/j.iheduc.2013.06.001
  72. F. Chen et al., "The predictive value of pre-recruitment achievement on resident performance in anesthesiology," J. Clin. Anesth., vol. 39, pp. 139-144, 2017. https://doi.org/10.1016/j.jclinane.2017.03.052
  73. A. Ghanizadeh, "The interplay between reflective thinking, critical thinking, self-monitoring, and academic achievement in higher education," High. Educ., vol. 74, no. 1, pp. 101-114, 2017. https://doi.org/10.1007/s10734-016-0031-y
  74. N. Barootchi and M. H. Keshavarz, "Assessment of achievement through portfolios and teacher-made tests," Educ. Res., vol. 44, no. 3, pp. 279-288, 2002. https://doi.org/10.1080/00131880210135313
  75. L. He et al., "Synchronous distance education vs traditional education for health science students: A systematic review and meta-analysis," Med. Educ., vol. 55, no. 3, pp. 293-308, 2021. https://doi.org/10.1111/medu.14364