• Title/Summary/Keyword: National assessment of educational achievement system

Search Result 26, Processing Time 0.026 seconds

Development and Using for Practical Model of Performance Assessment in The Earth Science Education (지구과학 수행평가 모형의 개발 및 활용방안)

  • Kim, Sang-Dal;Choi, Sung-Bong;Han, Sang-A
    • Journal of the Korean Society of Earth Science Education
    • /
    • v.1 no.1
    • /
    • pp.1-13
    • /
    • 2008
  • The purpose of this research is to accomplish the goal of science education based in the seventh science course of study by suggesting the plan for development of executable method in the learning process of Earth Science education and establishing a practical model to evaluate its achievement. Furthermore, the idea of this research is to recognize a way of using and consideration at practical use of the model. Since the purpose of the educational evaluation is to maximize the efficiency of school studying, there are some negative aspects in our current method of evaluation to achieve the purpose. New system has been introduced into the educational evaluation to resolve such a critical issue. Despite some positive aspects in the system, it could not be escaped from the multiple choice and pens examination. This could be caused by in various limitations, especially the insufficiency of teachers' awareness and the data about the Performance assessment. This research is to develop and use the practical model for the Performance assessment in consideration of current educational circumstances of Junior and High school. The model of the Performance assessment in this research is to sufficiently evaluate student's ability and skill in the learning process of Earth Science education. Hence, it is dedicated to the education for human being and improve quality in the learning process of the Earth Science education among the modern society, which is characterized globalization and information. Furthermore, it may promote the growth of various character of students and increase creativity and skill for the problem solving.

  • PDF

Analysis on Evaluation Inquiry of Lectures for the Improvement on University Lecture Quality - Focused on Liberal Art Courses of Engineering and Science Schools at SNU - (대학 강의 질 개선을 위한 강의 평가 문항 분석 - 서울대학교 이공계열 교양과목을 중심으로 -)

  • Lee H.W.;Kang H.S.;Jung Y.S.;Heo E.
    • Journal of Engineering Education Research
    • /
    • v.8 no.4
    • /
    • pp.52-63
    • /
    • 2005
  • National competitiveness is related directly to the strength of educational competitiveness of universities. Seoul National University (SNU) has been taking efforts to improve its competitiveness in University education in variety of ways and the classroom assessment is one key example of those. The current classroom assessment system practiced at universities is being used to evaluate courses and professors in charge by the university administration or evaluation committee. The classroom assessment system is not intended to put students and professors as the subject of the evaluation. In this case, the evaluation is intended wrongfully to rank the courses and evaluate professors' achievement by assigning grades on the lectures. Instead, a proper classroom assessment system should be targeted to improve the quality of lectures by encouraging communication among professor and students in the classroom. In this study, it was intended to investigate a suitable classroom assessment system to enhance the effectiveness of education, not to rank the courses and evaluate professors' achievement. For this purpose, research has been carried out to investigate opinions of professors at SNU on the criteria of classroom assessment and to analyze the criteria of classroom assessment at other domestic universities in Korea. The inquiries for feedback on the lecture by the student in the class was analyzed. The current classroom assessment system at SNU was reviewed and an improvement plan was devised to evaluate liberal art courses of engineering and science schools at SNU. In this research, the problems in the classroom assessment system was reviewed and improvement points were searched to utilize the classroom assessment system more effectively for the improvement of lecture quality.

Associations among Perceptional Typology with Computer Based Assessment, Computer Efficacy, Personality, and Academic Achievement (컴퓨터기반평가(Computer Based Assessment: CBA) 인지유형과 컴퓨터 효능감, 성격, 학업성취와의 관계)

  • Kim, Jin-Young
    • Journal of Digital Convergence
    • /
    • v.17 no.4
    • /
    • pp.13-18
    • /
    • 2019
  • The purposes of the present study were finding out educational implications and enhancing the efficient use of computer-based assessments (CBA) in class designes. This paper examined associations of CBA perceptional typology, academic achievement, personality, and computer efficacy. Participants were fifty senior students who took more than 50% of CBA classes in a university that introduces online learning-based system (LMS) with CBA. As a result, there were significant differences between CBA types and GPA and between CBA types and personality. In other words, the CBA adjustment type showed the highest GPA score and CBA dissatisfaction/paper test preference type showed the lowest GPA. Similarly, in terms of personality, CBA adjustment typology was significantly higher conscientiousness than other types. CBA dissatisfaction type had the lowest score of conscientiousness. In addition, the higher the level of conscientiousness, agreeableness and neuroticism, the higher the GPA score. This study is meaningful in that it is the first attempt to seek links CBA type with academic achievement and personality.

Exploring Differences of Student Response Characteristics between Computer-Based and Paper-Based Tests: Based on the Results of Computer-Based NAEA and Paper-Based NAEA (컴퓨터 기반 평가와 지필평가 간 학생 응답 특성 탐색 -컴퓨터 기반 국가수준 학업성취도 평가 병행 시행 결과를 중심으로-)

  • Jongho Baek;Jaebong Lee;Jaok Ku
    • Journal of The Korean Association For Science Education
    • /
    • v.43 no.1
    • /
    • pp.17-28
    • /
    • 2023
  • In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.

A blueprint for designing and developing the listening and the reading test of National English Ability Test (NEAT): Item-types decision-making model (국가영어능력평가시험(NEAT)의 검사지 구성의 원칙과 절차: 문항 유형 확정 모델)

  • Kim, Yong-Myeong
    • English Language & Literature Teaching
    • /
    • v.16 no.4
    • /
    • pp.153-184
    • /
    • 2010
  • On the bases of the 5 principles and the 4 criteria for designing and developing of the listening and the reading test of National English Ability Test (NEAT), this study presents Item-Types Decision-Making Model as a blueprint for designing and constructing the two tests. It sets up the criteria for validating item types, designs a modular type of test specifications, constructs an item-types bank, and specifies a complementary type of test specifications of the two tests. To gather all these threads up, it constructs Item-Types Decision-Making Model which consists of such components as the item-type pool, the validity criteria and the procedures of testing item types, the item-types bank, the modular and the complementary type test specification. Thus, it shows how the Model works in developing and constructing the two level-differentiated listening and reading tests (the 2nd and the 3rd rank) of NEAT. Finally, it discusses some implications and applications of the Model to the two level-differentiated tests (the A and the B type) of 2014 CSAT (College Scholastic Ability Test) systems, National Assessment of Educational Achievement (NAEA), and classroom testing. In conclusion, Item-Types Decision-Making Model functions as a testing template in an item development system and as a matrix in an item-types bank system.

  • PDF

An Analysis and the Improvement of Jeju Self-Governing School Policy (제주형 자율학교 정책 분석 및 발전방향)

  • Lee, In-Hoi
    • Journal of Digital Convergence
    • /
    • v.13 no.2
    • /
    • pp.23-34
    • /
    • 2015
  • The purpose of this study is to analyze comprehensively Jeju Self-Governing School Policy (JSSP) by using the four dimensional views of policy theory frame and to suggest its improvements. The results are as follows: First, JSSP should improve differentiation of curriculum and locality centered on local basis, wide application of the special laws, and professional accountability. Second, JSSP should improve the policy structure of educational governance and differentiated standard of students achievement assessment, resolve equity issue, and secure the self-finance of the schools. Third, JSSP should improve localization of educational administration, administrative and financial support for teachers, parent's empowerment, and students understanding of the policy, and expand principal invitation system, Fourth, JSSP should improve public relations, the roles of the Council and professionalism of assessors, and adopt efficiency approach into the assessment system.

Automatic Scoring System for Korean Short Answers by Student Answer Analysis and Answer Template Construction (학생 답안 분석과 정답 템플릿 생성에 의한 한국어 서답형 문항의 자동채점 시스템)

  • Kang, SeungShik;Jang, EunSeo
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.5
    • /
    • pp.218-224
    • /
    • 2016
  • This paper proposes a computer-based practical automatic scoring system for Korean short answers through student answer analysis and natural language processing techniques. The proposed system reduces the overall scoring time and budget, while improving the ease-of-use to write answer templates from student answers as well as the accuracy and reliability of automatic scoring system. To evaluate the application of the automatic scoring system and compare to the human scoring process, we performed an experiment using the student answers of social science subject in 2014 National Assessment of Educational Achievement.

A Longitudinal Trend Analysis in Scientific Knowledge Achievement Progress (초.중.고 학생들의 과학 지식 성취 수준 추이 분석을 위한 종단적 연구)

  • Kwon, Jae-Sool;Choi, Byung-Soon;Kwon, Chi-Soon;Yang, Il-Ho;Lee, Gyoung-Ho;Kim, Ji-Na
    • Journal of The Korean Association For Science Education
    • /
    • v.19 no.2
    • /
    • pp.185-193
    • /
    • 1999
  • The long term trend of studensts' science achievement is a very important factor to check the effectiveness of science educational policy. However, up to date no such effort to understand the trend of Korean students' science achievement has been put into action. Recently, the Science Education Center in Korea National University of Education has been attempted to collect nation wide data for students' science achievement. The first part of the effort was to develop item pools. This study was the second part to collect nation wide data and to check any change during the two year time interval. In this study, the item pools developed by Kwon et. al.(1998) were used with some modification. The data were collected two times; February 1997 and March 1999. The subjects collected nationally were 8,766 students in 1997 and were 4,398 in 1999. The subjects were collected randomly but stratified by region and sex. As the results, the trends of achievement change during the two years were different from elementary to high school. The achievement scores were decreased in elementary schools and increased in high school. In case of middle schools, the change was not significant. However, even in elementary schools the knowledge on theory was increased significantly while knowledge on facts and principles were decreased. In contrast, the knowledge on fact showed the most increase in high schools. In this study, the data were analysed in light of region, sex, behavioral objective levels(ability) and context of test items. The science achievement monitoring system developed by the Science Education Center in Korea National University of Education can be an effective tool for monitoring students' achievement on the national level.

  • PDF

Application Methods and Development Assessment Tools for Creative Convergence Education Programs for Elementary and Secondary Schools based on Hyper Blended Practical Model (하이퍼 블렌디드 실천모델 기반 초·중등 창의 융합 교육 프로그램 평가도구 개발 및 적용 방안)

  • Choi, Eunsun;Park, Namje
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.2
    • /
    • pp.117-129
    • /
    • 2022
  • The ability to creatively pursue new knowledge and perspectives across various disciplines has established itself as a basic literacy for living in the 21st-century convergence era. With the development of various creative education programs, assessment tools that can objectively and systematically evaluate learners' academic achievement are also required. Therefore, this paper proposed the self assessment, peer assessment, creativity assessment, and reflection tool based on the hyper blended practical model as assessment tools for creative convergence education programs for elementary and secondary school students. The developed assessment tools attempted to develop more completed evaluation methods by modifying two items and deleting four items through validity tests. In addition, the evaluation tool was applied to 596 elementary and secondary school students nationwide, and the application results were analyzed through one-way ANOVA and Wordcloud system. As a result of the analysis, it was found that the self assessment and the reflection tool need to develop questions according to the grade group. In addition, we proposed to use these assessment tools in blended classes or various educational activities in the changing classroom environment. We hope that this paper provides implications for developing evaluation systems and tools for creative convergence education.

Developing and Assessing a Learning Progression for the Ecosystem (생태계에 대한 학습발달과정의 개발과 평가)

  • Yeo, Chaeyeong;Lee, Hyonyong
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.29-43
    • /
    • 2016
  • There have been much efforts to reconstruct the science curriculum focusing on Disciplinary Core Ideas(DCI) in many countries such as America and Europe, the most practical effort has been to design a curriculum with learning progressions(LPs). LPs describe stepwise how students can systematically move toward the understanding of more sophisticated ideas or scientific activities and explain in succession the process of understanding the ideas while the students learn. In this study, a LP for ecosystems has been developed, and the developed LP is then evaluated accordingly. The Ecosystem is one of the DCI of the life science in Next Generation Science Standards(NGSS). The development process of the LP was set at step 4(Development, Assessment, Analysis, and Amendment), and developed through an iterative process of sequences. As a result of analyzing the developed LP, an assessment based on the LP provides reliable information to identifying student ability. This study proposes the development process of the LP and its methodological aspects to use Core Achievement Standards, Ordered Multiple-Choice items and the Rasch model. In addition, using the empirically proven LP suggests a way of strengthening curriculum linked to educational content, teaching methods and assessment. Utilizing the proposed development process in this study will be to present the standard into the direction of becoming part of the curriculum. Currently, the state of domestic research for the LP is still lacking. This study determined the development process of the LP and the need to conduct future research on the LPs.