• Journal of Science Education
• /
• v.36 no.2
• /
• pp.293-302
• /
• 2012

The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.38 no.5
• /
• pp.42-52
• /
• 2010

This research analyzed the overall issues pertaining to the questions that appear in the professional landscape architect screening system to assess 1he recognition of test-takers when it comes to the test questions in terms of the question objectivity, appropriateness, difficulty level and so forth The purpose of this is to present a set of recommendations so that the screening system can he improved and the professional landscape architect screening system consolidate its position. This in turn can help the professional landscape architect qualification process consolidate its position and improve the status of the landscape area in the industrial field. The research of this study was conducted for the all-round development of Landscape Architecture. The research method was divided into two stages, and a group of experts was leveraged to study subjects that are tested and subjects allocated. A survey was conducted of candidates and certification holders to assess the questions that appear in the test in terms of their level, objectivity, difficulty level, tendency of questions and so forth. Firstly, the study demonstrated that the subjects tested in the professional landscape architect test are different from the testing subjects that are suggested in the enforcement ordinance of the National Technical Professional Law. In addition, o1her problems include the overvaluation of a subject for testing, a lack of objectivity in testing, and difficulty level adjustment of questions. One main reason for many of these kinds of problems is that the questions appeared without thorough review and there is a lack of management concerning the members of the commtittee that develops the question. Accordingly, to make up for these problems, a viable screening system such as the reorganization of subjects that are tested, assigning suitable subjects, securing of question objectivity, and difficulty level of developed questions are necessary.

• Journal of Gifted/Talented Education
• /
• v.22 no.1
• /
• pp.117-139
• /
• 2012

This study compared the cognitive conflict on peer instruction concerning the level of difficulty in question, between middle school science gifted students and non-gifted students. For the study, 35 the 7th grade science-gifted students in the organization affiliated with Science Education Institute for the Gifted in Seoul and Gyeong-gi province, and 14 the 8th grade science-gifted students, and 71 the 8th grade students. They performed peer instruction on propagation of straight light and composition of light and then, discussed three concept problems. After discussing the students took paper pencil test about changing levels of cognitive conflict. Regardless of the level of difficulty in question, the science-gifted students showed meaningful decreased figures on cognitive re-evaluation factors after peer-discussion. They trusted their peers, so during discussion, they explained their concepts. Furthermore discussion process enabled them to do reflective thinking. consequently, discord of students dropped, and total figures of cognitive conflict also declined. Science-gifted students have a tendency to worry lower than general students, though they felt anxiety as difficulty of the problems after peer-discussion. Through peer-discussion, science-gifted students presented statically decreased anxiety factors. By means of analyzed results of changing cognitive conflict of science-gifted students, developing and adapting strategies of cognitive conflict considering learner characteristics of science-gifted students is needed.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.431-438
• /
• 2003

In this study, we have developed a web-based adaptive testing system using item response theory´s computerized adaptive testing to diagnose underachievers, and to check the evaluation results immediately. Adaptive testing system simple is not the fact that it presents a question to students. It calculates information of a question and presents the question to students. It controls the response of the students under extraction conditions of the next question. It extracts the question which is the most suitable it presents. In this adaptive testing system, you can extract questions according to the level of the students, and adjust the length and the level of the difficulty according to the response of the students.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.12
• /
• pp.2232-2238
• /
• 2008

Most questions made for remote examinations on E-learning databank based selection system use methods of making questions automatically using degrees of difficulty. This method is the kernel of a question selection that degrees of difficulty as make test questions, and then needs continuous management for degrees of difficulty. This paper presents improved algorithms for dynamically adjustment of degrees of difficulty based on examination result that is more efficient sot of questions. We identified this algorithm is more effective as compared with previous algorithms on web-based education systems.

• International Journal of Contents
• /
• v.15 no.3
• /
• pp.1-6
• /
• 2019

The purpose of this study was to identify the psychometric properties of the vocational ability scale used in the 8th Panel Survey of Employment for the Disabled in Korea by using the Rasch model. The sample data was collected from 398 individuals with intellectual disabilities. Item fitness, item difficulty, the appropriateness of the rating scale, and the separation index of the vocational ability scale were evaluated. All 15 items show an appropriate fitness level. The analysis of item difficulty indicate that modifications are required. Specifically, the need for the addition of less difficult question items is identified. The use of a 5-point rating scale is shown to decrease the test difficulty in terms of clarity and readability when appropriate and a 4-point modification is also determined as appropriate. With respect to the outcomes of the analysis, the person separation reliability value and separation index are high, and the reliability of the items is also high.

• The Journal of Korean Association of Computer Education
• /
• v.6 no.2
• /
• pp.1-8
• /
• 2003

In existing the learner testing system, it has a weak point to determine differently the difficulty of each question which has been estimated by teacher's view and the subjective stand point. In this paper, we develops the learner testing system which supports the estimation of the individual ability of learner, provides the questions for suitable to the individual learner level, and able to estimate the question of individual that used by three parameters such as the difficulty parameter, discrimination parameter, and guessing parameter. Also, it is applied to three-parameters logistic model of IRT(Item Response Theory) for using CAT(Computer Adaptive Testing) technique.

• The KIPS Transactions:PartA
• /
• v.15A no.2
• /
• pp.125-134
• /
• 2008

We implemented a system being able to suggest example sentences for multiple choice tests, considering the level of students. To build the system, we designed an automatic method for sentence generation, which made it possible to control the difficulty degree of questions. For the proper evaluation in the multiple choice tests, proper size of question pools is required. To satisfy this requirement, a system which can generate various and numerous questions and their example sentences in a fast way should be used. In this paper, we designed an automatic generation method using a linguistic resource called WordNet. For the automatic generation, firstly, we extracted keywords from the existing sentences with the morphological analysis and candidate terms with similar meaning to the keywords in Korean WordNet space are suggested. When suggesting candidate terms, we transformed the existing Korean WordNet scheme into a new scheme to construct the concept similarity matrix. The similarity degree between concepts can be ranged from 0, representing synonyms relationships, to 9, representing non-connected relationships. By using the degree, we can control the difficulty degree of newly generated questions. We used two methods for evaluating semantic similarity between two concepts. The first one is considering only the distance between two concepts and the second one additionally considers positions of two concepts in the Korean Wordnet space. With these methods, we can build a system which can help the instructors generate new questions and their example sentences with various contents and difficulty degree from existing sentences more easily.

• The Journal of the Korea Contents Association
• /
• v.11 no.2
• /
• pp.13-21
• /
• 2011

It is not easy to develop the system as the subjective-type evaluation has the difficulty in natural language processing. This thesis designs and implements the automatic evaluation system with natural language processing technique. To solve the degradation of general evaluation system, we define the question type and improve the performance of evaluation through the adaptive process for each question type. To evaluate the system, we analyze the correlation between human evaluation and term-based evaluation, and between human evaluation and this system evaluation. We got the better result than term-based evaluation. It needs to expand the question type and improve the adaptive processing technique for each type.

• Journal of the Korean School Mathematics Society
• /
• v.13 no.2
• /
• pp.323-343
• /
• 2010

The purpose of the study was to analyze difficulty analyzed through a quantitative method examining rate of correct answerers to each questions in the side of difficulty that students solving questions felt by finding variables to predict difficulty of questions in an objective way, not in an intuitive way, and examining what variables difficulty that each student solving questions felt depended on. The study divided 6 students in the 3rd grade of a high school into a two-person group or a three-person group and observed their question-solving process the total 11times for three months from March, to May. The study an alyzed what variables difficulty that each student felt depended on through semi-structuralized interview. As a result, the study could see that difficulty of questions depended on contents, strangeness of material, behavioral range, type of questions and complexity of questions.