• Journal of Gifted/Talented Education
• /
• v.12 no.4
• /
• pp.26-44
• /
• 2002

We have developed a tool and solution to test creativity level for science field. This test tool was considered 7 creativity elements. In development process, it was verified for contents validity, clarity of the item etc. The test developed in this study was analyzed item analysis after applying for 332 middle school students. As a results of item analysis, it showed meaningful(validity: 92%, item difficulty: $42%{\sim}73%$, reliability: 0.84, item discriminating power: $0.22{\sim}0.70$)over the level of a standard basis. This means that the test tool was useful in the test process of creativity level for science.

• Korean Journal of Child Studies
• /
• v.24 no.3
• /
• pp.135-149
• /
• 2003

This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

• Journal of Fisheries and Marine Sciences Education
• /
• v.18 no.1
• /
• pp.49-57
• /
• 2006

The purpose of this study was to develop and validate of mentoring-function scale for college students. This research collected preliminary data from 219 college students' responses for item and scale quality analyses, and collected 289 college students' for item and scale quality analyses. Data were analyzed to obtain item quality, reliability, and validity analysis. The results of this study were as follows; The mentoring-function scale was defined by 4 factors. The 4 factors were 'psycho-soical', 'career-development', 'role-modeling', 'friendship'. Criterion-related validity evidence was obtained from the correlation analysis as the criterion measures.

• Journal of the Korean Home Economics Association
• /
• v.39 no.1
• /
• pp.221-232
• /
• 2001

The purpose of this study was to develop a scale for evaluation of preschool children's peer competence and to examine its validity and reliability. The 15 items of the preliminary scale were completed by teachers, and peer rating scale for assessment of peer acceptance was administered to 365 children 5 to 6 years of age. The methods for data analysis included item analysis, factor analysis for construct validity, Pearson correlations between teacher's ratings of peer competence and children's ratings of peer acceptance for concurrent validity, and Cronbach's u for reliability. The 15 items of the scathe were found be satisfactory in terms of item response distribution and item discrimination. Factor analysis revealed that a 3-factor solution was the best fit: sociability, prosocial behavior, leadership in peer relations. Correlations between teacher's ratings and children's ratings were as significant. Cronbach'so ranged from .88 to .93 for three subscales and .93 for the total scale. It was concluded that the psychometric properties of the peer competence scale in general were acceptable for use.

• Journal of Fisheries and Marine Sciences Education
• /
• v.23 no.1
• /
• pp.13-22
• /
• 2011

The purpose of this study was to development and validation of the 'course evaluation' scale for learner-centered in university. The research collected preliminary data from 1,567 university students's responses for item and scale quality analyses, and collected 2,539 university students's for item and scale quality analyses, and 300 university professors's responses for validation. Data were analyzed to obtain item quality, reliability, and validity analysis. The results of the study were as follows; The 'course evaluation' scale for learner-centered in university was defined by 5 factors. The 5 factors were structure and sincerity of lecture, suitability of report and test, level of consulting for student, application of educational media, communication. The results of the confirmatory factor analysis confirmed five sub-scales in the 'course evaluation' scale for learner-centered in university scale. Criterion-related validity evidence was obtained from the correlation analysis as the criterion measures. Cross validity evidence was obtained from the confirmatory factor analysis in university professors.

• Women's Health Nursing
• /
• v.24 no.3
• /
• pp.297-309
• /
• 2018

Purpose: To develop Pregnancy Risk symptom Perception Scale (PRPS) and evaluate its validity and reliability. Methods: A preliminary 30-item version of PRPS was developed through literature review, in-depth interview, and Content Validity. Each item was scored on a four-point Likert scale. The preliminary scale was developed based on 301 pregnant women who visited a hospital. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson's correlation coefficients, and Cronbach's ${\alpha}$ (0.90 for total item, 0.80 to 0.88 for factors). Results: The PRPS consisted of 27 items. Three factors (physical, environmental, and emotional factors) explained 55% of the total variance. Cronbach's Criterion validity was supported by comparison with the Perception of Pregnancy Risk Questionnaire (r=0.34). In reliability test, the reliability coefficient of pregnancy risk symptom perception was high at 0.90. Conclusion: These results suggest that the pregnancy risk symptom perception scale developed in this study comprises items that can assess the level of pregnant women's pregnancy risk symptom perception in Korea. Its validity and reliability were proven. PRPS can be utilized to measure pregnant women's risk symptom perception during pregnancy. PRPS will contribute to the development of systematic prenatal care and effective risk management.

• Journal of Agricultural Extension & Community Development
• /
• v.4 no.1
• /
• pp.201-209
• /
• 1997

The objective of this study were 1) to review concepts of user information satisfaction (UIS), 2) to analyze tools for measuring user information satisfaction, 3) to identify factors affecting information satisfaction. The study was carried out by the analysis of literatures related to information system. The construct of UIS has been operationalized in many different ways. Several studies employed single-item rating scales; such scales have been criticized as unreliable. Single-item scales also provide little information as to what the user finds dissatisfying(satisfying) and are thus of limited utility outside a research setting. Multiple-item UIS measures have become increasingly common. Generally, they are of two types. The first focuses on the information system product. With such diverse names as "system acceptance", "output quality", and "appreciation", these scales focus on the content of the information system and the manner in which the information is presented. The second type of multiple-item scale includes the organizational support for developing and maintaining the system as well as the system product itself. This type of instrument contains items concerned with training, documentation, development procedures, systems maintenance, etc., as well as items related to system content. Thus it provides an indicator of the overall quality of information services provided by an information service function. Generally, UIS measures have not been carefully validated. Recently, however, several rigorous attempts have been made to develop valid and reliable UIS measure.

• Korean Journal of Child Studies
• /
• v.13 no.1
• /
• pp.16-37
• /
• 1992

The purpose of this study was the development of a scale to assess maternal anxiety after mother-child separation. Subjects consisted of 384 mothers who had children from 6 to .36 months of age. A questionnaire consisting of eighty Likert-type items and Spielberger's(1970) State Anxiety Scale were administered to mothers and data were analyzed using item analysis. factor analysis. multiple regression. Cronbach's ${\alpha}$. Pearson's correlation and F-test. Sixty of the eighty items were significant and deemed acceptible through item discrimination method with indices ranging from. 32 to .95. Factor analytic procedures have selected 54 items of the 60-item scale and supported a 5-factor solution. The subscales labeled 'Maternal Separation Anxiety'. 'Perception of Separation Effects on the Child', 'Desire for Physical Cuddling and Closeness'. 'Attitudes toward the Value or Importance of Exclusive Maternal Care' and 'Employment-related Separation Concerns,' Finally. a multiple regression analysis conducted to reduce the length of the scale yielded a 39-item form for the Maternal Separation Anxiety Scale(MSAS). Internal consistency of the MSAS was high(Cronbach's ${\alpha}$ =.85). The correlation of the MSAS with the Spielberger's State Anxiety measure yielded a coefficient of .36, revealing a moderate and positive relationship.

• School Mathematics
• /
• v.14 no.4
• /
• pp.517-529
• /
• 2012

Assessment in the school should be done consistently in accordance with the national curriculum. This study analyzed the process that preservice teachers developed the question items. The preservice teachers already equipped with the knowledge about the curriculum, didn't reflect it to items at first. However, in the review and modification process with colleague discussions, they get the curriculum coherence faithfully. And the item completeness gets higher such as to conform to the item intent, to help the students easily understand the item and to have the consistency between items.

• Journal of Engineering Education Research
• /
• v.26 no.3
• /
• pp.35-41
• /
• 2023

The study was conducted to develop two parallel short forms for the Convergent thinking and Problem solving questionnaires which are part of H University's core competency diagnostic tools, based on Multi-Item Response Theory. Item responses of 2,580 students were analyzed using Graded Response Model(GRM) to determine item difficulty and discrimination of each item. The research results are as follows. Two parrallel short tests were developed for the Convergent thinking questionnaire consisting of 12 items which were originally 17 items. Likewise, the Problem solving questionnaire, which originally consisted of 15 questions, was divided into two parallel short forms, each consisting of 9 items. The reliability of the shortened parallel tests was confirmed through internal consistency analysis, and their similarity to the original tests was established through correlation analysis. This study contributed to quality management of competency-based education and programs at H University by developing shortened tests. Based on the results, implications were presented as well as limitations and discussions.