• Journal of the Korean Society of Earth Science Education
• /
• v.9 no.3
• /
• pp.276-291
• /
• 2016

This study is to develop a valid and reliable instrument for measuring students' creative engineering problem solving propensity. The creative engineering problem solving is operationally defined in this study as a creative problem solving skill in an engineering context. To develop the instrument, first we define seven common constructs between engineering problem solving skill and creative problem solving skill through an intensive literature review; motivation, context, personal character, engineering design, engienering habits of mind, understandings of engineering and engineers, communication skill, and collaboration skill. Based on the seven constructs and the face validity test conducted by two in-service science teachers and 4 experts in science education research, 40 preliminary items were developed. Then the preliminary instrument was implemented in a science gifted highschool to measure the reliability of the instrument. From the 40 items, 34 items were selected through the initial reliability test by Cronbach's ${\alpha}$(>.75). Finally through the three times of factor analysis process, 28 items in five construct categories were selected; motivation (3 items), engineering design (6 items), engineering habits of mind (9 items), understandings of engineering and engineers (4 items), communication and collaboration skill (6 items). The factor analysis result showed that the reliability of each construct category was between .733 to .892., meaning that the instrument is reliable in terms of the higher structural validity (each item is categorized in an appropriate construct category). We expect that the creative engineering problem solving propensity instrument developed in this study can be used in various contexts for STEAM education research as a reliable and valid instrument.

• Journal of The Korean Association For Science Education
• /
• v.39 no.2
• /
• pp.263-277
• /
• 2019

This study analyzed the current use of science-related test tools in affective area in Korean academic journals for the last 30 years since 1989 and the cases of modification of the original tools related to the tools. This provides practical information on the development and improvement of test tools in the future and offers the basis for developing valid test tools. The study was conducted in two stages. We analyzed the status of 88 domestic science education researches dealing with testing tools related affective characteristics and 57 domestic and foreign resource tools referenced by them. After that, we compared the characteristics of the five cases in which the original tool was revised and the concrete item correction examples. The results were analyzed as follows: topics that have emerged continuously or that have recently begun to appear in domestic research, the research situations according to their purpose and measurement methods used by the tool, and use state of original tools. The background and key points of revision were analyzed for the five tools, TOSRA, SAI, PISA items, STEBI-A/B, SMQ, whose revision process were disclosed. In addition, the changes of the items were analyzed by comparing the four test items with the questions before and after the revision. As a result of item analysis, item improvement was proceeding in the direction of enhancing readability, clarifying meaning, and changing items according to change of sub constructs. The implications of this study are as follows: notes on interpreting the results obtained from the tool with multiple mixed constructs, the possibility of the testing tool that broadens the horizon of the research, error recognition in the subjective self-report, and notes when applying test tools from other disciplines to science.

• The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
• /
• v.19 no.3 s.31
• /
• pp.134-145
• /
• 2006

Objective : This study was carried out to investigate what type of assumption and conditions are needed for the application of various statistical techniques such as descriptive statistics, t-test, analysis of variance, correlation analysis, regression analysis and chi-square test and to evaluate that they are used correctly in the research process. Methods : One more methods of statistical analysis were used in 91 papers among 162 papers selected from the journal of Korean oriental medical Ophthalmology & Otolaryngology & Dermatology from April 2003 to December 2005. So we analysed the type of statistical analysis method in 91 papers(clinical and experimental study) and assessed the their validity of statistical techniques by the check list consisting of 34 items(3 items for validity assessment of descriptive statistics, 6 items for t-test, 7 items for analysis of variance, correlation analysis and regression analysis, respectively, 4 items for chi-square test) Results : 1. The type of 65(40%) cases is experimental trial, the type of 55(34%) cases is case report, the type of 26(16%) cases is clinical trial and the type of 16(10%) cases is review, in 91 papers using statistical techniques among 162 papers selected from the journal of Korean oriental medical Ophthalmology & Otolaryngology & Dermatol-ogy from April 2003 to December 2005. 2. One more methods of statistical analysis were used in the experimental and clinical study. When we classified 125 units using statistical analysis methods in 91 papers according to statistical techniques such as descriptive statistics, t-test, analysis of variance, correlation analysis, regression analysis and chi-square test, the number of independent sample t-test is 33(26%), the number of only descriptive statistics is 28(22%), the number of independent sample t-test is 33(26%), the number of only descriptive statistics is 28(22%), the number of one way ANOVA is 15(12%), the number of non-parametric test 10(8%). 3. After carrying out one way ANOVA, the number of using multiple comparison methods is 15(Scheffe:6(26%), Duncan:4(17%), Dunnett:3(13%), Tukey:2(9%)) out of 23 (total case carrying out one way ANOVA). 8(35%) out of 23 did not enforce multiple comparison methods after carrying out one way ANOVA. 4. From the assessment of validity about 63 cases using statistical techniques(except descriptive statistics), 5(8%) cases are proper, the other 58(92%) are improper, so we recognized a serious misuse of statistical application in our journal. 5. The number of case below 10 sample size in experimental and clinical study(except descriptive statistics) is 31(34%) and frequent. Also the number of case containing no mention of sample size is 41(45%, including culture study). 6. For example of statistical error, there are wrong choice of statistical technique, lack of check on standard assumption(such as standard distribution, equivariance, independence), and so on. Conclusions : We investigated the validity of statistical analysis methods in our journal by check list consisting of 34 items and suggested correct statistical analysis methods. We should practice the spread of education about statistical analysis methods and precis application, enhance objectivity and reliability of our thesis and further correspond with purpose of scientific study.

• Research in Mathematical Education
• /
• v.12 no.1
• /
• pp.27-37
• /
• 2008

A test as a form of diagnostic of algorithm and logic abilities is considered. Such test for measuring abilities and achievements of talented children has been designed and used at the Kharkiv Regional Olympiad in Informatics. Quality of the test and its items is analyzed. Correlation between the test results of children and their success in creating mathematical models, designing of complicated algorithms and translating these algorithms into computer programs is discussed.

• Fire Protection Technology
• /
• s.14
• /
• pp.5-12
• /
• 1993

This report is explained about test results of carbon dioxide extinguiching system components and pack-age type system (Kits) for automatic fire extinguishing system. A carbon dioxide system may be used to protect one or more hazards or hazards by menas of directional valves. Package system shall be installed to protect hazards within the limitations. The testing program was progressed by three items, external oppearance test, performance test and Total Flooding Fire Extinguishing System test. The object of this report is present the problem which apperar from the analysis of test results.

• The Journal of Korean Association of Computer Education
• /
• v.17 no.2
• /
• pp.39-51
• /
• 2014

In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

• Journal of The Korean Association For Science Education
• /
• v.17 no.1
• /
• pp.65-73
• /
• 1997

The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach $\alpha$) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

• Research in Community and Public Health Nursing
• /
• v.7 no.2
• /
• pp.400-409
• /
• 1996

To investigate industrial fatigue and low back pain, the questionaire survey for subjective symptoms of fatigue and low back pain was carried out among 591 male workers aged 20-55 employed in an automobile industry in Korea. Workers participated to this study were divided into low back pain group(LBP) and control group, according to the self-reports by written questionaires. The subjective sysptoms of fatigue comprised three groups of 10 items each, representing dullness and sleepiness(level of cerebral activation), difficulty in concentration(level of motivation) and bodily projection of fatigue. The resultant data were processed for $\chi^2-test$, t-test and a pearson's correlation coefficient to confirm the relationships. The results were as follows: 1. 30 items of fatigue subjective symptoms exeptone item, 'lack in perseverance', were directly associated with low back pain. 2. The percentage of fatigue complaint were sig nificantly higher in LBP group. 3. Of the 30 items of fatigue subjective symptoms, the highest percentage was accounted for 'eye strain'(27.9%), followed by 'whole body feels tired' and 'legs feel heavy'(22.9%), 'feel like lying'(21.4%), 'feel a pain in the low back'(18.7%), 'feel drowsy'(16.4%) and 'feel stiffness in the neck or the shoulders'(16.2%) in the order of sequence. 4. The average weighted score for the first group of fatigue items(dullness and sleepiness) was the largest among three groups and was followed by the second group(difficulty in concentration) and the third group(bodily projection of fatigue) in the order of sequence, suggesting the heavier shift work stress of the workers. 5. In the groups of the aged 30-40, work duration of 5-7yrs, heavy work amount and irregular work speed, significant high fatigue complaints were revealed in terms of eye strain, whole body feels tired, legs feel heavy, feel like lying, feel a pain in the low back and feel stiffness in the neck or the shoulders. 6. A significant negative correlations were shown between age, work duration and eleven subjective symptoms while positive reciprocal correlations were shown between eleven items with one another.

• The Journal of Internal Korean Medicine
• /
• v.38 no.6
• /
• pp.917-929
• /
• 2017

Objectives: The objective of this study was to investigate the validity of the preliminary critical pathway of integrative medicine to improve the quality of life of lung cancer patients who received chemotherapy. Methods: The vertical axis of the preliminary critical pathway of integrated medicine consisted of nine domains: assessment, treatment, activity, consult, diet, medication, Korean medical examination, education, and others. The frame of the horizontal axis was the date from hospitalization to discharge. A total of 105 items in this preliminary critical pathway were validated by an expert group from October 28, 2016 to November 4, 2016. A total of ten experts from two different medical institutions participated in the validity test, using the four-point Content Validity Index (CVI) scale. The items with validity of greater than 80% were considered as significant. Results: The analysis of the content validity of 105 items showed 102 items with greater than 80% agreement. Assessment, treatment, consult, diet, medication, and education showed 100% agreement. Only three items showed a low validity (62.5%). Based on additional comments, the preliminary critical pathway of integrative medicine has been supplemented. Conclusions: This study suggests the possibility of using the integrated medical critical pathway for patients with lung cancer who received chemotherapy.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.6
• /
• pp.187-196
• /
• 2017

In using lecture evaluation methods to improve the quality of education, most universities need to reflect the changes in the educational environment. The transformation of university education into a mixed learning environment blending face-to-face education and online education necessitates the development of appropriate lecture evaluation items. For this purpose, we analyzed the items and the factor analysis for the students of C university in Daejeon. The primary data were carried out with 47 measurement items in 10 domains, such as planning and preparation of lectures, which were found through previous research analysis. Secondary data were validated by using the items confirmed through analysis of preliminary test data. The study results showed that 20 items including six domains such as planning and preparation of lectures, learning materials, learning tasks, instruction media, online course test and grades were derived. These study results suggest that universities lectures should be evaluated to ensure improvement.