• Title/Summary/Keyword: Assessment Item Development

Search Result 228, Processing Time 0.025 seconds

Analysing the Use of Test Tools in Science-Related Affective Domain and its Improvements (과학 관련 정의적 영역 검사 도구 활용 및 개선 내용 분석)

  • Chung, Sue-Im;Shin, Donghee
    • Journal of The Korean Association For Science Education
    • /
    • v.39 no.2
    • /
    • pp.263-277
    • /
    • 2019
  • This study analyzed the current use of science-related test tools in affective area in Korean academic journals for the last 30 years since 1989 and the cases of modification of the original tools related to the tools. This provides practical information on the development and improvement of test tools in the future and offers the basis for developing valid test tools. The study was conducted in two stages. We analyzed the status of 88 domestic science education researches dealing with testing tools related affective characteristics and 57 domestic and foreign resource tools referenced by them. After that, we compared the characteristics of the five cases in which the original tool was revised and the concrete item correction examples. The results were analyzed as follows: topics that have emerged continuously or that have recently begun to appear in domestic research, the research situations according to their purpose and measurement methods used by the tool, and use state of original tools. The background and key points of revision were analyzed for the five tools, TOSRA, SAI, PISA items, STEBI-A/B, SMQ, whose revision process were disclosed. In addition, the changes of the items were analyzed by comparing the four test items with the questions before and after the revision. As a result of item analysis, item improvement was proceeding in the direction of enhancing readability, clarifying meaning, and changing items according to change of sub constructs. The implications of this study are as follows: notes on interpreting the results obtained from the tool with multiple mixed constructs, the possibility of the testing tool that broadens the horizon of the research, error recognition in the subjective self-report, and notes when applying test tools from other disciplines to science.

Reliability Evaluation of the Estimation of Suspended Sediment Dispersion (부유사 확산예측 모형의 신뢰도 평가에 관한 연구)

  • Tac, Dae-Ho;Chung, Younjin;Jun, Eun-Ju;Yang, Joon-Yong
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.28 no.6
    • /
    • pp.890-898
    • /
    • 2022
  • Dispersion of suspended sediment, caused by coastal and marine development, is a key item in assessing marine environmental impact as it adversely affects marine life by increasing the level of turbidity and decreasing the amount of sunlight in seawater. However, its estimation has not been reliable because of the absence of a standard for the data measurement and divergent approaches to the impact assessment. In this study, we examined the estimation models from 58 Marine Environmental Impact Statements (MEISs, 2012-2014) to identify the gaps in the assessment and devise ways of improving the estimation. We developed four index items-grid system; unit load, particle size, and settling velocit-to evaluate their reliability in the estimation. The mean reliability score of each index was overall low-25 for grid system, 60 for unit load, 34 for particle size, and 17 for settling velocity. To ensure high reliability, it is important to develop a standard guideline that defines precise measurement of suspended sediment for unit load and settling velocity by particle size, followed by a grid system with compatible size for modelling. This can improve the estimation and thus underlie coherent impact assessment of suspended sediment dispersion on marine environment.

Development of a Quality of Life Scale for Patients with Breast Cancer in Korea (국내 유방암 환자의 삶의 질 측정 도구 개발에 관한 연구)

  • Chae, Young-Ran;Choe, Myoung-Ae
    • Korean Journal of Adult Nursing
    • /
    • v.13 no.3
    • /
    • pp.486-495
    • /
    • 2001
  • The purpose of this study was to develop a Quality of Life(QOL) scale for breast cancer patients in Korea and to test the validity and reliability of the instrument. To achieve the purpose of the study, a questionnaire was developed to interview 10 breast cancer patients and distributed to 155 patients with breast cancer in Korea. For data analysis, SPSS WIN 8.0/PC were used. Item analysis and factor analysis were carried out to test validity of the QOL scale. Cronbach's ${\alpha}$ and Guttman split half coefficient were used to test reliability of the scale. The results were as follows; As a result of the item analysis, 27 items were selected from the total of 34 items. 6 factors were selected by factor analysis. Six factors were labeled as 'response to cancer diagnosis and treatment', 'family well-being', 'physical concerns', 'psychological well-being', 'spiritual well-being', and 'economic concerns'. Six factors were explained by 72.236% out of the total variance. The first factor explained 20.738% and the second factor explained 16.593%, which were major factors for Korean breast cancer patients. Chronbach's ${\alpha}$ coefficient of the tool was .9120, and Guttman split-half coefficient was .8148. The scale was identified to be a tool with a high degree of reliability and validity. Therefore, this scale can be effectively utilized for assessment of Quality of Life of patients with breast cancer in Korea.

  • PDF

Development of Stress Coping Behaviors Measurement Scale for Korean Workers (제조업 근로자에 대한 스트레스 대처행동 측정도구 개발)

  • Jeong, Jin Wook;Heo, Kyung-Hwa;KIm, Ki-Woong
    • Korean Journal of Occupational Health Nursing
    • /
    • v.16 no.1
    • /
    • pp.48-57
    • /
    • 2007
  • Purpose: To develop the stress coping behavior measurement scale(SCBMS) for the workers in manufacturing industry. Methods: Developing of SCBMS was based on job stress and psycho-social health status. Job stress and psycho-social health status were estimated by using the Karasek's job content questionnaire (JCQ) and the general health questionnaire (GHQ-28), and the general characteristics for subjects were estimated by self-reported questionnaire and interview. Result: The subjects were 456 male workers who had never been occupationally exposed to hazardous chemical and other materials, was mean age 31.27 years and mean work duration was 4.81 years. As a result of factor analysis for developed stress coping questionnaire, four factors were extracted such as inactive, active, health and emotional behavior from 15 question items of stress coping questionnaire. Fifteen items passed for item internal consistency (100% success rate) and item discriminant validity (100% success rate). Cronbach's alpha coefficient for each factor ranged from 0.56 to 0.77. The active behavior correlated positively with job demand of JCQ (r=0.12, p<0.05), but total GHQ-28 was negatively correlation (r=-0.24, p<0.01), respectively. Conclusion: These results demonstrated the reliability and validity of SCBMS. Thus, the results may prove to be a useful assessment tool in evaluating stress coping behavior.

  • PDF

Community Gardening Activities and Their Effects on Mental Health of Residents

  • Jang, Hye Sook;Gim, Gyung Mee;Jeong, Sun-Jin;Kim, Jae Soon
    • Journal of People, Plants, and Environment
    • /
    • v.22 no.4
    • /
    • pp.333-340
    • /
    • 2019
  • This study was conducted to find out the effects of plant cultivation activities in the village gardening program hosted by Gyeonggi-do on the psychology and physiology of participants. This study conducted a survey on 20 villagers aged 57.70±9.23 on average and collected their saliva before Session 1 and after the final Session 10. The experiment was conducted by carrying out the village gardening program once a week for total 10 weeks. Psychological assessment was conducted by measuring the level of plant cultivation experience, four elements (repose, fascination, coherence, legibility) of the Perceived Restorativeness Scale (PRS) and stress levels, and also conducting the Wilcoxon paired signed ranks test. As the result of comparatively analyzing the saliva collected before and after the program, the total cortisol level, which is a stress hormone, decreased with statistical significance after the program (t=14.521, p<.001). The level of plant cultivation activities increased with statistical significance after the program, and the PRS increased with statistical significance in the three elements of repose, fascination and legibility excluding coherence. In addition, as the result of examining the change in the stress level of participants with the sum of all item scores, it was found that the stress level decreased with statistical significance (p<.05) from 17.65 points to 15.30 points after the program. Hence, plant cultivation activities in the village community have positive effects such as attention restoration or stress relief. In addition, the activities can also contribute to mental connection and healthcare of residents.

A Proposal of Curriculum and Teaching Sequence for Seasonal Change by Exploring a Learning Progression (학습 발달과정 탐색을 통한 계절의 변화 교육과정 및 교수 계열 제안)

  • Heo, Jaewan;Lee, Kiyoung
    • Journal of the Korean earth science society
    • /
    • v.39 no.3
    • /
    • pp.260-274
    • /
    • 2018
  • The purpose of this study was to propose curriculum and teaching sequence for seasonal change by exploring a learning progression. For the purpose, 4 steps of construct modeling approach (specifying construct, item design, outcome space, and measurement model) proposed by Wilson (2005) was applied. In the stage of specifying construct, 'length of shadow according to seasons', 'position of constellation according to seasons', 'seasons of the southern hemisphere and northern hemisphere', 'cause and phenomenon of seasonal change' were selected as the subconstructs of seasonal changes, and constructed a construct map showing the level of development from level 1 to level 4 for each subconstruct based on the results of the previous research. In the item design stage, we developed five assessment items consisting of 3 items in the form of C-E (choose and explain) and two items in the form of CR (constructed response), applied it to 383 elementary, middle and high school students. In the outcome space stage, the students' responses to the assessment items were categorized based on the construct map. The categories were classified into 4 levels according to student ability and scores of 1-4 were given. In the measurement model stage, we applied the partial credit model of the Rasch model and compared whether the learning pathway created from the results of students' response coincides with the construct map. Based on the results of the research, we modified the construct map and finally created hypothetical learning progression on seasonal change. Finally, we proposed an orientation of curriculum amendment and effective teaching sequence for seasonal change.

U-IT Technical evaluation and Product sorting management Processing (U-IT 기술 평가 및 제품 선별 관리 프로세싱)

  • Kim, Hye-Sun;Yang, Hae-Sul
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.9 no.4
    • /
    • pp.1086-1094
    • /
    • 2008
  • Today's small and medium-sized enterprises in technology development for future industrial growth engine. In addition evaluation of the technological competitiveness of companies and countries for R&D investment as a significant item evaluated constantly expanding, he said. However, R&D productivity to properly measure and assess the companies rarely. This paper examines the existing technology, technology assessment, the study's limitations, the small and medium-sized companies to complement the U-IT TE and PSMP Model suggested by the design environment, and technology-related companies in the technology, the ability to comprehensively assess and as a tool to leverage, technical analysis and quantitative evaluation and production from the completion of the Process Model, presented want to formalize.

Dog park planning items and needs assessment in consideration of Korean pet culture (애견문화를 고려한 '도그파크' 계획항목과 요구도)

  • Lim, Soo-Hee;Lee, Gwan-Gyu;Yang, Byoung-E
    • KIEAE Journal
    • /
    • v.5 no.1
    • /
    • pp.19-25
    • /
    • 2005
  • Rapid urbanization and social development have brought about changes in family structure. In urbanized areas, recently the number of dogs that are a majority of companion animals has increased significantly in Korea. Consequently, a lot of friction between the general public who are not fond of dogs and dog owners in public places such as parks has been happening. A lot of countries that are taking a lead role in animal welfare have built dog parks that the general public and dogs can enjoy together. This research starts with the realization that the concept of 'dog park' needs to be introduced in Korea as more and more Koreans own dogs and other pets. This research aims to provide guidance for dog park planning by drawing planning items and analyzing the needs of each item. Total 56 planning items including dog zone, dog playground, and dog training facility, are drawn in this research. There are differences in the needs according to sex, age and the amount of time they spent with their dogs, however overall there is the highest needs in separated area for dogs in parks.

The Design and Development of On-line Game Characteristic Evaluation System by a Heuristic Evaluation Item (사용성(Heuristics) 평가 항목을 통한 온라인 게임성 평가 시스템 설계 및 구현)

  • Kang, Ki-Ho;Choi, Hwan-Eon;Jung, Chool-Gon;Hong, Soo-Bong
    • Journal of Korea Game Society
    • /
    • v.9 no.1
    • /
    • pp.63-74
    • /
    • 2009
  • This paper mainly focused on research developing online game characteristic evaluation system based on game characteristic evaluation model design. Online game characteristic evaluation system is a system that evaluates game online in real-time using evaluation elements defined by model design. Game characteristic evaluation system uses heuristic evaluation method, which is used to execute evaluation in four parts, technical element, manage element, social element, and competitive element. To verify objectivity and validity of game characteristic evaluation, assessment was performed by three groups of beginners, intermediates, and professionals to increase the trust. And game characteristic evaluation forum was hosted to collect opinion from diverse classes.

  • PDF

Development of a test of Korean Speech Intelligibility in Noise(KSPIN) using sentence materials with controlled word predictability (소음환경에서 표적단어의 예상도가 조절된 한국어의 문장검사목록개발 시안)

  • Kim, Jin-Sook;Pae, So-Yeong;Lee, Jung-Hak
    • Speech Sciences
    • /
    • v.7 no.2
    • /
    • pp.37-50
    • /
    • 2000
  • This paper describes a test of everyday speech understanding ability, in which a listener's utilization of the context-situational information of speech is assessed, and is compared with the utilization of acoustic-phonetic information. The test items are sentences which are presented in a babble type of noise, and the listener response is the key word in the sentence. The key words are always two-syllabic nouns and the questioning sentences are added to obtain the responding key words. Two types of sentences are used. One is the high-predictable sentences for which the key word is somewhat predictable from the context. The other is the low-predictable sentences for which the key-word cannot be predicted from the context. Both types are included in six 40-item forms of the test, which are balanced for intelligibility, key-word familiarity and predictability, phonetic content, and length. Performance of normally hearing listeners shows significantly different functions for various signal-to-noise ratios. The potential applications of this test, particularly in the assessment of speech understanding ability in the hearing impaired, are discussed.

  • PDF