• Title/Summary/Keyword: Model Validation

Search Result 3,217, Processing Time 0.029 seconds

Wildfire Severity Mapping Using Sentinel Satellite Data Based on Machine Learning Approaches (Sentinel 위성영상과 기계학습을 이용한 국내산불 피해강도 탐지)

  • Sim, Seongmun;Kim, Woohyeok;Lee, Jaese;Kang, Yoojin;Im, Jungho;Kwon, Chunguen;Kim, Sungyong
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_3
    • /
    • pp.1109-1123
    • /
    • 2020
  • In South Korea with forest as a major land cover class (over 60% of the country), many wildfires occur every year. Wildfires weaken the shear strength of the soil, forming a layer of soil that is vulnerable to landslides. It is important to identify the severity of a wildfire as well as the burned area to sustainably manage the forest. Although satellite remote sensing has been widely used to map wildfire severity, it is often difficult to determine the severity using only the temporal change of satellite-derived indices such as Normalized Difference Vegetation Index (NDVI) and Normalized Burn Ratio (NBR). In this study, we proposed an approach for determining wildfire severity based on machine learning through the synergistic use of Sentinel-1A Synthetic Aperture Radar-C data and Sentinel-2A Multi Spectral Instrument data. Three wildfire cases-Samcheok in May 2017, Gangreung·Donghae in April 2019, and Gosung·Sokcho in April 2019-were used for developing wildfire severity mapping models with three machine learning algorithms (i.e., Random Forest, Logistic Regression, and Support Vector Machine). The results showed that the random forest model yielded the best performance, resulting in an overall accuracy of 82.3%. The cross-site validation to examine the spatiotemporal transferability of the machine learning models showed that the models were highly sensitive to temporal differences between the training and validation sites, especially in the early growing season. This implies that a more robust model with high spatiotemporal transferability can be developed when more wildfire cases with different seasons and areas are added in the future.

Validation of Surface Reflectance Product of KOMPSAT-3A Image Data: Application of RadCalNet Baotou (BTCN) Data (다목적실용위성 3A 영상 자료의 지표 반사도 성과 검증: RadCalNet Baotou(BTCN) 자료 적용 사례)

  • Kim, Kwangseob;Lee, Kiwon
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.6_2
    • /
    • pp.1509-1521
    • /
    • 2020
  • Experiments for validation of surface reflectance produced by Korea Multi-Purpose Satellite (KOMPSAT-3A) were conducted using Chinese Baotou (BTCN) data among four sites of the Radical Calibration Network (RadCalNet), a portal that provides spectrophotometric reflectance measurements. The atmosphere reflectance and surface reflectance products were generated using an extension program of an open-source Orfeo ToolBox (OTB), which was redesigned and implemented to extract those reflectance products in batches. Three image data sets of 2016, 2017, and 2018 were taken into account of the two sensor model variability, ver. 1.4 released in 2017 and ver. 1.5 in 2019, such as gain and offset applied to the absolute atmospheric correction. The results of applying these sensor model variables showed that the reflectance products by ver. 1.4 were relatively well-matched with RadCalNet BTCN data, compared to ones by ver. 1.5. On the other hand, the reflectance products obtained from the Landsat-8 by the USGS LaSRC algorithm and Sentinel-2B images using the SNAP Sen2Cor program were used to quantitatively verify the differences in those of KOMPSAT-3A. Based on the RadCalNet BTCN data, the differences between the surface reflectance of KOMPSAT-3A image were shown to be highly consistent with B band as -0.031 to 0.034, G band as -0.001 to 0.055, R band as -0.072 to 0.037, and NIR band as -0.060 to 0.022. The surface reflectance of KOMPSAT-3A also indicated the accuracy level for further applications, compared to those of Landsat-8 and Sentinel-2B images. The results of this study are meaningful in confirming the applicability of Analysis Ready Data (ARD) to the surface reflectance on high-resolution satellites.

Development and Validation of the Korean Tier 3 School-Wide Positive Behavior Support Implementation Fidelity Checklist (KT3-FC) (한국형 긍정적 행동지원 3차 실행충실도 척도(KT3-FC)의 개발과 타당화)

  • Won, Sung-Doo;Chang, Eun Jin;Cho Blair, Kwang-Sun;Song, Wonyoung;Nam, Dong Mi
    • Korean Journal of School Psychology
    • /
    • v.17 no.2
    • /
    • pp.165-180
    • /
    • 2020
  • As a tiered system of supports, School-Wide Positive Behavior Support (SWPBS) is an evidence-based practice in the educational system of Korea. An important aspect of SWPBS is the ongoing progress monitoring and evaluation of implementation fidelity. This study aimed to develop and validate the Korean Tier 3 School-Wide Positive Behavior Support Implementation Fidelity Checklist (KT3-FC). The preliminary KT3-FC consisted of a 37-item, 6-factor checklist. In the first phase of the study, 10 experts reported that the range of content validity of the KT3-FC was adequate. In the second phase of the study, 185 teachers (52 men and 133 women) who implemented SWPBS completed the KT3-FC, Individualized Supports Questionnaire, School Climate Questionnaire, School Discipline Practice Scale, and PBS Effectiveness Scale. An exploratory factor analysis resulted in a 5-factor structure, with 20 items, instead of 37 items, consisting of: (a) progress monitoring and evaluation of the individualized supports, (b) provision of supports by aligning and integrating mental health and SWPBS, (c) crisis management planning, (d) problem behavior assessment, and (e) establishment of individualized support team. The internal consistency of the KT3-FC was good (full scale α = .950, sub-factor α = .888 ~ .954). In addition, the KT3-FC showed good convergent validity, having statistically significant correlations with the Individualized Support Questionnaire, School Climate Questionnaire, School Discipline Practice Scale, and the PBS Effectiveness Scale. Finally, the confirmatory factor analysis showed that the 5-factor model of the KT3-FC had some good model fits, indicating that the newly developed fidelity measure could be a reliable and valid tool to assess the implementation of Tier 3 supports in Korean schools. Accordingly, the KT3-FC could contribute to implement SWPBS as an evidence-based behavioral intervention for Korean students.

Development and Validation of Change Motivation Scale for Growth and Development (성장 및 발전을 위한 변화동기 척도 개발 및 타당화)

  • Lee Eun Joo;Tak Jin kook
    • The Korean Journal of Coaching Psychology
    • /
    • v.7 no.1
    • /
    • pp.59-89
    • /
    • 2023
  • In this study, change motivation for growth and development is defined as 'the power to set a specific action direction for change based on the perception of one's current behavior in order to achieve a goal that one considers important, and to be willing to act'. In addition, the purpose of this study was to develop and validate a scale to measure the motivation for change for growth and development of general adults. To develop preliminary questions, interviews were conducted with 7 coaching experts and 9 experienced coaches, and an open-ended questionnaire was conducted with 55 adults. Afterwards, 7 factors and 83 questions were selected through three rounds of item classification and content validity verification, and a preliminary survey was conducted targeting 321 general adults, and 42 items, 4 factors, were derived through exploratory factor analysis. did Finally, the main survey was conducted with 631 adults in order to verify the validity of the construct concept of the change motivation scale and the validity of the criterion. Divided into two groups, 315 people in group 1 conducted exploratory factor analysis and 316 people in group 2 conducted confirmatory factor analysis to verify the concept of change motivation scale. As a result of the factor analysis of Group 1, it was found that the 3 factor structure consisting of 31 items was appropriate, and as a result of the confirmatory factor analysis of Group 2, the goodness of fit of the modified model of the 3 factor structure was confirmed, which motivated change. The construct validity of the scale was demonstrated. As a result of analyzing the correlations with various variables for the analysis of convergent validity and criterion-related validity of the Motivation for Change scale, each of the three factors was found to be significantly related to most variables. Finally, the significance, implications and limitations of this study, and future research were discussed.

Development and Validation of the Korean Wellness Scale (한국형 웰니스 척도(KWS) 개발 및 타당화)

  • Choi, Kyunghwa;Tak, Jinkook
    • The Korean Journal of Coaching Psychology
    • /
    • v.5 no.2
    • /
    • pp.127-170
    • /
    • 2021
  • This study developed a measure to measure wellness-seeking behavior in important areas of life for general adults in Korea and verified its validity. For the development of the wellness scale, 31 factors derived through literature review, expert interviews, in-depth interviews, open questionnaires 1 and 2, and 182 questions were selected as the final 10 factors and 99 questions. Through exploratory factor analysis of the results of the preliminary survey of 351 adults in Korea, 58 questions of 10 factors were derived, and some of the questions reflecting important concepts in each factor were revised, and this survey was conducted with 63 questions of 10 factors. In this survey conducted on 667 people, to verify the validity of the composition concept of this test, the entire sampling was divided into two groups, one group was subjected to exploratory factor analysis, and the other group was subjected to confirmatory factor analysis. As a result of exploratory factor analysis, 63 questions of 10 factors (work, community, family, others, economic power, self-esteem, leisure, physical health, spirituality, and self-growth) were finally derived, and confirmatory factor analysis using the structural equation model verified that the model fit criteria were met. Convergence validity was verified using the K-MHC-SF and Wellness Index for Workers to verify whether the derived wellness scale and its sub-factors actually measure wellness. As a result of analyzing the relationship between the variables and factors of the Subjective Happiness Scale and Life Scale to verify the validity related to the criteria, it was found to be a significant correlation. As a result of confirming the significance of each path through multiple regression analysis, the 'self-esteem' on the wellness scale was identified as the most important factor influencing subjective happiness and life satisfaction. Finally, discussions on this research process and results, academic significance and practical significance, limitations, and future research directions were presented.

  • PDF

Retrieval of Hourly Aerosol Optical Depth Using Top-of-Atmosphere Reflectance from GOCI-II and Machine Learning over South Korea (GOCI-II 대기상한 반사도와 기계학습을 이용한 남한 지역 시간별 에어로졸 광학 두께 산출)

  • Seyoung Yang;Hyunyoung Choi;Jungho Im
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.5_3
    • /
    • pp.933-948
    • /
    • 2023
  • Atmospheric aerosols not only have adverse effects on human health but also exert direct and indirect impacts on the climate system. Consequently, it is imperative to comprehend the characteristics and spatiotemporal distribution of aerosols. Numerous research endeavors have been undertaken to monitor aerosols, predominantly through the retrieval of aerosol optical depth (AOD) via satellite-based observations. Nonetheless, this approach primarily relies on a look-up table-based inversion algorithm, characterized by computationally intensive operations and associated uncertainties. In this study, a novel high-resolution AOD direct retrieval algorithm, leveraging machine learning, was developed using top-of-atmosphere reflectance data derived from the Geostationary Ocean Color Imager-II (GOCI-II), in conjunction with their differences from the past 30-day minimum reflectance, and meteorological variables from numerical models. The Light Gradient Boosting Machine (LGBM) technique was harnessed, and the resultant estimates underwent rigorous validation encompassing random, temporal, and spatial N-fold cross-validation (CV) using ground-based observation data from Aerosol Robotic Network (AERONET) AOD. The three CV results consistently demonstrated robust performance, yielding R2=0.70-0.80, RMSE=0.08-0.09, and within the expected error (EE) of 75.2-85.1%. The Shapley Additive exPlanations(SHAP) analysis confirmed the substantial influence of reflectance-related variables on AOD estimation. A comprehensive examination of the spatiotemporal distribution of AOD in Seoul and Ulsan revealed that the developed LGBM model yielded results that are in close concordance with AERONET AOD over time, thereby confirming its suitability for AOD retrieval at high spatiotemporal resolution (i.e., hourly, 250 m). Furthermore, upon comparing data coverage, it was ascertained that the LGBM model enhanced data retrieval frequency by approximately 8.8% in comparison to the GOCI-II L2 AOD products, ameliorating issues associated with excessive masking over very illuminated surfaces that are often encountered in physics-based AOD retrieval processes.

Development and Validation of Career Barrier Scale for Career Interruption Women (경력단절여성 진로장벽 척도 개발 및 타당화)

  • Ae Ri Kim;Jin Kook Tak
    • The Korean Journal of Coaching Psychology
    • /
    • v.8 no.1
    • /
    • pp.1-50
    • /
    • 2024
  • The purpose of this study is to identify career barrier factors experienced by career interruption women, develop a tool to measure career barrier, and verify their validity. To this end, preliminary questions were developed by reviewing literature, conducting one-on-one in-depth interviews with 10 women on career interruption, and conducting an open questionnaire with 100 women on career interruption. The subjects of the study were married women aged 20 to 54 who had past employment experience, wanted to be re-employed, and experienced retirement due to marriage, pregnancy, childbirth, childcare, and family care, and the period of career interruption was selected for more than one year. After that, 63 questions were selected for 7 factors. A preliminary survey was conducted on 300 women with career interruption in Korea, and as a result, 63 questions of 6 factors were derived through exploratory factor analysis. The main survey was conducted with 44 questions of 6 factors by partially modifying the questions reflecting the important concepts in each factor. In this survey of 600 people, in order to verify the validity of the constituent concept of this test, the entire sample was divided into two groups, and group 1 (G1, N=309) conducted exploratory factor analysis and group 2 (G2, N=291) conducted confirmatory factor analysis. As a result of exploratory factor analysis for Group 1, 34 questions of 6 factors were finally derived, and a confirmatory factor analysis of Group 2(G2) was conducted to confirm the model fit of the derived factors, and it was confirmed that the model fit criteria were met. In order to verify the convergence validity of the developed career barrier scale, a correlation analysis was conducted with the career barrier test for female college students, and as a result of the analysis, the career barrier scale for women with career interruption and the career barrier test for female college students showed statistically significant correlation. In order to verify the validity of the criterion, the results of a correlation analysis with variables of job preparation behavior, job stress, state anxiety, and life satisfaction were all found to be statistically significant. Finally, the academic, practical, and policy significance and limitations of this study and future research directions were presented.

Validation of ENVI-met Model with In Situ Measurements Considering Spatial Characteristics of Land Use Types (토지이용 유형별 공간특성을 고려한 ENVI-met 모델의 현장측정자료 기반의 검증)

  • Song, Bong-Geun;Park, Kyung-Hun;Jung, Sung-Gwan
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.17 no.2
    • /
    • pp.156-172
    • /
    • 2014
  • This research measures and compares on-site net radiation energy, air temperature, wind speed, and surface temperature considering various spatial characteristics with a focus on land use types in urban areas in Changwon, Southern Gyeongsangnam-do, to analyze the accuracy of an ENVI-met model, which is an analysis program of microclimate. The on-site measurement was performed for three days in a mobile measurement: two days during the daytime and one day during the nighttime. The analysis using the ENVI-met model was also performed in the same time zone as the on-site measurement. The results indicated that the ENVI-met model showed higher net radiation than the on-site measurement by approximately $300Wm^{-2}$ during the daytime whereas the latter showed higher net radiation energy by approximately $200Wm^{-2}$ during the nighttime. The temperature was found to be much higher by approximately $2-6^{\circ}C$ in the on-site measurement during both the daytime and nighttime. The on-site measurement also showed higher surface temperature than the ENVI-met by approximately $7-13^{\circ}C$. In terms of the wind speed, there was a significant difference between the results of the ENVI-met model and on-site measurement. As for the correlation between the results of the ENVI-met model and on-site measurement, the temperature showed significantly high correlation whereas the correlations for the net radiation energy, surface temperature, and wind speed were very low. These results appear to be affected by excessive or under estimation of solar and terrestrial radiation and climatic conditions of the surrounding areas and characteristics of land cover. Hence, these factors should be considered when applying these findings in urban and environment planning for improving the microclimate in urban areas.

Development of the Risk Evaluation Model for Rear End Collision on the Basis of Microscopic Driving Behaviors (미시적 주행행태를 반영한 후미추돌위험 평가모형 개발)

  • Chung, Sung-Bong;Song, Ki-Han;Park, Chang-Ho;Chon, Kyung-Soo;Kho, Seung-Young
    • Journal of Korean Society of Transportation
    • /
    • v.22 no.6
    • /
    • pp.133-144
    • /
    • 2004
  • A model and a measure which can evaluate the risk of rear end collision are developed. Most traffic accidents involve multiple causes such as the human factor, the vehicle factor, and the highway element at any given time. Thus, these factors should be considered in analyzing the risk of an accident and in developing safety models. Although most risky situations and accidents on the roads result from the poor response of a driver to various stimuli, many researchers have modeled the risk or accident by analyzing only the stimuli without considering the response of a driver. Hence, the reliabilities of those models turned out to be low. Thus in developing the model behaviors of a driver, such as reaction time and deceleration rate, are considered. In the past, most studies tried to analyze the relationships between a risk and an accident directly but they, due to the difficulty of finding out the directional relationships between these factors, developed a model by considering these factors, developed a model by considering indirect factors such as volume, speed, etc. However, if the relationships between risk and accidents are looked into in detail, it can be seen that they are linked by the behaviors of a driver, and depending on drivers the risk as it is on the road-vehicle system may be ignored or call drivers' attention. Therefore, an accident depends on how a driver handles risk, so that the more related risk to and accident occurrence is not the risk itself but the risk responded by a driver. Thus, in this study, the behaviors of a driver are considered in the model and to reflect these behaviors three concepts related to accidents are introduced. And safe stopping distance and accident occurrence probability were used for better understanding and for more reliable modeling of the risk. The index which can represent the risk is also developed based on measures used in evaluating noise level, and for the risk comparison between various situations, the equivalent risk level, considering the intensity and duration time, is developed by means of the weighted average. Validation is performed with field surveys on the expressway of Seoul, and the test vehicle was made to collect the traffic flow data, such as deceleration rate, speed and spacing. Based on this data, the risk by section, lane and traffic flow conditions are evaluated and compared with the accident data and traffic conditions. The evaluated risk level corresponds closely to the patterns of actual traffic conditions and counts of accident. The model and the method developed in this study can be applied to various fields, such as safety test of traffic flow, establishment of operation & management strategy for reliable traffic flow, and the safety test for the control algorithm in the advanced safety vehicles and many others.

Development and Validation of the Social Entrepreneurship Measurement Tools: From an Organizational-Level Behavioral Perspective (사회적기업가정신 척도 개발 및 타당화 연구: 조직차원의 행동적 관점에서)

  • Cho, Han Jun
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.18 no.3
    • /
    • pp.97-113
    • /
    • 2023
  • In order to generalize the social entrepreneurship model with cooperation orientation and increase the possibility of using the model, this study developed a measurement tool and tested it with 389 executives of social enterprises. For the development of the measurement tool, preliminary measurement items were formed through review of previous studies, and a questionnaire was tentatively composed of 40 measurement items in five areas through an expert panel review of the measurement items. A total of 389 questionnaires were collected by conducting a questionnaire survey targeting Korean social enterprise managers, and exploratory and confirmatory factor analysis were conducted using 375 questionnaires that could be analyzed. Five factors for 24 items were derived through exploratory factor analysis and reliability analysis. Through a series of analysis processes including primary and secondary confirmatory factor analysis, the model fit of the newly constructed social entrepreneurship research model was confirmed, and the validity and reliability of the measurement tools were verified. As a result of this study, the model fit of the social entrepreneurship model(social value orientation; innovativeness; pro-activeness; risk-taking; cooperation orientation) is verified, thereby improving the theoretical explanatory power of social entrepreneurship research and at the same time providing the basis and basis for theoretical expansion of follow-up research. The study proved the possibility of generalizing the social entrepreneurship model with added cooperation orientation, and at the same time, the measurement tool used in this study was widely used as a tool to measure social entrepreneurship theoretically and practically. In addition, it was confirmed that the cooperation orientation is manifested in corporate decision-making and activity behaviors for resource mobilization and capacity building, opportunity and performance creation, social capital and network reinforcement, and governance establishment of social enterprises.

  • PDF