• Title/Summary/Keyword: Validation tool

Search Result 635, Processing Time 0.031 seconds

Construction and Validation of a Data Synchronization Server supporting OMA DS Standards (OMA DS 표준을 지원하는 자료동기화 서버 구축 및 적합성 검증)

  • Pak, Ju-Geon;Park, Kee-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.5
    • /
    • pp.79-91
    • /
    • 2011
  • In this paper, a DS (Data Synchronization) server for mobile communication environments is constructed and the suitability and the performance of its operations are validated. The DS server provides a way to update the newest data and keep data consistency for clients (mobile devices). In addition, the DS server constructed in this paper supports various synchronization types, and detects all changes and conflicts. In case of data conflicts, the DS server resolves the conflicts according to the several policies implemented in this work. The DS server conforms to the OMA(Open Mobile Alliance) DS standard protocol for interoperability with other mobile devices and servers. In addition to the transmission-by record scheme proposed by the OMA DS standard protocol, the DS server constructed in this paper also provides the transmission-by field scheme for the enhancement transmission performance between the server and clients. In order to validate its operations, data synchronization between the DS server and the SCTS (SyncML Conformance Test Suit), the suitability validation tool provided by the OMA, is performed. The validation results show that the DS server constructed in this paper satisfies all of the test cases except the Large Object function. The Large Object function will be implemented later because the function is not needed for the personal information synchronization process which this paper aims for. Also, synchronization times of the DS server are measured while increasing the number of data and clients. The results of the performance evaluations demonstrate that the DS server is scalable, in the sense that it has not suffered from any serious bottlenecks with respect to the number of data and clients. We expect that this work will provide a framework for various studies in the future for improving mobile DS operations.

Validation and Calibration of Semi-Quantitative Food Frequency Questionnaire - With Participants of the Korean Health and Genome Study - (반정량식품섭취빈도조사지의 타당성 검증 및 보정 - 지역사회 유전체 코호트 참여자를 대상으로 -)

  • Ahn, Youn-Jhin;Lee, Ji-Eun;Cho, Nam-Han;Shin, Chol;Park, Chan;Oh, Berm-Seok;Kimm, Ku-Chan
    • Korean Journal of Community Nutrition
    • /
    • v.9 no.2
    • /
    • pp.173-182
    • /
    • 2004
  • We carried out a validation-calibration study of the food frequency questionnaire (FFQ) that we had previously developed for a community-based cohort of the Korean Genome and Health Study of the Korea National Genome Research Institute. We have collected a total of 254 3-day diet records (DRs) from 400 subjects, 200 each randomly selected from the two study cohorts of Ansung and Ansan. FFQ was administered at the time of cohort recruitment in 2001, and DRs were collected during a two month period from January through February of 2002. The mean age was 52.2 years. Farming for men and housewife for women were the most common occupations. The majority of the subjects had undergone 6∼12 years of education. The general characteristics including demographic and other data were not different from the total cohort subjects. Absolute levels of consumed nutrients including total energy (energy), protein, fat, carbohydrate, calcium, phosphorus, sodium, potassium, iron, retinol, carotene, vitamin A, thiamin, riboflavin, niacin and vitamin C were compared. The average of energy intake was not significantly different between the data collected by the 2 methods. However, consumptions of protein and fat were higher in data of DRs, whereas that of carbohydrate was higher in FFQ data. Significant correlation of each nutrient consumption between the data sets was observed (p < 0.05) except in the case of iron, while the average correlation coefficient between them was 0.22 ranging from 0.33 for energy to 0.11 for iron. The results of cross classification by quantile for exact classification ranged from 25.2% (carotene) to 35.0% (phosphorus), and from 64.6% (vitamin A) to 76.4% (retinol) for adjacent classification. The proportion of completely opposite classification was 8.1% in average. Calibration slope was estimated by regression and calibration parameters ranged from 0.025 for carotene to 0.423 for niacin. We conclude that the FFQ we have developed is an appropriate tool for assessing the nutrient intakes as ranking exposures in epidemiology studies in view that amounts of consumed nutrients obtained by FFQ were similar to those collected by DRs, that correlations between consumed nutrients collected by these methods were significant, and that classification results were relatively fair. The correlation coefficients, however, were lower than expected, which may be mainly due to the survey season. In fact, any short-term dietary survey cannot accurately reflect the overall dietary intakes that change heavily depending on seasons. Further studies including the analysis of chemical indices would be helpful for the studies of causal relationship between the diet and disease.

Development and Validation of the Korean Implementation Fidelity Checklist of Tier 1 School-Wide Positive Behavior Support (KIFC-T1) (한국형 학교차원 긍정적 행동지원 1차 실행충실도 척도(KIFC-T1)의 개발과 타당화)

  • Nam, Dong Mi;Chang, Eun Jin;Won, Sung-Doo;Cho Blair, Kwang-Sun;Song, Wonyoung
    • Korean Journal of School Psychology
    • /
    • v.17 no.3
    • /
    • pp.401-419
    • /
    • 2020
  • The purpose of this study was to validate the Korean Implementation Fidelity Checklist of Tier 1 School-Wide Positive Behavior Support (KIFC-T1) for use in the Korean educational system. Tier 1 support, which is universal supports, within a multi-tiered, school-wide positive behavior support (SWPBS) model, aims to provide support to and prevent problem behaviors among all students in a school. The initial KIFC-T1 consisted of 48 items and 11 factors and was developed based on a literature review. Its content was validated by experts. The validated KIFC-T1 was introduced to 185 special school teachers who had experience implementing SWPBS and who used the instrument to assess the degree to which their schools had implemented Tier 1 support. Based on their responses, the construct validity of the KIFC-T1 was examined using factor, item, and internal consistency reliability analyses. The concurrent validity of the tool was examined using the PBS Evaluation Tool, School Climate Questionnaire, School Discipline Practice Scale, and PBS Effectiveness Scale. The analyses revealed that KIFC-T1 had a stable five-factor structure with 35 items, had good reliability (Cronbach's α=.956, each factor's Cronbach's α=.834-.951), and its results were statistically significantly correlated with those of the PBS Evaluation Tool, School Discipline Practice Scale, and the PBS Effectiveness Scale. However the KIFC-T1's results were not statistically significantly correlated with the results of the School Climate Questionnaire. These results suggest that KIFC-T1 is a reliable and valid tool for assessing the fidelity of universal support implementations.

Development and Validation of the Social Entrepreneurship Measurement Tools: From an Organizational-Level Behavioral Perspective (사회적기업가정신 척도 개발 및 타당화 연구: 조직차원의 행동적 관점에서)

  • Cho, Han Jun
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.18 no.3
    • /
    • pp.97-113
    • /
    • 2023
  • In order to generalize the social entrepreneurship model with cooperation orientation and increase the possibility of using the model, this study developed a measurement tool and tested it with 389 executives of social enterprises. For the development of the measurement tool, preliminary measurement items were formed through review of previous studies, and a questionnaire was tentatively composed of 40 measurement items in five areas through an expert panel review of the measurement items. A total of 389 questionnaires were collected by conducting a questionnaire survey targeting Korean social enterprise managers, and exploratory and confirmatory factor analysis were conducted using 375 questionnaires that could be analyzed. Five factors for 24 items were derived through exploratory factor analysis and reliability analysis. Through a series of analysis processes including primary and secondary confirmatory factor analysis, the model fit of the newly constructed social entrepreneurship research model was confirmed, and the validity and reliability of the measurement tools were verified. As a result of this study, the model fit of the social entrepreneurship model(social value orientation; innovativeness; pro-activeness; risk-taking; cooperation orientation) is verified, thereby improving the theoretical explanatory power of social entrepreneurship research and at the same time providing the basis and basis for theoretical expansion of follow-up research. The study proved the possibility of generalizing the social entrepreneurship model with added cooperation orientation, and at the same time, the measurement tool used in this study was widely used as a tool to measure social entrepreneurship theoretically and practically. In addition, it was confirmed that the cooperation orientation is manifested in corporate decision-making and activity behaviors for resource mobilization and capacity building, opportunity and performance creation, social capital and network reinforcement, and governance establishment of social enterprises.

  • PDF

Validation of the Developed Nutritional Screening Tool for Hospital Patients (입원환자를 위해 개발된 영양검색 도구의 타당성 검증)

  • Lee, Jeong-Sook;Cho, Mi-Ran;Lee, Geum-Ju
    • Journal of Nutrition and Health
    • /
    • v.43 no.2
    • /
    • pp.189-196
    • /
    • 2010
  • Malnutrition has been associated with higher hospital costs, mortality, rates of complications and longer length of hospital stay. Several nutritional screening tools have been developed to identify patients with malnutrition risk. However, many of those require much time and labor to administer and may not be applicable to a Korean population. Therefore, the aim of this study was to develop nutritional screening tool for Korean inpatients. Then we compare nutritional screening tools that developed and previously described. Seven hundred sixty-four patients at hospital admission were screened nutritional status and classified as well nourished, malnutrition stage 1 or stage 2 by the KNNRS (Kyunghee Neo Nutrition Risk Screening), PG-SGA (Patient-Generated Subjective Global Assessment) and NRS-2002 (Nutritional Risk Screening-2002). The KNNRS, PG-SGA and NRS-2002 respectively classified 28.7%, 51.3%, 48.5% of patients as malnourished status. Compared to the PG-SGA, the KNNRS had sensitivity 60.7% (95% CI 54.2-67.0) and specificity 81.2% (95% CI 75.3-85.2). Agreement was fair between KNNRS and PG-SGA (k = 0.34). Compared to the NRS-2002, the KNNRS had sensitivity 57.8% (95% CI 53.4-60.9) and specificity 64.4% (95% CI 60.2-69.8). Agreement was poor between KNNRS and NRS-2002 (k = 0.18). These result should include that the KNNRS and PGSGA have clinical relevance and fair concordance. However the rate of malnourished patients by KNNRS were less than by PG-SGA. For more effectivity of nutritional screening and management, the criteria of KNNRS would be better revised.

Study on Climate Change Impacts on Hydrological Response using a SWAT model in the Xe Bang Fai River Basin, Lao People's Democratic Republic (기후변화에 따른 라오스인민공화국의 시방파이 유역의 수문현상 예측에 대한 연구: SWAT 모델을 이용하여)

  • Phomsouvanh, Virasith;Phetpaseuth, Vannaphone;Park, Soo Jin
    • Journal of the Korean Geographical Society
    • /
    • v.51 no.6
    • /
    • pp.779-797
    • /
    • 2016
  • A calibrated hydrological model is a useful tool for quantifying the impacts of the climate variations and land use/land cover changes on sediment load, water quality and runoff. In the rainy season each year, the Xe Bang Fai river basin is provisionally flooded because of typhoons, the frequency and intensity of which are sensitive to ongoing climate change. Severe heavy rainfall has continuously occurred in this basin area, often causing severe floods at downstream of the Xe Bang Fai river basin. The main purpose of this study is to investigate the climate change impact on river discharge using a Soil and Water Assessment Tool (SWAT) model based on future climate change scenarios. In this study, the simulation of hydrological river discharge is used by SWAT model, covering a total area of $10,064km^2$ in the central part of country. The hydrological model (baseline) is calibrated and validated for two periods: 2001-2005 and 2006-2010, respectively. The monthly simulation outcomes during the calibration and validation model are good results with $R^2$ > 0.9 and ENS > 0.9. Because of ongoing climate change, three climate models (IPSL CM5A-MR 2030, GISS E2-R-CC 2030 and GFDL CM3 2030) indicate that the rainfall in this area is likely to increase up to 10% during the summer monsoon season in the near future, year 2030. As a result of these precipitation increases, the SWAT model predicts rainy season (Jul-Aug-Sep) river discharge at the Xebangfai@bridge station will be about $800m^3/s$ larger than the present. This calibrated model is expected to contribute for preventing flood disaster risk and sustainable development of Laos

  • PDF

Optimization of Multiclass Support Vector Machine using Genetic Algorithm: Application to the Prediction of Corporate Credit Rating (유전자 알고리즘을 이용한 다분류 SVM의 최적화: 기업신용등급 예측에의 응용)

  • Ahn, Hyunchul
    • Information Systems Review
    • /
    • v.16 no.3
    • /
    • pp.161-177
    • /
    • 2014
  • Corporate credit rating assessment consists of complicated processes in which various factors describing a company are taken into consideration. Such assessment is known to be very expensive since domain experts should be employed to assess the ratings. As a result, the data-driven corporate credit rating prediction using statistical and artificial intelligence (AI) techniques has received considerable attention from researchers and practitioners. In particular, statistical methods such as multiple discriminant analysis (MDA) and multinomial logistic regression analysis (MLOGIT), and AI methods including case-based reasoning (CBR), artificial neural network (ANN), and multiclass support vector machine (MSVM) have been applied to corporate credit rating.2) Among them, MSVM has recently become popular because of its robustness and high prediction accuracy. In this study, we propose a novel optimized MSVM model, and appy it to corporate credit rating prediction in order to enhance the accuracy. Our model, named 'GAMSVM (Genetic Algorithm-optimized Multiclass Support Vector Machine),' is designed to simultaneously optimize the kernel parameters and the feature subset selection. Prior studies like Lorena and de Carvalho (2008), and Chatterjee (2013) show that proper kernel parameters may improve the performance of MSVMs. Also, the results from the studies such as Shieh and Yang (2008) and Chatterjee (2013) imply that appropriate feature selection may lead to higher prediction accuracy. Based on these prior studies, we propose to apply GAMSVM to corporate credit rating prediction. As a tool for optimizing the kernel parameters and the feature subset selection, we suggest genetic algorithm (GA). GA is known as an efficient and effective search method that attempts to simulate the biological evolution phenomenon. By applying genetic operations such as selection, crossover, and mutation, it is designed to gradually improve the search results. Especially, mutation operator prevents GA from falling into the local optima, thus we can find the globally optimal or near-optimal solution using it. GA has popularly been applied to search optimal parameters or feature subset selections of AI techniques including MSVM. With these reasons, we also adopt GA as an optimization tool. To empirically validate the usefulness of GAMSVM, we applied it to a real-world case of credit rating in Korea. Our application is in bond rating, which is the most frequently studied area of credit rating for specific debt issues or other financial obligations. The experimental dataset was collected from a large credit rating company in South Korea. It contained 39 financial ratios of 1,295 companies in the manufacturing industry, and their credit ratings. Using various statistical methods including the one-way ANOVA and the stepwise MDA, we selected 14 financial ratios as the candidate independent variables. The dependent variable, i.e. credit rating, was labeled as four classes: 1(A1); 2(A2); 3(A3); 4(B and C). 80 percent of total data for each class was used for training, and remaining 20 percent was used for validation. And, to overcome small sample size, we applied five-fold cross validation to our dataset. In order to examine the competitiveness of the proposed model, we also experimented several comparative models including MDA, MLOGIT, CBR, ANN and MSVM. In case of MSVM, we adopted One-Against-One (OAO) and DAGSVM (Directed Acyclic Graph SVM) approaches because they are known to be the most accurate approaches among various MSVM approaches. GAMSVM was implemented using LIBSVM-an open-source software, and Evolver 5.5-a commercial software enables GA. Other comparative models were experimented using various statistical and AI packages such as SPSS for Windows, Neuroshell, and Microsoft Excel VBA (Visual Basic for Applications). Experimental results showed that the proposed model-GAMSVM-outperformed all the competitive models. In addition, the model was found to use less independent variables, but to show higher accuracy. In our experiments, five variables such as X7 (total debt), X9 (sales per employee), X13 (years after founded), X15 (accumulated earning to total asset), and X39 (the index related to the cash flows from operating activity) were found to be the most important factors in predicting the corporate credit ratings. However, the values of the finally selected kernel parameters were found to be almost same among the data subsets. To examine whether the predictive performance of GAMSVM was significantly greater than those of other models, we used the McNemar test. As a result, we found that GAMSVM was better than MDA, MLOGIT, CBR, and ANN at the 1% significance level, and better than OAO and DAGSVM at the 5% significance level.

The Alignment Evaluation for Patient Positioning System(PPS) of Gamma Knife PerfexionTM (감마나이프 퍼펙션의 자동환자이송장치에 대한 정렬됨 평가)

  • Jin, Seong Jin;Kim, Gyeong Rip;Hur, Beong Ik
    • Journal of the Korean Society of Radiology
    • /
    • v.14 no.3
    • /
    • pp.203-209
    • /
    • 2020
  • The purpose of this study is to assess the mechanical stability and alignment of the patient positioning system (PPS) of Leksell Gamma Knife Perfexion(LGK PFX). The alignment of the PPS of the LGK PFX was evaluated through measurements of the deviation of the coincidence of the Radiological Focus Point(RFP) and the PPS Calibration Center Point(CCP) applying different weights on the couch(0, 50, 60, 70, 80, and 90 kg). In measurements, a service diode test tool with three diode detectors being used biannually at the time of the routine preventive maintenance was used. The test conducted with varying weights on the PPS using the service diode test tool measured the radial deviations for all three collimators 4, 8, and 16 mm and also for three different positions of the PPS. In order to evaluate the alignment of the PPS, the radial deviations of the correspondence of the radiation focus and the LGK calibration center point of multiple beams were averaged using the calibrated service diode test tool at three university hospitals in Busan and Gyeongnam. Looking at the center diode for all collimators 4, 8, and 16 mm without weight on the PPS, and examining the short and long diodes for the 4 mm collimator, the means of the validation difference, i.e., the radial deviation for the setting of 4, 8, and 16 mm collimators for the center diode were respectively measured to 0.058 ± 0.023, 0.079 ± 0.023, and 0.097 ± 0.049 mm, and when the 4 mm collimator was applied to the center diode, the short diode, and the long diode, the average of the radial deviation was respectively 0.058 ± 0.023, 0.078 ± 0.01 and 0.070 ± 0.023 mm. The average of the radial deviations when irradiating 8 and 16 mm collimators on short and long diodes without weight are measured to 0.07 ± 0.003(8 mm sd), 0.153 ± 0.002 mm(16 mm sd) and 0.031 ± 0.014(8 mm ld), 0.175 ± 0.01 mm(16 mm ld) respectively. When various weights of 50 to 90 kg are placed on the PPS, the average of radial deviation when irradiated to the center diode for 4, 8, and 16 mm is 0.061 ± 0.041 to 0.075 ± 0.015, 0.023 ± 0.004 to 0.034 ± 0.003, and 0.158 ± 0.08 to 0.17 ± 0.043 mm, respectively. In addition, in the same situation, when the short diode for 4, 8, and 16 mm was irradiated, the averages of radial deviations were 0.063 ± 0.024 to 0.07 ± 0.017, 0.037 ± 0.006 to 0.059 ± 0.001, and 0.154 ± 0.03 to 0.165 ± 0.07 mm, respectively. In addition, when irradiated on long diode for 4, 8, and 16 mm, the averages of radial deviations were measured to be 0.102 ± 0.029 to 0.124 ± 0.036, 0.035 ± 0.004 to 0.054 ± 0.02, and 0.183 ± 0.092 to 0.202 ± 0.012 mm, respectively. It was confirmed that all the verification results performed were in accordance with the manufacturer's allowable deviation criteria. It was found that weight dependence was negligible as a result of measuring the alignment according to various weights placed on the PPS that mimics the actual treatment environment. In particular, no further adjustment or recalibration of the PPS was required during the verification. It has been confirmed that the verification test of the PPS according to various weights is suitable for normal Quality Assurance of LGK PFX.

A Study of Reliability and Validity on the Korean Version of Social Adaptation Self Rating Scale(SASS) (한국어판 사회적응자기평가척도(SASS)의 신뢰도 및 타당도 연구)

  • Kim, Hyeong-Seob;Kim, Yong-Ku;Yoon, Choong-Han;Jeong, Han-Yong;Cheong, Young-Ki
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.8 no.2
    • /
    • pp.212-227
    • /
    • 2000
  • This study was designed to testify the reliability and validation on the Korean version of the Social Adaptation Self-rating Scale(SASS) which was developed from Bose et al. for the evaluation of social motivation and behavior of depressed patients in 1997. Interests for the social world, those of social functioning, of patients were involved in the addition of new measure of disturbance. And those were distinct from abnormalities of thought, mood and symptoms of patients with major depression. As the previous reports there were several evidences that treatments may be less likely to be effective if the system they act on is dysfunctional. Thus, a better social situation favoured better outcome. As a matter of fact, however, those reports were developed in the course of the evaluation of interpersonal therapy(IPT) and cognitive therapy. Accordingly the conversed question -whether pharmacological therapy with antidepressants can impact on social functioning in addition to addressing the core features of illness- has been addressed. To date, anyhow, it is accepted that enhancement of social functioning may be a therapeutic principle in its own right and illness rarely divorced from social context. In terms of those concepts the introduction of an assessment of social functioning into pharmacotherapeutic studies of depression has been welcomed and might be a potent instrument for evaluating the relative pharmacoeconomic benefits of different treatments. Despite of many scales which were applied for the evaluation of symptoms in the patients with depression, however, the scale for the evaluation of social functiong has not been introduced in Korea yet. Thus, this study was designed to introduce the concepts of social functioning in the patients with depression and to testify the reliability and validation on Korean version of SASS. This Korean version of SASS was submitted to a reliability and validation procedure based on the data from healthy general population survey in 291 individuals and 40 patients with major depression. Cronbach a was 0.790 in total subjects group and the correlation of test-retest was statistically significant(y=0.653, p<0.0l). Thus, the Korean version of SASS might be shown to be valid and reliable. The results of multivariate analyses allowed the identification of 3 principle factors(factor 1 = intersts in social activities, factor 2 = active interpersonal relationship, factor 3 = selfesteem) in normal group, however, it could be counted as only one factor in the depression group because nearly total items of SASS were involved in factor 1. In the view of these results, the Korean version of SASS may be useful additional tool for the evaluation of social functioning in depression.

  • PDF

Validation of nutrient intake of smartphone application through comparison of photographs before and after meals (식사 전후의 사진 비교를 통한 스마트폰 앱의 영양소섭취량 타당도 평가)

  • Lee, Hyejin;Kim, Eunbin;Kim, Su Hyeon;Lim, Haeun;Park, Yeong Mi;Kang, Joon Ho;Kim, Heewon;Kim, Jinho;Park, Woong-Yang;Park, Seongjin;Kim, Jinki;Yang, Yoon Jung
    • Journal of Nutrition and Health
    • /
    • v.53 no.3
    • /
    • pp.319-328
    • /
    • 2020
  • Purpose: This study was conducted to evaluate the validity of the Gene-Health application in terms of estimating energy and macronutrients. Methods: The subjects were 98 health adults participating in a weight-control intervention study. They recorded their diets in the Gene-Health application, took photographs before and after every meal on the same day, and uploaded them to the Gene-Health application. The amounts of foods and drinks consumed were estimated based on the photographs by trained experts, and the nutrient intakes were calculated using the CAN-Pro 5.0 program, which was named 'Photo Estimation'. The energy and macronutrients estimated from the Gene-Health application were compared with those from a Photo Estimation. The mean differences in energy and macronutrient intakes between the two methods were compared using paired t-test. Results: The mean energy intakes of Gene-Health and Photo Estimation were 1,937.0 kcal and 1,928.3 kcal, respectively. There were no significant differences in intakes of energy, carbohydrate, fat, and energy from fat (%) between two methods. The protein intake and energy from protein (%) of the Gene-Health were higher than those from the Photo Estimation. The energy from carbohydrate (%) for the Photo Estimation was higher than that of the Gene-Health. The Pearson correlation coefficients, weighted Kappa coefficients, and adjacent agreements for energy and macronutrient intakes between the two methods ranged from 0.382 to 0.607, 0.588 to 0.649, and 79.6% to 86.7%, respectively. Conclusion: The Gene-Health application shows acceptable validity as a dietary intake assessment tool for energy and macronutrients. Further studies with female subjects and various age groups will be needed.