• Title/Summary/Keyword: Test Validation

Search Result 1,786, Processing Time 0.035 seconds

A Study on the Development and Validation of the Information Literacy Test by Guilford's Structure of Intellect Model (길포드의 지능구조모형에 의한 정보활용능력 검사도구 개발 및 타당성 연구)

  • Lee, Byeong-Ki
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.47 no.2
    • /
    • pp.181-200
    • /
    • 2013
  • The test instrument utilized to diagnose and evaluate a trainee's ability are necessary for an effective information literacy education. Nevertheless, there is a lack of a standardized test instrument to comprehensively measure students' information literacy. The purpose of this study is to develop a standardized test instrument to evaluate the information literacy of middle school students, and to verify the reliability and validity of the test instrument. For this purpose, this study selected factors that can show the information literacy and developed an information literacy test framework that was designed based on Guilford's SOI model and Meeker's SOI-LA test. The test instrument that was developed through this study is a 30-item Web-based multiple-choice test. This study administrated tests in middle school students (794 students joined), and analyzed difficulty, reliability, discrimination index, validity of tests, and reviewed tests items to qualify the standardized test. The cutoff score was also decided when using these tests as a diagnostic information literacy assessment.

The Development and Validation of a Mobile-based English Speaking Test Convergence Model (모바일 영어말하기평가 융합 시스템 모형 타당도 검사)

  • Kim, Jungtae
    • Journal of the Korea Convergence Society
    • /
    • v.7 no.2
    • /
    • pp.25-31
    • /
    • 2016
  • In the study, a convergence model of a mobile-based English speaking test was developed. Based on the needs analysis from Korean college students, a speaking test App for iOS and Android mobile devices was developed and its test validity was examined. To develop the test, test items, scoring features and scales were developed. The result of the needs analysis survey showed that 69 out of 87 (79.3%) owned Android phones whereas only 17 (19.5%) held iPhones. Based on the result, an English speaking test App was developed. The technologies used for the test included HTML5, the Javasciript bridge technology, Node and Express, and Mongo DB. In the experiment, five examinees took the test. The test validity was obtained in that all the functions of the test were successfully operated and some feedback was gathered.

Development and Testing of a Machine Learning Model Using 18F-Fluorodeoxyglucose PET/CT-Derived Metabolic Parameters to Classify Human Papillomavirus Status in Oropharyngeal Squamous Carcinoma

  • Changsoo Woo;Kwan Hyeong Jo;Beomseok Sohn;Kisung Park;Hojin Cho;Won Jun Kang;Jinna Kim;Seung-Koo Lee
    • Korean Journal of Radiology
    • /
    • v.24 no.1
    • /
    • pp.51-61
    • /
    • 2023
  • Objective: To develop and test a machine learning model for classifying human papillomavirus (HPV) status of patients with oropharyngeal squamous cell carcinoma (OPSCC) using 18F-fluorodeoxyglucose (18F-FDG) PET-derived parameters in derived parameters and an appropriate combination of machine learning methods in patients with OPSCC. Materials and Methods: This retrospective study enrolled 126 patients (118 male; mean age, 60 years) with newly diagnosed, pathologically confirmed OPSCC, that underwent 18F-FDG PET-computed tomography (CT) between January 2012 and February 2020. Patients were randomly assigned to training and internal validation sets in a 7:3 ratio. An external test set of 19 patients (16 male; mean age, 65.3 years) was recruited sequentially from two other tertiary hospitals. Model 1 used only PET parameters, Model 2 used only clinical features, and Model 3 used both PET and clinical parameters. Multiple feature transforms, feature selection, oversampling, and training models are all investigated. The external test set was used to test the three models that performed best in the internal validation set. The values for area under the receiver operating characteristic curve (AUC) were compared between models. Results: In the external test set, ExtraTrees-based Model 3, which uses two PET-derived parameters and three clinical features, with a combination of MinMaxScaler, mutual information selection, and adaptive synthetic sampling approach, showed the best performance (AUC = 0.78; 95% confidence interval, 0.46-1). Model 3 outperformed Model 1 using PET parameters alone (AUC = 0.48, p = 0.047) and Model 2 using clinical parameters alone (AUC = 0.52, p = 0.142) in predicting HPV status. Conclusion: Using oversampling and mutual information selection, an ExtraTree-based HPV status classifier was developed by combining metabolic parameters derived from 18F-FDG PET/CT and clinical parameters in OPSCC, which exhibited higher performance than the models using either PET or clinical parameters alone.

Modified Test Statistic for Identity of Two Distribution on Credit Evaluation (신용평가에서 두 분포의 동일성 검정에 대한 수정통계량)

  • Hong, C.S.;Park, H.S.
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.2
    • /
    • pp.237-248
    • /
    • 2009
  • The probability of default on the credit evaluation study is represented as a linear combination of two distributions of default and non-default, and the distribution of the probability of default are generally known in most cases. Except the well-known Kolmogorov-Smirnov statistic for testing the identity of two distribution, Kuiper, Cramer-Von Mises, Anderson-Darling, and Watson test statistics are introduced in this work. Under the assumption that the population distribution is known, modified Cramer-Von Mises, Anderson-Darling, and Watson statistics are proposed. Based on score data generated from various probability density functions of the probability of default, the modified test statistics are discussed and compared.

Validation of 17 Microsatellite Markers for Parentage Verification and Identity Test in Chinese Holstein Cattle

  • Zhang, Yi;Wang, Yachun;Sun, Dongxiao;Yu, Ying;Zhang, Yuan
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.23 no.4
    • /
    • pp.425-429
    • /
    • 2010
  • To develop an efficient DNA typing system for Chinese Holstein cattle, 17 microsatellites, which were amplified in four fluorescent multiplex reactions and genotyped by two capillary electrophoresis injections, were evaluated for parentage verification and identity test. These markers were highly polymorphic with a mean of 8.35 alleles per locus and an average expected heterozygosity of 0.711 in 371 individuals. Parentage exclusion probability with only one sampled parent was approximately 0.999. Parentage exclusion probability when another parent' genotype was known was over 0.99999. Overall probability of identity, i.e. the probability that two animals share a common genotype by chance, was $1.52{\times}10^{-16}$. In a test case of parentage assignment, the 17 loci assigned 31 out of 33 cows to the pedigree sires with 95% confidence, while 2 cows were excluded from the paternity relationship with candidate sires. The results demonstrated the high efficacy of the 17 markers in parentage analysis and individual identification for Chinese Holstein cattle.

Tracer Experiment and Computational Fluid Dynamics Analysis for the Drainage Efficiency of a Reservoir (배수지의 배수효율분석을 위한 추적자실험 및 전산유체해석)

  • Cho, Jung-Yeon;Go, Sun-Ho;Kwac, Lee-Ku
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.16 no.2
    • /
    • pp.22-27
    • /
    • 2017
  • During the water treatment process for household water supply, a reservoir is the last place the water is stored before being supplied to users, and the duration of the water's stay is an important factor that affects its safety. This may cause the concentration of the residual chlorine disinfectant to increase and thus lower the water's quality. The concentration and discharge efficiency of residual chlorine must be verified and managed, because these are key factors that affect the reservoir's performance. Because the actual verification test for analyzing the efficiency of a reservoir and the disinfectant's dilution capacity is difficult, simulations are generally conducted using the computational fluid analysis method. However, the simulation results require validation with experiments. The error and drainage efficiency were analyzed in this study by comparing and analyzing the actual tracer test and simulation so that the actual test for a hexagonal drainage can be replaced by the computational fluid analysis method. Based on the results of the efficiency analysis, the hexagonal reservoir was found to be appropriate, and the simulation's reliability was verified with a tracer test.

A Study of Translation Conformity on Korean Version of a Balance Evaluation Systems Test (한국어판 Balance Evaluation Systems Test의 번역 적합성 연구)

  • Jeon, Yong-jin;Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.25 no.1
    • /
    • pp.53-61
    • /
    • 2018
  • Background: The process of language translation, adaptation, and cross-cultural validation of tools for use in multiple countries requires the adoption of well-established, comprehensive, and rigorous methodological approaches. Back translation, which is the most recommended method, permits the detection of errors in the translation and the identification of words or phrases that cannot be accurately or literally translated. Objects: The aim of this study was to verify the content validity of a Korean version of a Balance Evaluation Systems test (BESTest) by using a back-translation method. Methods: This research was conducted in six steps: 1) translation of the BESTest into Korean, 2) evaluation of the translation conformity of Korean-translated BESTest, 3) evaluation of the degree of translation comprehension, 4) back translation of Korean BESTest, 5) evaluation of the technical and conceptual equivalence, and 6) completion of the Korean version of BESTest by the translation verification committee. Results: In this study, Korean version of the BESTest achieved a rating of more than 3 (moderate) for translation comprehension, and technical equivalence and conceptual equivalence of back translation were evaluated as 3 (moderate) or more. Conclusion: The Korean version of the BESTest has proven content validity and is an appropriate tool to measure balance function.

Model-Based Development and Test Method for The AUTOSAR Embedded Software (AUTOSAR 임베디드 소프트웨어의 모델기반 개발 및 테스트 방법 - 사례연구 : 운전자 위치제어 시스템)

  • Park, Gwangmin;Kum, Daehyun;Lee, Seonghun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.4 no.4
    • /
    • pp.164-173
    • /
    • 2009
  • Automotive systems have tended to be equipped with many electronic contents to satisfy safety, comport, convenience, and entertainment services over the past years. As a result, the amount of vehicle embedded software in electrical/electronic(E/E) systems is steadily increasing to manage these requirements. This leads to the traditional, document-based software development in the vehicle embedded systems being increasingly displaced by a model-based development in order to reduce software development time and cost. Due to the application of model-based development, a great evolution is being realized in the aspect of efficiency, but the development is being made without sufficient testing. So, erroneous automotive embedded software may cause serious problems such as car accidents which relate to human safety. Therefore, efficient methods for model-based test and validation are needed to improve software reliability in the stage of embedded software development. This paper presents the model-based development and test method for AUTOSAR embedded software to improve its reliability and safety, and it is demonstrated based on the case study.

  • PDF

Accelerated Life Test Design of an Electromagnetic Shielding Door Hinge (전자파 차폐도어용 힌지의 가속 수명 시험법 설계)

  • Kim, Do Sik;Cheong, Han Young
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.41 no.9
    • /
    • pp.887-895
    • /
    • 2017
  • This paper presents a study on the accelerated life tests of parts that operate during the opening and closing of door frames, particularly door hinges. Hinge theoretical verification and validation of the test equipment in the present study and the different structures and fault mode, depending on the purpose of usage analysis, failure mode for one of the hinges of the switchgear components used for electromagnetic shielding facilities and on-site operating conditions. The accelerated life test was designed for the characteristic lifetime prediction of the components, by estimating the shape parameter and the acceleration factor.

Direct ECC Bypass Phenomena in the MIDAS Test Facility During LBLOCA Reflood Phase

  • B.J. Yun;T.S. Kwon;D.J. Euh;I.C. Chu;Park, W.M.;C.H. Song;Park, J.K.
    • Nuclear Engineering and Technology
    • /
    • v.34 no.5
    • /
    • pp.421-432
    • /
    • 2002
  • As one of the advanced design features of the APR1400, direct vessel injection (DVI) system is being considered instead of conventional cold leg injection (CLI) system. It is known that the DVI system greatly enhances the reliability of the emergency core cooling (ECC) system. However, there is still a dispute on its performance in terms of water delivery to the reactor core during the reflood phase of a large-break loss-of-coolant accident (LOCA). Thus, experimental validation is under progress. In this paper, test results of direct ECC bypass performed in the steam-water test facility tailed MIDAS (Multi-dimensional Investigation in Downcomer Annulus Simulation) are presented. The test condition is determined, based on the preliminary analysis of TRAC code, by applying the ‘modified linear scaling method’with the l/4.93 length scale . From the tests, ECC direct bypass fraction, steam condensation rate and information on the flow distribution in the upper annulus downcomer region are obtained.