• Title/Summary/Keyword: Test Accuracy

Search Result 4,922, Processing Time 0.207 seconds

Finding Unexpected Test Accuracy by Cross Validation in Machine Learning

  • Yoon, Hoijin
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.12spc
    • /
    • pp.549-555
    • /
    • 2021
  • Machine Learning(ML) splits data into 3 parts, which are usually 60% for training, 20% for validation, and 20% for testing. It just splits quantitatively instead of selecting each set of data by a criterion, which is very important concept for the adequacy of test data. ML measures a model's accuracy by applying a set of validation data, and revises the model until the validation accuracy reaches on a certain level. After the validation process, the complete model is tested with the set of test data, which are not seen by the model yet. If the set of test data covers the model's attributes well, the test accuracy will be close to the validation accuracy of the model. To make sure that ML's set of test data works adequately, we design an experiment and see if the test accuracy of model is always close to its validation adequacy as expected. The experiment builds 100 different SVM models for each of six data sets published in UCI ML repository. From the test accuracy and its validation accuracy of 600 cases, we find some unexpected cases, where the test accuracy is very different from its validation accuracy. Consequently, it is not always true that ML's set of test data is adequate to assure a model's quality.

A Study on the Test Workpiece for Accuracy Evaluation of 5-Axis Machine Tool (5축 공작기계 정밀도 평가를 위한 표준 공작물에 관한 연구)

  • Youn, Jae-Woong;Kim, Ki-Hwan;Park, Jong Tak
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.31 no.5
    • /
    • pp.431-439
    • /
    • 2014
  • Recently, a demand for precision 5-axis machine tools is significantly increasing, and the maintenance of machine tool accuracy becomes more important. it is very difficult to evaluate to accuracy of 5-axis M/C in the production site since it needs expensive measuring equipment and skilled engineer. On the other hand, evaluation items of 5-axis M/C are not systematically organized in the existing KS and ISO standards. In this study, the evaluation items for 5-axis M/C were derived systematically and a test workpiece was developed to evaluate the machine tool accuracy more easily. The error sources of machine tool can be estimated by machining and measuring of the test workpiece. The correlation between the machine tool accuracy and the accuracy of machined test workpiece was analyzed. As a result, the accuracy of machined test workpiece represented the accuracy of machine tool and the error sources very effectively.

Development of Effective Test Method for Positioning Accuracy of Armed Vehicle Inertial Navigation System (기동화력장비 관성항법장치의 효과적인 위치정확도 시험방법 개발)

  • Kim, Sung Hoon;Bae, In Hwa;Kim, Sang Boo
    • Journal of Korean Society for Quality Management
    • /
    • v.51 no.4
    • /
    • pp.619-632
    • /
    • 2023
  • Purpose: The main function of INS (Inertial Navigation System) is to measure the position of an armed vehicle and its performance is confirmed through the positioning accuracy test of Korean Defense Standards (KDS). The current standards, however, do not provide clear test methods and the conditions for performing positioning accuracy tests. Accordingly, the purpose of this study is to develop a new method for positioning accuracy test which would be effective. Methods: In this study, a new INS positioning accuracy test method is suggested based on the analysis of test data collected through a statistical experiment known as central composite design. For the positioning accuracy experiment of K105A1, a self-propelled artillery, two factors of driving velocity and driving distance are considered. Results: Based on the analysis of experimental data, a regression model for the positioning error is fitted and the positioning accuracy test of INS is so developed to maximize the positioning error. The standard proximity rate is used as an additional test criterion to evaluate the performance level of INS. Conclusion: The proposed new positioning accuracy test for INS has the advantage of finding the nonconforming items effectively. It is also expected to be utilized for the other similar INS positioning accuracy tests.

Diagnostic Accuracy of Clinical Test for Anterior Cruciate Ligament Injury: Systematic Review

  • Deniz Yasemin;Sang-Woo Pyun;HyungSu Lee;Seong-Eun Kim;SunGyu Han;Dongyeop Lee;Ji-Heon Hong;Jae-Ho Yu;Jin-Seop Kim;Seong-gil Kim
    • The Journal of Korean Physical Therapy
    • /
    • v.35 no.3
    • /
    • pp.57-63
    • /
    • 2023
  • Purpose: The aim of this study was to conduct a systematic review of randomized controlled studies from 2012 to present that explore the diagnostic accuracy of clinical tests used for diagnosing anterior cruciate ligament (ACL) injury. Methods: Study design: Systematic review. Literature search of the PubMed and Scholar databases was conducted using keywords related to diagnostic accuracy of clinical tests for ACL injury. The PRISMA Guidelines were followed to conduct this study. The Cochrane Risk of Bias Tool was utilized to assess the quality of each included study. Results: As a result, 8 studies were included, and 6 clinical tests used in ACL tears were evaluated for diagnostic accuracy. The pivot shift test was reported as having the highest +LR (29.5) value with a sensitivity of 59% and a specificity of 98%. However, the test with the lowest -LR value was the lever test, and the values were as follows: -LR (0.08), +LR (4.7), specificity (80%), sensitivity (94%). Conclusion: In this study, it was concluded that a single clinical test is not sufficient to determine the presence of ACL injury. Test combinations have a higher diagnostic accuracy than a single test. In this study, the accuracy of the clinical tests was examined without considering the amount of ACL rupture and acute-chronic condition. Further research is required to examine the impact of these two factors on diagnostic accuracy of clinical test.

A Miniaturized Catadioptric Laser-Irradiation-Precision Test System

  • Liu, Huan;Sun, Hao;Wang, Chunyan
    • Current Optics and Photonics
    • /
    • v.5 no.2
    • /
    • pp.164-172
    • /
    • 2021
  • In this paper a catadioptric laser-irradiation-precision test system is designed, to achieve a high-precision laser-irradiation-accuracy test. In this system, we adopt the method of imaging the entire target surface at a certain distance to realize the measurement of laser-irradiation precision. The method possesses the advantages of convenient operation, high sensitivity, and good stability. To meet the test accuracy requirement of 100 mm/km (0.01%), the coma, field curvature, and distortion over the entire field of view should be eliminated from the optical system's design. Taking into account the whole length of the tube and the influence of stray light on the structure type, a catadioptric system with a hood added near the primary imaging surface is designed. After optimization using the ZEMAX software, the modulation transfer function (MTF) of the designed optical system is 0.6 at 30 lp/mm, the full-field-of-view distortion is better than 0.18%, and the energy concentration in the 10-㎛-radius surrounding circle reaches about 90%. The illumination-accuracy test results show that the measurement accuracy of the radiation hit rate is better than 50 mm when the test distance is 1 km, which is better than the requirement of 100 mm/km for the laser-irradiation-accuracy test.

A Study on Practical PMM Test Technique for Ship Maneuverability Using System Identification Method (선박의 조종성능 추정에 있어서 시스템식별법을 이용한 PMM 시험 기법에 대한 연구)

  • 이태일;권순홍
    • Journal of Ocean Engineering and Technology
    • /
    • v.16 no.6
    • /
    • pp.25-31
    • /
    • 2002
  • A system identification method is introduced to increase the prediction accuracy of a ship's maneuverability in PMM test, analysis. To improve the accuracy of linear hydrodynamic coefficients, the analysis techniques of pure sway and yaw tests are developed, and confirmed. In the analysis of sway tests, accuracy to linear hydrodynamic coefficients depends on the frequency of sway motion. To obtain nonlinear hydrodynamic coefficients for large drift angles, a combined yaw test is introduced. Using this system identification method, runs of PMM test can be reduced while retaining sufficient accuracy, compared to the Fourier integration method. Through the comparisons with sea trial results and the Fourier integration method, the accuracy and efficiency of the newly proposed system identification method, based on least square method, has been validated.

A Test Result on the Positional Accuracy of Kompsat-3A Beta Test Images

  • Oh, Jae Hong;Seo, Doo Chun;Lee, Chang No
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.34 no.2
    • /
    • pp.133-142
    • /
    • 2016
  • KOMPSAT-3A (KOrea Multi-Purpose SATellite-3A) was launched in March 25 2015 with specification of 0.5 meters resolution panchromatic and four 2.2 meters resolution multi spectral sensors in 12km swath width at nadir. To better understand KOMPSAT-3A positional accuracy, this paper reports a test result on the accuracy of recently released KOMPSAT-3A beta test images. A number of ground points were acquired from 1:1,000 digital topographic maps over the target area for the accuracy validation. First, the original RPCs (Rational Polynomial Coefficients) were validated without any GCPs (Ground Control Points). Then we continued the test by modeling the errors in the image space using shift-only, shift and drift, and the affine model. Ground restitution accuracy was also analyzed even though the across track image pairs do not have optimal convergence angle. The experimental results showed that the shift and drift-based RPCs correction was optimal showing comparable accuracy of less than 1.5 pixels with less GCPs compared to the affine model.

Calculation of Sample Size for Guided Missile Considering Test Method and Reliability Growth (유도무기 시험평가 방법과 신뢰성 성장을 고려한 시험 수량 산출)

  • Lee, Youn-ho;Kim, Jae-hwang;Lee, Kye-shin;Lee, Jong-sin;Lee, Myoung-jin;Kim, Doo-hyun
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.20 no.6
    • /
    • pp.844-852
    • /
    • 2017
  • Since guided weapon is high-cost and one-shot device which is non-reusable, it requires a lot of resources to prove required accuracy as a part of reliability demonstration. Once a test for proving accuracy rate of guided missile fails, it causes an additional cost and delay of schedule. This study introduces an equation for proper sample size and plan for guided-missile accuracy rate test in order to minimize the risk of test failure. Proper sample size for the test is derived by considering the reliability growth. Furthermore, each task for accuracy rate test is defined according to the development step. Therefore, this study can contribute to reduce sample size for accuracy rate test in order to meet the reliability requirement and assure transparency in the test process.

A Study on Direction Finding Accuracy Analysis for Airborne ESM (항공용 전자전장비의 방향탐지 정확도 분석기법)

  • Lee, Young-Joong;Kim, In-Seon;Park, Joo-Rae
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.11 no.6
    • /
    • pp.63-73
    • /
    • 2008
  • The helicopter position, heading data and the direction finding data of ESM are essentially required to compensate the parallax and analyze the direction finding accuracy of heliborne ESM in flight test phase. In the case of the long test range compared with small platform like as LYNX helicopter and Jisim Island test site, the parallax compensation for direction finding accuracy calculation and GPS position error can be neglected. In this paper, the direction finding accuracy on the basis of helicopter propeller was calculated by coordinate changing between helicopter and transmitting antenna from WGS84 coordinate to navigation coordinate using helicopter position and direction finding data.

Comparison of Accuracy of RP Processes (RP 공정의 정밀도 비교 평가)

  • 변홍석;신행재;이관행
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2000.11a
    • /
    • pp.330-333
    • /
    • 2000
  • Dimensional accuracy and surface quality are very important in rapid prototyping especially when the models are used for the production of tools. This paper presents the development of benchmarking part to investigate dimensional accuracy and surface finish. A new test part is designed to perform benchmarking of major rapid prototyping processes such as selective laser sintering, laminated object manufacturing, stereolithography apparatus, and fused deposition modeling. The test part design includes basic manufacturing features such as holes, walls, squares, cylinder and etc. In addition, the small features are included in order to evaluate the fine details that can be manufactured by a specific RP process. The CMM program that automatically measures different features in the test part is also developed. The evaluation of accuracy as well as surface roughness are discussed for major rapid prototyping processes.

  • PDF