• Title/Summary/Keyword: performance evaluation metric

Search Result 99, Processing Time 0.03 seconds

Implementation of Z-Factor Statistics for Performance Evaluation of Quality Innovation in the High Throughput Process (High Throughput 프로세스에서 품질혁신의 성능평가를 위한 Z-Factor의 적용방안)

  • Choi, Sung-Woon
    • Journal of the Korea Safety Management & Science
    • /
    • v.15 no.1
    • /
    • pp.293-301
    • /
    • 2013
  • The purpose of this study is to introduce the limit of previously used six sigma quality process evaluation metrics, $Z_{st}$ and $P_{pk}$, and a solution to overcome this drawback by using a metric based on performance evaluation of Z-factor quality innovation. Case analysis on projects from national six sigma contest from 2011 to 2012 is performed and literature review on new drug development HTS (High Throughput Screening) is used to propose innovative performance evaluation metrics. This research shows that experimental study on six sigma evaluation metric, $Z_{st}$ and $P_{pk}$, have no significance difference between industrial type (Manufacturing, Semi-Public Institute, Public Institute) and CTQ type (Product Technology Type CTQ, Process Technology Type CTQ). Following discovery characterize this quality improvement as fixed target type project. As newly developed moving target type of quality innovation performance metric Z-Factor is used for evaluating experimental study, hypothetical analysis suggests that $Z_{st}$ and $P_{pk}$ share different relationship or even show reciprocal relationship. Constraints of the study are relatively small sample size of only 37 projects from past 2 years and conflict on having interview and communication with six sigma quality practitioner for qualitative experimental study. Both moving target type six sigma innovation project and fixed target type improvement project or quality circle enables efficient ways for a better understanding and quality practitioner use by applying quality innovation performance metric. Downside of fixed target type quality performance evaluation metric, $Z_{st}$ and $P_{pk}$, is presented through experimental study. In contrast, advantage of this study is that high throughput requiring product technology, process technology and quantum leap typed innovation effect is evaluated based on precision and accuracy and Z-Factor that enables relative comparison between enterprises is proposed and implemented.

Performance Evaluation Methodology in Virtual Environments (가상화 시스템의 성능 평가 방법)

  • Jang, Ji-Yong;Han, Sae-Young;Kim, Jin-Seok;Park, Sung-Yong
    • The KIPS Transactions:PartA
    • /
    • v.15A no.3
    • /
    • pp.167-180
    • /
    • 2008
  • Consolidating servers into a virtualized system increases entire system utilization, while suffers from performance degradation due to the additional virtualization layer. In this paper, we proposed a performance evaluation methodology for comparing virtualized systems with native non-virtualized systems. We defined a system waste rate per consolidated throughput as a metric, and described the method for calculating system waste rate and consolidated throughput for both of virtualized systems and non-virtualized systems. Using the proposing performance evaluation methodology, we established testbeds, evaluated their performance, and compared the metrics of both systems. As a result of the evaluation, we could show the appropriateness of our methodology and analyze the effect of the application characteristics.

Efficient Routing Protocol to Select a High-Performance Route in Wireless Mesh Networks

  • Youn, Joo-Sang
    • Journal of information and communication convergence engineering
    • /
    • v.7 no.2
    • /
    • pp.185-192
    • /
    • 2009
  • In wireless mesh networks multi-rate technology environment, a mesh node can dynamically modify the data transmission rate on a particular link, in response to link distance, or more accurately, the perceived SNR ratio between neighbor nodes. In such networks, existing route selection schemes use a link quality metric. Thus, these schemes may easily result in the network being overloaded. In this paper, a new route metric is proposed; it considers both per-hop service delay and link quality at mesh nodes. In addition, the Load-Aware AODV (LA-AODV) protocol using the proposed metric is presented. The performance evaluation is performed by simulation using the OPNET simulator. It is demonstrated that the LA-AODV protocol outperforms the existing routing protocols using other existing route metrics in multi-rate WMN environment.

Production Performance Prediction of Pig Farming using Machine Learning (기계학습기반 양돈생산성 예측방안)

  • Lee, Woongsup;Sung, Kil-Young;Ban, Tae-Won;Ham, Young Hwa
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.1
    • /
    • pp.130-133
    • /
    • 2020
  • Smart pig farm which is based on IoT has been widely adopted by many pig farmers. In order to achieve optimal control of smart pig farm, the relation between environmental conditions and performance metric should be characterized. In this study, the relation between multiple environmental conditions including temperature, humidity and various performance metrics, which are daily gain, feed intake, and MSY, is analyzed based on data obtained from 55 real pig farm. Especially, based on preprocessing of data, various regression based machine learning algorithms are considered. Through performance evaluation, we show that the performance can be predicted with high precision, which can improve the efficiency of management.

A study on the performance test of canopy cloth on the fishery sea anchor (어업용 씨앵커 본체 천의 성능에 관한 연구)

  • Kyung-Jin RYU;Namgu KIM;Yoo-Won LEE
    • Journal of the Korean Society of Fisheries and Ocean Technology
    • /
    • v.59 no.2
    • /
    • pp.110-116
    • /
    • 2023
  • In this study, samples of sea anchor canopy cloth mainly used in Korean jigging fishing vessels were collected and tested for performance evaluation. The canopy cloth of sea anchor is a basic element of form composition that is known to have the greatest influence on anchor performance. In order to evaluate the performance of sea anchor canopy cloth, five types of samples were tested for new metric count, tensile strength, water vapour transmission rate and drying speed according to the national standard (KS), and some correlations were identified. As a result of the test, the new metric count of cloths was 335.5-443.4 denier in warp and 217-447.6 denier in weft, and the minimum tensile strength was 860 N in warp direction and 430 N in weft direction. The apparent number and tensile strength of cloth were proportional, the water vapour transmission rate of the sample was 206.8 g/m2h, and the drying speed was 90-100 min. This study partially confirmed the performance evaluation based on speculation by the standard test method, and further research is needed on the clear relationship between the research results and the performance of the sea anchor.

Comparative Evaluation of Chest Image Pneumonia based on Learning Rate Application (학습률 적용에 따른 흉부영상 폐렴 유무 분류 비교평가)

  • Kim, Ji-Yul;Ye, Soo-Young
    • Journal of the Korean Society of Radiology
    • /
    • v.16 no.5
    • /
    • pp.595-602
    • /
    • 2022
  • This study tried to suggest the most efficient learning rate for accurate and efficient automatic diagnosis of medical images for chest X-ray pneumonia images using deep learning. After setting the learning rates to 0.1, 0.01, 0.001, and 0.0001 in the Inception V3 deep learning model, respectively, deep learning modeling was performed three times. And the average accuracy and loss function value of verification modeling, and the metric of test modeling were set as performance evaluation indicators, and the performance was compared and evaluated with the average value of three times of the results obtained as a result of performing deep learning modeling. As a result of performance evaluation for deep learning verification modeling performance evaluation and test modeling metric, modeling with a learning rate of 0.001 showed the highest accuracy and excellent performance. For this reason, in this paper, it is recommended to apply a learning rate of 0.001 when classifying the presence or absence of pneumonia on chest X-ray images using a deep learning model. In addition, it was judged that when deep learning modeling through the application of the learning rate presented in this paper could play an auxiliary role in the classification of the presence or absence of pneumonia on chest X-ray images. In the future, if the study of classification for diagnosis and classification of pneumonia using deep learning continues, the contents of this thesis research can be used as basic data, and furthermore, it is expected that it will be helpful in selecting an efficient learning rate in classifying medical images using artificial intelligence.

Research on the Performance of Protocols and the Evaluation Metric for VIDEO Transmissions in an Ad Hoc Network

  • Chen, Ruey-Shin;Chao, Louis R.;Chen, Ching-Piao;Tsai, Chih-Hung
    • International Journal of Quality Innovation
    • /
    • v.10 no.1
    • /
    • pp.115-126
    • /
    • 2009
  • Video transmission effectiveness in the Ad Hoc network is becoming important recently, if different routing protocols are applied. Some researchers conclude that the reactive protocols are better for file transfer protocol (FTP) and constant bit rate (CBR) or hypertext transfer protocol (HTTP) transmission in an Ad Hoc wireless network but the performance report of video transmission is not much. This study adopts Qualnet (Network Simulator) as a simulation tool for environmental designing and performance testing, and employs an experimental design with eight groups. Our experiment shows that: (1) The performance of AODV (reactive) protocol is better than DSDV, ZRP and DSR when the transmission load has only one video stream; (2) Proactive (DSDV) and Hybrid protocols (ZRP) are better for a smaller Ad Hoc network when it transmits a video stream with some applications (VoIP, FTP and CBR). We conclude that packet loss rate is sensitive to the quality of video transmission and it has negative relationship with Peak Signal-to-Noise Ratio (PSNR) value. In addition, our experiment also shows that PSNR is a simple Metric for the performance evaluation of video transmission.

A Study on Establishing Performance Measurement and Evaluation System of ATM (ATM 성능측정 및 평가체계 구축 연구)

  • Seo, Youngsung;Park, Bomi;Kim, Jun-hyuk
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.26 no.1
    • /
    • pp.37-43
    • /
    • 2018
  • There has been the migration to a performance-based approach in many areas which include transition planning at global, regional and local levels, performance-based navigation and safety management. Achieving continuous success of Air Traffic Management (ATM) systems would require a performance-based approach to raise productivity and efficiency of it through performance measurements and reviews. This paper considers establishment planning of performance measurement and evaluation system for ATM. Related to key performance areas proposed by International Civil Aviation Organization, performance indicators and metrics which could be used to measure and evaluate ATM performance are presented. Also, organizational system and operational planning for efficient operation of ATM are presented.

Performance comparison evaluation of speech enhancement using various loss functions (다양한 손실 함수를 이용한 음성 향상 성능 비교 평가)

  • Hwang, Seo-Rim;Byun, Joon;Park, Young-Cheol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.40 no.2
    • /
    • pp.176-182
    • /
    • 2021
  • This paper evaluates and compares the performance of the Deep Nerual Network (DNN)-based speech enhancement models according to various loss functions. We used a complex network that can consider the phase information of speech as a baseline model. As the loss function, we consider two types of basic loss functions; the Mean Squared Error (MSE) and the Scale-Invariant Source-to-Noise Ratio (SI-SNR), and two types of perceptual-based loss functions, including the Perceptual Metric for Speech Quality Evaluation (PMSQE) and the Log Mel Spectra (LMS). The performance comparison was performed through objective evaluation and listening tests with outputs obtained using various combinations of the loss functions. Test results show that when a perceptual-based loss function was combined with MSE or SI-SNR, the overall performance is improved, and the perceptual-based loss functions, even exhibiting lower objective scores showed better performance in the listening test.

Lightweight Quality Metric Based on No-Reference Bitstream for H.264/AVC Video

  • Kim, Yo-Han;Shin, Ji-Tae;Kim, Ho-Kyom
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.6 no.5
    • /
    • pp.1388-1399
    • /
    • 2012
  • This paper proposes a quality metric based on a No-Reference Bitstream (NR-B) having least computational complexity for the assessment of the human-perceptual quality of H.264 encoded video. The proposed NR-B method performs a modeling of encoding distortion with three bit-stream information (i.e. frame-rate, motion-vector, and quantization-parameter) that can be directly extractable from the encoded bitstream and does not require additional complex processing of final pictures. From performance evaluation using 165 compressed video sequences, the experiment results show that the proposed metric has a higher correlation with subjective quality than is achieved with other comparable methods.