• 제목/요약/키워드: performance metrics

검색결과 764건 처리시간 0.027초

Counting What Will Count: How to Empirically Select Leading Performance Indicator

  • Pauwels, Koen;Joshi, Amit
    • 아태비즈니스연구
    • /
    • 제2권2호
    • /
    • pp.1-35
    • /
    • 2011
  • Facing information overload in today's complex environments, managers look to a concise set of marketing metrics to provide direction for marketing decision making. While there have been several papers dealing with the theoretical aspects of dashboard creation, no research creates and tests a dashboard using scientific techniques. This study develops and demonstrates an empirical approach to dashboard metric selection. In a fast moving consumer goods category, this research selects leading indicators for national-brand and store-brand sales and revenue premium performance from 99 brand-specific and relative-to-competition variables including price, brand equity, usage occasions, and multiple measures of awareness, trial/usage, purchase intent, and liking/satisfaction. Plotting impact size and wear-in time reveals that different kinds of variables predict sales at distinct lead times, which implies that managerial action may be taken to turn the metrics around before performance itself declines.

  • PDF

Evaluation System for Defense IT Project in Korea: Post-Implementation Stage

  • Lee, Sangho;Song, Chong-Hyun
    • Journal of Multimedia Information System
    • /
    • 제5권4호
    • /
    • pp.291-297
    • /
    • 2018
  • Performance measurement is not an easy task. However, it is necessary to measure the expected value of the informatization project to be invested, to help the successful progress of the informatization project, and to confirm the result of the informatization project. This study describes the evaluation systems of the defense informatization project in Korea used after the end of the informatization project (post-implementation evaluation stage). In the post-implementation evaluation stage of proposed system, the informatization project is evaluated in terms of performance achievement, project plan compliance, project management, and economic validity. For each element, this study suggests metrics and practical measurement method. With metrics and their method, it can be evaluated which project is better than others. Moreover, the lessons learned can be developed. Under scarce budget condition, defense organizations can make better performance from IT project with the evaluation system suggested in this study.

Layer 3 이더넷 스위치 성능 시험 방법론 연구 (A Methodology for Performance Testing of Ethernet Switch)

  • 김용선
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2000년도 추계종합학술대회 논문집(1)
    • /
    • pp.441-444
    • /
    • 2000
  • This paper covers the performance testing for layer 3 Ethernet switch based on various methodologies by which we can measure essential metrics such as throughput, latency, frame loss rate, and back to back frames. In the first place, layer 2 and layer 3 switch evolution is introduced followed by description of IP packet switching in layer 3 switch. And then, the above test metrics and test methodologies are illustrated as well. At last, we conduct the performance testing for layer 3 switch in case of transmitting packets of 64, 128, 256, 512, 1024, 1280, and 1518 byte size and analyze then results.

  • PDF

An Anomaly Detection Framework Based on ICA and Bayesian Classification for IaaS Platforms

  • Wang, GuiPing;Yang, JianXi;Li, Ren
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제10권8호
    • /
    • pp.3865-3883
    • /
    • 2016
  • Infrastructure as a Service (IaaS) encapsulates computer hardware into a large amount of virtual and manageable instances mainly in the form of virtual machine (VM), and provides rental service for users. Currently, VM anomaly incidents occasionally occur, which leads to performance issues and even downtime. This paper aims at detecting anomalous VMs based on performance metrics data of VMs. Due to the dynamic nature and increasing scale of IaaS, detecting anomalous VMs from voluminous correlated and non-Gaussian monitored performance data is a challenging task. This paper designs an anomaly detection framework to solve this challenge. First, it collects 53 performance metrics to reflect the running state of each VM. The collected performance metrics are testified not to follow the Gaussian distribution. Then, it employs independent components analysis (ICA) instead of principal component analysis (PCA) to extract independent components from collected non-Gaussian performance metric data. For anomaly detection, it employs multi-class Bayesian classification to determine the current state of each VM. To evaluate the performance of the designed detection framework, four types of anomalies are separately or jointly injected into randomly selected VMs in a campus-wide testbed. The experimental results show that ICA-based detection mechanism outperforms PCA-based and LDA-based detection mechanisms in terms of sensitivity and specificity.

3차원 집적 영상 시스템의 최적 파라미터 (Optimum parameters of 3D integral imaging system)

  • 조명진;이병국
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2012년도 추계학술대회
    • /
    • pp.1019-1022
    • /
    • 2012
  • 집적 영상 (Integral Imaging) 기술은 3차원 이미징 (Imaging)과 디스플레이를 위한 기술이다. 많은 파라미터들이 3차원 집적 영상 시스템의 성능에 영향을 준다. 3차원 시스템 성능의 척도 (Performance Metric)를 정의하고 이러한 파라미터들을 최적화함으로써 향상된 시스템 성능을 얻을 수 있다. 본 논문에서는 주어진 시스템 조건하에서 성능 척도를 사용하여 3차원 집적 영상 시스템의 성능을 최적화하는 방법에 대해 설명한다. 이 분석에서, 성능 척도를 최적화하기 위해 렌즈의 개구수 (Numerical Aperture), 영상 센서간의 거리, 영상 센서의 수, 픽셀 크기, 그리고 픽셀 수와 같은 시스템 파라미터들을 최적화하여 선택한다. 이미징 처리과정을 설명하기 위해 파동 광학 (Wave Optics)을 사용하였다.

  • PDF

Assessing the R&D Effectiveness and Business Performance: A Review of Their Mechanisms and Metrics

  • Cho, Yonghee
    • STI Policy Review
    • /
    • 제9권1호
    • /
    • pp.1-29
    • /
    • 2018
  • With the constant growth of R&D investment, it has been increasingly necessary to evaluate the effectiveness of R&D performance and there is a high emphasis on ensuring the accountability and effectiveness of R&D programs. The evaluation of performance of a firm is especially necessary in times of economic downturn to justify R&D investment. However, there is a marked shortage of clear guidelines as to where and how particular metrics are used to measure the output and outcome of R&D activity in firms. Many firms have difficulties in selecting appropriate indicators for their R&D and financial performances. To fill this gap, this article discusses and presents the findings from the literature in such a way that they become useful for researchers or managers who are in charge of measuring the R&D and business performances arising from innovation activities. Finally, based on the findings about metrics of R&D performance, this article proposes the hypothetical framework to investigate the relationship between technology forecasting, strategic technology planning, and business performance. The framework of this article will assist policy makers, universities, research institutes/national laboratories, and companies to enhance their decision making process in technology development.

Speech Rhythm Metrics for Automatic Scoring of English Speech by Korean EFL Learners

  • 장태엽
    • 대한음성학회지:말소리
    • /
    • 제66호
    • /
    • pp.41-59
    • /
    • 2008
  • Knowledge in linguistic rhythm of the target language plays a major role in foreign language proficiency. This study attempts to discover valid rhythm features that can be utilized in automatic assessment of non-native English pronunciation. Eight previously proposed and two novel rhythm metrics are investigated with 360 English read speech tokens obtained from 27 Korean learners and 9 native speakers. It is found that some of the speech-rate normalized interval measures and above-word level metrics are effective enough to be further applied for automatic scoring as they are significantly correlated with speakers' proficiency levels. It is also shown that metrics need to be dynamically selected depending upon the structure of target sentences. Results from a preliminary auto-scoring experiment through a Multi Regression analysis suggest that appropriate control of unexpected input utterances is also desirable for better performance.

  • PDF

DeLone과 McLean의 정보시스템 성공 모형을 통한 추천시스템 성공 요인 재구성 (Reconfiguration of Recommender System Success with DeLone and McLean's Model of IS Success)

  • 권오병
    • 지식경영연구
    • /
    • 제11권4호
    • /
    • pp.21-39
    • /
    • 2010
  • Recommender system is a core component of e-commerce. Correspondingly, metrics to evaluate the system performance have been developed and applied. However, even though we have lots of applications that have tried to adopt recommender systems, the dearth of successfully installed recommender systems for more than a decade leads us to a skeptical thinking that current metrics do not sufficiently indicate the recommender system success in business viability point of view. Hence, the purpose of this paper is to reconfigure measures for recommender system success. Adopting DeLone and McLean's amended model of information system success as the underlying framework, content analysis with intellectual properties on recommender systems was conducted to modify the currently used metrics. Then a model of recommender system success is proposed based on the newly identified metrics are compared with traditional metrics.

  • PDF

인용 지표를 이용한 재순위화 및 질의 확장의 성능 평가 - 인용색인 데이터베이스를 기반으로 - (Performance Evaluation of Re-ranking and Query Expansion for Citation Metrics: Based on Citation Index Databases)

  • 이혜경;이용구
    • 한국문헌정보학회지
    • /
    • 제57권3호
    • /
    • pp.249-277
    • /
    • 2023
  • 본 연구의 목적은 인용 지표가 인용 색인 데이터베이스의 검색성능 향상에 기여할 가능성을 파악하는 데에 있다. 이를 위하여 본 연구는 문헌정보학 분야 10개의 질의를 Web of Science에서 검색하여 수집한 3,467건의 문헌과 2000년부터 2021년까지 SSCI 문헌정보학 분야 저널 85종에 수록된 60,734건의 문헌을 기반으로 적합성 판단을 거쳐, 검색 결과의 상위 100순위에 대한 성능 및 검색 방식과 인용 지표를 활용한 재순위화, 그리고 벡터 공간모형 검색시스템 구축 등에 따른 질의 확장 실험을 수행하였다. 그 결과 첫째, 인용 지표를 단독으로 사용한 재순위화의 성능은 Web of Science의 검색성능과 상이하였으며, 인용 지표는 Web of Science 기존 시스템에 적용되지 않는 독립적인 지표로 작용하고 있었다. 둘째, 고유 질의어 수에 질의어의 총 출현 빈도를 조합하고 인용수를 보조적으로 사용했을 때, 성능에 긍정적인 영향을 미칠 것으로 확인하였다. 셋째, 질의 확장에서는 전반적으로 벡터 공간모형 기반 검색시스템의 기본 성능 대비 성능이 향상되었다. 넷째, 이용자 적합성을 통해 질의 확장을 적용한 경우가 시스템 적합성을 적용한 경우보다 성능이 향상 되었다. 다섯째, 피인용 수를 적합 문헌과 더불어 사용하면 최상위권 내 적합 문헌에서의 순위 변동 가능성을 보여주었다.

정보보호제품 품질평가를 위한 품질 모델 및 메트릭에 관한 연구 (A Study on the Quality Model and Metrics for Evaluating the Quality of Information Security Products)

  • 윤여웅;이상호
    • 정보보호학회논문지
    • /
    • 제19권5호
    • /
    • pp.131-142
    • /
    • 2009
  • 정보보호제품 사용자는 보안성과 성능을 포함한 좋은 품질의 정보보호제품을 요구하고 있으나 정보보호제품에 대한 품질평가는 물론 다양한 정보보호제품의 품질을 평가하기 위한 품질 모델과 정보보호제품별 메트릭에 대한 연구가 전무한 실정이다. 본 논문에서는 정보보호제품을 3가지 제품군으로 분류하고, 다양한 정보보호제품이 가질 수 있는 보안성과 성능을 분석하였다. 이를 통하여 정보보호제품의 보안성과 성능이 고려된 품질 모델을 새롭게 정의하였고 정의된 품질모델은 7개의 품질 특성과 24개의 품질 부특성을 가진다. 또한, 정보보호제품의 품질평가에 사용가능한 62개의 공통 메트릭과 45개의 확장 메트릭으로 구성하고 특정 정보보호제품의 품질평가 메트릭을 생성하는 방법을 제안하였다. 제안된 메트릭 생성 방법은 다양한 정보보호제품에 적용할 수 있도록 메트릭의 확장이 가능하며 침입차단시스템, 침입탐지시스템 및 지문인식시스템에 대한 품질평가 메트릭을 생성하고 검증하여 다양한 정보보호제품에 적용가능함을 보였다.