• Title/Summary/Keyword: data evaluation framework

Search Result 473, Processing Time 0.028 seconds

Automatic False-Alarm Labeling for Sensor Data

  • Adi, Taufik Nur;Bae, Hyerim;Wahid, Nur Ahmad
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.2
    • /
    • pp.139-147
    • /
    • 2019
  • A false alarm, which is an incorrect report of an emergency, could trigger an unnecessary action. The predictive maintenance framework developed in our previous work has a feature whereby a machine alarm is triggered based on sensor data evaluation. The sensor data evaluator performs three essential evaluation steps. First, it evaluates each sensor data value based on its threshold (lower and upper bound) and labels the data value as "alarm" when the threshold is exceeded. Second, it calculates the duration of the occurrence of the alarm. Finally, in the third step, a domain expert is required to assess the results from the previous two steps and to determine, thereby, whether the alarm is true or false. There are drawbacks of the current evaluation method. It suffers from a high false-alarm ratio, and moreover, given the vast amount of sensor data to be assessed by the domain expert, the process of evaluation is prolonged and inefficient. In this paper, we propose a method for automatic false-alarm labeling that mimics how the domain expert determines false alarms. The domain expert determines false alarms by evaluating two critical factors, specifically the duration of alarm occurrence and identification of anomalies before or while the alarm occurs. In our proposed method, Hierarchical Temporal Memory (HTM) is utilized to detect anomalies. It is an unsupervised approach that is suitable to our main data characteristic, which is the lack of an example of the normal form of sensor data. The result shows that the technique is effective for automatic labeling of false alarms in sensor data.

A Study on the Improvement of the Criteria for the Management Evaluation Related to the Means-Efficiency of Public Library (공공도서관 수단효율성관련 경영평가기준의 개선방향에 관한 연구)

  • Jung, Won Joo;Hong, Hyun Jin
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.28 no.4
    • /
    • pp.203-221
    • /
    • 2017
  • This study is to suggest some improvement directions of the criteria for the management evaluation in order to contribute to the achievement of lasting value of the continuous development and publicity in regard to the public library means-efficiency. To this end, This study analyzed the means-efficiency evaluation criteria via theoretical review on business analysis of private enterprise and the analysis framework based on it. The improvement of evaluation criteria in regard to efficiency for the continuous development of public library are as follows. 1) Regardless of domestic and foreign, an efficiency index in the performance evaluation index of public library is absolutely insufficient. The sufficient indexes measuring efficiency which is appropriate for the concept of performance should be developed. 2) A flow data representing input and performance in certain time period is insufficient. Therefore, evaluation index consisted of flow data should be more developed. 3) Long term stock data is excluded in the term cost as it is the cost used for the long term such as fixed assets. However, it is useful as input data, which is realized through the perfect accounting.

A Development of the Model for Evaluating the Security of Information Systems in Health Care Organizations (의료기관의 정보보안 수준 측정을 위한 평가모형 개발)

  • Ahn, Sun-Ju;Kwon, Soon-Man
    • Korea Journal of Hospital Management
    • /
    • v.10 no.4
    • /
    • pp.98-112
    • /
    • 2005
  • The purpose of this study is to develop a framework for evaluating security levels in hospitals. We classify security indicators into administrative, technical and physical safeguards. The security evaluation model for hospital information systems was applied to three general hospitals. The analysis of the results showed a low security level in information systems. In particular, requirements for administrative and physical safeguards were very low. Hospitals need strict security policies more than other organizations because their information systems contain patients' highly confidential data. The evaluation model developed in this study can be used for guidelines and as a checklist for hospitals. The security evaluation in hospital informational systems needs to be an essential element of hospital evaluation.

  • PDF

A Study on the Application of a Meta-Evaluation Approach for the Development of an Evaluation Scale for Multicultural Family Support Services (다문화가족지원사업 평가지표 개발을 위한 메타평가의 적용)

  • Song, Hye-Rim;Park, Jeong-Yoon
    • Journal of Family Resource Management and Policy Review
    • /
    • v.15 no.3
    • /
    • pp.43-62
    • /
    • 2011
  • The purpose of this study was to propose a framework and system for an advanced evaluation scale for the Multicultural Family Support Center and its services. For this study, we used the Meta-Evaluation method, which is also known as an 'evaluation of the evaluation.' The data were collected from 134 surveys of individuals working in the Multicultural Family Support Center. The questionnaire consisted of two parts: a) general opinions regarding the present evaluation scale; and b) concrete opinions about the details of the scale. The results indicated several problems and issues for improvement. In light of these results, we suggest that not only do the detailed scales have to be modified to incorporate workers' opinions, but also that the management of the evaluation system itself has to be improved in order to achieve more effective evaluation procedures.

  • PDF

Development of a Novel Integrated Evaluation Index for Freeway Traffic Data (고속도로 교통자료 품질 통합평가지표 개발)

  • PARK, Hyunjin;YOON, Mijung;KIM, Hae;OH, Cheol
    • Journal of Korean Society of Transportation
    • /
    • v.33 no.4
    • /
    • pp.417-429
    • /
    • 2015
  • Evaluation of traffic data quality is a backbone of better traffic information and management systems because it directly affects the reliability of traffic information. This study developed an integrated index for evaluating the quality of archived intelligent transportation systems (ITS) data. Two novel indices including spatio-temporal consistency and severity of missing data were devised and integrated with existing indices such as availability and completeness. An evaluation framework was proposed based on the developed integrated index. Both analytical hierarchical analysis (AHP) technique and entropy method were adopted to derive mixed weighting values to be used for the integrated index. It is expected that the proposed methodology would be effectively used in enhancing the quality of traffic data as a part of traffic information system.

Establishment and Standardization of Evaluation Procedure for Urban Flooding Analysis Model Using Available Inundation Data (가용 침수 자료를 활용한 도심지 침수 해석 모형의 평가 절차 수립 및 표준화)

  • Shin, Eun Taek;Jang, Dong Min;Park, Sung Won;Eum, Tae Soo;Song, Chang Geun
    • Journal of the Korean Society of Safety
    • /
    • v.35 no.2
    • /
    • pp.100-110
    • /
    • 2020
  • Recently, the frequency of typhoon and torrential rain due to climate change is increasing. In addition, the upsurge in the complexity of urban sewer network and impervious surfaces area aggravates the inland flooding damage. In response to these worsening situations, the central and local governments are conducting R&D tasks related to predict and mitigate the flood risk. Researches on the analysis of inundation in urban areas have been implemented through various ways, and the common features were to evaluate the accuracy and justification of the model by comparing the model results with the actual inundation data. However, the evaluation procesure using available urban flooding data are not consistent, and if there are no quantitative urban inundation data, verification has to be performed by using press releases, public complaints, or photos of inundation occurring through 'CCTV'. Because theses materials are not quantitative, there is a problem of low reliability. Therefore, this study intends to develop a comparative analysis procedure on the quantitative degree and applicability of the verifiable inundation data, and a systematic framework for the performance assessment of urban flood analysis model was proposed. This would contribute to the standardization of the evaluation and verification procedure for urban flooding modelling.

Differentiated message handling and performance evaluation for the NGN call control services (NGN 서비스의 호 처리 차별화 방안 및 성능분석)

  • 정문조;황찬식
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.40 no.12
    • /
    • pp.145-154
    • /
    • 2003
  • In this paper we propose service schemes for the control message of voice and data connections served by a Softswitch in NGN (next generation networks). After that we propose a method of evaluating the performance of a Softswitch that provides a limited delay to voice connections. Via numerical experiments, we verify the implication of the proposition in the design of a Softswitch, which simultaneously incorporates voice and data services in the NGN framework.

A Study on Building of Outcomes Evaluation System Using Data of a Public Library (공공도서관 데이터를 활용한 도서관 성과평가 시스템 구축 연구)

  • Han, Sang-woo;Park, Sung-jae
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.52 no.4
    • /
    • pp.163-178
    • /
    • 2018
  • The purpose of this study is to build outcomes evaluation system for measuring outcomes of programs provided by a public library. For the study, we constructed outcomes evaluation system(LibOutcomes system) that applied library outcome measurement framework based on the logic model and this system made librarians to measure outcome directly import data from the KOLAS and upload it. As a result, LibOutcomes system was useful for verifying outcomes as visual result. In addition, since the system was built a web-based system, it is possible to secure accessibility and ease of use. Finally, we suggested possibility to expand the system as a function of KOLAS in the future.

Virtual World-Based Information Security Learning: Design and Evaluation

  • Ryoo, Jungwoo;Lee, Dongwon;Techatassanasoontorn, Angsana A.
    • Journal of Information Science Theory and Practice
    • /
    • v.4 no.3
    • /
    • pp.6-27
    • /
    • 2016
  • There has been a growing interest and enthusiasm for the application of virtual worlds in learning and training. This research proposes a design framework of a virtual world-based learning environment that integrates two unique features of the virtual world technology, immersion and interactivity, with an instructional strategy that promotes self-regulatory learning. We demonstrate the usefulness and assess the effectiveness of our design in the context of information security learning. In particular, the information security learning module implemented in Second Life was incorporated into an Introduction to Information Security course. Data from pre- and post- learning surveys were used to evaluate the effectiveness of the learning module. Overall, the results strongly suggest that the virtual world-based learning environment enhances information security learning, thus supporting the effectiveness of the proposed design framework. Additional results suggest that learner traits have an important influence on learning outcomes through perceived enjoyment. The study offers useful design and implementation guidelines for organizations and universities to develop a virtual world-based learning environment. It also represents an initial step towards the design and explanation theories of virtual world-based learning environments.

A Case Study on the e-SCM Web-service Design for Auto-parts Industry of a Commercial Vehicle (상용차 부품 조달 기업을 위한 e-SCM 웹서비스 설계 및 구현 사례 연구)

  • Oh, Myung-Hyun;Yang, Jae-Kyung
    • Journal of the Korea Safety Management & Science
    • /
    • v.14 no.1
    • /
    • pp.129-136
    • /
    • 2012
  • This study proposes a collaboration system framework on the web service in a supply chain to implement an efficient virtual supply chain and improve an ability to fulfill received orders over a supply chain. The system based on the framework proposed in this paper plays an important role for automatic order negotiation and placing/receiving an order noticed in web service by the main system. Furthermore, it can evaluate the fulfillment of received orders over a supply chain by using the transaction results from hierarchically related vendors and establish efficient manufacturing plans. In a word, this system is the automated system for creating manufacturing plans, placing and receiving orders. A little more important main function of this system is that it has a dynamic evaluation capability about fulfillment with received orders over a supply chain, and improves the evaluation method of fulfillment ability with received orders with related to direct dealing vendors, which is a main problem in existing system. As a result, this system is able to reduce the work load of the sales and purchasing materials, production control division, to manage accurate inventory promptly, to maintain the optimal inventory level by analyzing the information of fulfillment ability with received orders, and to enhance the level of service for customers.