• 제목/요약/키워드: Analyzing Performance of Data

검색결과 1,404건 처리시간 0.028초

아파치 스쿱을 사용한 하둡의 데이터 적재 성능 영향 요인 분석 (Analysis of the Influence Factors of Data Loading Performance Using Apache Sqoop)

  • ;고정현;여정모
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제4권2호
    • /
    • pp.77-82
    • /
    • 2015
  • 빅데이터 기술은 데이터 처리 속도가 빠르다는 면에서 주목을 받고 있다. 그리고 관계형 데이터베이스(Relational Database: RDB)에 저장되어있는 대용량 정형 데이터를 더 빠르게 처리하기 위해서 빅데이터 기술을 활용하는 연구도 진행되고 있다. 다양한 분산 처리 도구들을 사용하여 분석 성능을 측정하는 연구는 많지만 분석하기 전 단계인 정형 데이터 적재의 성능에 관한 연구는 미미하다. 때문에 본 연구에서는 RDB 안에 저장되어있는 정형 데이터를 아파치 스쿱(Apache Sqoop)을 사용하여 분산 처리 플랫폼 하둡(Hadoop)으로 적재하는 성능을 측정하였다. 그리고 적재에 영향을 미치는 요인을 분석하기 위해 여러 가지 영향 요소를 변경해가면서 반복적으로 실험을 수행하였고 RDB 기반으로 구성된 서버 간의 적재 성능과 비교하였다. 실험 환경에서 아파치 스쿱의 적재 속도가 낮았지만 실제 운영하고 있는 대규모 하둡 클러스터 환경에서는 더 많은 하드웨어 자원이 확보되기 때문에 훨씬 더 좋은 성능을 기대할 수 있다. 이는 향후 진행할 적재 성능 개선 및 하둡 환경에서 정형 데이터를 분석하는 전체적인 단계의 성능을 향상시킬 수 있는 방법에 대한 연구의 기반이 될 것으로 예상한다.

생애주기분석을 위한 궤도 마모 및 틀림 데이터 처리 및 분석 (Track Wear and Irregularity Data Processing and Analysis for Life Cycle Performance)

  • 공정식;정민철;김정훈;김건우
    • 한국철도학회:학술대회논문집
    • /
    • 한국철도학회 2011년도 정기총회 및 추계학술대회 논문집
    • /
    • pp.1123-1128
    • /
    • 2011
  • Generally, there are many types of data, such as wear data or irregularity data, are detected for analyzing railway performance. The analysis of railroad wear or irregularity data is most effective method for the efficient railway maintenance. Especially, the track damaged directly by train, have as important position with the inspection data. This study suggest the Life-Cycle performance analysis method and process of railroad by analyzing two types of data, wear data and irregularity data. This analysis methods can be applied to suggest the Life-Cycle performance of railroad based on environmental factors or design factors, such as sleeper type, roadbed type, cant, the radius of curvature, speed, maintenance history and so on.

  • PDF

부하테스트를 이용한 금융 시스템의 성능개선 사례 (A Case Study for Improving Performance of A Banking System Using Load Test)

  • 김태석;이종윤;김종수
    • 한국멀티미디어학회논문지
    • /
    • 제18권12호
    • /
    • pp.1501-1508
    • /
    • 2015
  • In this paper, we describe a case study to improve performance through the load testing of multi-tired system for financial accounts before the system opening. The load test was conducted after the data collection tools(Performance Monitor, DB PSSDiag) were installed. By analyzing the collected log, we were able to identify the main sector requiring performance improvements among the presentation tier, web tier, business logic tier and data tier. The ASP.NET server-down on the web tier could be improved by modifying the parameter values in the configuration file. Some server downs occurred on the business logic tier when a large number of users access at the same time, were more difficult to be solved. By analyzing the hang-dump at the server-down time, we were able to find a process that caused the problem. and we had to modify the relevant codes. For major performance improvements of the data-tier, indices of some queries was optimized by using the built-in DBMS query analyzer, after analyzing the log of long-response-time queries. The problems and solutions considered in this case study will be a reference for the performance improvement of a multi-layer system with the similar structure.

풍력발전기의 하중 측정을 위한 해석 소프트웨어의 개발 (Development of an Analysis Software for the Load Measurement of Wind Turbines)

  • 길계환;방제성;정진화
    • 풍력에너지저널
    • /
    • 제4권1호
    • /
    • pp.20-29
    • /
    • 2013
  • Load measurement, which is performed based on IEC 61400-13, consists of three stages: the stage of collecting huge amounts of load measurement data through a measurement campaign lasting for several months; the stage of processing the measured data, including data validation and classification; and the stage of analyzing the processed data through time series analysis, load statistics analysis, frequency analysis, load spectrum analysis, and equivalent load analysis. In this research, we pursued the development of an analysis software in MATLAB to save labor and to secure exact and consistent performance evaluation data in processing and analyzing load measurement data. The completed analysis software also includes the functions of processing and analyzing power performance measurement data in accordance with IEC 61400-12. The analysis software was effectively applied to process and analyse the load measurement data from a demonstration research for a 750 kW direct-drive wind turbine generator system (KBP-750D), performed at the Daegwanryeong Wind Turbine Demonstration Complex. This paper describes the details of the analysis software and its processing and analysis stages for load measurement data and presents the analysis results.

A Comparison of Human Performance between Operators of a Main Control Room in the SMR

  • Heo, Eun Mee;Byun, Seong Nam;Park, Hong Joon;Park, Geun Ok
    • 대한인간공학회지
    • /
    • 제33권1호
    • /
    • pp.27-37
    • /
    • 2014
  • Objective: This study aims to improve human performance by analyzing the operators' tasks and providing input data on the composition of future SMART operators. Background: SMART is a nuclear reactor for export which needs operators who can satisfy both safety and economic feasibility. Therefore, this study is fundamental research on the composition of operators and this research analyzed SMART tasks in terms of human safety performance. Method: After analyzing 10 SMART EOG in hierarchical task analysis, this study classified task performance types according to task requirements of NUREG-0711 (Rev.3). Results: This study found the task frequency of SMART EOG and 12 operating task types. Conclusion: This study expects that human performance can be improved by analyzing the personal errors, which have the highest task frequency among 12 operating task types. Application: The results of this study can be applied as base data when licensing needs to be acquired.

신생산기술 실행과정상에 조직 적응노력의 효과성 분석

  • 이상곤;이진주
    • 한국경영과학회:학술대회논문집
    • /
    • 대한산업공학회/한국경영과학회 1994년도 춘계공동학술대회논문집; 창원대학교; 08월 09일 Apr. 1994
    • /
    • pp.627-632
    • /
    • 1994
  • This study suggests the contingency framework understanding the implementation of NIMT and conducts empirical analysis using survey data. The main objectives of the thesis are as follows : (1) analyzing the relationship between adaptation requirements and organizational adaptation efforts. (2) analyzing the relationship between organizational adaptation efforts and implementation performance, and the moderating effect of the adaptation requirements. (3) analyzing the relationship between organizational adaptation efforts and organization characteristics(organization size, technical capability, top management support). A field study was undertaken to test the hypothesized relationships among adaptation efforts, adaptations requirements, organization characteristics, implementation performance. Data were collected from 52 NMT implementation projects of 45 machine tool, metal component firms. The emprical relflts indicated that adaptation requirrnents, organization characteristics were significantly related to organizational adaptation efforts and adaptation efforts can significantly improve implementation perfomance, but the moderating effect of adaptation requirements on adaptation efforts and implementation performance was not supported.

Mixed-effects LS-SVR for longitudinal dat

  • Cho, Dae-Hyeon
    • Journal of the Korean Data and Information Science Society
    • /
    • 제21권2호
    • /
    • pp.363-369
    • /
    • 2010
  • In this paper we propose a mixed-effects least squares support vector regression (LS-SVR) for longitudinal data. We add a random-effect term in the optimization function of LS-SVR to take random effects into LS-SVR for analyzing longitudinal data. We also present the model selection method that employs generalized cross validation function for choosing the hyper-parameters which affect the performance of the mixed-effects LS-SVR. A simulated example is provided to indicate the usefulness of mixed-effect method for analyzing longitudinal data.

광센서 조광제어시스템의 효율적인 조광율 결정을 위한 실험 데이터 분석 (Analysis of experimental data on daylight responsive dimming system performance for determining on effective dimming ratio)

  • 김가영;최안섭
    • 한국조명전기설비학회:학술대회논문집
    • /
    • 한국조명전기설비학회 2005년도 학술대회 논문집
    • /
    • pp.167-172
    • /
    • 2005
  • This study based on the experimental data on the daylight responsive dimming systems performance. The purpose of this study increases the energy-saving effects by reducing excessive intensity of radiation of artificial lighting through analyzing incident daylight. The photosensor sends amounts of detected luminous flux to digital control unit(DCU) as a signal and then, it can decide dimming ratios, by received a proper dimming signal from DCU. Generally it is effective to control artificial lighting with the different control ratio of each row by setting a photosensor as same numbers and rows as artificial lighting. However, it is ineffective to do in initial costs of systems aspect in offices. By analyzing the data of this performance and finding regular ration between photosensors. we will execute different dimming ratios to each row of artificial lighting by a single photosensor.

  • PDF

항공안전 데이터 분석 기반 항공기 감항관리체계 개선 방안 연구 (Feasibility Study of Aviation Safety Data Analysis for Airworthiness Management System Improvement)

  • 정현진;김승각;김용;심영민
    • 한국항공운항학회지
    • /
    • 제25권2호
    • /
    • pp.25-38
    • /
    • 2017
  • Current limitation of Aviation airworthiness manage system and text based Aviation safety report data, lack of Data Manage system for aviation parts failure and lack of continuing airworthiness related to task linking system for Inspection/Report/Improvement(AD ; Airworthiness Directive) have been apprehended to suggest direction of realizing improved operating system by applying aviation airworthiness manage system by using standardization and safety performance index based managing and safety performance index based data analyzing.

Analyzing Management Factors on Enterprise Performance

  • Dahlgaard, Jens J.;Ciavolino, Enrico
    • International Journal of Quality Innovation
    • /
    • 제8권3호
    • /
    • pp.1-10
    • /
    • 2007
  • A sample of Italian manufacturing companies was selected in order to verify the abilities and effects (relationships) of the management factors human resources, leadership and strategic planning on company performance. The Partial Least Squares (PLS) estimation method was used for analyzing the data collected, where the relationships between the management factors and performance were formalized by a Structural Equation Model (SEM). The analysis of the survey data showed unexpected result regarding the non significant direct relationship between Leadership and Performance. The effect of Leadership is obtained by an indirect relationship through Human Resources. The combination of Leadership and Human Resources has hence been identified as the management factors which have the highest impact on the performance of Italian industrial companies. Another interesting and unexpected result was that there was no significant impact of Strategic Planning on Performance. It seems that the leaders of Italian industrial companies have not understood that good strategic planning is a necessary condition for achieving excellence. So another improvement area is in fact Strategic Planning. This area should have the highest priority of any top management team and the focus should include how to establish a strong relationship between strategic planning and performance. No correlation between strategic planning and performance is a strong indication that something is wrong. It is not enough that Leadership is doing Strategic Planning-Leadership is also about studying and follow up on results in order to assure impacts on performance. This link seems to be missing in Italian industrial companies.