• 제목/요약/키워드: Setting parameters

검색결과 504건 처리시간 0.031초

An Analytic solution for the Hadoop Configuration Combinatorial Puzzle based on General Factorial Design

  • Priya, R. Sathia;Prakash, A. John;Uthariaraj, V. Rhymend
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제16권11호
    • /
    • pp.3619-3637
    • /
    • 2022
  • Big data analytics offers endless opportunities for operational enhancement by extracting valuable insights from complex voluminous data. Hadoop is a comprehensive technological suite which offers solutions for the large scale storage and computing needs of Big data. The performance of Hadoop is closely tied with its configuration settings which depends on the cluster capacity and the application profile. Since Hadoop has over 190 configuration parameters, tuning them to gain optimal application performance is a daunting challenge. Our approach is to extract a subset of impactful parameters from which the performance enhancing sub-optimal configuration is then narrowed down. This paper presents a statistical model to analyze the significance of the effect of Hadoop parameters on a variety of performance metrics. Our model decomposes the total observed performance variation and ascribes them to the main parameters, their interaction effects and noise factors. The method clearly segregates impactful parameters from the rest. The configuration setting determined by our methodology has reduced the Job completion time by 22%, resource utilization in terms of memory and CPU by 15% and 12% respectively, the number of killed Maps by 50% and Disk spillage by 23%. The proposed technique can be leveraged to ease the configuration tuning task of any Hadoop cluster despite the differences in the underlying infrastructure and the application running on it.

큐 변화량을 이용한 적응식 AQM 성능 향상에 관한 연구 (A Study on Performance Improvement of Adaptive AQM Using the Variation of Queue Length)

  • 김종화;이기영
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2005년도 추계종합학술대회
    • /
    • pp.159-162
    • /
    • 2005
  • Random Early Detection (RED), one of the most well-known Active Queue Management (AQM), has been designed to substitute Tail Drop and is nowadays widely implemented in commercially available routers. RED algorithm provides high throughput and low delay as well as a solution of global synchronization. However RED is sensitive to parameters setting, so the performance of RED, significantly depends on the fixed parameters. To solve this problem, the Adaptive RED (ARED) algorithm is suggested by S. Floyd. But, ARED also uses fixed parameters like target-queue length; it is hard to respond to bursty traffic actively. In this paper, we proposed AQM algorithm based on the variation of current queue length in order to improve adaptability about burst traffic. We measured performance of proposed algorithm through a throughput, marking-drop rate and bias phenomenon. In experimentation, we raised a packet throughput as reduced packet drop rate, and we confirmed to reduce a bias phenomenon about bursty traffic.

  • PDF

가연조건에 따른 나일론 섬유의 물성 (II) - Disk/Yarn과 온도의 영향 - (Physical Properties of Nylon Textured Yarn according to False Twist Texturing Parameters (II) - Effect of Disk/Yarn and Temperature -)

  • 허종태
    • 한국염색가공학회지
    • /
    • 제20권1호
    • /
    • pp.36-43
    • /
    • 2008
  • False twist texturing uses the thermoplastic property of synthetic yarn and produces a bulk and a stretch by giving the filament a permanent crimp. This study investigated the effects of false twist texturing parameters, disk/yarn(D/Y) and heater temperature, on the physical properties of nylon textured yarn. D/Y was a primary determinant of twist numbers of filaments and was proportionally increased with the twist numbers of filaments, resulting in an increase of crimp rigidity of the textured yarn. Heater temperature, a determinant of the heat setting of transformed filaments, was proportionally increased with the increase of crimp rigidity. Nylon 6 was partially melted at $190^{\circ}C$. This study consequently suggested the optimal parameters of nylon 6 85d/68f full-dull POY.

국내 서해안 준설토의 침강압밀특성에 관한 실험 연구 (Experimental study on characteristics of sedimentation and consolidation for dredged clay in the west coastal of Korea)

  • 전상현;유남재
    • 한국지반공학회:학술대회논문집
    • /
    • 한국지반공학회 2009년도 춘계 학술발표회
    • /
    • pp.1190-1197
    • /
    • 2009
  • Design parameters related to Yano's method(1984, 1985), one of experimental approaches having been used widely in Korea to estimate sedimentation and consolidation of dredged and reclaimed ground, were analyzed and their propriety were reassessed in this paper. Data analyses were performed on the basis of the settling test results using samples from the west coastal area of Korea. From analysis of results, for specific characteristics of these dredged and reclaimed marine soft clays, co-relations of initial water content - coefficient of sedimentation/ consolidation - initial setting velocity were evaluated. Relation between height of soil solid and surface height of slurry at the stages of initiation and termination of consolidation was also assessed. Finally ranges and average values of these design parameters were evaluated and typical empirical equations between these design parameters were also proposed.

  • PDF

릴리프밸브 쿠션기구 내장형 공기압 실린더의 구동 특성 (Driving Characteristics of Pneumatic Cylinder with Relief Valve Cushion Devices)

  • 김도태
    • 드라이브 ㆍ 컨트롤
    • /
    • 제13권4호
    • /
    • pp.7-13
    • /
    • 2016
  • This paper presents the meter-out and meter-in speed control characteristics of a pneumatic cylinder with relief valve type cushion device. The piston displacement and velocity are measured to investigate high speed driving performance with variation of the pressure setting in relief valve, air supply pressure, load mass, the supply and exhaust flow rate from the cylinder. Also, the internal pressures and temperatures driving pressure and cushion chamber are measured. The piston displacements and velocities of meter-out and meter-in control are compared experimentally determined data. A comparison experimental data meter-out and meter-in control show that a relief valve type cushion device is suitable for high speed pneumatic cylinders. The desired response characteristics of piston displacement and velocity are satisfactory adjust the pressure setting of a relief valve with varying system parameters such as air supply pressure, load mass and controlled flow rate.

소형 어선용 주기구동 유압식 고주파수 발전장치에 관한 연구 ( 1 ) - 유압펌프 제어방식 - (Hydraulic Constant Frequency Generation System Driven by Main Engine for Small Fishing Boat - Hydraulic Pump Control Type -)

  • 이일영;박상길;정용길
    • 수산해양기술연구
    • /
    • 제24권1호
    • /
    • pp.30-35
    • /
    • 1988
  • An electrical power generation system driven by main engine shaft, briefly SG system for middle or small size fishing boat is studied experimently. In the SG system, power transmission is performed by a variable displacement hydraulic pump driven by the main engine and a constant displacement hydraulic motor. It was verified that the SG system enabled the generation of electrical power with constant frequency regardless main engine speed. In the SG system, setting reference frequency, sensing generator output frequency and setting controller parameters are performed by performed by programming in a microcomputer, so a countermeasure for physical situations of control object is very easy. Futhermore, the SG system has following features; low initial installation cost, wide freedom of installation in engine room, advantage of application in existing ships, especially fishing boat with hydraulic fishing equipments.

  • PDF

자체 항법 정보만을 이용한 비행 중 기압 고도계 설정 방법 (Procedure of Barometer Setting in Flight with On-board Navigation Data alone)

  • 정석영
    • 한국항공우주학회지
    • /
    • 제40권4호
    • /
    • pp.300-308
    • /
    • 2012
  • 무인기의 INS/GPS/기압고도계 결합항법 시스템에서 비행체 자체 항법 정보만을 이용하여 QNH 혹은 QFE 방식의 기압 고도계를 설정하는 방법을 제안한다. 본 설정 방법은 비행체 외부로부터 주어지는 대기나 고도 정보에 의존하지 않고 자체 항법 시스템의 정보만을 사용하며 설정 방법에 따라 요구되는 일정 형태의 비행을 통해 얻어진 정보를 수학적으로 처리하여 기준값을 산출한다. 비행체 자체 정보만을 사용함으로써 지상 지원 장비에서 대기 정보 측정 시스템을 제외하는 등 간소화나 지원 시설의 요구 조건이 완화될 수 있고 지상 지원이 가용하지 않는 영역에서의 비행도 가능하다. 특히 회귀 분석 기법을 이용한 방법은 고도와 기압, 온도의 세 가지 기준값을 설정함에 있어 고도와 기압, 두 가지 정보만을 요구하며 온도 자료가 필요하지 않다. 그러므로 기압 고도 산출에 온도 정보가 전혀 필요하지 않아 비행체의 대기 정보 측정 시스템도 간소화될 수 있다.

큐렛팁을 장착한 압전방식 초음파치석제거기의 작업조건에 따른 치과주조용 합금의 삭제에 관한 연구 (The Effect of a Piezoelectric Ultrasonic Scaler with Curette Tip on Casting Gold Removal in Vitro)

  • 이영규
    • Journal of Periodontal and Implant Science
    • /
    • 제31권3호
    • /
    • pp.531-542
    • /
    • 2001
  • Periodontal debridement is most important procedure in periodontal treatment, because periodontal disease is the biofilm infection. The use of ultrasonic instrument has many clinical advantages compared to classical hand instrument. The introduction of newly developed ultrasonic scaler tips made the use of ultrasonic scaler popular. However the study of tooth substance removal according to the working parameters of ultrasonic scaler with newly developed tips is not sufficient. The purpose of this study is to evaluate the effects of working parameters of piezoelectric ultrasonic scaler with curette tip on casting gold removal. The working parameters was standardized by the sledge device which controls lateral force(0.5 N, 1.0 N, 2.0 N) and power setting was adjusted 2, 4, 8 in P mode and S mode and instrumentation time was 5 seconds. The defect depth and width were measured with profile meter and defect surface was examined by SME. The depth of defect was significantly large in S mode( $39.58{\pm}19.35{\mu}m$) compared to P mode( $8.37{\pm}6.98{\mu}m$). There was significant decrease of depth of defect between 1.0N($32.87{\pm}27.18{\mu}m$) and 2.0N( $14.86{\pm}15.04{\mu}m$). The area of defect was also significantly large in S mode($4482.42{\pm}3551.71{\mu}m^2$) compared to P mode( $922.06{\pm}960.32{\mu}m^2$). There was significant decrease of area of defect between 1.0N($3889.12{\pm}3936.00{\mu}m$) and 2.0N( $974.66{\pm}986.01{\mu}m$). The change of mode did not effect on the width of the defect. The change of power setting did not effect on the depth, width, and area of defect. In spite of limitation of this study it could be concluded that the use of piezoelectric ultrasonic scaler with curette tip on S mode could make significant tooth substance loss.

  • PDF

AEKF(Adaptive Extended Kalman Filter)를 이용하는 건축 구조물의 손상탐지 (Damage Detection of Building Structures using AEKF(Adaptive Extended Kalman Filter))

  • 윤다요;김유석;박효선
    • 한국전산구조공학회논문집
    • /
    • 제32권1호
    • /
    • pp.45-54
    • /
    • 2019
  • 본 논문에서는 EKF기법의 초기 파라미터 설정에 따른 상태벡터의 발산 문제를 해결하고자 AEKF기법을 제시한다. EKF기법의 초기 파라미터는 상태벡터 수렴 및 안정성에 중요한 역할을 함으로 초기 파라미터의 적절한 설정은 EKF를 사용함에 있어 매우 중요하다. AEKF방법은 초기 파라미터인 P행렬을 k스텝마다 업데이트하여 초기 상태벡터의 변화에 민감하게 반응할 수 있으며, 또한 초기 상태벡터와 실제 시스템 모델과의 차이가 크게 발생하여도 적응적으로 P행렬의 값을 조절하여 상태벡터의 수렴을 가능하게 한다. 또한 Q행렬 및 R행렬을 k스텝 업데이트하여 상태벡터의 수렴 안정성을 더욱 확보하였다. 3DOF시스템을 통해서 AEKF기법의 결과와 EKF, UKF기법을 비교 검증하였다.

SAMPLING BASED UNCERTAINTY ANALYSIS OF 10 % HOT LEG BREAK LOCA IN LARGE SCALE TEST FACILITY

  • Sengupta, Samiran;Dubey, S.K.;Rao, R.S.;Gupta, S.K.;Raina, V.K
    • Nuclear Engineering and Technology
    • /
    • 제42권6호
    • /
    • pp.690-703
    • /
    • 2010
  • Sampling based uncertainty analysis was carried out to quantify uncertainty in predictions of best estimate code RELAP5/MOD3.2 for a thermal hydraulic test (10% hot leg break LOCA) performed in the Large Scale Test Facility (LSTF) as a part of an IAEA coordinated research project. The nodalisation of the test facility was qualified for both steady state and transient level by systematically applying the procedures led by uncertainty methodology based on accuracy extrapolation (UMAE); uncertainty analysis was carried out using the Latin hypercube sampling (LHS) method to evaluate uncertainty for ten input parameters. Sixteen output parameters were selected for uncertainty evaluation and uncertainty band between $5^{th}$ and $95^{th}$ percentile of the output parameters were evaluated. It was observed that the uncertainty band for the primary pressure during two phase blowdown is larger than that of the remaining period. Similarly, a larger uncertainty band is observed relating to accumulator injection flow during reflood phase. Importance analysis was also carried out and standard rank regression coefficients were computed to quantify the effect of each individual input parameter on output parameters. It was observed that the break discharge coefficient is the most important uncertain parameter relating to the prediction of all the primary side parameters and that the steam generator (SG) relief pressure setting is the most important parameter in predicting the SG secondary pressure.