• Title/Summary/Keyword: optimal configuration

Search Result 774, Processing Time 0.026 seconds

An Analytic solution for the Hadoop Configuration Combinatorial Puzzle based on General Factorial Design

  • Priya, R. Sathia;Prakash, A. John;Uthariaraj, V. Rhymend
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.11
    • /
    • pp.3619-3637
    • /
    • 2022
  • Big data analytics offers endless opportunities for operational enhancement by extracting valuable insights from complex voluminous data. Hadoop is a comprehensive technological suite which offers solutions for the large scale storage and computing needs of Big data. The performance of Hadoop is closely tied with its configuration settings which depends on the cluster capacity and the application profile. Since Hadoop has over 190 configuration parameters, tuning them to gain optimal application performance is a daunting challenge. Our approach is to extract a subset of impactful parameters from which the performance enhancing sub-optimal configuration is then narrowed down. This paper presents a statistical model to analyze the significance of the effect of Hadoop parameters on a variety of performance metrics. Our model decomposes the total observed performance variation and ascribes them to the main parameters, their interaction effects and noise factors. The method clearly segregates impactful parameters from the rest. The configuration setting determined by our methodology has reduced the Job completion time by 22%, resource utilization in terms of memory and CPU by 15% and 12% respectively, the number of killed Maps by 50% and Disk spillage by 23%. The proposed technique can be leveraged to ease the configuration tuning task of any Hadoop cluster despite the differences in the underlying infrastructure and the application running on it.

Effects of Material Properties on Optimal Configuration Design of Absorbing Porous Materials (흡음을 위한 다공성 물질의 최적형상설계에서 물성치의 영향)

  • Lee, Joong-Seok;Kim, Yoon-Young;Kang, Yeon-June
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.622-624
    • /
    • 2008
  • This investigation studies the effects of material properties and corresponding propagation wave types on optimal configurations of sound absorbing porous materials in maximizing the absorption performance by topology optimization. The acoustic behavior of porous materials is characterized by their material properties which determine motions of the frame and the air. When the frame has a motion, two types of compressional wave propagate in the porous material. Because each wave in the material make different influence on the absorption performance, it is important to understand the relative contribution of each wave to the sound absorption. The relative contribution of the propagating waves in a porous material is determined by the material properties, therefore, an optimal configuration of a porous material to maximize the absorption performance is apparently affected by the material properties. In fact, virtually different optimal configurations were obtained for absorption coefficient maximization when the topology optimization method developed by the authors was applied to porous materials having different material properties. In this investigation, some preliminary results to explain the findings are presented. Although several factors should be considered, the present investigation is focused on the effects of the material properties and corresponding propagation waves on the optimized configurations.

  • PDF

Preliminary optimal configuration on free standing hybrid riser

  • Kim, Kyoung-Su;Choi, Han-Suk;Kim, Kyung Sung
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.10 no.3
    • /
    • pp.250-258
    • /
    • 2018
  • Free Standing Hybrid Riser (FSHR) is comprised of vertical steel risers and Flexible Jumpers (FJ). They are jointly connected to a submerged Buoyancy Can (BC). There are several factors that have influence on the behavior of FSHR such as the span distance between an offshore platform and a foundation, BC up-lift force, BC submerged location and FJ length. An optimization method through a parametric study is presented. Firstly, descriptions for the overall arrangement and characteristics of FSHR are introduced. Secondly, a flowchart for optimization of FSHR is suggested. Following that, it is described how to select reasonable ranges for a parametric study and determine each of optimal configuration options. Lastly, numerical analysis based on this procedure is performed through a case study. In conclusion, the relation among those parameters is analyzed and non-dimensional parametric ranges on optimal arrangements are suggested. Additionally, strength analysis is performed with variation in the configuration.

An Optimal Initial Configuration of a Humanoid Robot (인간형 로봇의 최적 초기 자세)

  • Sung, Young-Whee;Cho, Dong-Kwon
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.56 no.1
    • /
    • pp.167-173
    • /
    • 2007
  • This paper describes a redundancy resolution based method for determining an optimal initial configuration of a humanoid robot for holding an object. There are three important aspects for a humanoid robot to be able to hold an object. Those three aspects are the reachability that guarantees the robot to reach the object, the stability that guarantees the robot to remain stable while moving or holding the object, and the manipulability that makes the robot manipulate the object dexterously. In this paper, a humanoid robot with 20 degrees of freedom is considered. The humanoid robot is kinematically redundant and has infinite number of solutions for the initial configuration problem. The complex three-dimensional redundancy resolution problem is divided into two simple two-dimensional redundancy resolution problems by incorporating the symmetry of the problem, robot's moving capability, and the geometrical characteristics of the given robot. An optimal solution with respect to the reachability, the stability, and the manipulability is obtained by solving these two redundancy resolution problems.

Methods of constructing optimal topology to improve performance of STP (STP의 성능 향상을 위한 최적의 토폴로지 구성방법)

  • Park Sung-Han;Jang Jong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.10 no.2
    • /
    • pp.271-275
    • /
    • 2006
  • In STP, network performance differs depending on topology configuration. Therefore, we need to configure right topology for the optimal efficiency of networking. This paper suggest the optimal topology configuration for efficient networking between ethernet switchs. It finds out the best topology configuration by calculation mathematical model which uses transmission time between root switch and other switchs in the same domain. And it also analysed performance difference on locations of root switch. Through the performance analysis, we could conclude that placing the root switch in the center is the most efficient.

Optimal WAMS Configuration in Nordic Power System

  • Mohamed A.M. Hassan;Omar H. Abdalla;Hady H. Fayek;Aisha H.A. Hashim;Siti Fauziah Toha
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.3
    • /
    • pp.130-138
    • /
    • 2023
  • The Smart grids are considered as multi-disciplinary power systems where the communication networks are highly employed. This paper presents optimal wide area measurement system (WAMS) configuration in Nordic power system. The transition from SCADA to WAMS becomes now trend in all power systems to ensure higher reliability and data visibility. The optimization applied in this research considered the geographical regions of the Nordic power system. The research considered all the devices of WAMS namely phasor measurement units (PMUs), phasor data concentrators (PDCs) and communication links. The study also presents two scenarios for optimal WAMS namely base case and N-1 contingency as different operating conditions. The result of this research presents technical and financial results for WAMS configuration in a real power system. The optimization results are performed using MATLAB 2017a software application.

A Fast Configuration Method for Load Balancing in Distribution System (배전계통의 부하평형을 고려한 고속 계통구성방법)

  • Nam, Kee-Young;Choi, Sang-Bong;Jeong, Seong-Hwan;Ryoo, Hee-Suk;Kim, Ho-Yong
    • Proceedings of the KIEE Conference
    • /
    • 2003.07a
    • /
    • pp.381-383
    • /
    • 2003
  • The authors have developed a solution method based on the incremental algorithm. The optimal load balance between feeders is found through the incremental algorithm with allowing the loop configuration. Therefore loops can be configured in the resulting configuration, and then we must eliminate all loops to satisfy radiality of distribution system because the distribution system is operated under radial status. But the optimal load balance through incremental algorithm is deteriorated when the loops are eliminated. In this paper, authors propose a new method which is to improve the searching procedure of path in the incremental algorithm, that is, so as not to make loop in the path configuration.

  • PDF

Design and comparative study of various Two-Dimensional Grain Configurations based on Optimization Method

  • Nisar, Khurram;Liang, Guozhu
    • Proceedings of the Korean Society of Propulsion Engineers Conference
    • /
    • 2008.03a
    • /
    • pp.226-234
    • /
    • 2008
  • Grain design has always been a vital and integral part of Solid Rocket Motor(SRM) design. Basing on the design objectives set by the system designer, the SRM designer has many options available for selecting the Grain configuration. Many of the available configurations may fulfill the required parameters of volumetric loading fraction, web fraction & Length to diameter ratios and produce internal ballistic results that may be in accordance to the design objectives. However, for any given set of design objectives, it is deemed necessary that best possible configuration be selected, designed and optimized. Hence optimal results of all applicable configurations are vital to be attained in order to compare and finalize the design that will produce most efficient performance. Generally the engineers pay attention and have skills on a specific grain configuration. The designing methodologies and computer codes available usually focus on single grain configuration may it be Star, Wagon Wheel or slotted tube. Hardly one can find a software or a design methodology where all such configurations can be worked on jointly and not only adequate designs be found but optimal solutions reached by applying an optimization method to find final design best suited for any design objective. In the present work design requirements have been set, grain configurations have been selected and their designing has been conducted. The internal ballistic parameters have been calculated and after finding the preliminary design solutions, the optimal solutions have been found. In doing so, software has been developed comprising of computer programs for designing the 2D grains including Star, Wagon Wheel and Slotted Tube configurations. The optimization toolbox of Matlab Fmincon has been used for getting optimal solutions. The affects of all the independent geometric design variables on the optimized solutions have been analyzed. Based on results attained from Optimization Method, an in depth comparison of Grain Configurations and analysis of performance prediction outputs have been conducted to come to conclusion as to which grain configuration is ideal for the current design requirement under study.

  • PDF

An Analysis on The Optimal Partitioning Configuration of Cache for Meeting Deadlines of Real-Time Tasks (실시간 태스크의 마감시간 만족을 위한 캐쉬 최적 분할 형태의 분석)

  • Kim, Myung-Hee;Joo, Su-Chong
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.11
    • /
    • pp.2891-2902
    • /
    • 1997
  • This paper presents an analysis on the optimal partitioning configuration of cache (memory) for meeting deadlines of periodic and aperiodic real-time task set. Our goal is not only to decrease the deadline missing ratio of each task by minimizing the task utilization, but also to allocate another tasks to idle spaces of cache. For this reason, we suggest an algorithm so that tasks could be allocated to cache segments. Here, the set of cache segments allocated tasks is called a cache partitioning configuration. Based on how tasks allocate to cache segments, we can get various cache partitioning configurations. From these configurations, we obtain the boundary of task utilization that tasks are possible to schedule, and analyze the cache optimal partitioning configuration that can be executed to minimize the task utilization.

  • PDF

Robust wireless sensor network configuration design for structural health monitoring with optimal information-energy tradeoff

  • Xiao-Han Hao;Sin-Chi Kuok;Ka-Veng Yuen
    • Smart Structures and Systems
    • /
    • v.33 no.6
    • /
    • pp.465-482
    • /
    • 2024
  • In this paper, a robust wireless sensor network configuration design method is proposed to develop the optimal configuration under the consideration of sensor failure and energy consumption. A malfunctioned sensor in a wireless sensor network may lead to data transmission failure of the entire sensing cluster, inducing severe deterioration in system identification performance. The proposed method determines a wireless sensor network configuration that is robust against sensor failure. By utilizing Bayesian inference, we introduce a robust indicator to evaluate the impact on estimation accuracy of sensor configurations with various malfunctioned sensors. Moreover, a network formation strategy is proposed to optimize the energy efficiency of the wireless sensor network configuration. Therefore, the resultant robust wireless sensor network configuration can operate with the minimum energy consumption while the measurement information of the sensor network with malfunctioned sensors can be guaranteed. The proposed method is illustrated by designing the robust wireless sensor network configurations of a truss model and a bridge model.